personal-projects/leo-claude-mktplace
Template
0
1
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

feat: add data-platform plugin (v4.0.0) #149

Merged
lmiranda merged 1 commits from feat/data-platform-plugin-v4.0.0 into development 2026-01-25 19:27:26 +00:00
Conversation 0 Commits 1 Files Changed 39 +5413 -6
lmiranda commented 2026-01-25 19:24:45 +00:00
Owner
Copy Link

Summary

  • Add new data-platform plugin for data engineering workflows
  • MCP server with 32 tools (pandas: 14, PostgreSQL: 10, dbt: 8)
  • Arrow IPC data_ref system for DataFrame persistence
  • Pre-execution validation for dbt
  • SessionStart hook for PostgreSQL connectivity
  • 71 tests with full coverage

Test plan

  • All 71 tests passing
  • Manual verification of MCP server startup
  • Test /initial-setup command flow

🤖 Generated with Claude Code

## Summary - Add new data-platform plugin for data engineering workflows - MCP server with 32 tools (pandas: 14, PostgreSQL: 10, dbt: 8) - Arrow IPC data_ref system for DataFrame persistence - Pre-execution validation for dbt - SessionStart hook for PostgreSQL connectivity - 71 tests with full coverage ## Test plan - [x] All 71 tests passing - [ ] Manual verification of MCP server startup - [ ] Test /initial-setup command flow 🤖 Generated with [Claude Code](https://claude.ai/code)
lmiranda added 1 commit 2026-01-25 19:24:46 +00:00
feat: add data-platform plugin (v4.0.0) 89f0354ccc 
Add new data-platform plugin for data engineering workflows with:

MCP Server (32 tools):
- pandas operations (14 tools): read_csv, read_parquet, read_json,
  to_csv, to_parquet, describe, head, tail, filter, select, groupby,
  join, list_data, drop_data
- PostgreSQL/PostGIS (10 tools): pg_connect, pg_query, pg_execute,
  pg_tables, pg_columns, pg_schemas, st_tables, st_geometry_type,
  st_srid, st_extent
- dbt integration (8 tools): dbt_parse, dbt_run, dbt_test, dbt_build,
  dbt_compile, dbt_ls, dbt_docs_generate, dbt_lineage

Plugin Features:
- Arrow IPC data_ref system for DataFrame persistence across tool calls
- Pre-execution validation for dbt with `dbt parse`
- SessionStart hook for PostgreSQL connectivity check (non-blocking)
- Hybrid configuration (system ~/.config/claude/postgres.env + project .env)
- Memory management with 100k row limit and chunking support

Commands: /initial-setup, /ingest, /profile, /schema, /explain, /lineage, /run
Agents: data-ingestion, data-analysis

Test suite: 71 tests covering config, data store, pandas, postgres, dbt tools

Addresses data workflow issues from personal-portfolio project:
- Lost data after multiple interactions (solved by Arrow IPC data_ref)
- dbt 1.9+ syntax deprecation (solved by pre-execution validation)
- Ungraceful PostgreSQL error handling (solved by SessionStart hook)

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
lmiranda merged commit af0b92461a into development 2026-01-25 19:27:26 +00:00
lmiranda deleted branch feat/data-platform-plugin-v4.0.0 2026-01-25 19:27:26 +00:00
Sign in to join this conversation.
Reviewers
No Reviewers
Labels
Clear labels
Component/API
API endpoints, contracts, and integration
 Component/Auth
Authentication and authorization
 Component/Backend
Backend service code and business logic
 Component/Database
Database schemas, migrations, queries
 Component/Deploy
Deployment, infrastructure, DevOps
 Component/Docs
Documentation and guides
 Component/Frontend
User interface and client-side code
 Component/Infra
Infrastructure and system configuration
 Component/Testing
Test infrastructure and frameworks
 Tech/Docker
Docker containers and compose
 Tech/FastAPI
FastAPI backend framework
 Tech/JavaScript
JavaScript/Node.js code
 Tech/PostgreSQL
PostgreSQL database
 Tech/Python
Python language and libraries
 Tech/Redis
Redis cache and pub/sub
 Tech/Vue
Vue.js frontend framework
Complexity/Complex
High uncertainty or many dependencies
 Complexity/Medium
Some unknowns or dependencies
 Complexity/Simple
Straightforward, well-understood
 Effort/L
3-5 days
 Effort/M
1-2 days
 Effort/S
2-4 hours
 Effort/XL
> 1 week
 Effort/XS
< 2 hours
 Priority/Critical
Immediate attention required
 Priority/High
Important, needs attention soon
 Priority/Low
Nice to have, can wait
 Priority/Medium
Normal priority
 Type/Bug
Something isn't working
 Type/Chore
Maintenance tasks
 Type/Documentation
Documentation improvements
 Type/Feature
New feature or request
 Type/Refactor
Code refactoring without changing behavior
 Type/Test
Testing related
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
lmiranda
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: personal-projects/leo-claude-mktplace#149
Delete Branch "feat/data-platform-plugin-v4.0.0"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?