Spaces:

aamanlamba
/

Lineage-graph-accelerator

Sleeping

🚀 Lineage Graph Accelerator - AI-Powered Data Lineage Extraction & Visualization

Tired of manually documenting data pipelines? This tool automatically extracts and visualizes data lineage from dbt, Airflow, SQL, BigQuery, and more - powered by Gradio 6, Google Gemini AI, and Model Context Protocol (MCP).

Built for the Gradio Agents & MCP Hackathon - Winter 2025 🎂

🔗 Try it Live: https://huggingface.co/spaces/aamanlamba/Lineage-graph-accelerator

✨ Key Features:
• AI Assistant: Generate lineage from natural language using Google Gemini
• MCP Integration: Connect to Model Context Protocol servers for metadata
• Multiple Input Formats: dbt manifests, Airflow DAGs, SQL DDL, BigQuery, custom JSON
• Interactive Visualizations: Mermaid diagrams with zoom, PNG/SVG export
• Enterprise Export: OpenLineage, Collibra, Microsoft Purview, Alation, Apache Atlas
• Demo Gallery: Pre-built samples with 50+ node complex pipelines

🎯 Real-World Impact:
Solve data governance and compliance challenges by automatically documenting data flows across your entire data platform. Perfect for data engineers, analysts, and compliance teams.

📚 Documentation:
• GitHub: https://github.com/aamanlamba/lineage-graph-accelerator
• User Guide: Full documentation included
• Author: https://aamanlamba.com

🏆 Competition:
Gradio Agents & MCP Hackathon - Winter 2025
Track 2: MCP in Action (Productivity)
Celebrating MCP's 1st Birthday!

🛠️ Tech Stack:
• Gradio 6.0 - Modern UI framework
• Google Gemini API - AI-powered lineage generation
• Model Context Protocol - Metadata extraction
• Mermaid.js - Interactive graph visualization
• Python - Backend processing

💡 Use Cases:
✓ Data governance and compliance documentation
✓ Impact analysis for data changes
✓ Onboarding new team members to complex pipelines
✓ Migration planning and data catalog integration
✓ Automated lineage for CI/CD pipelines

📊 What You'll See in This Demo:
0:00 - Introduction & Problem Statement
0:35 - AI Assistant (Gemini) generating lineage from natural language
1:05 - MCP Integration with Local Demo server
1:30 - Demo Gallery with complex samples
1:55 - Export to data catalogs (Collibra, Purview, Atlas)
2:15 - Interactive features & Call to Action

🔔 Subscribe for more AI + Data Engineering tools!

#Gradio #MCP #DataLineage #AI #DataEngineering #GoogleGemini #HuggingFace #DataGovernance #Hackathon #Python #DataCatalog #MLOps #Analytics

Tags (if uploading to YouTube):

gradio, mcp, data lineage, google gemini, ai, data engineering, huggingface, model context protocol, data governance, data catalog, dbt, airflow, sql, bigquery, collibra, purview, alation, atlas, openlineage, python, machine learning, mlops, data analytics, hackathon, gradio 6

Thumbnail Ideas (if you want to create one):

Text Overlay:

LINEAGE GRAPH
ACCELERATOR
AI-Powered | Gradio 6 | MCP

Visual Elements:

Screenshot of the purple gradient banner
Screenshot of a complex lineage graph
"AI-Powered" badge
Your photo or avatar
HuggingFace logo

Colors:

Purple gradient (#667eea to #764ba2)
White text
High contrast for readability

Social Media Snippet (for embedding):

🚀 Just launched Lineage Graph Accelerator for the Gradio Agents & MCP Hackathon!

✨ AI-powered data lineage extraction with:
• Google Gemini natural language generation
• MCP integration for metadata
• Export to Collibra, Purview, Atlas
• Interactive Mermaid visualizations

🔗 Try it: https://huggingface.co/spaces/aamanlamba/Lineage-graph-accelerator
🎥 Demo: [YouTube Link]

#Gradio #MCP #DataLineage #AI

LinkedIn Post Version:

🚀 Excited to share my submission for the Gradio Agents & MCP Hackathon - Winter 2025!

Introducing: **Lineage Graph Accelerator** - An AI-powered tool that automatically extracts and visualizes data lineage from modern data platforms.

🎯 The Problem:
Data engineers spend hours manually documenting data pipelines. Documentation quickly becomes outdated. Impact analysis requires tribal knowledge.

💡 The Solution:
Automated lineage extraction from dbt, Airflow, SQL, BigQuery + natural language using Google Gemini AI, powered by Model Context Protocol (MCP) and Gradio 6.

✨ Key Features:
• AI Assistant for generating lineage from descriptions
• MCP integration for real-time metadata
• Export to Collibra, Microsoft Purview, Alation, Apache Atlas
• Interactive visualizations with zoom and export
• 50+ node complex pipeline support

🔗 Try it live: https://huggingface.co/spaces/aamanlamba/Lineage-graph-accelerator
🎥 Demo video: [YouTube Link]
💻 GitHub: https://github.com/aamanlamba/lineage-graph-accelerator

Built with: #Gradio #MCP #GoogleGemini #Python #DataEngineering

Thanks to @Hugging Face, @Gradio, and @Anthropic for hosting this amazing hackathon! 🎂

What data governance challenges are you facing? Let me know in the comments!

#DataLineage #AI #DataGovernance #DataEngineering #MLOps #HuggingFace #Hackathon

X/Twitter Post Version:

🚀 Just shipped Lineage Graph Accelerator for the @Gradio + MCP Hackathon!

AI-powered data lineage extraction with:
✨ @Google Gemini natural language generation
✨ MCP integration
✨ Export to Collibra, Purview, Atlas
✨ Interactive graphs

🔗 Try it: https://huggingface.co/spaces/aamanlamba/Lineage-graph-accelerator
🎥 Demo: [YouTube Link]

#Gradio #MCP #DataLineage #AI

Copy any of these and customize as needed! The YouTube description includes all important links, features, and is optimized for search. 🎬