Abir Das

Hello, I'm

Abir Das

|

About Me

I turn messy enterprise data into clean, reliable systems — and then teach AI to reason over them. From wiring up Snowflake warehouses and dbt models to building agentic RCA systems with LangGraph and MCP, I operate at the intersection of Data Engineering and Applied AI. Currently at Red Hat, I ship pipelines that process at scale, craft validation frameworks that catch issues before stakeholders do, and orchestrate it all with Airflow so nothing falls through the cracks.

Experience
Current Dec 2024 – Present

Associate Software Engineer

Red Hat Bengaluru, India
  • Build and optimize scalable data pipelines using Python and SQL for enterprise data processing.
  • Maintain Snowflake data warehouse infrastructure, ingest enterprise sources via Fivetran, design and maintain dimensional data models using dbt, with documentation and tests for analytics and reporting.
  • Orchestrate complex workflows using Apache Airflow (Astro) with DAGs for automated data processing.
  • Built ValidX, a data validation framework (Python, YAML, Snowflake) with multi-env support, CI/CD integration (GitLab/GitHub), Slack alerts, and optional LLM-based failure summarization and root-cause hints.
  • Built an agentic on-call RCA system for data products: LangGraph agent + MCP tools that resolve Atlan assets, sync dbt manifests, and auto-trace column lineage through compiled SQL to root-cause data quality incidents.
Jun 2024 – Dec 2024

Apprentice

Red Hat Bengaluru, India
  • Developed an AI-powered Training Foundation Builder leveraging the RAG approach to generate baseline training content, enabling teams to kickstart their content creation process efficiently.
  • Integrated a chatbot with advanced conversation and session handling features, providing users with real-time assistance and a seamless interactive experience.
  • Designed the application with an intuitive user interface to simplify usage for non-technical users, enhancing accessibility and adoption.
Education
2016 – 2020

B.Sc. Statistics (Honours)

University of Calcutta

Statistical methods, mathematical modelling & analytical foundations. Core training in probability theory, inferential statistics, and data analysis techniques.

2021 – 2023

M.S. Operational Research

University of Delhi

Advanced studies in optimization, decision science & data-driven modelling. Specialization in algorithmic problem-solving and quantitative methods for complex systems.

Explore My

Skills & Expertise

Programming

Python SQL Git FastAPI

Data Engineering

Snowflake dbt Atlan Fivetran ETL/ELT

ML / AI

LangGraph MCP AI Agents

Cloud / DevOps

OpenShift CI/CD

Orchestration

Airflow (Astro) DAGs Workflow Automation

Visualization

Streamlit

Read & Watch

Blog & Talks

Talk

GIDS 2023 — Invited Speaker

PyBandit — A Website Optimization Framework for E-Commerce SMBs

Watch Talk
Medium

Medium Blog

Writing about Data Engineering, AI Agents, and building scalable ML systems.

Read on Medium

Get in Touch

Contact Me