Your Name
Data Engineer (AI / ML Platforms)
City, India · +91 98XXX XXXXX · your.name@email.com · linkedin.com/in/yourname · github.com/yourname
Professional Summary
Data Engineer with 5 years of experience building reliable ETL and streaming pipelines on Snowflake, Airflow, dbt and Spark. Recently built the RAG ingestion pipeline and vector database that power an internal AI assistant for 4,000 employees. Focused on Data Quality, Data Modeling and pipelines that are idempotent, tested and monitored.
Skills
- Languages: SQL, Python
- Data Platforms: Snowflake, BigQuery, PostgreSQL, Apache Spark, Kafka
- Orchestration & Modeling: Apache Airflow, dbt, Data Modeling (star schema), ETL / ELT, Data Pipelines
- AI Data: Embeddings, Vector Database (pgvector), RAG ingestion, Feature Store
- Quality & Ops: Data Quality (Great Expectations, dbt tests), Docker, CI/CD
Professional Experience
Data Engineer II, Contoso Retail Pvt. Ltd., Gurugram Jan 2022 to Present
- Built 35 Apache Airflow DAGs and 120 dbt models feeding Snowflake, processing 80M rows/day with 99.7% on time delivery.
- Designed a star schema Data Modeling layer for sales and inventory that cut dashboard query time by 65%.
- Built a RAG ingestion pipeline (chunking, Embeddings, pgvector Vector Database) with incremental reindexing, keeping 25,000 policy documents fresh within 1 hour.
- Added Data Quality tests and freshness alerts that reduced data incidents from 9 to 2 per quarter.
- Streamed 12K clickstream events/second through Kafka and Apache Spark Structured Streaming, refreshing recommendation features every 30 seconds.
Data Engineer, Fabrikam Logistics, Hyderabad Jun 2020 to Dec 2021
- Migrated 40 legacy ETL jobs from cron scripts to Airflow, eliminating manual reruns.
- Built SQL and Python pipelines that produced daily ML training datasets for 3 delivery time models, cutting data prep time by 70%.
Projects
RAG Ingestion Pipeline · Airflow, pgvector, Python github.com/yourname/RagIngest
- Open source pipeline that detects changed documents by hash, embeds only those chunks again and reports retrieval hit rate (89% top 4).
Education
B.E., Information Technology, Your University · 2020
Certifications
- SnowPro Core Certification
- Google Cloud Professional Data Engineer