AI dictionary · Data
What is Data pipeline?Data pipeline kya hai?
Also called: ETL pipeline
Data pipeline: Automated steps that move data from sources, clean and transform it, and deliver it for reports or models.Apne aap chalne wale steps jo sources se data laate, saaf aur transform karte, aur reports ya models tak pahunchaate hain.
🧸 Think of it likeAise samjho
Like a water supply system: water is collected, filtered and piped to every tap, automatically every day.Paani ki supply jaisa: paani ikattha hota hai, filter hota hai aur har nal tak pipe se pahunchta hai, roz automatically.
📘 ExplainedVistaar se
A pipeline extracts data (databases, APIs, files), loads and transforms it (SQL, dbt, Spark) and publishes clean tables, features or vector indexes. It's orchestrated on a schedule (Airflow) with retries, data quality checks and alerts. Good pipelines are idempotent, so reruns and backfills don't create duplicates.Pipeline data nikaalti hai (databases, APIs, files), load aur transform karti hai (SQL, dbt, Spark) aur saaf tables, features ya vector indexes publish karti hai. Schedule pe orchestrate hoti hai (Airflow), retries, data quality checks aur alerts ke saath. Acchi pipelines idempotent hoti hain, taaki reruns aur backfills duplicates na banayein.
💡 Real exampleAsli example
Every night, orders are copied from the app database, cleaned and turned into a sales dashboard table.Har raat orders app database se copy, saaf aur sales dashboard table mein badle jaate hain.
📖 Learn it step by stepStep by step seekho
🔗 Related termsJude hue shabd
Questions people ask
What is Data pipeline?
Automated steps that move data from sources, clean and transform it, and deliver it for reports or models. A pipeline extracts data (databases, APIs, files), loads and transforms it (SQL, dbt, Spark) and publishes clean tables, features or vector indexes. It's orchestrated on a schedule (Airflow) with retries, data quality checks and alerts. Good pipelines are idempotent, so reruns and backfills don't create duplicates.
How can I understand Data pipeline in simple words?
Like a water supply system: water is collected, filtered and piped to every tap, automatically every day.
What is an example of Data pipeline?
Every night, orders are copied from the app database, cleaned and turned into a sales dashboard table.
Data pipeline ka matlab kya hai?
Apne aap chalne wale steps jo sources se data laate, saaf aur transform karte, aur reports ya models tak pahunchaate hain. Paani ki supply jaisa: paani ikattha hota hai, filter hota hai aur har nal tak pipe se pahunchta hai, roz automatically.
See Data pipeline in the full A to Z dictionary · Start a free AI course