Knowledge Graph — Coursera Notes › Academic disciplines › Information Technology / Computer Science › Artificial Intelligence › Machine Learning & Data

Data pipeline

concept · part of Machine Learning & Data

Automated processes that ingest raw data, clean/transform it, and load it to a destination such as a database or model.

Inside Data pipeline (2)

• Ingestion pipeline — An ingestion pipeline is a series of processes that automate the collection, transformation, and movement of data from various sources into a centralized data repository (e.g., data warehouse, data lake, cloud storage).
• Data transformation — The stage in a data pipeline where data is cleaned, reshaped, joined, filtered, aggregated, or prepared.

Connections

• Uses Azure Data Factory
• Uses Azure Databricks
• Related to Azure Data Factory

This is the text view of an interactive 3D knowledge graph — open this page with JavaScript enabled to explore it visually.