Knowledge Graph — Coursera Notes › Academic disciplines › Information Technology / Computer Science › Artificial Intelligence › Machine Learning & Data › Data pipeline

Data transformation

concept · part of Data pipeline

The stage in a data pipeline where data is cleaned, reshaped, joined, filtered, aggregated, or prepared.

Transform data into suitable format for storage and analysis. Includes:

Cleaning: Remove or correct erroneous, incomplete, or inconsistent data.
Deduplication: Ensure no duplicate records.
Enrichment: Add additional context (e.g., combining data from multiple sources).
Restructuring: Change data structure to fit target storage.

Apply quality checks: verify data types, check for null values, validate data ranges.

Connections

Uses Snowpark DataFrame
Related to Data preprocessing

This is the text view of an interactive 3D knowledge graph — open this page with JavaScript enabled to explore it visually.

Select a node

The owner's editing tools — shown here so you can see how the graph is grown, but read-only.

Click a bubble to drill in · click again to collapse · drag to move around