Instiq

1Data Ingestion and Transformation

Practice questions →Glossary →
  • 1.1Data Ingestion (Batch and Streaming)

    Understand batch ingestion (scheduled, bulk) vs. streaming ingestion (continuous, near real-time), and choosing among Kinesis Data Streams / Data Firehose / MSK. The starting point for "Data Ingestion and Transformation" in DEA-C01.

  • 1.2ETL and the Data Catalog with AWS Glue

    Understand AWS Glue crawlers and the Data Catalog (schema inference, central metadata), serverless Spark ETL jobs, and ETL vs. ELT.

  • 1.3Orchestration and Stream Processing

    Understand pipeline orchestration (Step Functions / Managed Workflows for Apache Airflow), stream processing (Managed Service for Apache Flink), and lightweight transforms with Lambda.