Data Pipeline Engineering
- Apache Kafka and Confluent Platform for real-time event streaming
- Apache Flink and Spark Structured Streaming for stateful stream processing
- Airflow and Prefect for batch pipeline orchestration and scheduling
- dbt for SQL-first data transformation with full version control and testing
Storage & Analytics
- BigQuery, Snowflake, and Redshift for cloud data warehousing
- TimescaleDB and InfluxDB for time-series data storage and querying
- Delta Lake and Apache Iceberg for large-scale analytical data storage
- Grafana, Metabase, and Tableau for business intelligence dashboards