Your Guide to Data Engineering
This community-driven roadmap helps newcomers navigate the complex world of data engineering. Use it as a reference to guide your self-learning journey.
Whether you're just starting out or looking to expand your skills, this roadmap provides a clear path through the essential concepts, tools, and technologies in the field.
How to Use This Guide
- 1
Explore the categories
Browse through different sections based on your interests and needs
- 2
Check topic details
Expand sections to see specific topics and recommended resources
- 3
Learn at your own pace
Use the difficulty indicators and time estimates as a general guide
- 4
Join the community
Connect with other learners to share resources and experiences
Data Engineering Fundamentals
Core concepts and principles of data engineering
SQL
The language of data
Python
The Swiss Army knife for data engineers
Linux
Essential command line skills for data engineers
Git and GitHub
Version control for collaborative development
Data Modeling
Structuring data for optimal use
Suggested Learning Path
While everyone's journey is unique, here's a recommended sequence to build your skills efficiently
Beginner Level
Data Engineering Fundamentals
Core concepts and principles of data engineering
SQL
The language of data
Python
The Swiss Army knife for data engineers
Linux
Essential command line skills for data engineers
Git and GitHub
Version control for collaborative development
Data Modeling
Structuring data for optimal use
Intermediate Level
DBT
Transform your data in your warehouse
Docker
Containerization for data applications
Data Integration with Airbyte
Connect and integrate data from various sources
Orchestration with Airflow
Coordinate and automate complex data workflows
CI/CD
Continuous integration and deployment for data pipelines
Advanced Level
Cloud
Harness the power of cloud computing
Spark
Process big data at scale
Terraform
Infrastructure as code for data platforms
Kafka
Build real-time data streaming pipelines
Want to Contribute to our Roadmap?
Help the community grow by contributing to our roadmap to help aspiring data engineers learn faster and better