Data Engineer

← All career guides Data and AI Data Engineer Builds reliable data ingestion, transformation, storage, orchestration, and governance systems. Find relevant jobs→Print learning guideOpen Hitchhiker's guide→ Skill coverage 100% 7 of 7 skills Course coverage 79% 23 of 29 courses Skill coverage shows how much of the role's capability map already has a published course. Course coverage shows how much of the mapped course pipeline for this role has shipped. Role skills 7 Published coverage 7 Relevant courses 23 Capability map Skills Importance describes how central each capability is to the role. Course coverage shows where you can build the skill in the current OpenSkills catalog. 01 Data foundations 4 capabilities SQL Importance: Essential (5 of 5) Queries and transforms relational data effectively. Course coverage SQL FundamentalsAdvanced SQL for Analytics (planned)Data modeling Importance: Essential (5 of 5) Designs models aligned with operational and analytical workloads. Course coverage Data Engineering FundamentalsData ModelingWarehouses and lakes Importance: Essential (5 of 5) Selects and structures analytical storage platforms. Course coverage Data Lakes and LakehousesData WarehousingData wrangling Importance: Essential (5 of 5) Cleans, reshapes, and validates heterogeneous data. Course coverage Data WranglingPython for Analysis 02 Data platforms 3 capabilities Batch and stream processing Importance: Essential (5 of 5) Builds scalable bounded and unbounded data pipelines. Course coverage Batch Data ProcessingFreeETL and ELTStream ProcessingApache Kafka FundamentalsApache Kafka OperationsApache Pulsar FundamentalsEvent StreamingApache Flink FundamentalsApache Spark FundamentalsDatabricks FundamentalsBatch Inference and Offline Scoring, Feature Stores with Feast, Streaming Feature Engineering (planned)Data orchestration Importance: Essential (5 of 5) Schedules, coordinates, retries, and observes pipeline work. Course coverage Apache Airflow FundamentalsDagster Fundamentals (planned)Data quality and governance Importance: Essential (5 of 5) Makes data trustworthy, discoverable, traceable, and controlled. Course coverage Data QualityData GovernanceData LineageData RetentionMaster Data ManagementData and Model Versioning with DVC (planned) Learning path Relevant courses Print all introsPrint all cheatsheets Core foundations The concepts this role is built on. Batch Data ProcessingFreeData Engineering FundamentalsData Lakes and LakehousesData ModelingData QualityData WarehousingData WranglingETL and ELTSQL FundamentalsStream Processing Supporting knowledge Adjacent knowledge that improves day-to-day judgment. Apache Airflow FundamentalsApache Kafka FundamentalsApache Kafka OperationsApache Pulsar FundamentalsData GovernanceData LineageData RetentionEvent StreamingMaster Data ManagementPython for AnalysisAdvanced SQL for Analytics, Batch Inference and Offline Scoring, Dagster Fundamentals, Data and Model Versioning with DVC, Feature Stores with Feast, Streaming Feature Engineering (planned) Specializations Deeper paths for particular environments or directions. Apache Flink FundamentalsApache Spark FundamentalsDatabricks Fundamentals Put the map to work Find Data Engineer roles. Search multiple job sources at once with queries tailored to this career, then use the skill map above to evaluate what each role actually asks for. Open job search→ Keep exploring More in Data and AI Data Analyst→Data Scientist→ Show more Show less Tingkat senioritas Tingkat pemula Jenis pekerjaan Penuh waktu Fungsi pekerjaan Teknologi Informasi Industri Pelatihan dan Bimbingan Profesional Referensi meningkatkan kesempatan Anda untuk diwawancarai oleh OpenSkills hingga 2x Lihat orang yang mungkin Anda kenal