Skip to content

docs(de-pro): restructure to the Oct 9 2026 exam (9 domains, 60 questions) - #35

Merged
kengio merged 8 commits into
mainfrom
docs/de-professional-oct-2026-blueprint
Oct 26, 2026
Merged

kengio merged 8 commits into
mainfrom
docs/de-professional-oct-2026-blueprint

Conversation

@kengio

@kengio kengio commented Oct 26, 2026

Copy link
Copy Markdown
Owner

Summary

Restructure Data Engineer Professional for the new Oct 9, 2026 exam: 9 domains (previously 10), 60 scored questions, English only per the PDF. Every one of the 45 PDF skill bullets is quoted in its topic README's coverage table and linked to the files that teach it. The PR adds 14 topic files for the new skills and fixes several factual errors.

Type of change

  • Factual correction
  • New practice question
  • New mock-exam question
  • Topic-file expansion or rewrite
  • Blueprint refresh (Databricks updated the exam guide for a cert)

Which certification(s) does this touch?

  • Data Engineer Professional

Blueprint / source alignment

  • Exam guide: Oct 9, 2026 PDF. The cert page still shows the old 10 domains and 59 questions; this conflict is noted in the cert README.
  • Domains: 23 / 12 / 12 / 10 / 15 / 8 / 5 / 10 / 5 %.
    • "Data Sharing and Federation" folds into Ingestion.
    • "Data Manipulation" replaces "Data Transformation, Cleansing, and Quality".
  • New skills:
    • AUTO CDC
    • Lakeflow Connect database CDC
    • OpenSharing
    • Clean Rooms
    • VARIANT
    • AI functions
    • ABAC with governed tags
    • CLUSTER BY AUTO / predictive optimization
    • UC metric views
    • Lakehouse alerts
    • Declarative Automation Bundles project structure
    • Job repair and parameter overrides
  • Fixes:
    • UC grant inheritance and DENY
    • invalid system-table columns
    • Jobs API 2.1 → 2.2
    • fake Repos endpoints
    • a nonexistent CREATE STORAGE CREDENTIAL statement
  • Platform callouts:
    • Lakeflow Spark Declarative Pipelines (2025-11-12)
    • Declarative Automation Bundles (2026-03-16)
    • OpenSharing (2026-06-10)
    • Community Edition retired (2026-01-01)

Folder map

New folder Came from
01-developing-code-for-data-processing old 01 + AUTO CDC, compute, testing
02-data-ingestion-and-acquisition old 07 + CDC (from 03), OpenSharing and federation (from 10)
03-data-manipulation batch ETL, Delta ops, dedup, expectations
04-monitoring-and-alerting same, + CLI / REST API
05-cost-and-performance-optimization old 02
06-ensuring-data-security-and-compliance old 05
07-data-governance old 08
08-debugging-and-deploying old 06 (asset-bundles → declarative-automation-bundles)
09-data-modeling old 09-data-modelling + partitioning

README & CLAUDE.md sync

  • I updated the affected cert's README.md
  • The top-level README.md, CLAUDE.md, and CHANGELOG.md updates for every cert are batched into the shared-content PR of this Oct 2026 refresh series.

3-round self-review

  • Round 1 · [x] Round 2 · [x] Round 3 (found no new style issues beyond older convention debt; see below)

Verification

  • markdownlint: 0 errors. The regenerated debriefs also fix 266 MD059 errors that were already there.
  • Links: 0 broken, across 1,065 links from anywhere in the repo into this cert
  • python3 practice/build.py --cert data-engineer-professional:
    • 155 practice questions (82 new), 63 + 60 mock questions
    • 0 skipped, 0 duplicate IDs

Anything reviewers should know

  • Merge order: this PR rewrites link paths in ~20 files outside the cert (Data Analyst, DE Associate, shared/, labs/, learning-paths/, images/). Merge it before the DE Associate, Data Analyst, and shared PRs of this series; those will be rebased on top.
  • Progress reset: practice-quiz progress for DE Pro resets because question IDs changed.
  • Removed link: the ExamTopics link (a question-dump site) is gone from the practice README.
  • Product-name gaps: the docs don't use the exact term "Lakehouse alerts" and have no agent-quality system table, so that bullet is covered conceptually. Pipelines write Delta only, so Iceberg is covered as a read target and via USING ICEBERG MVs (Preview).
  • Known debt (not fixed here):
    • ~40 older topic files lack the preamble callouts
    • some files exceed 600 lines
    • the practice answer key skews to B (67 of 155)

🤖 Generated with Claude Code

Renames the topic folders to match the 9 sections of the Oct 9, 2026
exam guide, in the same order (01 Developing Code ... 09 Data Modeling).
The old Data Sharing and Federation and Data Transformation folders are
removed; their files now live under Ingestion, Developing Code and Data
Manipulation. Relative links are rewritten across the repo.
Lakeflow Declarative Pipelines -> Lakeflow Pipelines, Databricks Asset
Bundles -> Declarative Automation Bundles, Delta Sharing -> OpenSharing,
Data Modelling -> Data Modeling. Link targets and URLs are unchanged.
…actice questions

New topic files for skills added in the Oct 9, 2026 guide: Python project
structure and dependencies, UDFs and UC functions, Lakeflow Connect
database CDC, Clean Rooms, VARIANT, AI functions, Lakehouse alerts,
managed tables and predictive optimization, disk caching, ABAC with
governed tags, anonymization and data purging, tags and comments, job
repair, and dimensional modeling with metric views. Existing files for
OpenSharing, Lakehouse Federation, Lakeflow Pipelines, AUTO CDC, CDC,
system tables, the SDK, bundles and Git folders are updated and checked
against docs.databricks.com. Compute is split into two parts.

Topic READMEs now map each exam-guide bullet to the files that cover it,
and the nav lines are regenerated. Practice questions are regrouped into
9 section files (73 existing + 82 new 2026-blueprint questions) and the
JSON bank is rebuilt.
…ions

Each mock question now sits under its Oct 9, 2026 section heading, so
the practice-quiz mock banks report 9 domains. Debriefs get a 9-section
resource map, a per-question map with descriptive link text (fixes the
MD059 lint errors) and per-section counts. Mock READMEs show the counts
and drop the old 10-domain table.
…xam guide

Cert README: Oct 9, 2026 exam overview (60 scored questions, English
only), 9-domain pie and Study Topics table, a 'What changed' callout, a
note on the cert page still showing the old 10-domain layout, a
product-name callout, and an updated progress tracker and course list.

Resources: exam tips, final review, official links and the Lakeflow
Pipelines cheat sheet are rewritten for the 9 sections and current
product names (AUTO CDC, OpenSharing, Declarative Automation Bundles).
Fixes wrong claims about UC grants not reaching future tables, DENY,
dev-mode expectations, and full-recompute materialized views.
Moves Best Practices after Common Issues in unit-testing part 2, adds
the abstract callout to access control, and fixes a doubled
'Lakeflow Pipelines pipeline' phrase. Lint, link check and the practice
build are clean.
Checked all 45 skill bullets in the topic READMEs against the Oct 9,
2026 PDF (verbatim match, each mapped to at least one file) and
spot-checked CREATE POLICY and metric view YAML syntax against the docs.
Swaps the correct choice of 28 B-keyed questions with another choice so
the 155-question bank is A 39 / B 39 / C 39 / D 38 (was A 34 / B 67 /
C 33 / D 21). Correct Answer lines and letter references in the
explanations are updated; question text, IDs and mock exams unchanged.
@kengio
kengio force-pushed the docs/de-professional-oct-2026-blueprint branch from 9c3a7e3 to f46c1a3 Compare October 26, 2026 14:55
@kengio
kengio merged commit 7ed452b into main Oct 26, 2026
2 checks passed
@kengio
kengio deleted the docs/de-professional-oct-2026-blueprint branch October 26, 2026 14:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant