Skip to content

docs(de-assoc): restructure to the Aug 2026 guide's 7 weighted domains - #37

Merged
kengio merged 11 commits into
mainfrom
docs/de-associate-aug-2026-refresh
Oct 26, 2026
Merged

kengio merged 11 commits into
mainfrom
docs/de-associate-aug-2026-refresh

Conversation

@kengio

@kengio kengio commented Oct 26, 2026

Copy link
Copy Markdown
Owner

Summary

Restructure Data Engineer Associate to match the current exam guide: exam published May 4, 2026, guide updated Aug 6, 2026, with 7 officially weighted domains. Topic folders now map 1:1 to the domains. This adds 15 topic files, rewrites several inaccurate files, remaps the practice bank, and regroups and corrects both mock exams.

Type of change

  • Factual correction
  • New practice question
  • Topic-file expansion or rewrite
  • Blueprint refresh (Databricks updated the exam guide for a cert)

Which certification(s) does this touch?

  • Data Engineer Associate

Blueprint / source alignment

  • Exam guide: Aug 2026 PDF. Weights: Intelligence Platform 6 · Ingestion & Loading 21 · Transformation & Modeling 22 · Lakeflow Jobs 16 · CI/CD 10 · Troubleshooting/Monitoring/Optimization 10 · Governance & Security 15 (%).
  • Topic READMEs: each traces every exam-guide skill to the files that cover it.
  • 15 new topic files:
    • ingestion patterns + Lakeflow Connect
    • COPY INTO / Auto Loader
    • JDBC/REST + semi-structured data
    • data quality
    • Gold layer objects
    • Spark tuning
    • control flow
    • Git folders
    • Liquid Clustering + predictive optimization
    • compute troubleshooting
    • managed/external tables
    • row filters / column masks / ABAC
    • and more
  • Rewritten files:
    • triggers (the Quartz cron examples were wrong)
    • job monitoring
    • access control (legacy USAGE privileges and a "column-level ACL coming later" section were wrong)
    • compute (invented DBU prices removed)
    • bundles (now Declarative Automation Bundles)
    • Spark UI
  • Fixes in mock answers: DBFS root, 120-minute auto-stop, Auto Loader mode, dbutils.taskValues, SKIPPED status, event log, ignoreChanges.
  • Platform callouts:
    • Lakeflow Spark Declarative Pipelines (2025-11-12)
    • Declarative Automation Bundles (2026-03-16)
    • OpenSharing (2026-06-10)
    • Community Edition retired → Free Edition
    • UC DENY explained: the classic statement is Hive-metastore only; ABAC DENY policies are Beta

README & CLAUDE.md sync

  • I updated the affected cert's README.md
  • The top-level README.md, CLAUDE.md, and CHANGELOG.md updates for every cert are batched into the shared-content PR of this Oct 2026 refresh series.

3-round self-review

  • Round 1 · [x] Round 2 · [x] Round 3 · [x] Round 4 (answer-key rebalance)

Verification

  • markdownlint: 0 errors on 57 modified files
  • python3 practice/build.py --cert data-engineer-associate:
    • 145 practice questions (60 new); per domain 21 / 24 / 35 / 15 / 15 / 18 / 17
    • 45 + 45 mock questions
    • 0 skipped
  • Answer key balanced: A 37 · B 36 · C 36 · D 36 (was B 57)
  • Links: 742 checked. The 5 that don't resolve yet point at DE Professional paths renamed in docs(de-pro): restructure to the Oct 9 2026 exam (9 domains, 60 questions) #35 and resolve once it merges.
  • All 145 Python blocks and 34 YAML/JSON blocks parse

Anything reviewers should know

🤖 Generated with Claude Code

kengio added 11 commits October 26, 2026 21:59
…mains

Move the 6 legacy topic folders into 7 folders that match the official
August 2026 exam guide domains 1:1, rewrite the cert README (exam
overview, official weights, What changed callout, platform-update note)
and all 7 topic READMEs with per-domain skill-coverage tables, and add
the three new Data Ingestion and Loading topic files.
Add data cleaning/quality, Gold layer objects, and Spark tuning
parameter files; add abstract + What the Exam Tests preambles and
normalised nav lines to all moved topic files; modernise lakehouse and
workspace files (UC paths instead of DBFS mounts, Git folders).
…te content

Add control-flow (retries, If/else, For each, Run if, task values) and
Git folders topic files; rewrite triggers (scheduled/file arrival/table
update, corrected Quartz cron), Declarative Automation Bundles
(variables, precedence, modes, CLI), and compute services/cost models
from current docs; replace boilerplate Common Issues entries.
Add Liquid Clustering/predictive optimization, compute troubleshooting,
managed vs external tables (SET/UNSET MANAGED), and row filters/column
masks/ABAC files; rewrite job monitoring (matrix view, statuses), Spark
UI (skew/shuffle/spill, salting) and access control (UC privileges,
DENY legacy vs ABAC DENY policies). DE Pro links point at the renamed
DE Pro paths coordinated with the de-pro refresh.
… 60 2026-blueprint questions

Rebuild the practice-question files per August 2026 domain (85 legacy
questions remapped, outdated ones corrected: GROUP BY ordinal, LIVE
TABLE syntax, SQL endpoint, Repos, USAGE/ownership in UC), add 60 new
questions covering every exam-guide skill bullet, bump CERT_TITLES to
Aug 6, 2026, and regenerate the practice bank JSON (145 questions).
Reorder both mock exams into 7-domain sections with regenerated answer
keys and section trackers, fix outdated answers (DBFS root vs UC
volumes, SQL warehouse auto-stop defaults, Auto Loader addNewColumns,
dbutils.jobs.taskValues, Upstream failed, pipeline event log,
skipChangeCommits), and rewrite README domain tables and debrief maps.
…t 2026 guide

Rewrite exam-tips (format, 7-domain weights, must-know list, traps),
official-links (grouped by domain, Free Edition, rename release notes)
and final-review; point learning-paths/master-roadmap and the
screenshot inventory at the renamed topic folders; replace a 404
DataFrames docs link.
Replace DataFrame.except (a Python keyword) with exceptAll in the time
travel file and remove a // comment from a JSON block in job
monitoring. All 145 python and 34 yaml/json blocks in the cert's topic
files now parse; markdownlint, link check, and practice build pass.
…e CI source

Use 'Declarative Automation Bundles (formerly Databricks Asset Bundles)'
in the remaining practice question, cite the Databricks GitHub Actions
docs for the bundle CI sketch, and regenerate the practice bank. The
target default behaviour was checked against the bundle settings docs.
Rename in-body 'Best Practices' headings in the access-control and data
sharing files so the terminal Use Cases → Official Documentation
sequence stays in the order CLAUDE.md requires.
Swap the correct choice with the target position in 118 of 145
practice questions so A/B/C/D are 37/36/36/36, updating each Correct
Answer line. No explanation references choice letters, so none needed
rewording. Question text, IDs, and mock exams unchanged.
@kengio
kengio force-pushed the docs/de-associate-aug-2026-refresh branch from 0fb8046 to f8d1dee Compare October 26, 2026 15:00
@kengio
kengio merged commit 67a2098 into main Oct 26, 2026
2 checks passed
@kengio
kengio deleted the docs/de-associate-aug-2026-refresh branch October 26, 2026 15:01
kengio added a commit that referenced this pull request Oct 26, 2026
kengio added a commit that referenced this pull request Oct 26, 2026
* docs: move shared pipeline cheat sheet, code examples, and labs to current Lakeflow, pyspark.pipelines, AI Search, and agent APIs

* docs: refresh shared appendix (glossary, version history, renewal guide, comparison tables) for 2025-2026 renames and current exam guides

* docs: rename sweep across interview prep, learning paths, error/troubleshooting appendix, UC cheat sheet, and shared Anki decks; refresh learning-path domain tables to current exam guides

* docs(th): add 2025-2026 renamed Databricks terms to Thai glossary

* fix: keep Anki card front stable for the Delta Sharing card (OpenSharing note moved to the back)

* review(round1): flag MLflow 2.x mlflow.evaluate examples with MLflow 3 genai.evaluate notes

* review(round2): tighten publishing-mode and Agent Bricks wording to match the cited docs

* docs: sync README, CLAUDE.md, CONTRIBUTING, CHANGELOG, practice README and Thai status for the Oct 2026 refresh

* docs: per-cert CHANGELOG detail + fix master-roadmap links after rebase

* fix: restore current CERT_TITLES in practice/build.py (reverted during #37 rebase) and rebuild DA bank labels

* docs: refresh README badges (Oct 2026, Delta Lake 4.x, AI Search / Genie Agents)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant