Apache Spark (Learning Spark 2nd Ed.)

Exam-tuned Spark cheat-sheet from 'Learning Spark 2nd Ed.' that flags its own 2020 knowledge cutoff.

Tested · Works

Test report

Verdict
Tested · Works
Score
8.8/10
Tested
Jul 16, 2026
Environment
Claude Code 2.x (agent harness)
Upstream re-checked
Aug 10, 2026 · 77f88ea

On a broadcast-vs-shuffle-join question the skill's join-strategy table covered all 5 real strategies (BHJ/SMJ/SHJ/BNLJ/Cartesian) against a generic baseline that only named 2, and it proactively disclosed its own blind spot ('this book was published in 2020... Spark Connect, Pandas API on Spark, AQE-on-by-default are not covered') rather than silently guessing at post-2020 material.

Scored on four weighted criteria — install, triggering, output vs. baseline, docs. How scoring works

  • Installs cleanly 5/5
  • Triggers reliably 5/5
  • Output vs. baseline 7/10
  • Docs & honesty 5/5

What Apache Spark (Learning Spark 2nd Ed.) does

A chapter-indexed knowledge base distilled from 'Learning Spark, 2nd Edition' covering Spark architecture, DataFrame/Dataset APIs, Spark SQL, tuning, and Structured Streaming, tuned for Databricks Associate Developer exam prep. Triggers on Apache Spark / PySpark questions, exam prep, or the book's frameworks; explicitly flags what it does NOT cover (Spark Connect, pandas-on-Spark, post-2020 AQE defaults) since the source book predates them.

How to install Apache Spark (Learning Spark 2nd Ed.)

git clone https://github.com/Galius5136/databricks-spark-3.5-cert-prep
cd databricks-spark-3.5-cert-prep
mkdir -p ~/.claude/skills
cp -r skills/apache-spark ~/.claude/skills/apache-spark

Skills live in ~/.claude/skills/ (global) or .claude/skills/ (per-project). Restart Claude Code after installing.

Commands — how to trigger Apache Spark (Learning Spark 2nd Ed.)

  • /apache-spark Exam-tuned Spark cheat-sheet from 'Learning Spark 2nd Ed.' that flags its own 2020 knowledge cutoff.

It also activates on plain-language prompts like these:

  • should I use a broadcast join or shuffle join for this dataset?
  • explain Structured Streaming windowing for the Databricks exam
  • how does Spark's DataFrame API differ from the Dataset API?

Frequently asked questions

Is the Apache Spark (Learning Spark 2nd Ed.) skill free?
Yes. The skill itself is free from Galius5136/databricks-spark-3.5-cert-prep. SkillProof publishes the install command and an independent test verdict at no cost.
Does Apache Spark (Learning Spark 2nd Ed.) work with Claude Code?
We tested it with Claude Code 2.x (agent harness) on Jul 16, 2026. Verdict: Tested · Works. On a broadcast-vs-shuffle-join question the skill's join-strategy table covered all 5 real strategies (BHJ/SMJ/SHJ/BNLJ/Cartesian) against a generic baseline that only named 2, and it proactively disclosed its own blind spot ('this book was published in 2020... Spark Connect, Pandas API on Spark, AQE-on-by-default are not covered') rather than silently guessing at post-2020 material.
What is the Apache Spark (Learning Spark 2nd Ed.) SkillProof Score?
8.8/10 — installs cleanly 5/5, triggers reliably 5/5, output vs. baseline 7/10, docs & honesty 5/5.
How do I install Apache Spark (Learning Spark 2nd Ed.)?
Copy the install command from this page, run it in your terminal, and restart Claude Code. Skills live in ~/.claude/skills/ (global) or .claude/skills/ inside a project.
Can I use Apache Spark (Learning Spark 2nd Ed.) with Cursor, Copilot, Gemini CLI, Codex or other AI tools?
The SKILL.md format is native to Claude (Claude Code, Desktop, claude.ai). The instructions inside adapt to other assistants: Cursor rules, GitHub Copilot instructions, Windsurf rules, Custom GPTs, AGENTS.md for OpenAI Codex, and GEMINI.md for Google Gemini CLI — our conversion guides cover each, and the free converter on the tools page does the wrapping for you.