Apache Spark (Learning Spark 2nd Ed.)
Exam-tuned Spark cheat-sheet from 'Learning Spark 2nd Ed.' that flags its own 2020 knowledge cutoff.
Test report
- Verdict
- Tested · Works
- Score
- Tested
- Jul 16, 2026
- Environment
- Claude Code 2.x (agent harness)
- Upstream re-checked
- Aug 10, 2026 · 77f88ea
On a broadcast-vs-shuffle-join question the skill's join-strategy table covered all 5 real strategies (BHJ/SMJ/SHJ/BNLJ/Cartesian) against a generic baseline that only named 2, and it proactively disclosed its own blind spot ('this book was published in 2020... Spark Connect, Pandas API on Spark, AQE-on-by-default are not covered') rather than silently guessing at post-2020 material.
Scored on four weighted criteria — install, triggering, output vs. baseline, docs. How scoring works
- Installs cleanly 5/5
- Triggers reliably 5/5
- Output vs. baseline 7/10
- Docs & honesty 5/5
What Apache Spark (Learning Spark 2nd Ed.) does
A chapter-indexed knowledge base distilled from 'Learning Spark, 2nd Edition' covering Spark architecture, DataFrame/Dataset APIs, Spark SQL, tuning, and Structured Streaming, tuned for Databricks Associate Developer exam prep. Triggers on Apache Spark / PySpark questions, exam prep, or the book's frameworks; explicitly flags what it does NOT cover (Spark Connect, pandas-on-Spark, post-2020 AQE defaults) since the source book predates them.
How to install Apache Spark (Learning Spark 2nd Ed.)
git clone https://github.com/Galius5136/databricks-spark-3.5-cert-prep
cd databricks-spark-3.5-cert-prep
mkdir -p ~/.claude/skills
cp -r skills/apache-spark ~/.claude/skills/apache-spark
Skills live in ~/.claude/skills/ (global) or .claude/skills/
(per-project). Restart Claude Code after installing.
Commands — how to trigger Apache Spark (Learning Spark 2nd Ed.)
-
/apache-sparkExam-tuned Spark cheat-sheet from 'Learning Spark 2nd Ed.' that flags its own 2020 knowledge cutoff.
It also activates on plain-language prompts like these:
-
should I use a broadcast join or shuffle join for this dataset? -
explain Structured Streaming windowing for the Databricks exam -
how does Spark's DataFrame API differ from the Dataset API?
Frequently asked questions
- Is the Apache Spark (Learning Spark 2nd Ed.) skill free?
- Yes. The skill itself is free from Galius5136/databricks-spark-3.5-cert-prep. SkillProof publishes the install command and an independent test verdict at no cost.
- Does Apache Spark (Learning Spark 2nd Ed.) work with Claude Code?
- We tested it with Claude Code 2.x (agent harness) on Jul 16, 2026. Verdict: Tested · Works. On a broadcast-vs-shuffle-join question the skill's join-strategy table covered all 5 real strategies (BHJ/SMJ/SHJ/BNLJ/Cartesian) against a generic baseline that only named 2, and it proactively disclosed its own blind spot ('this book was published in 2020... Spark Connect, Pandas API on Spark, AQE-on-by-default are not covered') rather than silently guessing at post-2020 material.
- What is the Apache Spark (Learning Spark 2nd Ed.) SkillProof Score?
- 8.8/10 — installs cleanly 5/5, triggers reliably 5/5, output vs. baseline 7/10, docs & honesty 5/5.
- How do I install Apache Spark (Learning Spark 2nd Ed.)?
- Copy the install command from this page, run it in your terminal, and restart Claude Code. Skills live in ~/.claude/skills/ (global) or .claude/skills/ inside a project.
- Can I use Apache Spark (Learning Spark 2nd Ed.) with Cursor, Copilot, Gemini CLI, Codex or other AI tools?
- The SKILL.md format is native to Claude (Claude Code, Desktop, claude.ai). The instructions inside adapt to other assistants: Cursor rules, GitHub Copilot instructions, Windsurf rules, Custom GPTs, AGENTS.md for OpenAI Codex, and GEMINI.md for Google Gemini CLI — our conversion guides cover each, and the free converter on the tools page does the wrapping for you.