SkillProof tested Claude skills

Skill Article Publisher

Publicación git con lint MDX y commit semántico — roto en la práctica

Por foreveryh · foreveryh/claude-skills-tutorial

Tested · Didn't pass

Skill Article Publisher — Publicación git con lint MDX y commit semántico — roto en la práctica

Qué hace

Bundles two Python scripts que claim to validate MDX articles (frontmatter, escaped comparison operators, tag balance), run a build check, generate a Conventional-Commits message y push. Aimed at fumadocs/Next.js documentation repos y triggers on requests to validate, commit o publish .mdx files. In execution the validator misses real MDX compile errors y el documented dry run creates an actual commit.

Informe de la prueba

Construimos un fumadocs-style repo con one deliberately broken MDX article y compiled it con @mdx-js/mdx to get ground truth: two genuine errors, an unclosed <Callout> y a bare Promise<void> in prose. El bundled validate_mdx.py caught neither, y instead flagged two '>80% accuracy' lines that compile fine — plain `npm run build`, la no-skill baseline, pinpointed both real errors con line numbers in about a second. Worse, el documented dry run is not a dry run: running publish_article.py without --push ran `git add -A` y created a real commit de 1658 files, incluyendo un .env.local holding SECRET_TOKEN y el whole node_modules tree, con no confirmation prompt. Two more executed failures: a new untracked article in directory mode reports 'No changes detected', y a relative file path crashes con an unhandled ValueError traceback. Instálelo the normal way, into ~/.claude/skills, y MDX validation es silently skipped entirely because the script hardcodes a lookup for .claude/skills/skill-article-publisher inside the target project.

Probado el: 2026-08-10 · Claude Code 2.x (agent harness)

Instalación

git clone https://github.com/foreveryh/claude-skills-tutorial.git
mkdir -p ~/.claude/skills
cd claude-skills-tutorial && cp -r .claude/skills/skill-article-publisher ~/.claude/skills/skill-article-publisher

Comandos y prompts de ejemplo

  • /skill-article-publisherPublicación git con lint MDX y commit semántico — roto en la práctica

Los skills se activan con peticiones en lenguaje natural, sin comandos que memorizar. Tras instalarlo, prompts como estos lo activan (en inglés):

  • Validate this MDX article and commit it with a conventional message
  • Check my new docs article for frontmatter and tag balance errors
  • Build and publish this fumadocs MDX article to the repo

Informe completo →