Skip to content

fix(sagemaker-ai): quote model-evaluation skill description to fix YAML parse error#175

Open
youtae wants to merge 1 commit into
awslabs:mainfrom
youtae:fix/sagemaker-ai-model-evaluation-yaml-frontmatter
Open

fix(sagemaker-ai): quote model-evaluation skill description to fix YAML parse error#175
youtae wants to merge 1 commit into
awslabs:mainfrom
youtae:fix/sagemaker-ai-model-evaluation-yaml-frontmatter

Conversation

@youtae
Copy link
Copy Markdown

@youtae youtae commented May 22, 2026

Fixes a YAML frontmatter parse error in the sagemaker-ai plugin's model-evaluation skill.

Related

Same class of fix as #10. No existing issue or PR addresses this skill.

Changes

The description in plugins/sagemaker-ai/skills/model-evaluation/SKILL.md is an unquoted YAML plain scalar that contains a colon followed by a space (two evaluation types: LLM-as-Judge). A YAML parser treats that colon as a mapping indicator inside a block scalar and rejects the frontmatter with mapping values are not allowed here.

Effect: the skill loads with empty metadata (the name, description, and metadata.version fields are silently dropped), so the skill does not trigger, and claude plugin validate plugins/sagemaker-ai fails with:

✘ frontmatter: YAML frontmatter failed to parse: YAML Parse error: Unexpected token.
  At runtime this skill loads with empty metadata (all frontmatter fields silently dropped).

Fix: wrap the description value in single quotes. This turns it into a valid quoted scalar while preserving the text verbatim, including the inner double quotes and the colon. The change is a single line; no wording is altered.

I scanned all 28 SKILL.md files in the repo with a YAML parser; this was the only one that failed to parse. After the change, claude plugin validate plugins/sagemaker-ai reports ✔ Validation passed.

Acknowledgment

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of the project license.

…ML parse error

The model-evaluation SKILL.md description is an unquoted YAML plain scalar that
contains a colon-space sequence ("two evaluation types: LLM-as-Judge"). The YAML
parser reads that colon as a mapping indicator and rejects the frontmatter with
"mapping values are not allowed here". When this happens the skill loads with
empty metadata (name, description, and version are silently dropped), so the
skill no longer triggers and "claude plugin validate" reports an error.

Wrapping the description in single quotes makes it a valid quoted scalar while
preserving the text verbatim, including the inner double quotes and the colon.
This is the same class of fix as awslabs#10.
@youtae youtae requested review from a team as code owners May 22, 2026 17:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant