Skip to content

Commit 340233e

Browse files
konsta95claude
konsta95
and
claude
committed
plugin-dev: the suite header states the control figures at the current 92-shape corpus
The own-grammar note still gave the control figures from a 44-shape corpus (19 and 20 of 44, Claude Code 2.1.266). Re-measured on Claude Code 2.1.278 with the corpus at 92 shapes: VALIDATOR pointed at PR anthropics#89404's script fails the corpus check on 35 of 92 (57/92 agree); this script's own-grammar version (e830ff6) on 37 of 92 (55/92 agree). The old figures stay as history. The suite itself is unchanged: 39 pass on 2.1.274 and 2.1.278, 92/92 shapes agree. Co-Authored-By: Claude Fable 5.1 <[email protected]>
1 parent 9b01484 commit 340233e

1 file changed

Lines changed: 3 additions & 2 deletions

File tree

‎plugins/plugin-dev/skills/agent-development/scripts/validate-agent.test.sh‎

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -10,8 +10,9 @@
1010
# Every check names the defect it pins, and each was seen FAILING against a validator that has
1111
# that defect before it was accepted here:
1212
# own-grammar the script decided parse-ability with an awk classifier of its own. With
13-
# VALIDATOR pointed at PR #89404's script the corpus check below fails on 19 of
14-
# 44 shapes, at the previous version of this script on 20 of 44 (Claude Code
13+
# VALIDATOR pointed at PR #89404's script the corpus check below fails on 35 of
14+
# 92 shapes, at this script's own-grammar version (e830ff6) on 37 of 92 (Claude
15+
# Code 2.1.278; 19 and 20 of 44 when the corpus had 44 shapes, Claude Code
1516
# 2.1.266): false passes (an unterminated quote, a list, a number, a boolean, a
1617
# null), a false error (a tab-indented continuation), and parse failures
1718
# reported in the script's words rather than the product's

0 commit comments

Comments
 (0)