@ecto/harness
AMCP server package @mecheval/harness
Install
agr install @ecto/harness --target claudeThis artifact does not publish files for Claude.
Document
{ "name": "@mecheval/harness", "version": "0.0.1", "private": true, "description": "MechEval harness — drives a solver against a task, calls the grader, writes a run blob.", "type": "module", "main": "dist/index.js", "bin": { "mecheval-run": "dist/cli.js", "mecheval-matrix": "dist/matrix-cli.js", "mecheval-leaderboard": "dist/leaderboard-cli.js" }, "exports": { ".": "./dist/index.js", "./pass_k": "./dist/pass_k.js" }, "files": [ "dist" ], "scripts": { "build": "tsc", "test": "vitest run" }, "dependencies": { "@anthropic-ai/sdk": "^0.88.0", "@modelcontextprotocol/sdk": "^1.0.0", "@vcad/mcp": "*", "openai": "^4.104.0" }, "devDependencies": { "@types/node": "^22", "typescript": "^5.4", "vitest": "^1" } }
Trustgrade A
- passBody integrity
Whether the stored document is plausibly the kind of file the artifact declares, rather than something fetched by mistake.
- warnType matchbest-effort: server code not analyzed
Whether the artifact is really the kind of thing its metadata claims it is.
- passFreshness
How long since the source repository was last pushed to.
- passPrompt injection
Scans the artifact's own text for instructions aimed at your agent rather than at you.
- passLicense
Whether the source repository declares an SPDX license permissive enough to redistribute.
How the grade is calculated
Each check contributes 0 points when it passes, 1 when it warns, and 2 when it fails. The total maps to a letter:
- Aevery check passed
- Bone warning
- Ctwo warnings
- Dprompt injection or body integrity failed, or three warnings
- Fone of those failed, and something else is wrong
These are automated hygiene checks, not a security audit, and not a dependency or vulnerability scan. A grade of A means nothing was flagged — not that the artifact is safe.
Versions
git-ac3442bbe10f2026-08-03