← Browse

@yogsoth-ai/evaluation-filtering

A

Multi-dimensional evaluation and tiered filtering of generated ideas.

skillclaude

Install

agr install @yogsoth-ai/evaluation-filtering --target claude

Writes 1 file into .claude/skills/, pinned to git-f67c9926.

  • .claude/skills/evaluation-filtering/SKILL.md

Document


name: evaluation-filtering description: Multi-dimensional evaluation and tiered filtering of generated ideas. Orchestrates novelty assessment → feasibility check → ranking → selection. execution: tactic

Evaluation Filtering

Multi-dimensional evaluation and tiered filtering of generated ideas.

Stages

Stage 1: Novelty Assessment

Score all ideas on novelty dimensions using novelty-scoring SOP. Assign tier: BREAKTHROUGH / HIGH / MODERATE / INCREMENTAL.

Stage 2: Feasibility Signal

For HIGH and BREAKTHROUGH tier ideas, assess initial feasibility:

  • Technical feasibility (can it be built with known methods?)
  • Resource feasibility (reasonable cost/time/expertise?)
  • Constraint satisfaction (does it meet stated requirements?)

This is a signal, not a deep validation — that's the convergence repo's job.

Stage 3: Ranking

Rank ideas by composite score: novelty (0.6) × feasibility signal (0.2) × completeness (0.2).

Stage 4: Selection

Select top ideas for output. All BREAKTHROUGH ideas pass regardless of feasibility. HIGH ideas pass if feasibility ≥ MEDIUM. MODERATE ideas pass only if they fill a coverage gap.

Minimum Yield

MetricFloor
Ideas evaluatedall generated ideas
Ideas scored on all dimensions100%
Tier distribution reportedyes
Top ideas selected≥5 (or all BREAKTHROUGH + HIGH)

Available SOPs

SOPRole
novelty-scoringStage 1 — multi-dimensional novelty assessment
constraint-injectionStage 2 — test feasibility under constraints
idea-synthesisStage 3 — refine top ideas into complete descriptions
saturation-detectionPre — determine if enough ideas exist to evaluate

Trustgrade A

  • passBody integrity

    Whether the stored document is plausibly the kind of file the artifact declares, rather than something fetched by mistake.

  • passType matchnot applicable to this artifact type

    Whether the artifact is really the kind of thing its metadata claims it is.

  • passFreshness

    How long since the source repository was last pushed to.

  • passPrompt injection

    Scans the artifact's own text for instructions aimed at your agent rather than at you.

  • passLicense

    Whether the source repository declares an SPDX license permissive enough to redistribute.

How the grade is calculated

Each check contributes 0 points when it passes, 1 when it warns, and 2 when it fails. The total maps to a letter:

  • Aevery check passed
  • Bone warning
  • Ctwo warnings
  • Dprompt injection or body integrity failed, or three warnings
  • Fone of those failed, and something else is wrong

These are automated hygiene checks, not a security audit, and not a dependency or vulnerability scan. A grade of A means nothing was flagged — not that the artifact is safe.

Versions

  • git-f67c99269e442026-07-31