Publishing

Anyone can publish an eval pack. If you've designed a skill and thought carefully about what makes a good response, your evals are worth sharing.

Who should publish?

• Domain experts who know what "correct" looks like for a given task
• Skill authors who want community feedback on their evaluation criteria
• Teams standardizing eval coverage across agents

What a skill pack looks like

A pack is a folder with a single evals.json file:

my-skill/
└── evals.json

evals.json format

{
  "skill_name": "AI Review Response Tool",
  "version": "1.0.0",
  "evals": [
    {
      "id": "review-response-1",
      "prompt": "Write a response to this code review comment: 'This function is too long'",
      "expected_output": {
        "expectations": [
          "Acknowledges the concern",
          "Proposes a concrete refactoring approach",
          "Is professional in tone"
        ]
      }
    }
  ]
}

Publish via CLI

npx evalify-cli publish ./my-skill

The CLI validates your pack, prompts for confirmation, and uploads:

You'll need to log in first if you haven't already:

npx evalify-cli login

Publish via web

You can also publish directly from the browser at evalify.sh/publish. Sign in with GitHub and fill out the form — no CLI required.