{"name":"daymade-llm-eval-harness-llm-eval-harness","owner":{"name":"ClaudePluginHub"},"plugins":[{"name":"daymade-llm-eval-harness-llm-eval-harness","source":{"source":"git-subdir","url":"https://github.com/daymade/claude-code-skills","path":"llm-eval-harness"},"description":"Evaluate any LLM behind an OpenAI- or Anthropic-compatible endpoint across four dimensions — speed (TTFT + thinking-aware tokens/sec), concurrency/stability (success rate, p50/p90, breaking point), Anthropic protocol compliance (thinking-block trigger rate), and quality regression against your own accumulated use cases (blind-judge precision). Use to benchmark a model, verify a tokens-per-second claim, compare models head-to-head, or vet a newly released model before adopting it.","version":"1.0.0","strict":false,"keywords":["llm","eval","benchmark","model-comparison","speed-test","concurrency","protocol-compliance","tokens-per-second","ttft","thinking-aware"],"category":"testing"}]}