hugging-face-evaluation-manager

499

Description

Add and manage evaluation results in Hugging Face model cards. Supports extracting eval tables from README content, importing scores from Artificial Analysis API, and running custom model evaluations with vLLM/lighteval. Works with the model-index metadata format.

Tool Access

Full access

Inherits all available tools

Supporting Files

12 files

Additional assets for this skill

Tool Access

This skill inherits all available tools. When active, it can use any tool Claude has access to.

Supporting Assets

examples/USAGE_EXAMPLES.md

examples/artificial_analysis_to_hub.py

examples/example_readme_tables.md

examples/metric_mapping.json

requirements.txt

scripts/evaluation_manager.py

scripts/inspect_eval_uv.py

scripts/inspect_vllm_uv.py

scripts/lighteval_vllm_uv.py

scripts/run_eval_job.py

scripts/run_vllm_eval_job.py

scripts/test_extraction.py

Links

GitHub Stats

48 forks

Updated 4 days ago

Related Skills

gitops-workflow

22.8K

Implement GitOps workflows with ArgoCD and Flux for automated, declarative Kubernetes deployments with continuous reconciliation. Use when implementing GitOps practices, automating Kubernetes deployments, or setting up declarative infrastructure management.

From kubernetes-operations

helm-chart-scaffolding

22.8K

Design, organize, and manage Helm charts for templating and packaging Kubernetes applications with reusable configurations. Use when creating Helm charts, packaging Kubernetes applications, or implementing templated deployments.

From kubernetes-operations

k8s-manifest-generator

22.8K

Create production-ready Kubernetes manifests for Deployments, Services, ConfigMaps, and Secrets following best practices and security standards. Use when generating Kubernetes YAML manifests, creating K8s resources, or implementing production-grade Kubernetes configurations.

From kubernetes-operations