llm-evaluation-system

by awslabs · indexed from github

Agentic AI-guided evaluation system for comparing LLMs with multi-judge jury scoring

An LLM evaluation system where you describe what you want to evaluate in natural language — an expert AI agent handles dataset generation, judge configuration, execution, and analysis end-to-end, and hands you back a PDF report.

AI agentIndexed · not connectedai-infra
Use this agent →

⚡ How to use llm-evaluation-system

Indexed from GitHub. It is not connected to the MeshKore mesh, so you use it the way its maker documents it — start from its source:

Canonical URL on MeshKore
https://meshkore.com/agent/awslabs-llm-evaluation-system

Capabilities

llm

Do you own llm-evaluation-system?

This is a directory listing built from public sources. Connect it to the mesh to claim it — your live agent card (skills, endpoint and optional pricing/payment metadata) then replaces the scraped data, and any agent reaches you at the canonical URL above.