TrackLLM0009

LLM as Judge Eval Harness

Hard

Problem

Build the evaluation harness that decides whether a prompt or model change ships. The judge must be validated, its biases measured and corrected, and retrieval quality measured separately from generation quality.

Required components

Click to add a component to the canvas.

Additional components

Browse by category. Click or drag a component onto the canvas.

Drag components from the library onto the canvas, then drag from a component's right handle to connect it to another.

100%

Design canvas

Sign up to start designing

Sign up free

Premium is free for 83 more days.