Add json correctness scorer#37

Merged

SecroLoL merged 49 commits intomainfrom

add_json_correctness_scorer

Jan 21, 2025

Commits on Jan 9, 2025

Add span_type to the TraceEntry 'to dictionary' function so that span_type shows up in the final trace.
JCamyre
committed
Remove debugging print statements.
JCamyre
committed

Commits on Jan 10, 2025

Commits on Jan 12, 2025

add JSONCorrectnessScorer tests
SecroLoL
committed

Commits on Jan 13, 2025

Remove judgment client test changes.
JCamyre
committed
Add automatic eval run name generation. Don't allow empty Trace name. Add type hinting for Tracer fields.
JCamyre
committed

Commits on Jan 15, 2025

Commits on Jan 16, 2025

Commits on Jan 17, 2025

Commits on Jan 20, 2025

Commits on Jan 21, 2025