Make evaluation run names unique#33

Merged

SecroLoL merged 8 commits intomainfrom

joseph/eval-run-name-uniqueness

Jan 10, 2025

Commits on Jan 8, 2025

Add new field override to running evals.
JCamyre
committed
Call endpoint to check whether an eval run name exists for a particular user and project.
JCamyre
committed
Modularize eval run name duplicate check.
JCamyre
committed
Add new e2e test for every scenario relating to log results and overriding eval run names.
JCamyre
committed
Make e2e test more robust by using a random eval name. Use try and excepts to handle for errors. Add comments.
JCamyre
committed
Uncomment tests. Add overrides where necessary for testing.
JCamyre
committed
Add return type annotation. Remove logic related to actual eval run name.
JCamyre
committed
Modularize eval results logging logic.
JCamyre
committed