You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Some parts of logic used in this baseline use an LLM being run locally:
27
+
28
+
* theme labeling in `run_theme_detection.py`
29
+
* evaluation of theme labels against the Theme Label Guideline - coming up
30
+
31
+
We use `lmsys/vicuna-13b-v1.5` by default which we tested on 4x Nvidia V100's (@16GB each). Please feel free to use the local setup or API access that works best for you. In case of any questions, please feel free to contact the organizers e.g. via Github issues.
0 commit comments