Human preference predition support #466
Description
I develop a custom cstimer serving to collect human-prefer data and train a human preference predict NN model. The training code is here.
Though there are still a few todos. I'm just curious about that is there any plan to support this type of ai-assited cstimer and merge ?