vllm
lm_eval >= 0.4.10
ray
