kserve==0.12.0
torch
torchvision
transformers
accelerate
sentence-transformers>=2.7.0
argparse
optimum
onnx
ray[serve]<=2.9.3,>=2.9.2
