accelerate
asyncio
deepspeed>=0.15.0
deepspeed-kernels
fastapi
fastchat
Flask-RESTful
grpcio
grpcio-tools
Pillow
pydantic>=2.0.0
pyzmq
safetensors
shortuuid
torch
transformers
ujson
Werkzeug
