Deepinfer

DeepInfer

is the high-performance inference framework that powers DeepSeek’s large-scale production services. This open-source release provides offline inference with the core features needed for serving at scale.

https://github.com/deepseek-ai/DeepInfer