inference
Swap GPT for any LLM by changing a single line of code
Audio & Video
Swap GPT for any LLM by changing a single line of code
Open product
Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API. **Xinference (Xorbits Inference) is an open-source distributed inference platform.** Deploy and run models on heterogeneous hardware, from a local machine to a distributed cluster.
Disclosure. Listings are free. Boosted placement is a paid, clearly-labelled promotion and never affects editor's picks or the organic Top rated order.