Skip to content
@xorbitsai

Xorbits

Xorbits builds production-ready infrastructure for Model Inference and AI Agents.

XorbitsAI

XorbitsAI builds production-ready infrastructure for Model Inference and AI Agents.

We focus on scalable model serving, agent orchestration, and intelligent system deployment — enabling teams to move from models to real-world AI systems.

Core Projects

Slack Twitter

  • xinference: a powerful and versatile library designed to serve language, speech recognition, and multimodal models.
  • xagent: Enterprise agent platform for building, deploying, and operating AI teammates.
  • xoscar: Python actor framework for heterogeneous computing.

Our Focus

We are building the next generation of AI infrastructure:

  • 🔹 Scalable model inference
  • 🔹 Agent orchestration & dynamic planning
  • 🔹 Enterprise-ready deployment
  • 🔹 Private & on-prem AI systems

From inference to intelligent agents — we help teams build real AI systems, not just demos.

Pinned Loading

  1. inference inference Public

    Open-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed…

    Python 9.7k 901

  2. xagent xagent Public

    Enterprise agent platform for building, deploying, and operating AI teammates.

    Python 310 85

  3. xrouter-llm xrouter-llm Public

    A prompt-aware LLM router that predicts which models can complete each request, then selects the cheapest capable one: 53.2% lower cost and +1.9 pts completion on our tested dataset.

    Python 42 2

  4. xllamacpp xllamacpp Public

    xllamacpp - a Python wrapper of llama.cpp

    Python 3 1

  5. inference-client inference-client Public

    Python 9 10

  6. xoscar xoscar Public

    Python actor framework for heterogeneous computing.

    Python 177 31

Repositories

Showing 10 of 20 repositories
  • xagent Public

    Enterprise agent platform for building, deploying, and operating AI teammates.

    xorbitsai/xagent's past year of commit activity
    Python 310 85 986 70 Updated Nov 20, 2026
  • inference Public

    Open-source inference platform for language, vision, embedding, reranking, image, audio, and video models. Deploy with multiple engines across heterogeneous hardware, from a laptop to a distributed cluster. Serve models through OpenAI-compatible APIs.

    xorbitsai/inference's past year of commit activity
    Python 9,666 Apache-2.0 901 7 24 Updated Nov 20, 2026
  • xllamacpp Public

    xllamacpp - a Python wrapper of llama.cpp

    xorbitsai/xllamacpp's past year of commit activity
    Python 3 MIT 1 2 0 Updated Nov 17, 2026
  • xagent-sdk Public

    Xagent Python SDK

    xorbitsai/xagent-sdk's past year of commit activity
    Python 1 Apache-2.0 1 14 0 Updated Nov 15, 2026
  • .github Public
    xorbitsai/.github's past year of commit activity
    0 0 0 0 Updated Nov 10, 2026
  • xagent-docs Public
    xorbitsai/xagent-docs's past year of commit activity
    MDX 0 CC-BY-4.0 4 0 0 Updated Nov 9, 2026
  • xoscar Public

    Python actor framework for heterogeneous computing.

    xorbitsai/xoscar's past year of commit activity
    Python 177 Apache-2.0 31 20 6 Updated Nov 9, 2026
  • deepdoc-lib Public
    xorbitsai/deepdoc-lib's past year of commit activity
    Python 2 Apache-2.0 4 1 1 Updated Nov 9, 2026
  • xorbitsai/xinference-helm-charts's past year of commit activity
    Smarty 15 Apache-2.0 15 0 0 Updated Nov 8, 2026
  • xorbitsai/inference-client's past year of commit activity
    Python 9 Apache-2.0 10 0 0 Updated Nov 8, 2026

People

This organization has no public members. You must be a member to see who’s a part of this organization.