Lightning-AI/LitServe

A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.

View on GitHub
Python
Stars 3.9k
Forks 295
License Apache-2.0
Open Issues 49
Updated 3d ago