SDKs
Python SDK
Official Python client for Inferia LLM
Installation
pip install inferiaCLI Reference
The inferia package comes with a built-in CLI for managing the entire platform.
usage: inferia [-h] {init,filtration-gateway,inference-gateway,orchestration-gateway,api-start} ...Commands
inferia init
Initializes the database schema.
- Usage:
inferia init - Requires: valid
POSTGRES_DSNin.env.
inferia api-start
Starts the full stack (Inference, Filtration, Orchestrator + Worker) in a single process.
- Usage:
inferia api-start - Options:
--host: Bind host (default:0.0.0.0)--port: Bind port (default:8000)--workers: Number of worker processes.
inferia inference-gateway
Starts only the Inference Gateway.
- Port: Defaults to
8001.
inferia filtration-gateway
Starts only the Filtration Gateway.
- Port: Defaults to
8000.
inferia orchestration-gateway
Starts only the Orchestration Gateway (Control Plane).
- Port: Defaults to
8080.