Get started
Install PLLM, inspect a private inference plan, and run the local development benchmark.
PLLM documentationView Markdown ↗
- Install PLLM with a supported Python version.
- Inspect a private inference plan without starting a service or downloading model weights.
- Run the local development benchmark through the client, preparation, and inference roles on one machine.
- Connect an SDK or coding agent through the trusted loopback gateway.
The CLI currently inspects metadata. Its dev dashboard command is a developer
tool, not a production interface. The Python package also exposes planning,
compilation, benchmarking, assurance, and runtime APIs. Check the support status
for each API instead of assuming that every model and protocol combination is
available.