pllm
Learn

Get started

Install PLLM, inspect a private inference plan, and run the local development benchmark.

PLLM documentationView Markdown ↗
  1. Install PLLM with a supported Python version.
  2. Inspect a private inference plan without starting a service or downloading model weights.
  3. Run the local development benchmark through the client, preparation, and inference roles on one machine.
  4. Connect an SDK or coding agent through the trusted loopback gateway.

The CLI currently inspects metadata. Its dev dashboard command is a developer tool, not a production interface. The Python package also exposes planning, compilation, benchmarking, assurance, and runtime APIs. Check the support status for each API instead of assuming that every model and protocol combination is available.

Loading documentation index…

Search runs locally in this browser.