pllmPRIVATE INFERENCE
RUNTIME

Operate

Assign client, preparation, and inference responsibilities without weakening the privacy design.

PLLM documentationView Markdown ↗

Client boundary keeps plaintext application data with the user.
Provider roles separate preparation and inference responsibilities.
Deployment describes current support and missing orchestration.
Serving integrations connect the trusted gateway to SDKs and coding agents.

Python SDK example

import pllm

deployment = pllm.Deployment.local(root=".pllm/local")
assert deployment.to_spec() == {"kind": "local", "root": ".pllm/local"}

API: pllm.Deployment

This records local intent only; it does not start or authenticate services.

Python client

Construct the native PLLM client, inspect its resources, and choose it instead of the gateway only when your process owns the private client boundary.

On this page

Python SDK example