pllm.server Python API

The server facade constructs the trusted client-boundary ASGI gateway with health, Responses API, and bounded runtime routes. Presence documents API availability, not complete model, security, or deployment coverage; check implementation status before relying on a path.

Research context

This API is project infrastructure rather than an implementation of one specific paper. Relevant method pages link their primary sources separately.

Python SDK example

The example performs a bounded offline task and checks an observable result. It does not download a checkpoint or contact a provider.

import pllm.server as server

app = server.create_app()
routes = {route.path for route in app.routes}
assert {"/healthz", "/v1/responses"} <= routes

API: pllm.server

Objects and signatures

create_app

Builds the app ASGI application from validated runtime dependencies.

• Canonical object: pllm.runtime.server.create_app
• Kind: function
• Signature/type: (config: 'GatewayConfig \| None' = None, *, backend_registry: 'BackendRegistry \| None' = None, private_models: 'dict[str, MaskedBigramModel] \| None' = None, engines: 'dict[str, InferenceEngine] \| None' = None, audit_hook: 'Callable[[str, bytes], None] \| None' = None) -> 'FastAPI'
• Public exports: pllm.create_app, pllm.runtime.create_app, pllm.server.create_app