pllm
Research

Research for high-performance private LLM inference.

PLLM is a high-performance private LLM multi-party inference runtime and autonomous research harness. We independently reimplement useful methods, compose compatible components, and benchmark complete plans to determine what improves the system.

A runtime and a research system.

The runtime keeps plaintext, model state, masks, and decoding inside the client boundary while separate services perform prepared masked computation. The research harness turns pinned papers and hypotheses into reusable components, immutable plans, assurance records, and matched benchmark evidence.

Reimplement independently

Research papers are specification and provenance inputs. Implementations are built in PLLM's Rust and Python stack rather than imported as runtime dependencies.

Compose by capability

Like-for-like cache, numeric, protocol, preparation, kernel, and placement components live together behind stable typed contracts.

Compare complete plans

Correctness and privacy remain hard gates. Latency, throughput, traffic, memory, preparation, quality, energy, and cost remain separate measurements.

Three research records.

Each record serves a different reader. The whitepaper explains why PLLM exists, the technical paper defines the implemented system and its limits, and the paper catalog tracks the methods that may improve it.

Loading documentation index…

Search runs locally in this browser.