News from the team

All Posts

Engineering

September 2026

700 TPS on Kimi K3: A Case for TPU Megakernels

How whole-model visibility, explicit VMEM staging and cross-layer prefetching push TPU v7 decode throughput past the GB200 baseline.

Announcement

September 2026

Google and Inferact Announce Engineering Partnership to Make TPU a First-Class Target for Open Inference

Google Cloud and Inferact align on one engineering roadmap to bring production-grade vLLM inference to TPU, with all resulting work upstreamed to open source

Announcement

August 2026

Inferact Announces Full Certification of Kimi K3 Vendor Verification, Bringing Production Inference Stack to Everyone

Inferact is happy to announce full certification of the Inferact Platform for Kimi K3 vendor verification (KVV).

Announcement

January 2026

Introducing Inferact: Building the Future of AI Inference

Inferact, founded by vLLM's core maintainers, raises $150M to make AI inference cheaper and faster for everyone.

Take control of your inference.

Tell us a model to serve. We'll help optimize it.

Talk to an engineer