Sign inPlan my launch
Launches

LightSeek Foundation

TokenSpeed is a speed-of-light LLM inference engine

About

TokenSpeed is a speed-of-light LLM inference engine designed from first principles for agentic workloads, with a compiler-backed modeling mechanism for parallelism, a high performance scheduler, a safe KV resource reuse restriction, a pluggable layered kernel system that supports heterogeneous accelerators, and SMG integration.

Made by
lightseekorg
Category
AI agents & assistants
Built
Open source
Stage
Live
Licence
MIT
GitHub
★ 2.9k · updated 4d ago
Curated by LaunchWoo

We added this from the product's public website. Is it yours? Claim it to edit the listing, set your launch date or remove it.

Claim this listing