Skip to content
AIMarketCap

Mooncake

Product
Moonshot AIPart of Moonshot Research Infrastructureactive

KV-cache-centric serving architecture and open-source inference infrastructure.

Launched
—
Models
—
Modality
—
Open source
Yes
API available
—
Releases
1

Releases

1
Mar 2024Mooncake serving architecture releasedMooncake

Moonshot released Mooncake, a KV-cache-centric architecture for disaggregated large-model serving.

Moonshot AI Research paperMoonshot AIMooncake