Mooncake
ProductKV-cache-centric serving architecture and open-source inference infrastructure.
- Launched
- —
- Models
- —
- Modality
- —
- Open source
- Yes
- API available
- —
- Releases
- 1
Releases
Mar 2024Mooncake serving architecture releasedResearch paper
Moonshot released Mooncake, a KV-cache-centric architecture for disaggregated large-model serving.

