Together Inference Engine
ProductOptimized inference runtime powering Together endpoints with research-driven kernels, quantization, and speculative decoding.
- —
- —
- —
- —
- —
- 2
Releases
Jul 18, 2024Together releases Inference Engine 2.0Feature update
Together released a new inference stack with Turbo and Lite endpoints and reported decoding throughput up to four times faster than vLLM.
Nov 2023Together launches Inference EngineProduct launch
Together introduced its optimized inference engine across serverless endpoints and dedicated model deployments.