Releases

Anthropic introduced Contextual Retrieval, combining contextual embeddings and BM25 to improve retrieval-augmented generation.

La Plateforme added support for Pixtral and expanded developer tooling for multimodal applications.

Accelerate reached its 1.0 release-candidate milestone after becoming a core distributed-compute layer in the Hugging Face ecosystem.

Anthropic launched prompt caching to reduce latency and cost for repeated long-context prompts.

DeepSeek introduced disk-based context caching to reduce repeated-token costs.

The API gained JSON mode, function calling, chat-prefix completion and fill-in-the-middle completion.

Mistral AI introduced self-service fine-tuning through La Plateforme and released customization tooling.

Anthropic made tool use generally available across the Claude API, Amazon Bedrock, and Google Vertex AI.

Hugging Face launched LeRobot to bring open models, datasets, policies, and reproducible tooling to real-world robotics.

DeepSeek opened an OpenAI-compatible API for its chat and coding models.

Cohere added function calling and tool-use capabilities for building grounded enterprise agents.

Anthropic expanded commercial legal protections and improved API access and enterprise terms.

Google releases the Gemini API through Google AI Studio and Vertex AI, giving developers access to Gemini Pro.

Baidu fully opened ERNIE APIs to enterprise customers through AI Cloud.

xAI began early API access for Grok developers ahead of the later public beta.

OpenAI launched the Assistants API beta with Code Interpreter, Retrieval, and function calling.

Moonshot introduced developer API access to its language models.

Hugging Face released a production-grade server for serving text embedding and reranking models.

Meta introduced ExecuTorch, an open-source framework for efficient on-device PyTorch inference.

NVIDIA publicly released its open-source TensorRT-LLM library for optimized large-model inference.

HTTP endpoints backed by autoscaling Modal functions became generally available.

Modal's Python-first SDK and developer workflow reached general availability.

Perplexity launched pplx-api with hosted access to its PPLX chat models.

Microsoft Research releases AutoGen, a framework for building applications with conversing and collaborating AI agents.

Databricks introduced pay-per-token APIs and provisioned throughput for serving curated open foundation models.