Frontier
AI news.
Current frontier releases and research, summarized from live sources and linked to the original publisher.
Amazon SageMaker Inference: 2026 year-to-date launches in review
Generative AI inference is uniquely hard: models are tens to hundreds of gigabytes, latency requirements are measured in tokens per second, cold starts can span multiple minutes as containers and weights transfer, GPU capacity is constrained, and traditional monitoring tools expose none of the token-level signals that matter in production. Amazon SageMaker AI offers customers the ability to deploy AI models and consume them by the instance (instead of by the token), using two paths: managed endpoints for teams that
READ BRIEFING ↗Benchmarking LLM Inference at Scale with AIPerf
You’re deploying a model on a system. It starts up, prompts are getting responses. Now the hard question: Is this fast? Your instincts might lead you to send...
READ BRIEFING ↗Introducing Amazon SageMaker HyperPod Inference Gateway
Eliminate GPU waste. Reduce first-token latency by up to 82%. Install one Kubernetes-native addon with zero application changes. The problem: Naive routing wastes your most expensive resource Running large language models (LLMs) at scale on GPU clusters is expensive. The default Kubernetes load balancers are making it worse. Round-robin and least-connections algorithms have no visibility into what’s happening inside your GPUs: which pods have saturated KV caches, which are mid-way through long-context generations,
READ BRIEFING ↗Implementing defense-in-depth authorization for MCP tools on Amazon Quick
Each Model Context Protocol (MCP) tool invocation on Amazon Quick is an access event that can require defense-in-depth authorization at the tool and parameter level. This applies in addition to a valid token. Without granular controls, a single misconfigured permission can bypass the access requirements that organizations might need to fulfill for compliance purposes. In this blog post, you implement a multi-gate authorization pattern that evaluates OpenID Connect (OIDC) JSON Web Token (JWT) claims in sequence. The
READ BRIEFING ↗Our framework for reporting model misalignment
OpenAI shares a framework for tracking, investigating, and disclosing model misalignment, alongside six reports of unexpected or concerning model behavior.
READ BRIEFING ↗Helping older adults use AI in everyday life
OpenAI and AARP are bringing free, hands-on ChatGPT workshops to 1,000 older adults across 10 U.S. cities to build practical AI skills safely.
READ BRIEFING ↗How to connect AI usage to business value
Learn how ChatGPT Work and Codex analytics help teams understand AI usage and spend, identify training needs, and connect adoption to business outcomes.
READ BRIEFING ↗How workers are unlocking new ways of working
New OpenAI Economic Research shows how workers use AI beyond traditional roles and which new activities become recurring parts of their work.
READ BRIEFING ↗Dense vs. MoE Models: Active Parameters, Throughput, and When to Choose Each
How can a 30B-parameter model activate only 3B parameters per token, and still use the capacity of the larger model? Nemotron 3.5 Lightning illustrates the...
READ BRIEFING ↗Optimizing cost and latency with Amazon Bedrock prompt caching
Prompt caching in Amazon Bedrock can reduce your input token costs by up to 90 percent when you repeatedly send the same context to foundation models, based on Amazon Bedrock prompt caching pricing . Without caching, a 10,000-token contract sent alongside 50 user questions means 500,000 input tokens billed at full price for content the model has already processed. You can mitigate this issue by shortening prompts, reducing context windows, or implementing application-level caching. Each option involves a trade-off:
READ BRIEFING ↗Accelerating Dropless MoE Training in JAX with NVIDIA Transformer Engine
Mixture of experts (MoE) has become one of the defining architectural trends in large-scale AI model training. DeepSeek, Qwen, and Mixtral are examples of MoE...
READ BRIEFING ↗How Fyxer built an AI executive assistant people trust
Fyxer uses OpenAI models, fine-tuning, memory, and real user feedback to organize inboxes and draft emails in each user’s voice.
READ BRIEFING ↗Perplexity trusts GPT-6 Astra with end-to-end systems
Perplexity uses Astra to write communications, change software, and monitor production systems, and checks in much less frequently than with earlier models.
READ BRIEFING ↗Cognition helps Devin test its own work with GPT‑6 Astra
GPT‑6 Astra improves Devin’s ability to test software and show that it works, with the goal of helping engineers review less code and ship more.
READ BRIEFING ↗Rapidly scaling online storage to serve over 1 billion ChatGPT users
Learn how OpenAI evolved Habitat from a Python library into a globally distributed storage platform serving 1 billion ChatGPT users and 22M requests per second.
READ BRIEFING ↗How Full-Stack NIM Optimizations Deliver 2.5x More Users on Nemotron 3 Ultra
Deploying a large language model is only the first step toward production-ready serving. Production teams also need to serve as many concurrent users as...
READ BRIEFING ↗How a researcher uses Codex and ChatGPT to search for new antimicrobial molecules
César de la Fuente’s lab uses Codex and ChatGPT to search living and extinct genomes for antimicrobial candidates to fight drug-resistant infections.
READ BRIEFING ↗Introducing ChatGPT for Financial Services
Introducing ChatGPT for Financial Services, combining built-in financial data and GPT-6 Astra for research, modeling, and client-ready materials.
READ BRIEFING ↗Expanding AI access and cyber defense for federal, state, local, and tribal governments
OpenAI and GSA will offer eligible federal, state, local, and tribal governments $0 license fees, 50% off usage, and expanded cyber defense support.
READ BRIEFING ↗Build more natural voice experiences with GPT‑Live‑1 in the API
GPT‑Live‑1 brings natural, full-duplex voice conversations to the API, with stronger instruction following, custom voices, and telephony support.
READ BRIEFING ↗When to Use Encode-Prefill-Decode Disaggregation to Accelerate Multimodal Model Serving
Encode-prefill-decode (EPD) disaggregation is an inference optimization technique for multimodal models that separates the vision encoder stage from the prefill...
READ BRIEFING ↗Fine-tuning a 350M Model for Better Structured Outputs in 100 GRPO Steps
Read Hugging Face’s complete announcement and technical details at the original link.
READ BRIEFING ↗TimesFM-3: A zero-shot foundation model for multivariate forecasting
Data Management
READ BRIEFING ↗GigaPath-Flash and GigaTIME-Flash: Toward population-scale discovery with efficient pathology foundation models
At a glance The Flash family extends GigaPath and GigaTIME with dramatically improved efficiency, making large-scale pathology research more accessible and practical. A distilled pathology foundation model backbone reduces computational requirements without sacrificing performance, enabling repeated analyses across larger patient cohorts. These open models support population-scale discovery, helping researchers investigate disease biology, biomarkers, and clinical outcomes across diverse cancer datasets. GigaPath (
READ BRIEFING ↗Planetary prediction engine: Automating global models via Earth AI
Earth AI
READ BRIEFING ↗GlucoFM: Foundation model for continuous glucose monitoring
Health & Bioscience
READ BRIEFING ↗Training and Finetuning Multi-Vector Embedding Models with Sentence Transformers
Read Hugging Face’s complete announcement and technical details at the original link.
READ BRIEFING ↗Quantization-Aware Healing: a compressed, 4-bit model that outperforms its full-precision original
Read Hugging Face’s complete announcement and technical details at the original link.
READ BRIEFING ↗How mobility gives language models a deeper understanding of place
Algorithms & Theory
READ BRIEFING ↗EvoLib: Turning experience into evolving knowledge
At a glance Self-supervised. EvoLib enables large language models to learn from their own experience during inference, without requiring ground-truth labels or external feedback. From experience to knowledge. EvoLib transforms past attempts into reusable skills and reflective insights that can be applied to future tasks. Knowledge that evolves. Useful skills and insights are continually refined, consolidated, and reweighted, turning instance-specific observations into increasingly general knowledge over time. Learn
READ BRIEFING ↗