Tag: inference

All the articles with the tag "inference".

• OpenAI's Jalapeno Chip Is About Owning the Whole Stack

  24 Jun, 2026

  OpenAI's first custom Broadcom inference chip shows frontier AI labs becoming full-stack infrastructure companies, not just model providers.

• NVIDIA AgentPerf Makes Agent Serving A Datacenter Metric

  12 Jun, 2026

  NVIDIA's AA-AgentPerf results show why agent workloads need new infrastructure benchmarks built around concurrent sessions, tool calls, and latency.

• DiffusionGemma Is A Reminder That Token-By-Token Is Not Sacred

  10 Jun, 2026

  Google's DiffusionGemma explores parallel text generation, bidirectional context, and self-correction as an alternative path for faster local AI.