Here is your AI news roundup for September 22 (evening JST). The tooling for local LLMs matured another notch, and AI agents entered robot development in earnest — a day full of stories about “agents doing real work in the field.” Finance and security news rounded things out too: controversy shadowing the glory of the top-ranked open model, an AI data center company heading to an IPO, and the discovery of malware that weaponizes AI.
Transformers Runs llama.cpp Quants Directly — Local Inference Gets More Options
Hugging Face announced “Transformers now runs llama.cpp quants” in an official blog post. Until now, llama.cpp-style quantized models (GGUF and the like) were typically run on llama.cpp-family runtimes, treated as a world apart from the PyTorch-based Transformers ecosystem. With this announcement, it appears Transformers can now load and run llama.cpp quantized models directly. We could not retrieve the full article text at collection time, so we recommend checking the official blog for the exact supported formats and API specs. But if this makes it easier to combine Python-side assets (tokenizers, pipelines, and the surrounding tooling) with llama.cpp’s memory-frugal inference in a single codebase, the options for running local LLMs in production should broaden considerably.
Over on r/LocalLLaMA the same day, a benchmark report also drew attention: Qwen3.8-27B running on 2× RTX 3090, holding nearly two full 262k contexts in the KV cache while sustaining over 70 tok/s in a single stream, with prefill at around 10,000 tok/s. The poster says it was the result of painstaking tuning across dozens of quantization formats and vLLM, SGLang, and llama.cpp. Alongside efforts to run flagship-class models locally on a single high-end GPU, the culture of local inference optimization looks set to keep maturing.
NVIDIA Isaac ROS 5.0 — Humans and AI Agents Building Robots Together
At ROSCon, underway in Toronto, Canada, NVIDIA announced Isaac ROS 5.0, its collection of GPU-accelerated packages. The centerpiece this time is bringing AI agent workflows into robot development. The new “Isaac skills” for setup and manipulation are reusable workflows available to both developers and AI agents. NVIDIA also reworked the documentation itself into an agent-ready form that agents can easily parse, making it easier to carry developer intent straight into robot development tasks. The “AI agents write the code” wave has finally reached the robotics shop floor.
On the platform side, Isaac ROS 5.0 supports ROS Lyrical and Ubuntu 24.04, and in cooperation with the OSRA (Open Source Robotics Alliance), NVIDIA contributed a standard data-handling interface to ROS Lyrical for running robotics software efficiently across different computing hardware, including GPUs. CUDA has been released as a reference implementation of that GPU acceleration, turning it into an asset for the entire ROS community, estimated at roughly 1.3 million users.
MiMo-V2.6-Pro Debuts at No. 1 as Anthropic Claims a “Claude Training Data Leak”
As we reported previously, Xiaomi’s MiMo-V2.6-Pro took the top spot in evaluations among open-weight models. According to The Decoder, Anthropic claims that behind this success, Xiaomi siphoned off training data from Claude. So behind the bright story of hitting both price and performance through ruthless cost control — reinforcement learning for just $2.6 million — a dispute over where the training data came from now lingers.
The question of “which model’s outputs can be used for training” is becoming a common flashpoint across the industry as open-weight models rise. How the relationship between terms of service and model development gets sorted out is something we will be watching closely.
OpenAI’s Independent Math Advisory — but Its “Research Pace” Stays Out of Scope
New details have emerged on the story we reported earlier — OpenAI’s internal model solving more than 100 unsolved math problems with just one month of training (previous coverage: a framework for independent evaluation with the mathematics community). Responding to criticism from the mathematics community, OpenAI will back an independent advisory group at the Institute for Advanced Study (IAS) in Princeton — but reportedly OpenAI’s own research pace is excluded from what the group can advise on.
Even with a mechanism for outsiders to verify model performance and the attribution of results, the decision of “how fast to develop and release” itself stays in-house. The debate over how to fold the safety-versus-competition balance into external review looks set to continue.
Nscale Heads to an IPO — How Will the Market Price AI Data Centers’ “Big-Tech Dependence”?
TechCrunch reports that the IPO of Nscale, a UK-based AI data center developer, looks set to test Wall Street’s appetite for concentrated AI bets once again. The majority of the company’s revenue is said to hinge on just two tech giants, Microsoft and Anthropic, so the focus will be on how the market prices that customer-concentration risk. With the AI infrastructure investment boom still running, the fate of a company going public with a fragile revenue structure could also serve as a leading indicator of funding conditions for its peers.
Malware Guided by a Human-Free “AI Hivemind” — Spotted by Cisco Talos’s New Framework
Researchers at Cisco Talos built a new framework for identifying malware and hacking tools that make use of AI chatbots. And almost immediately after putting it into operation, they reportedly found something out of the ordinary. According to WIRED, it was malware guided by a “hivemind” of cooperating AIs — with no human operator anywhere. The fusion of attack tooling and generative AI is fast ceasing to be an imaginary threat. AI-powered detection and analysis capabilities are becoming an urgent necessity for defenders as well.
Wrap-up
It was a day of news that both extended the frontier and put its foundations back under the microscope: local inference tooling came together (Transformers × llama.cpp quants), and agents reached robot development and real business (Isaac ROS 5.0), while other stories forced a rethink of the foundations — the sustainability of model development (the MiMo controversy), governance (OpenAI’s independent advisory), capital flows (Nscale’s IPO), and new kinds of threats (AI-integrated malware). The mood of the moment: the issues on both the “using generative AI” side and the “supporting it” side are moving forward at the same time.