Running Mistral Medium 3.5 (128B) on Four RTX 3080s — A Community Challenge

Over on Reddit's r/LocalLLaMA community, an attempt to run Mistral Medium 3.5 (128B) and Qwen 3.5 (122B A10B) on four RTX 3080 (20GB) GPUs has been drawing attention.

The poster used llama-bench to distribute an IQ4_XS quantized model across the four GPUs with layer split, demonstrating that a 128B-class model can run inference with a total of 80GB of VRAM. Since RTX 3080s are relatively cheap on the used market, they are gaining attention as a realistic option for individuals running large-scale models.

Efforts like this, pushing the limits of consumer GPUs, are a testament to the vitality of the local LLM community.

openrouter/owl-alpha Revealed to Be Meituan LongCat

The true identity of "owl-alpha", a stealth model running on OpenRouter, has been revealed to be "LongCat", developed by the Chinese company Meituan.

A Reddit user detected its behavior in an LLM boardroom app and traced the connection between @OpenRouter's stealth model and @Meituan_LongCat. A growing number of models on OpenRouter are benchmarked anonymously with their developers undisclosed, and community-driven efforts to unmask them are intensifying.

Meituan is one of China's leading tech companies, and this move is being watched as a sign of its full-scale entry into the LLM field.

Critical CVSS 9.9 Vulnerability in Cursor — A Security Rethink for AI Coding Tools

A top-severity vulnerability with a CVSS score of 9.9 has been reported in the AI coding editor Cursor. The details are serious: a simple git clone could potentially hand over control of your PC.

In response, an article reviewing the security practices of AI coding tools, including Claude Code, has been published on Qiita. It recommends five key countermeasures: using sandboxed environments, minimizing privileges, restricting access to sensitive information, applying updates promptly, and making use of audit logs.

As AI coding tools become widespread, awareness is growing of the risk that the tools themselves can become attack vectors. Developers tend to sacrifice security in exchange for convenience, and this incident has once again underscored the importance of striking the right balance.

Google DeepMind Continuously Improves Robot Policies with Fleet-Scale RL

Google DeepMind has published a paper titled "Learning While Deploying (LWD)" on Hugging Face Daily Papers. It is a fleet-scale offline-to-online reinforcement learning framework — a method for continuously improving Vision-Language-Action (VLA) models while they are deployed.

Offline pretraining alone cannot fully cope with real-world distribution shifts and long-tail failure cases, and the paper tackles this by performing online reinforcement learning using data collected during deployment.

Crucially, it was validated on an actual robot fleet (a group of multiple robots), making it a major step toward the practical application of generalist robot policies.

A Deep Dive into the Engineering Constraints of Distributed LLM Inference

An article titled "The Engineering Constraints of Distributed LLM Inference over the Open Internet" has been gaining traction on Hacker News.

It systematically organizes the technical constraints involved in running distributed LLM inference over the open internet, analyzing the challenges — network latency, bandwidth limitations, inter-node synchronization costs, and more — that must be solved to make distributed inference practical.

Relatedly, a paper titled "Cloud Is Closer Than It Appears" has also appeared on arXiv. It prompts a rethink of the assumption that cloud-based inference is unsuitable for real-time control, showing that with properly provisioned high-throughput compute resources, cloud inference may be able to meet latency requirements.

450M-Parameter VLM Detects Wildfires on a Satellite — The Front Line of Edge AI

On r/LocalLLaMA, a practical approach to the challenge of being unable to run frontier models on satellites was introduced. It combines a 450M-parameter Vision-Language Model (LFM2.5-VL) with Sentinel-2 satellite data to build an end-to-end wildfire detection pipeline.

The use of compact VLMs on edge devices is becoming increasingly important for applications where communication latency cannot be tolerated. From Earth observation to disaster response, demand for models that can perform inference in the field is expected to keep growing.

Other Notable Papers

Adaptive Verification for MoE Speculative Decoding** — A technique that optimizes speculative decoding for Mixture-of-Experts models. It proposes a new approach to address the problems that arise as the draft tree grows (arXiv:2605.00342)

Countermeasures for VLM Hallucinations** — A method that reduces hallucinations through online self-calibration, without a teacher from a stronger model (arXiv:2605.00323)

Improving Low-Bit LLM Quantization** — Activation Residual Hessian Quantization (ARHQ) mitigates error propagation in low-bit quantization (arXiv:2605.00140)