Gemma 4 Technical Report Released — Dense and MoE Support with a Built-in Thinking Mode
Google has released the technical report for **Gemma 4**, the newest generation of its Gemma model family. It is an open-weight, natively multimodal language model offered in both dense and Mixture-of-Experts (MoE) architectures, with a lineup ranging from 2.3B to 31B parameters.
Key highlights:
The **12B model adopts an encoder-free unified architecture**, taking raw audio and image patches as direct input
Integrates a **thinking mode** that generates reasoning traces before responding
Design choices that improve inference speed, memory, and compute efficiency also boost long-context performance
Achieves substantial gains on STEM, multimodal, and long-context benchmarks
In human evaluations, Gemma 4 performs on par with larger frontier-class open models, making it a promising option for local and edge AI use.
Fable 5's Ripple Effects — "The Most Important Model Announcement Ever"
The impact of Anthropic's **Claude Fable 5** on the industry continues to unfold. In its [AINews field guide](https://www.latent.space/p/ainews-the-field-guide-to-fable), Latent Space called it "the most important model announcement in the world," reporting that people are racing to probe Fable 5's limits before the subscription subsidy ends.
Meanwhile, ITmedia AI+ put the question ["What will IT engineers' jobs look like in 10 years?"](https://www.itmedia.co.jp/aiplus/article/2607/07/2000000163/) directly to Fable 5 and ran a comparison against other AI models. Efforts to evaluate Fable 5's capabilities from multiple angles are spreading across the media.
In the same period, General Intuition and Shunyu Yao also announced new models, further intensifying the AI model race. With the release of GPT-5.6 Sol Ultra also anticipated, the frontier model layer is becoming increasingly fluid.
Qwen 3.6 27B "Completely Falls Apart" on Agent Tasks — Community Report
A report on Reddit's r/LocalLLaMA claiming that **Qwen 3.6 27B has serious problems with agentic work** is drawing attention.
Drawing on long experience with Qwen 3.5 122B (4-bit/5-bit), the poster tried running 3.6 27B at 8-bit/16-bit. While single-shot prompts produce genuinely impressive output (long-form generation, HTML demos, and the like), the poster reports that **in agentic work it keeps making mistakes and stops following instructions** — "it does something completely insane about once every four turns" — and that they ultimately went back to the 122B.
The local LLM community is discussing this as a case study of the gap between smaller models' benchmark performance and their stability in real-world operation.
SwarmResearch — A New Method for Orchestrating Coding Agents
A new orchestration method for long-running coding agents, called **SwarmResearch**, has been announced.
Conventional coding agents tend to converge on a single approach and then keep making low-level edits while missing superior alternative approaches. SwarmResearch addresses this problem with the following design:
A **Shepherd Agent** (orchestrator) directs multiple **Search Agents** using a global context
Each Search Agent maintains its own local context on a separate git branch
The orchestrator dynamically adjusts the degree of parallelism according to search depth
It discovered solutions on par with or better than state-of-the-art methods on 13 of 15 tasks, drawing attention as an approach that structurally improves the exploration capabilities of agents.
A Tool for Turning Claude Code Sessions into Fine-Tuning Data Gains Traction
On Reddit, a **tool that converts Claude Code / Codex / Pi sessions into fine-tuning data for local models** is generating buzz.
Version 1.5.0 supports all three session types — Claude Code, Codex, and Pi — and also offers a unified API. By extracting advanced reasoning patterns from closed models and reusing them as training data for open models, it is drawing interest as a practical tool for developers looking to improve local LLM performance.
HiLS Attention — End-to-End Learnable Sparse Attention for Infinite Context
A new chunk-level sparse attention mechanism for long-context modeling, called **Hierarchical Landmark Sparse (HiLS) Attention**, has been announced.
Existing chunked sparse attention suffers from low chunk-selection accuracy and falls short of full attention. HiLS decomposes attention hierarchically: each query attends independently per retrieved chunk, and the results are fused based on chunk-retrieval scores. By folding the retrieval scores into the forward computation, it enables end-to-end optimization with the language modeling loss.
Experiments show that HiLS-Attention achieves performance comparable to full attention while dramatically reducing computational cost on long contexts — a significant step toward practical infinite-context modeling.
---