Running DeepSeek V4 Flash Locally on a 3-GPU RTX Rig, Offloading MoE Layers to CPU for ~9 Tokens/sec

A post on Reddit's r/LocalLLaMA reported actually running the Q8 quantized build (the unsloth version) of DeepSeek V4 Flash on a rig with 2x RTX 3090 (24GB), 1x RTX 5090 (32GB), and 128GB of DDR4 RAM. Using llama.cpp's server mode, the MoE FFN layers are distributed across the three GPUs while the rest is offloaded to the CPU, keeping everything within 80GB of VRAM. Prompt evaluation ran at about 37.9 tokens/s and generation at about 9.07 tokens/s, and the poster says it outperformed Qwen 3.5 v2 on their own coding tasks. Given that the CPU platform is on the older side (Ryzen 3950X + X570 motherboard), a platform upgrade would likely squeeze out a bit more speed.

Can We Really Take HuggingFace for Granted? A Push to Archive Models

Another thread on r/LocalLLaMA posed the question: HuggingFace is convenient, but can we really assume it will always be there? Citing concerns such as UI regressions, license/takedown policies, and the possibility of geo-blocking, the discussion turned to whether major open weights should be archived on large HDDs. Rather than hedging against the risk of the company going under, most of the motivation is practical — reducing single-point dependence on infrastructure — and commenters exchanged mirroring techniques and strategies for securing storage capacity.

UK Media Warns of Lawyers Being Sued for Not Using AI

An article on Legal Cheek arguing that lawyers who fail to make use of AI tools could one day be sued for negligence has been drawing attention on HN. The argument goes that once AI adoption becomes the industry standard from an efficiency and quality-assurance standpoint, not using it could itself be interpreted as a breach of the duty of care. At the same time, challenges such as hallucinations and confidentiality remain, suggesting the legal profession as a whole has entered a stage where its underlying assumptions are being called into question.

Disney Rolls Out AI-Generated Content for Kids at Scale, Kotaku Criticizes

Kotaku reported that Disney has begun using AI-generated content (so-called AI slop) in earnest in children's programming and short-form videos. The report points to diminished brand affinity and the risk of children being exposed to low-quality content. It throws into sharp relief the position of major media companies squeezed between cost-cutting pressure and fan backlash — an issue that could well spread to other IP-holding companies.

An LLM-Integrated Multivariable Calculus Course Picks Up 22 Points on HN

academa.ai released an "LLM-integrated multivariable calculus course" that picked up 22 points on Hacker News. An LLM is embedded directly in the learning material, letting students verify their understanding of concepts and bounce ideas off exercises on the spot. While the debate over AI in education — tutor replacement or supplement — continues, the design philosophy of positioning the LLM as "scaffolding for learning the core of the discipline" looks like a useful reference.

From the Japanese-Speaking Web: Qiita Lines Up Practical AI Adoption Write-ups

On Qiita, articles on weaving AI into real-world work are stacking up: a solo developer streamlining idea generation with FastAPI x auditory hacks, a story of cutting sales proposal workload by 80% through AI-automated proposal writing, and an experiment running Qwen on a Linux virtual environment (FydeOS) to have it write code. The impression is that attention is shifting away from model selection toward "how to build AI into daily workflows."

---