llama.cpp merged PR #29887 two weeks ago and I think it is the most interesting thing to land in local inference this year, so I went through the PR, the benchmarks and the review thread and wrote up how it actually works. Short version below, long version linked at the end.

The problem

Qwen3.8-Flash-Next at Q4_0 is 93.7 GiB, and 65.4 GiB of that is experts. It is 125B total but only 6B active: 512 experts per layer, the router picks 10 (plus 1 shared) per token. One expert is 3 x 2560 x 640 = 4.9M params = about 2.6 MiB at 4-bit. 10 experts x 48 layers = 480 experts per token = about 1.3 GB of weights touched per token.

The observation

Expert routing has locality of reference. Token N+1 mostly picks the same experts as token N. A handful of experts are hot, most are almost never touched. That is the same property your CPU cache, your OS page cache, your browser cache, every CDN and Redis allkeys-lru all rely on.

The fix

PR #29887 (by am17an, a port of Tether’s qvac-fabric work, merged by ggerganov on Oct 7) sets aside a slice of VRAM as an LRU cache of experts. Hit: compute from VRAM, zero bytes moved. Miss: copy that one 2.6 MiB expert over PCIe and evict the least recently used one. The log prints the hit rate at exit.

Numbers from the PR description, same model file, same machine:

The 5090 gains more for two reasons: PCIe 5.0 halves the cost of every miss, and 32 GB means a bigger cache and fewer misses.

How to use it

llama-server -m Qwen3.8-Flash-Next-Q4_0.gguf -fa on -c 32768 -b 2048 -ub 2048 -cmoe --moe-cache-mib 11000

The PR author’s rule of thumb is about 10% of your expert bytes (65.4 GiB -> 6544 MiB). Env var form is LLAMA_ARG_MOE_CACHE_MIB.

SGLang merged the same idea 12 days later as “paged experts” in PR #42557

The part I find most interesting is LRU , Locality of reference go back to 1960s.

And i find locality of reference principle highly underrated.

Full write-up with the memory math script, an expert cache simulator you can run, and the benchmark table: https://cloudmash.blog/posts/moe-expert-offload-lru-cache-consumer-gpu/

llama.cpp PR #29887, MoE expert cache: https://github.com/ggml-org/llama.cpp/pull/29887

SGLang PR #42557, paged experts: https://github.com/sgl-project/sglang/pull/42557

• 3h 32m (Rating: 4.5/5) - [Wordpress Elementor Course: Develop Site Without Coding](https://www.easylearn.ing/course/build-website-no-coding)
• 4h 23m (Rating: 4.5/5) - [HTML and CSS for Beginners From Basic to Advance](https://www.easylearn.ing/course/html-css-beginner-to-advanced)
• 4h 47m (Rating: 4.4/5) - [Wordpress Web Development for Absolute Beginner Zero to Hero](https://www.easylearn.ing/course/beginner-wordpress-tutorial)
• (Rating: 4.4/5) - [AWS Certified AI Business Strategist (AIB-C01) Practice Exam](https://www.easylearn.ing/course/aws-aib-c01-practice-exams)
• More deals can be found on: [EasyLearn](https://www.easylearn.ing/)

• 18h 40m (Rating: 4.9/5) - [Presentation Skills and Business Storytelling, 430 Tools](https://www.easylearn.ing/course/hr-analitika-excel)
• 3h 7m (Rating: 3.5/5) - [LinkedIn Recruiter: talentos ocultos, 61 ferramentas [PT]](https://www.easylearn.ing/course/linkedin-recrutamento-avancado-pro)
• 25h 6m (Rating: 4.8/5) - [Data-Driven Strategy: Prove It With Numbers, 440+ Tools](https://www.easylearn.ing/course/hr-analitika-kurs)
• 3h 15m (Rating: 4.3/5) - [APIs in PHP: PHP Rest API Crash Course 2026](https://www.easylearn.ing/course/php-rest-api-mastery-course)
• 4h 32m (Rating: 1.0/5) - [CHRO Kurs: HR-Direktor als Business Leader, 100 Tools [DE]](https://www.easylearn.ing/course/chro-strategie-transformation)
• 2h 53m (Rating: 4.3/5) - [HR Records Management: Audit-Ready Employee Files, 70 Tools](https://www.easylearn.ing/course/hr-records-management-course)
• 27h 20m (Rating: 5.0/5) - [Service Business Management: Delivery, Clients, 510+ Tools](https://www.easylearn.ing/course/operations-manager-kurs)
• 5h 58m (Rating: 4.5/5) - [ChatGPT für HR: KI-Prompts gegen HR-Routine, 99 Tools [DE]](https://www.easylearn.ing/course/ki-hr-masterclass-chatgpt-personalwesen)
• 21h 12m (Rating: 4.5/5) - [HR Budgeting: Cost Planning, Forecasting, 250+ Tools](https://www.easylearn.ing/course/hr-budgeting-mastery)
• 12h 13m (Rating: 3.6/5) - [The Complete Digital Marketing Guide for Beginners](https://www.easylearn.ing/course/digital-marketing-beginner-guide)
• 4h 16m (Rating: none/5) - [أساسيات الأيزو 9001:2026: شرح المواصفة بندا بندا](https://www.easylearn.ing/course/iso-9001-2026-fundamentals-arabic-course)
• 3h 4m (Rating: none/5) - [IA agentica: dai chatbot agli agenti che fanno il lavoro](https://www.easylearn.ing/course/ia-agenti-autonomi-corso)
• 5h 2m (Rating: none/5) - [Framework de IA Segura do Google (SAIF): Guia de GRC](https://www.easylearn.ing/course/google-saif-grc-ia-segura)
• (Rating: none/5) - [[NEW] PMI Professional in Business Analysis Exam Preparation](https://www.easylearn.ing/course/business-analysis-exam-practice)
• More deals can be found on: [EasyLearn](https://www.easylearn.ing/)

​

Hi everyone,

I completed my BSc in Computer Science and currently have a 2-year career gap. My goal is to become a Full Stack Developer and get into the software industry.

I'm confused about what would be the better choice:

- Should I pursue an MCA?

- Or should I spend the next few months building strong full-stack skills, creating projects, and applying for jobs?

I'm worried that my 2-year gap might affect my chances of getting hired.

Has anyone been in a similar situation? If yes, what did you do, and what would you recommend?

I'd really appreciate advice from recruiters, developers, or anyone who has gone through a similar journey. Thanks!

Hii ,I am thinking about to take chai code cohort by hitesh Choudhary, I want to know about it . Is it good for beginner ,I am just know javascript pls give your pov on it

• 1h 40m (Rating: 4.4/5) - [Intentional Leadership](https://www.easylearn.ing/course/effective-leadership-guide)
• 10h 0m (Rating: 4.4/5) - [Fundamentals of Financial Services](https://www.easylearn.ing/course/financial-services-basics)
• 10h 0m (Rating: 4.4/5) - [Fundamentals of Financial Services](https://www.easylearn.ing/course/fundamentals-financial-services)
• 1h 55m (Rating: 4.4/5) - [How to Transform Your Life - practical ways](https://www.easylearn.ing/course/mastering-life-transformation)
• 1h 18m (Rating: 4.4/5) - [Purpose Driven Leadership](https://www.easylearn.ing/course/leadership-development)
• 1h 28m (Rating: 4.5/5) - [Leadership Through Tough Times](https://www.easylearn.ing/course/leading-through-uncertainty)
• 1h 38m (Rating: 4.6/5) - [Investing in Africa - Key factors for Investors to consider](https://www.easylearn.ing/course/investing-in-africa)
• 1h 3m (Rating: 4.3/5) - [Time Management, Productivity, Decision Making Tools & Aids](https://www.easylearn.ing/course/master-productivity)
• 1h 12m (Rating: 4.6/5) - [Your WORDS, Powerful Tools](https://www.easylearn.ing/course/master-your-words)
• 7h 0m (Rating: none/5) - [ISO 9001:2026 Lead Auditor: audit di un SGQ passo dopo passo](https://www.easylearn.ing/course/iso-9001-2026-lead-auditor)
• 5h 58m (Rating: none/5) - [ISO 9001:2026 Lead Implementer: budowa i wdrożenie SZJ](https://www.easylearn.ing/course/iso-9001-2026-lead-implementer-kurs)
• More deals can be found on: [EasyLearn](https://www.easylearn.ing/)

I’m making a free TypeScript course for people coming from JS and had to make a call early: strict on or off for the first lessons.

I went with strict on. The main reason is that the most useful catch in my intro lesson only exists with it. users.find(...) followed by found.name. Without strictNullChecks the undefined just gets swallowed by the type and TS says nothing, which is exactly the crash beginners hit in real code. Showing TS without strict basically teaches them it protects more than it does.

Same with noImplicitAny. A function like addTax(price) that gets “100” from a form returns 10020 because the plus concatenates. With strict, the untyped parameter is already an error, so beginners are pushed to add the annotation before they even know why.

The cost is real though. More red lines on day one, and some of those error messages are rough for someone who just learned what a type is.

The other thing I hammer early is that types are erased. Even now that Node can run .ts files directly, it just strips the types, it doesn’t check them. So anything coming from a server or a form still needs runtime validation, and I think a lot of people learn that way too late.

If you’ve onboarded juniors to TS, did you start strict or ease them in?

It’s crazy to think that the entire modern AI revolution started with researchers just trying to mathematically mimic a single biological neuron. When you zoom out, the timeline of AI architectures looks exactly like an evolutionary tree.

We went from struggling to solve basic logic puzzles (shoutout to the XOR problem) to building early neural networks, realizing they forgot things too quickly, battling the vanishing gradient problem, inventing LSTMs to give models actual memory, and eventually landing on Transformers with attention, the architecture that essentially ate the world. Every major roadblock forced a mutation that led to a massive paradigm shift.

But looking at this evolutionary timeline brings up a massive question: If Transformers are just the current "apex predator" of AI architecture, what exactly is the next evolutionary leap?

Are we going to see a completely new paradigm that makes self attention look as primitive as a basic AND gate? How do we even begin to perceive or predict what lies beyond our current models when the jumps are this exponential?

I went down a massive rabbit hole mapping out this entire evolutionary timeline. I wanted to see the exact breadcrumbs that led us here, so I put together a deep dive covering the journey from the first perceptrons to the modern era, complete with the foundational paper citations and the historical tweets that marked these shifts in real-time.

If you want to look at the complete map of how we got here to help predict where we are going, I compiled the whole history here: https://cloudmash.blog/posts/evolution-of-ai-perceptron-to-text-to-video/

Would love to hear your theories on what does the post Transformer era actually look like ? Like what can we imagine , how this intelligence on our command can do for us , how enterprise and big players can use it , what can happen ?

• 3h 56m (Rating: 4.3/5) - [Essential Photoshop Course for Beginner to Advanced](https://www.easylearn.ing/course/photoshop-course-beginner-to-advanced)
• 1h 54m (Rating: 4.0/5) - [Prompt Engineering & AI from Scratch: ChatGPT](https://www.easylearn.ing/course/chatgpt-power-user-course)
• 3h 55m (Rating: 4.5/5) - [Microsoft Excel Formulas and Functions: Learn Fast and Smart](https://www.easylearn.ing/course/learn-excel-formulas-smart)
• 2h 56m (Rating: 3.0/5) - [Excel Data Analysis and Pivot Table: Build Smart Dashboards](https://www.easylearn.ing/course/learn-excel-data-insights)
• More deals can be found on: [EasyLearn](https://www.easylearn.ing/)

• 6h 0m (Rating: 3.8/5) - [Cómo Crear una Página Web con WordPress Para Principiantes](https://www.easylearn.ing/course/wordpress-elementor)
• 4h 42m (Rating: 4.2/5) - [Cómo Crear Una Tienda Online Desde Cero Para Principiantes](https://www.easylearn.ing/course/tienda-online-wordpress-tiendanube)
• 1h 14m (Rating: 3.8/5) - [Cómo Crear una Página Web con Hostinger Desde Cero 2026](https://www.easylearn.ing/course/curso-crear-sitio-web-hostinger)
• (Rating: 4.2/5) - [Migra un Sitio Web de WordPress a otro Dominio o Hosting](https://www.easylearn.ing/course/wordpress-migration-tutorial)
• (Rating: 3.8/5) - [Crea Correos Corporativos con Dominio Propio en Gmail 2026](https://www.easylearn.ing/course/correos-corporativos-dominio-propio-gmail)
• 6h 5m (Rating: 4.5/5) - [Microsoft Excel Fast Track: From Zero to Hero in 360 Minutes](https://www.easylearn.ing/course/master-excel-6-hours)
• 4h 13m (Rating: 4.6/5) - [Business Strategy & Innovation: Frameworks for Growth](https://www.easylearn.ing/course/business-strategy-course-online)
• 2h 39m (Rating: 4.2/5) - [Bayesian Statistics: Practical A/B Testing](https://www.easylearn.ing/course/bayesian-statistics-ab-testing)
• 2h 9m (Rating: 4.2/5) - [Feature Engineering for Machine Learning with Python](https://www.easylearn.ing/course/machine-learning-feature-engineering)
• 4h 18m (Rating: 4.0/5) - [Brain-Computer Interface (BCI) Masterclass](https://www.easylearn.ing/course/bci-deep-learning-python)
• 6h 4m (Rating: 4.3/5) - [Natural Language Preprocessing Using spaCy](https://www.easylearn.ing/course/master-nlp-with-spacy)
• More deals can be found on: [EasyLearn](https://www.easylearn.ing/)

• 1h 55m (Rating: 4.9/5) - [AI Prototyping for Product Managers](https://www.easylearn.ing/course/ai-prototyping-for-product-managers)
• 15h 41m (Rating: 4.2/5) - [AI-Driven Market Analysis & Prediction](https://www.easylearn.ing/course/predictive-analytics-business)
• 4h 19m (Rating: 4.4/5) - [AI for Creative Marketing](https://www.easylearn.ing/course/ai-marketing-course)
• 1h 59m (Rating: 4.2/5) - [AI for Customer Success: Transforming Customer Relationships](https://www.easylearn.ing/course/transforming-cs-with-ai)
• 6h 15m (Rating: 4.3/5) - [AI Image Generation for Business & Marketing](https://www.easylearn.ing/course/ai-image-generation-for-business)
• 2h 5m (Rating: 4.8/5) - [AI for Creative Leaders](https://www.easylearn.ing/course/ai-creative-leadership-masterclass)
• 1h 10m (Rating: 4.3/5) - [Motivation et Équilibre Émotionnel. Crée ta Journée Parfaite](https://www.easylearn.ing/course/gerer-stress-booster-energie-udemy)
• More deals can be found on: [EasyLearn](https://www.easylearn.ing/)

• 1h 33m (Rating: 4.9/5) - [Cisco Unified Communications Manager CUCM Ultimate Training](https://www.easylearn.ing/course/cisco-cucm-ultimate-training)
• 11h 23m (Rating: 4.2/5) - [sap abap module pool programming for beginners](https://www.easylearn.ing/course/sap-abap-module-pool-development-course)
• (Rating: none/5) - [COBIT 2019 Foundation Deneme Sınavı: 450 Sınav Sorusu](https://www.easylearn.ing/course/isaca-cobit-deneme-sinavi-450-soru)
• 7h 22m (Rating: none/5) - [Auditor Líder ISO 9001:2026: audita un SGC paso a paso](https://www.easylearn.ing/course/auditor-lider-iso-9001-2026-certificacion)
• More deals can be found on: [EasyLearn](https://www.easylearn.ing/)