importantSYS.SOURCE: GitHub• 2026-07-31T14:12:38Z

Efficient Inference of Kimi K3 Model with 29 GB RAM and 0.50 tok/s Through NVMe Streaming

#ai #hardware #inference

The GitHub project 'waste' enables running the 2.78-trillion-parameter Kimi K3 model beyond available RAM by streaming activated weights from NVMe, achieving 0.50 tok/s. It provides a dependency-free C inference engine for efficient large-scale model execution.

Read original article

*** END OF TRANSMISSION ***

> ADOBE CAMPAIGN CLASSIC CVSS 10.0 CRITICAL VULNERABILITY ENABLES ARBITRARY CODE EXECUTION WITHOUT USER INTERACTION > HIJACKED HOTEL WI-FI NETWORKS EXPLOIT FAKE UPDATES TO DEPLOY SURVEILLANCE MALWARE > TEN CRITICAL ISSUES IMPACTING NAS SYSTEMS > THE PURPOSE AND VALUE OF LIBERAL ARTS EDUCATION IN MODERN CAREER DEVELOPMENT > DEVELOPMENT PIPELINE AS CRITICAL PRODUCTION SYSTEM IN SOFTWARE ENGINEERING > FLINT: A VISUALIZATION LANGUAGE FOR THE AI ERA > CHALLENGES IN MODERATING A MATRIX COMMUNITY: A WEEK-LONG EXPERIENCE > THE CHALLENGE OF EXISTENCE: A MINDFULNESS PRACTICE FOR PRESENT-MOMENT AWARENESS > OPENAI INVESTIGATES MULTIPLE AI AGENT ESCAPES FROM TEST ENVIRONMENTS > RIVIAN SPINOFF ALSO BEGINS E-BIKE DELIVERIES AMID SUPPLY CHAIN CHALLENGES> ADOBE CAMPAIGN CLASSIC CVSS 10.0 CRITICAL VULNERABILITY ENABLES ARBITRARY CODE EXECUTION WITHOUT USER INTERACTION > HIJACKED HOTEL WI-FI NETWORKS EXPLOIT FAKE UPDATES TO DEPLOY SURVEILLANCE MALWARE > TEN CRITICAL ISSUES IMPACTING NAS SYSTEMS > THE PURPOSE AND VALUE OF LIBERAL ARTS EDUCATION IN MODERN CAREER DEVELOPMENT > DEVELOPMENT PIPELINE AS CRITICAL PRODUCTION SYSTEM IN SOFTWARE ENGINEERING > FLINT: A VISUALIZATION LANGUAGE FOR THE AI ERA > CHALLENGES IN MODERATING A MATRIX COMMUNITY: A WEEK-LONG EXPERIENCE > THE CHALLENGE OF EXISTENCE: A MINDFULNESS PRACTICE FOR PRESENT-MOMENT AWARENESS > OPENAI INVESTIGATES MULTIPLE AI AGENT ESCAPES FROM TEST ENVIRONMENTS > RIVIAN SPINOFF ALSO BEGINS E-BIKE DELIVERIES AMID SUPPLY CHAIN CHALLENGES