Back to articles
Open Source Project of the Day (Part 8): NexaSDK - Cross-Platform On-Device AI Runtime for Running Frontier Models Locally

Open Source Project of the Day (Part 8): NexaSDK - Cross-Platform On-Device AI Runtime for Running Frontier Models Locally

via Dev.to PythonWonderLab

Introduction "What if the latest AI models could run on your phone, on IoT devices, even on edge devices — without needing to rely on the cloud?" This is Part 8 of the "Open Source Project of the Day" series. Today we explore NexaSDK ( GitHub ). Imagine running the Qwen3-VL multimodal model on an Android phone, using Apple Neural Engine for speech recognition on an iOS device, and running the Granite-4 model on a Linux IoT device — all without connecting to the cloud. That's the revolutionary experience NexaSDK delivers — bringing frontier AI models truly "down to earth" on all kinds of devices. Why this project? 🚀 NPU-first : The industry's first NPU-first on-device AI runtime 📱 Full platform support : PC, Android, iOS, Linux/IoT all covered 🎯 Day-0 model support : Supports newly released models (GGUF, MLX, NEXA formats) 🔌 Multimodal capabilities : LLM, VLM, ASR, OCR, Rerank, image generation, and more 🌟 Community recognized : 7.6k+ Stars, collaborates with Qualcomm on on-device AI co

Continue reading on Dev.to Python

Opens in a new tab

Read Full Article
2 views

Related Articles