🔥 Check out this must-read post from Hacker News 📖
📂 **Category**:
📌 **What You’ll Learn**:
The Swiss Army Knife of On-Device AI
Chat. Generate images. See. Listen. All on your phone. All offline. Zero data leaves your device.
Not just another chat app
Most “local LLM” apps give you a text chatbot and call it a day. Off Grid is a complete offline AI suite — text generation, image generation, vision AI, voice transcription, and document analysis, all running natively on your phone’s hardware.
Text Generation — Run Qwen 3, Llama 3.2, Gemma 3, Phi-4, and any GGUF model. Streaming responses, thinking mode, 15-30 tok/s on flagship devices. Bring your own .gguf files too.
Image Generation — On-device Stable Diffusion with real-time preview. NPU-accelerated on Snapdragon (5-10s per image), Core ML on iOS. 20+ models including Absolute Reality, DreamShaper, Anything V5.
Vision AI — Point your camera at anything and ask questions. SmolVLM, Qwen3-VL, Gemma 3n — analyze documents, describe scenes, read receipts. ~7s on flagship devices.
Voice Input — On-device Whisper speech-to-text. Hold to record, auto-transcribe. No audio ever leaves your phone.
Document Analysis — Attach PDFs, code files, CSVs, and more to your conversations. Native PDF text extraction on both platforms.
AI Prompt Enhancement — Simple prompt in, detailed Stable Diffusion prompt out. Your text model automatically enhances image generation prompts.
| Task | Flagship | Mid-range |
|---|---|---|
| Text generation | 15-30 tok/s | 5-15 tok/s |
| Image gen (NPU) | 5-10s | — |
| Image gen (CPU) | ~15s | ~30s |
| Vision inference | ~7s | ~15s |
| Voice transcription | Real-time | Real-time |
Tested on Snapdragon 8 Gen 2/3, Apple A17 Pro. Results vary by model size and quantization.
Grab the latest APK from GitHub Releases, install, and start chatting in under 2 minutes.
git clone https://github.com/alichherawalla/offgrid-mobile.git
cd OffgridMobile
npm install
# Android
cd android && ./gradlew clean && cd ..
npm run android
# iOS
cd ios && pod install && cd ..
npm run ios
Requires Node.js 20+, JDK 17 / Android SDK 34 (Android), Xcode 15+ (iOS). See full build guide.
Contributions welcome! Fork, branch, PR. See development guidelines for code style and the codebase guide for patterns.
Built on the shoulders of giants:
llama.cpp | whisper.cpp | llama.rn | whisper.rn | local-dream | ml-stable-diffusion | MNN | Hugging Face
Off Grid — Your AI, your device, your data.
No cloud. No subscription. No data harvesting. Just AI that works anywhere.
🔥 **What’s your take?**
Share your thoughts in the comments below!
#️⃣ **#GitHub #alichherawallaoffgridmobile #Swiss #Army #Knife #Offline #Chat #Speak #Generate #Images**
🕒 **Posted on**: 1771118287
🌟 **Want more?** Click here for more info! 🌟
