Introducing MyLLM AI: Local LLMs on Android
Today we're launching MyLLM AI — a free Android app that runs large language models entirely on your device. No cloud, no subscriptions, complete privacy.
The Problem with Cloud AI
Every major AI assistant today requires sending your data to remote servers. Your conversations, your questions, your creative work — all processed in data centers you don't control. And for the privilege, you pay $20-200 per month.
We built MyLLM AI to change that.
What is MyLLM AI?
MyLLM AI is a free, open-source Android application that runs large language models (LLMs) directly on your phone. Using llama.cpp as the inference engine, it can run models from 0.6 billion to 8 billion parameters — entirely offline.
Key Features
- 100% Local Processing — Every token is generated on your device's CPU/GPU
- Multiple Model Support — Choose from Qwen, Llama, Gemma, Phi, SmolLM, and DeepSeek
- 20+ Built-in Tools — Code interpreter, web search, file manager, translator, and more
- Autonomous Agent — An AI that can plan and execute multi-step tasks
- Voice Input — Speak to your AI using on-device speech recognition
- Chat History — All conversations stored locally, searchable and exportable
- Tiny Footprint — The app itself is only 31MB
How It Works
Under the hood, MyLLM uses llama.cpp — the incredible C++ library by Georgi Gerganov that makes LLM inference possible on consumer hardware. We bridge it to Kotlin through JNI, wrapping it in a clean Android architecture with Jetpack Compose.
Models are downloaded in GGUF format from HuggingFace. We support various quantization levels (Q4_K_M, Q5_K_M, Q8_0) so you can balance quality and performance for your device.
The Tech Stack
- Language: Kotlin with Jetpack Compose for the UI
- Architecture: Clean Architecture + MVVM with multi-module Gradle project
- Inference: llama.cpp via JNI (NDK arm64-v8a + x86_64)
- Storage: Room database for conversations, DataStore for preferences
- DI: Hilt for dependency injection
- Downloads: WorkManager for background model downloads
What's Next
This is just the beginning. We're working on Play Store distribution, iOS support, and a plugin API for developers. But today, you can download the APK and start chatting with AI — completely privately and free.
Download MyLLM AI →MyLLM AI Team
Building the future of private, on-device AI. We believe AI should run on your phone, respect your privacy, and be free for everyone.