How to Use AI on Your Phone for Free — No Internet, No Subscription, No Data Shared
Google's AI Edge Gallery app lets you run AI models directly on your phone, completely offline and for free. Here's what it does, how to set it up, and what you should know before trying it.
Google has a free app that lets you run AI directly on your phone. No subscription. No internet connection. No data leaving your device.
It's called Google AI Edge Gallery, and while it's been around since May 2025, it just got a major update that makes it worth paying attention to. The app now supports Gemma 4 (Google's newest and most capable open-source AI model) and it's available on both Android and iOS for the first time.
The app already hit #8 on the App Store's productivity chart within days of the update. Tech blogger Simon Willison called it "terrible name, really great app." Hugging Face co-founder Clément Delangue called the licensing shift behind it "a huge milestone." So what's the deal?
What It Actually Does
AI Edge Gallery lets you download AI models to your phone and run them locally. That means once the model is downloaded, everything happens on your device: your prompts, your images, your audio. Nothing gets sent to Google or any server.
Here's what you can do with it:
→ AI Chat — A chatbot similar to ChatGPT, but running entirely on your phone. It even has a "Thinking Mode" that shows you the model's reasoning step by step.
→ Ask Image — Take a photo or pick one from your gallery, and ask questions about it. Identify objects, read text from images, get descriptions.
→ Audio Scribe — Transcribe or translate audio recordings in real time, all on-device.
→ Agent Skills — This is new. The AI can now use tools like Wikipedia and interactive maps to complete multi-step tasks — all running offline on your phone.
→ Prompt Lab — A sandbox for single-turn tasks like summarizing text, rewriting content, or generating code.
How to Get It
- Go to the Google Play Store or Apple App Store and search for "Google AI Edge Gallery"
- Download and open the app
- Pick a model — Gemma 4 E2B is a good starting point (it's about 2.5GB)
- Wait for the model to download (you need internet for this step only)
- Once downloaded, you can go fully offline and start using it
Requirements: Android 12+ or iOS 17+. A relatively modern phone with decent processing power. Newer phones with dedicated AI chips (like Google Tensor, Snapdragon 8 Gen 2+, or Apple's A-series) will run it noticeably better.
Let's Be Honest About the Limitations
This is not a ChatGPT or Claude replacement. Cloud-based AI models are significantly more capable, as they have access to more computing power, larger model sizes, and can handle complex reasoning, long documents, and nuanced tasks much better.
What you're getting here is a smaller, faster, offline AI that's good for quick tasks: drafting short text, answering questions, transcribing audio, identifying objects in photos. Think of it as a capable pocket assistant, not a full AI workstation.
A few other things to keep in mind:
→ Battery drain is real. Running AI models locally is intensive work for your phone's processor. Your device will get warm and use more battery than usual.
→ Storage matters. Models take up several GBs. If your phone is already tight on space, you'll need to make room.
→ Older phones will struggle. Performance depends heavily on your hardware. A 2024 flagship will handle it smoothly. A budget phone from 2021 might not.
→ It's still experimental. Google labels this as an active development project. Expect occasional crashes and rough edges.
Why This Matters for You
Three reasons this is worth your attention, even if the app is still rough around the edges.
It can save you money. Right now, AI subscriptions cost $20-30/month per person. If you have a team of five, that's $100-150/month just for ChatGPT or Claude access. On-device AI is free. It's not as powerful yet but for quick drafts, transcription, image questions, and basic research, it handles those tasks without costing you a cent. As these models improve, the list of things you can do for free will only grow.
Your data stays yours. Every time you type a client's name, a contract detail, or a business idea into a cloud AI tool, that data travels through someone else's servers. Maybe that's fine for you. But if you work with sensitive client information, like legal, financial, medical or anything confidential, having an AI that processes everything locally on your device, with nothing sent anywhere, is a real advantage. No terms of service to worry about. No data policies to read. It just stays on your phone.
This is where AI is heading. On-device AI isn't a side project, it's the direction the entire industry is moving. Google, Apple, Qualcomm, and every major phone manufacturer are investing heavily in AI chips built into phones. The models are getting smaller and smarter. The hardware is getting faster. A year from now, the AI running on your phone will be significantly better than what you're seeing today. The people who start experimenting now will have a real head start when on-device AI becomes the default (it probably will).
You don't need to switch from ChatGPT or Claude today. But downloading this app, trying it out, and understanding what on-device AI can already do? That's 15 minutes well spent.
I'll be recording full tutorials on how to set this up and get the most out of it, so stay tuned!
Links: