Running Gemma 4 12B Entirely On-Device on a ANDROID PHONE—with Smooth Multitasking

Gemma
, ,
1

I developed an Android app to run the Gemma 4 12B model entirely on-device, downloaded from Hugging Face. My phone has 16GB RAM and 16GB swap, and it runs surprisingly fast! It still needs bug fixes and optimization, but I’m excited to automate everything on my phone.

check the demo:

2

Hi @aliahad -

Thanks for sharing this with the community! It’s really great to see your on-device Gemma 4 12B setup, and the Android app you built and demoed.