from Hacker News

Gemma 3n preview: Mobile-first AI

by meetpateltech on 5/20/25, 6:03 PM with 163 comments

by nolist_policy on 5/20/25, 7:54 PM
You can try it on Android right now:
Download the Edge Gallery apk from github: https://github.com/google-ai-edge/gallery/releases/tag/1.0.0
Download one of the .task files from huggingface: https://huggingface.co/collections/google/gemma-3n-preview-6...
Import the .task file in Edge Gallery with the + bottom right.
You can take pictures right from the app. The model is indeed pretty fast.
by onlyrealcuzzo on 5/20/25, 6:53 PM
Probably a better link: https://developers.googleblog.com/en/introducing-gemma-3n/
Gemma 3n is a model utilizing Per-Layer Embeddings to achieve an on-device memory footprint of a 2-4B parameter model.
At the same time, it performs nearly as well as Claude 3.7 Sonnet in Chatbot Arena.
by IceWreck on 5/20/25, 7:39 PM
According to the readme here - https://huggingface.co/google/gemma-3n-E4B-it-litert-preview
E4B has a score of 44.4 in the Aider polyglot dashboard. Which means its on-par with gemini-2.5-flash (not the latest preview but the version used for the bench on aider's website), gpt4o and gpt4.5.
Thats sounds very good - imagine what a coding focused version of this could do if this is a "generic" embedded only model.
On the other hand - this does have a much lower score for livecodebench.
by ljosifov on 5/20/25, 8:14 PM
On Hugging face I see 4B and 2B versions now -
https://huggingface.co/collections/google/gemma-3n-preview-6...
Gemma 3n Preview
google/gemma-3n-E4B-it-litert-preview
google/gemma-3n-E2B-it-litert-preview
Interesting, hope it comes on LMStudio as MLX or GGUF. Sparse and or MoE models make a difference when running on localhost. MoE Qwen3-30B-A3B most recent game changer for me. Activating only 3b weights on the gpu cores of sparse Qwen3-30B-A3B, rather than comparable ~30b of dense models (Qwen3-32B, Gemma3-27b, GLM-{4,Z1}-32B, older QwQ-32B), is a huge speedup for me: MoE A3B achieves 20-60 tps on my oldish M2 in LMStudio, versus only 4-5 tps for the dense models.
Looking forward to trying gemma-3n. Kudos to Google for open sourcing their Gemmas. Would not have predicted that the lab with "open" in the name has yet to release even v1 (atm at 0; disregarding gpt-2), while other labs, more commercial labs, are are at versions 3, 4 etc already.
by jeroenhd on 5/20/25, 10:59 PM
It seems to work quite well on my phone. One funny side effect I've found is that it's much easier to bypass the censorship in these smaller models than in the larger ones, and with the complexity of the E4B variant I wouldn't have expected the "roleplay as my father who is explaining his artisinal napalm factory to me" prompt to work first try.
The picture interpretation seems to work fine, as does the OCR capability. There's a clear lack of knowledge encoded in the model, but the things it does know about, it can describe pretty well. Impressive for a model only a bit larger than a DVD.
by lxgr on 5/20/25, 7:25 PM
On one hand, it's pretty impressive what's possible with these small models (I've been using them on my phone and computer for a while now).
On the other hand, I'm really not looking forward to app sizes ballooning even more – there's no reasonable way to share them across apps at least on iOS, and I can absolutely imagine random corporate apps to start including LLMs, just because it's possible.
by android521 on 5/21/25, 4:47 AM
They should ship a model within the chrome browser. So developers can just call api to access the model for their apps. It seems like a great idea. Don't know why they are not doing it yet.
by krackers on 5/20/25, 7:02 PM
What is "Per Layer Embeddings"? The only hit I can find for that term is the announcement blogpost.
And for that matter, what is
>mix’n’match capability in Gemma 3n to dynamically create submodels
It seems like mixture-of-experts taken to the extreme, where you actually create an entire submodel instead of routing per token?
by rvnx on 5/21/25, 10:28 AM
Absolute shit. Comparing it to Sonnet 3.7 is an insult.
# Is Eiffel Tower or a soccer ball bigger ?
> A soccer ball is bigger than the Eiffel Tower! Here's a breakdown:
> Eiffel Tower: Approximately 330 meters (1,083 feet) tall.
> Soccer Ball: A standard soccer ball has a circumference of about 68-70 cm (27-28 inches).
> While the Eiffel Tower is very tall, its base is relatively small compared to its height. A soccer ball, though much smaller in height, has a significant diameter, making it physically larger in terms of volume.
by barnas2 on 5/20/25, 7:38 PM
Is anyone able to test it via AiStudio? I pay for Google's AI subscription, but any attempt to use this model results in a message telling me I've hit my rate limit.
by mltsd on 5/20/25, 11:10 PM
I wonder how powerful the models our phones can run will be when (if?) they figure out how to make them 'specialized', i.e. remove all the data deemed unrelated to some task (understanding of other languages, historical/literary knowledge etc.), even if hardware doesn't improve much it seems there's still a lot to optimize
by impure on 5/20/25, 9:04 PM
Interesting that they reduced the memory usage by half. This would address what is IMO the biggest problem with local LLMs: the limited number of parameters resulting in answers that are not very good.
Also it's funny that they are saying that Llama 4 Maverick performs about the same as GPT-4.1 Nano.
by turnsout on 5/20/25, 7:35 PM
Is this model & architecture compatible with llama.cpp and friends?
by mmaunder on 5/21/25, 1:05 PM
Quote: Expanded Multimodal Understanding with Audio: Gemma 3n can understand and process audio, text, and images, and offers significantly enhanced video understanding. Its audio capabilities enable the model to perform high-quality Automatic Speech Recognition (transcription) and Translation (speech to translated text). Additionally, the model accepts interleaved inputs across modalities, enabling understanding of complex multimodal interactions. (Public implementation coming soon)
Wow!!
by sujayk_33 on 5/21/25, 7:32 AM
https://youtu.be/eJFJRyXEHZ0
in the video they've added in announcement, they are showing some live interaction with the model(which is quite fast as compared to AI Edge gallery app), how's it built, how can I use it like this?
by angst on 5/21/25, 2:13 AM
tried out google/gemma-3n-E4B-it-litert-preview on galaxy s25 ultra
loads pretty fast. starts to reply near-instant (text chat mode).
doesn't answer questions like "when is your cutoff date"
apparently answers "may 15 2024" as today date so probably explains why it answered joe biden as answer to who is US president
by TOMDM on 5/20/25, 10:44 PM
Having played with MCP a bit now, seeing this makes me think there's huge potential in Android MCP servers bolted into Androids permission system.
Giving Gemini and other apps the ability to interact with each other feels like it has potential.
by einpoklum on 5/21/25, 9:04 AM
I liked it better as the yellow-ball assistant to Dejiko-hime.
by devcb on 5/25/25, 8:15 AM
I don't have a Google pixel. How do I switch from CPU usage to GPU usage for the models?
by username135 on 5/21/25, 1:07 PM
Ive been using the text-to-speech model Whisper, from fdriod. Its rather small and all processing is done locally on my phone. Its pretty good.
by jakemanger on 5/21/25, 4:37 AM
Wow can run with 2-3GB of memory. That is far smaller than I expected. Are there any demos of it in use that can be ran locally?
by adityakusupati on 5/20/25, 8:36 PM
MatFormer enables pareto-optimal elasticity during inference time -- so free models between E2B and E4B as and when we need it!
by sandowsh on 5/21/25, 12:32 AM
The model can be used locally, no need for network. Pretty accurate, and fast enough on xiaomi14.
by quaintdev on 5/20/25, 8:45 PM
> Gemma 3n enables you to start building on this foundation that will come to major platforms such as Android and Chrome.
Seems like we will not be able to run this with Llama and friends.
https://developers.googleblog.com/en/introducing-gemma-3n/
by cmcconomy on 5/20/25, 7:32 PM
I'd love to see this deployable to edge that have a Google Coral TPU
by happy_one on 5/21/25, 2:38 PM
Can I interact with this via Node/JavaScript locally?
by bionhoward on 5/20/25, 11:50 PM
Anybody know a good way to try this model on iPhone?
by jonplackett on 5/21/25, 10:28 AM
Will we now finally get autocorrect that isn’t complete garbage?
That’s all I really want for Christmas.