Google puts Gemma 4 into Mac: AI Edge Gallery arrives on macOS

Google’s Official Local AI Client Finally Completes the Mac Puzzle

On June 3, Google brought AI Edge Gallery to macOS. This local model runner, which quietly launched on Android a year ago and only came to iOS a few months back, has now finally filled the most important gap on the desktop side. Along with it came two more things: a new model called Gemma 4 12B, and the Mac version of the AI Edge Eloquent offline transcription app.

Until now, running local large models was largely dominated by third-party tools like Ollama and LM Studio. For Mac users wanting to run Gemma, Llama, or Qwen, the usual route was to install Ollama, download GGUF files, and type a couple of commands. By releasing its official client, Google’s intent is crystal clear: their models, their channel, their end-to-end experience.

Not an Open Platform, but a Curated Google Store

Let’s first clarify how AI Edge Gallery differs from Ollama and LM Studio, because that determines who its target users are.

Ollama and LM Studio take the “model repository” route – you can run whatever you want, and they can handle the thousands of open-source models on Hugging Face. AI Edge Gallery is not like that. It currently offers only 5 models, all from Google, all with “it” in the name—short for instruct, meaning these weights have been instruction-tuned to understand natural-language directives like “summarize this text for me,” rather than merely continuing text.

This closed approach has pros and cons. The upside is stable experience – the team tuning the model is the same as the runtime team, so you won’t end up with awkward cases like some GGUF quantized builds overheating when running on Metal backend. The downside is equally clear: want to try a local version of Qwen3 or DeepSeek? Sorry, not here.

So AI Edge Gallery’s real target is not Ollama, but Apple’s future Apple Intelligence—both go for the “official tuning, privacy safeguards, works out of the box” path. The difference is Google is betting on open-weight Gemma, while Apple hides its models inside the system.

Gemma 4 12B: 12B Parameters, Comparable to a 26B MoE

The real highlight this time isn’t the client—it’s the simultaneously released Gemma 4 12B.

Google officially describes it as “designed to bring agentic multimodal intelligence directly to laptops.” Key specs:

• 12 billion parameters, placing it at the high end of today’s consumer local models
• Performance comparable to 26B-parameter MoE models—according to Google; even with a discount, it’s a clear upgrade over Gemma 3 12B
• Runs on consumer laptops with 16GB of RAM, unlike 70B-class open-source models
• Multimodal: supports text, image, and audio input
• Strong emphasis on coding ability

This parameter scale is cleverly chosen. Current consumer local models mostly range 2B–9B parameters—too small and they hit capability ceilings. 30B and above requires more RAM/VRAM than, say, a MacBook Air can handle. 12B hits a “just enough yet runnable” sweet spot.

Reddit benchmarks suggest 3–4B models run smoothly with at least 16GB unified memory, while 10B-class models are better with 24GB or more. In other words, Gemma 4 12B will run on a 16GB machine, but for better generation speed and longer context, 24GB M-series Macs are the real sweet spot.

In testing, Hong Kong media outlet unwire used a Mac mini M4 + 24GB unified memory to run a “plan a 4-day Kyoto trip” prompt. The model took ~8 seconds to think and ~40 seconds to produce a complete answer. Slower than cloud Gemini, but acceptable for local, offline, privacy-first use cases.

What’s Really Interesting: “Local Multimodality”

If it were just text generation, local models have been a hot battlefield for two years, nothing new. What makes Gemma 4 interesting is its ability to bring vision understanding into locally runnable territory.

AI Edge Gallery has a Ask Image feature: from the left menu, you can upload multiple images for the model to analyze. The first time you use it, you’ll need to download a vision model—for example, the lighter-weight Gemma-4-E2B-it as the vision engine.

In testing, feeding it 6 screenshots from Computex 2026 and asking “Summarize this year’s Computex from the images” produced a structured summary—automotive tech, new energy, AI compute platforms, etc.—in about 5 seconds. And importantly: the whole process was offline.

This capability is a game-changer for certain industries: lawyers processing contract scans, doctors reviewing medical images, journalists organizing materials, internal corporate audits—any vision data processing scenario that “cannot be uploaded to the cloud” can now be handled locally by a multimodal model. Previously, your only options were smaller, weaker models or huge 70B-class beasts.

The same logic applies to audio. Google hasn’t disclosed detailed benchmarks for Gemma 4 12B’s audio capabilities, but officially says all three modalities are supported. Paired with the newly released AI Edge Eloquent, the product line’s direction is obvious.

AI Edge Eloquent: Fully Local Transcription

A quick note on this transcription app.

Eloquent launched on iOS months ago, and now arrives on macOS alongside the client. Its features are straightforward:

• Real-time recording + transcription
• Automatically removes filler words like “um,” “ah,” “like”
• Light polishing for more readable text
• Supports different writing styles
• Lets you customize vocabulary (names, jargon, industry slang)

All processing is done locally—no cloud.

Here, Google is a latecomer. Whisper has already driven open-source speech recognition to a high point, and Mac tools like Wispr Flow and Superwhisper have long offered “local transcription + LLM polishing” as a subscription service. Eloquent’s advantages are being free and tightly integrated with AI Edge. But to win over existing Whisper users, Google still has to prove its transcription accuracy is just as good.

What This Means for Developers

Some takeaways:

1. Google has finally completed the desktop piece of its on-device AI strategy. Google is betting heavily on on-device AI—Pixel’s Gemini Nano, Android’s ML Kit, now AI Edge—but Mac was missing. Apple has its own Apple Intelligence, while Ollama captured the open-source ecosystem. Google’s official client fills that gap.

2. Gemma 4 12B is a must-test model for developers. 12B parameters + multimodality + runs on 16GB RAM covers a wide swath of Mac users. If you’re building local AI apps, privacy-sensitive workflows, or offline tools, Gemma 4 12B is likely to become a default choice. Run your usual benchmarks, focusing on coding, long-context, and vision understanding performance, before deciding whether to switch from Llama 3.x or Qwen3.

3. Closed client vs. open runtime trade-offs. AI Edge Gallery runs only Google’s 5 models—not very fun for pure tinkerers. But for B2B deployment to frontline staff, AI Edge Gallery’s “official, zero-config, fine-tuned” approach has way lower ops cost than letting everyone install Ollama themselves.

4. The cloud vs. local boundary is shifting fast. A year ago, we thought local models could only chat or draft emails. Now, a 12B multimodal model can analyze 6 images in 5 seconds. This already supports many real business scenarios. In the near future—when Gemma 5, Llama 5 arrive—the cloud’s moat may shrink to “ultra-long context + top-tier reasoning,” with the middle ground falling to local.

Some Rough Edges

Truth be told, AI Edge Gallery’s first version is a bit rough:

• Very limited model selection. Only 5 Google models; no cross-vendor comparison.
• No OpenAI-compatible API. Ollama can start a local server that LangChain or LlamaIndex can hook into directly. AI Edge Gallery currently feels like a standalone GUI, with unclear integration paths for developers.
• Opaque quantization strategy. In Ollama you can choose Q4, Q5, Q8; AI Edge Gallery just installs the prebuilt model. Power users looking to squeeze performance may find it limiting.

These issues will likely get fixed in future releases. For now, AI Edge Gallery is better for general users and enterprise deployment, not for AI engineers needing deep customization.

Practical Advice for Developers in China

If your daily work relies primarily on closed-source models like Claude or GPT, local models serve as a supplement, not a replacement—handling sensitive data, offline demos, or running test sets. Gemma 4 12B’s update is worth installing as a backup.

By the way, if you need to switch between cloud models and compare performance, OpenAI Hub lets you call GPT, Claude, Gemini, and DeepSeek with a single key, accessible from China, fully OpenAI-format compatible. Use Gemma 4 locally for privacy data, cloud models for complex reasoning—a mature engineering practice today.

Final Thoughts

This update from Google came without a keynote or launch event; 9to5Mac described it as “launches to macOS”—a typically low-key rollout. But in the broader trend of on-device AI, it’s actually a milestone: major vendors are now directly building local AI clients. Apple Intelligence is on the way, Google’s AI Edge now spans Android, iOS, and macOS, and Microsoft’s Copilot+PC is doing similar things on Windows.

In a year, running a 12B multimodal model locally on your computer might feel as natural as opening a browser today.

---

References

• Reddit r/MacOS discussion on AI Edge Gallery launching on macOS – includes tested memory requirements for running different parameter versions of Gemma 4 locally
• Gemma series models on Hugging Face – Google’s official open-weight Gemma repositories on Hugging Face