MediaTek is about to bring powerful AI apps to some Android phones

MediaTek chip illustration on the Samsung Galaxy S23 Ultra.
Nadeem Sarwar / Digital Trends

You may have already tried a bunch of generative AI apps on your phone. OpenAI’s ChatGPT or HeyPi are some examples of chatty AI apps, while the likes of Runway ML will let you create AI-generated videos right on your phone.

But so far, almost every generative AI app has relied on cloud-based computing, which means all the magical AI processing happens in the cloud, just the way Xbox kits do the heavy lifting at Microsoft server centers when you stream a console game on your phone or tablet.

MediaTek wants to change that, allowing for on-device generative AI computing right on your smartphone. That ambitious moonshot will materialize with the next flagship chipset by MediaTek, which is going to appear inside Android phones by the end of this year. The company is aided in its efforts by Facebook parent Meta, which is offering the Llama 2 model as the foundational stone for generative AI apps.

The chipmaker is touting a whole gamut of benefits from its on-device generative AI processing approach, which includes “seamless performance, greater privacy, better security and reliability, lower latency, the ability to work in areas with little to no connectivity, and lower operation cost.”

Speeding up generative AI on phones

White Xiaomi POCO F5 and bluish-green OnePlus Nord 3 held in hand over a heap of Android smartphones including OnePlus 11, Pixel 6a, Samsung Galaxy Z Flip 4, Galaxy S23.
Tushar Mehta / Digital Trends

The upcoming top-end MediaTek chip will employ three key tactics to enhance the generative AI experience for smartphones. First, it will feature a dedicated software stack optimized to run Llama 2, an open-source large language model developed by Meta that seeks to challenge OpenAI’s GPT and Google’s PaLM 2 models.

Llama 2, which was released in July, is “free for research and commercial use.” So far, not many apps that rely on the Llama 2 language model have arrived, as GPT-based AI apps are currently

Read More ...