Hot on the heels of a collaboration with Nvidia, MediaTek is announcing a collaboration with Meta to harness the capabilities of the recently released Llama 2 Large Language Model (LLM), integrating its software capabilities into MediaTek’s chips.
Llama 2, an open-source LLM from Meta, comprises generative text models ranging between 7 billion to 70 billion parameters. Llama 2 is so powerful that experts in the AI industry are comparing its performance capabilities to that of ChatGPT 3.5 and ChatGPT 4.
The partnership enables MediaTek to implement localized Generative AI processing on numerous devices, including smartphones, IoT, vehicles, smart home, all launched with MediaTek chips.
MediaTek’s goal is to establish an edge computing ecosystem around its chips, enabling developers to leverage MediaTek’s APUs and NeuroPilot AI Platform to build Generative AI software using Meta’s Llama 2 LLM.
Localized AI processing, often referred to as edge computing, advances AI technology. It empowers developers to offer users applications that are not only more secure and reliable, but most importantly, functional even in areas with no internet connectivity – which is not the case today since most AI processing still occurs in the cloud.
MediaTek’s pursuit of edge computing has several advantages for developers and users, such as improved performance for AI applications, enhanced security, reduced operation costs, and the capability to tailor app functionalities to individual users. This last feat is very challenging in cloud-based processing due to security and privacy concerns.
While unveiling the partnership, MediaTek disclosed that its next-generation flagship chipset will come with an upgraded APU featuring Transformer backbone acceleration and DRAM memory optimizations. These upgrades should enhance system performance, reduce energy consumption, and potentially cut hardware costs.
These announcements come on the heels of Qualcomm’s recent revelation of a partnership with Meta to bring on-device AI processing to devices powered by its chips.
These announcements have us looking forward to a future where smartphones offer users groundbreaking features, not just better cameras and thinner bezels.
MediaTek disclosed that its next-gen chips will be shipped with smartphones set to be launched by the end of 2023. If true, MediaTek could outpace its close competitor, Qualcomm, in reaching the market. Qualcomm has previously announced plans to release its chips in 2024.