MediaTek is bringing generative AI to cars

ChatGPT could be coming to your cockpit

Dimensity Auto Cockpit

Today at NVIDIA GTC 2024, MediaTek unveiled its latest range of SoCs (system-on-chip) tailored for automotive solutions under the banner of Dimensity Auto Cockpit. The lineup, comprising the Dimensity Auto Cockpit CX-1, CY-1, CM-1, and CV-1, was showcased, each geared toward specific automotive applications.

While all chips in the lineup integrate support for NVIDIA DRIVE OS, their performance capabilities vary significantly. For instance, the CX-1 is positioned for premium automotive applications, whereas the CV-1 caters to entry-level vehicles.

MediaTek is bringing generative AI to cars 2

For those unfamiliar, NVIDIA DRIVE OS serves as a fundamental software stack for autonomous vehicles (AV). This platform harnesses NVIDIA’s proprietary software and hardware features to facilitate the development and deployment of autonomous vehicle applications, prioritizing safety and security.

The standout feature of the new MediaTek SoCs is the integration of an ARM v9-A system, NVIDIA’s next-gen GPU accelerated AI computing, and NVIDIA RTX graphics. These components promise to bring advanced generative AI features, such as chatbots like ChatGPT, directly into vehicles equipped with these chips.

The prospect of having AI assistance while driving could revolutionize the driving experience, with features like AI agents capable of handling texts while the driver focuses on the road. This innovation holds the potential to significantly reduce accidents caused by distracted driving.

Moreover, MediaTek has hinted at the integration of large language models (LLMs) to power driver alertness detection, although specifics are scarce. Such AI capabilities could potentially detect signs of driver fatigue or impairment, potentially preventing accidents and enhancing overall road safety.

Beyond safety enhancements, the LLMs are expected to power various other applications within the vehicle, including entertainment, content delivery to in-car displays, and the creation of a more personalized and intuitive in-car experience.

Now, you might be questioning the role of NVIDIA RTX graphics chips in this context. These chips are poised to deliver immersive gaming experiences on the large displays often found in autonomous vehicles. With realistic visuals and lighting, coupled with AI-driven upscaling and frame generation, NVIDIA RTX promises to elevate in-car gaming to new heights.

The new MediaTek SoCs boast several other notable features that cater to various aspects of automotive technology. These include built-in support for front-facing, in-cabin, and bird’s-eye-view cameras, addressing different perspectives crucial for video conferencing or comprehensive vehicle monitoring and safety.

Additionally, the inclusion of advanced video conferencing features, such as AI gaze correction and AI-based audio enhancement, highlights the integration of cutting-edge AI technologies aimed at improving communication within the vehicle. Furthermore, the integrated audio DSP promises to provide seamless access to voice assistants, potentially enhancing the overall user experience through voice-activated commands and controls.

MediaTek SoC availability

MediaTek did not disclose when vehicles featuring their new SoCs will hit the market. Given the current state of autonomous vehicle technology, it wouldn’t be shocking if we have to wait until 2025 or even beyond to see these chips in commercially available cars.

As for pricing, it’s safe to assume that the costs of these chips will be factored into the overall price tag of the vehicles themselves.