Cerence has created an LLM-based platform leveraging its extensive automotive dataset and tech stack to deliver enhanced experiences for end users
Cerence AI for a world in motion introduced a pioneering, automotive-specific large language model, CaLLM, powered by NVIDIA technology. CaLLM (Cerence Automotive Large Language Model) serves as the foundation for Cerence’s next-generation in-car computing platform, running on the NVIDIA DRIVE platform. Cerence is working with NVIDIA to solve several key automaker challenges: accelerating time to market by enabling new user experiences to be deployed via a cloud integration with both existing embedded systems and new generative AI-powered domains, giving OEMs an advantage as drivers demand increasingly intelligent features and capabilities inside the car.
Read More: CIO Influence Interview with Joe Capes, Chief Executive Officer at LiquidStack
As automakers and mobility OEMs look to leverage generative AI and LLMs to improve the user experience, CaLLM meets several critical needs. It has a unique level of automotive-specific intelligence, leveraging Cerence’s extensive automotive expertise and fine-tuned, growing automotive dataset encompassing billions of tokens to deliver integrated in-car user experiences beyond those of general knowledge LLMs. CaLLM is distinctly able to support automotive functions, features, and requirements and is deeply customizable for automakers through training, fine-tuning, and bespoke applications. Its features include user personalization as well as built-in information retrieval for Cerence’s generative AI-powered applications like Cerence Car Knowledge.
Cerence is building CaLLM with the NVIDIA AI foundry service, which includes NVIDIA AI Foundation Models, NVIDIA AI Enterprise software, and NVIDIA accelerated computing. Cerence will first train CaLLM on its extensive dataset leveraging NVIDIA DGX Cloud and NVIDIA DGX systems and then develop the capabilities required for in-car user experiences. Second, to help achieve an ultrafast user experience, Cerence will deploy CaLLM in an NVIDIA-accelerated infrastructure with NVIDIA AI Enterprise, an end-to-end, cloud-native, secure software platform that accelerates training, fine-tuning, and inferencing of LLMs with the NVIDIA NeMo framework and the NVIDIA TensorRT-LLM optimization library.
Read More: CIO Influence Interview with Jake McClean, Chief Information Officer at Tanium
“We are delivering a breakthrough in-car computing platform that leverages our vertical tech stack to allow users to complete tasks across applications through a unified conversational interface,” said Iqbal Arshad, Chief Technology Officer, Cerence. “When paired with NVIDIA’s industry-leading AI frameworks and platforms, our exclusive dataset, deep relationships with automakers, and extensive market penetration put us in the ideal position to lead with our pioneering automotive-specific LLM, CaLLM, and our own in-car computing platform. As we look to the future, we see this proprietary architecture also benefiting industry leaders outside of automotive.”
“Generative AI and automotive LLMs are expected to enable new, intuitive, and personalized user experiences, capabilities, and features both inside and outside the car,” said Ali Kani, Vice President of Automotive, NVIDIA. “By tapping NVIDIA’s core expertise in cloud and edge technologies, Cerence can more quickly train, scale, and deploy these models within their in-car user-experience platform to enable safer, smarter, and more enjoyable rides.”
CaLLM serves a critical role in building the cars of the future, serving as the foundation for Cerence’s new in-car computing platform. This platform is the future of in-car interaction, an automotive- and mobility-specific assistant that provides an integrated in-cabin experience. While previous solutions required multi-step interactions to take place as distinct, separate steps – resulting in too many manual interactions and a high cognitive load for the driver – Cerence’s new platform combines all aspects of a user’s interaction into a seamless and intuitive conversational interface. Cerence’s new platform will enable smooth transitions for OEMs by reimagining their existing applications within the conversational interface while offering new generative AI-powered services.
[To participate in our interview series, please write to us at sghosh@martechseries.com]
