Smart cockpits are shifting from"feature accumulation" to"experience refinement" against experience refinement backdrop of more than 15 million global new energy vehicle (NEV) sales in 2024, with Chinese brands accounting for more than 60% of the market share. Technology upgrades, represented by 0.5-second voice interaction response and seamless switching between "on-board systems, smart homes, and mobile phones," have become a core pillar of Chinese auto companies' efforts to consolidate their "intelligentization" competitiveness. Not only does this breakthrough address the traditional pain point of delayed cockpit interaction and device fragmentation, it also marks a shift from a concept to a large-scale application of the "human-vehicle-home full-scenario smart ecosystem," injecting new growth momentum into the global new energy vehicle market.
I. Technological Leap: The "End-Cloud Collaboration" Revolution Behind 0.5-Second Voice Response
As the core entry point to the intelligent cockpit, the speed of voice interaction directly determines user experience. The 0.5-second response breakthrough in 2024 is not the result of a single hardware upgrade, but the systemic result of the deployment of lightweight large models and improved terminal computing power-a complete reversal of the industry's previous struggles of "slow awakening, slow recognition and slow execution."
1.Endface Large Model Realizes "Thousand Decision Level"
Traditional voice interaction rely on cloud server processing, where network latency typically results in response delay of 1-3 seconds. In 2024, Chinese automakers made a major breakthrough by optimising end-size models: Geely teamed up with Stepstar to roll out the Agent operating system, compressing the ability to deploy large models locally. It can handle voice conversations at milliseconds without relying on the network. This "end-side inference + cloud update" architecture, which limits the totallink time between recognition and execution of voice commands to less than 0.5 seconds, isan over 50% faster than the 1.2 seconds response time of mainstream models in 2023.
Huawei's practice with the AITO M9 is further proof of its technical viability. its Pangu large model, based on the computational power of the onboard Kirin 990A chip, not only achieves 0.5 seconds of instant response, but also supports 6-zone voiceprint recognition and wakeless interaction. Instead of saying"Hello, Xiaoyi," users can simply command "Open a gap in the front passenger window," perfectly in keeping with natural communication habits. This "wake-up + instant response" combination upgraded voice interactions from "tool calls" to "natural conversations."
2.Hardware Iteration Lays fundamental to performance
Enhanced computing power is the underlying guarantee to improve voice response speed. By 2024, the computing power of mainstream smart cockpit chips will generally exceeded 200 TOPS, a 40% increase from 2023. Domestic chips such as Huawei's Kirin 990A and Horizon Robotics' Journey 6 have become core technologies. the AITO M9, for example, has a two-chip architecture for its cockpit system, with different chips for voice processing and multi-screen rendering. This avoids response delays caused by competing computing power and provides hardware redundancy for 0.5 seconds of interaction.
At the same time, the upgrade of microphone array technology has further improved voice recognition accuracy. New generation cockpits typically have 4 to6 high-sensitivity microphones. Combined with beamforming algorithm, voice commands can be accurately captured within half a metre, even in a high-speed driving environments with background noise (120km/h), and recognition is over 98% cent accurate. This reduces interaction delays caused by repeating commands in the source.
ii. Scene reconstruction: a seamless ``car-home phone"Switching across the ecosystem
If 0.5 seconds of 0.5-second voice interaction solves the problem of "interaction efficiency," multiscreen connectivity breaks down "device silo," making smart cockpit the core hub for connecting travel and life scenarios. In 2024, ecosystem, represented by Hello Travel, will seamlessly connect three terminals -"in-car systems, smart homes, and mobile phones" -to reshape users' full-scenario experience.
1.Practice of ``seamless switching"in cross-device collaboration
Huawei has unveiled an industry-leading multi-screen linkage solution on the AITO M9 9 that lets users unlock vehicles by touching the rear rearview mirror on their phone. Meanwhile, unfinished video on the phone will automatically be transferred to the vehicle's 15.6-inch central control screen and can be switched to the 32-inch rear projection screen for continuous playback while driving. Once off the bus, the content is relayed back to the phone. The one-click, seamless flow experience comes from HarmonyOS's distributed technical architecture, which enables computing power sharing and data synchronization between devices, breaking down ecological barriers between Android and iOS systems.
In home scenarios, users can pre-turn on the Huawei Smart Selection air conditioner set the temperature to 26 degrees Celsius. During the ride, users can connect a voice commands directly to the smart lock, authorizing couriers to temporarily enter or store packages. Upon arrival at home, the shopping list in the in-car system will automatically sync to their phone, allowing users to place a quick order via the e-commerce app. This "travel-home" scenario closes loop and upgrades the smart cockpit from "in-car terminal" to "life manager."
2.Ecosystem Co-Construction Model Between Automakers and Tech Companies
Seamless switching experience can not be achieved without deep cooperation between auto companies and tech enterprises. Through the "HarmonyOS Intelligent Travel" model, Huawei has integrated more than 3,000 devices,including phones, tablets and smart home appliances, into its in-car ecosystem. Within 3 months of its launch, the AITO M9 had received more than 60,000 orders, making the smart cockpit ecosystem one of its core selling points. Geely has teamed up with Stepstar to create a smart speaker operating system that not only supports cross-device connectivity, but also allows AI agents to proactively sense the needs of a scene-for example, by automatically turning down the volume of music and activating child mode when a child is found asleep in the car, upgrading from "reactive" to "active."
The model effectively avoids the "feature accumulation" problem posed by J.D. Power in its 2024 China Smart Cockpit Research Insights. The average daily user interaction frequency was 12.3 times higher for models with cross-scene connectivity, up 87% compared to unconnected models, the data showed. Of these, "in-car mobile app circulation" and "in-car smart home" were the two most common features, accounting for 68%% and 52, respectively.
III. User value: Cognitive Upgrade from "functional satisfaction" to "experience value beyond"
The dual upgrades to smart cockpit not only optimise the user experience, but also reshape the perception of NEV value. In the growing market environment ofelectrification homogeneity '', ``intelligent experience"has become a key differentiator for chinese brands, further supporting the growth of global market share of chinese brands.
1. Increased Improved Interaction Efficiency and User Stickiness
J.D. Power's research shows that for every 0.1-second improvement voice response speed, user satisfaction increases by 4.2 points (out of 100). In 2024, models with a 0.5-second voice response received an average user satisfaction score of 89, 7 points higher than the industry average. "Instant feedback, no waiting" was the most praised experience point. For commuters, the 0.5-second response time means they can quickly adjust navigation or switch music via voice commands during rush hour, reducing the risk of distracted driving.
Cross-scene linkage further deepens user dependence. Data shows that 73 per cent of users who used the car-home phone switch seamlessly were willing to buy a car, 28 percentage points more than those who have not using it. "I used to worry about the incompatibility of smart home devices when I changed cars," user feedback said. Now, in the HarmonyOS ecosystem, new cars can be connected directly to older devices. That consistency makes it difficult for me to choose other brands. '
2. Experience quality Supports High-End Brand Breakthrough
Smart cockpit upgrades are becoming an important support for Chinese brands entering the high-end market. As a premium SUV priced at more than $500,000, the AITO M9's smart cockpit ecosystem capabilities are a core driver of its more than 60,000 presale models and a key factor in its continued top-end sales under new mobility brands. This is in line with BYD Han series logic of entering Europe's top 10 luxury electric vehicle sales with an intelligent edge, confirming a shift in Chinese brands from "price competition" to "experience competition."
Overseas, this empirical advantage is also attractive. European users are particularly in demand for "seamless mobile navigationin cars." When the Huawei/ Renault model was launched in Europe, 41% of user feedback mentioned the feature as key to differentiating the electric model from BMW and Mercedes-Benz. As Cui Dongshu, secretary-general of the China Passenger Car Association, states, china's the "technology export"of new energy Cars has expanded from batteries and motors to the smart cockpit ecosystem, which is the root cause of china's global market share of more than 60%.
IV. INTRODUCTION Industry Challenges and Future Directions: From Single-Point Breakthroughs to Ecosystem Synergies
Despite major upgrades to smart cockpit, three major challenges require to be addressed to solidify the experience's edge: technological change, uniform standards and privacy security. These challenges coincide with a shift in the new energy automotive industry from "quantity to quality."
1. Difficulties with Cross-Brand Adaptation and standardization
At present, "car-home phone" linkage is largely confined to a single ecosystem, and the barriers between Huawei HarmonyOS and Xiaomi HyperOS have not yet been broken down. If users use both Xiaomi phones and AITO cars, cross-device circulation functions willnot be available. In response, industry players are pushing for the Smart Cockpit Connectivity Standards. In 2024, the CAA joined 15 automakers and technology companies to launch research and development of cross-ecosystem interconnection protocols, with the goal of achieving a breakthrough in compatibility of mainstream systems by 2025.
2. Increasing Data Privacy and Security Risks
Multi-device linkage means a lot of user data circulates between on-board systems, mobile phones and smart homes, data leakage risks. In 2024, a flaw in a new mobile brand's in-car system allowed it to illegally gain control permissions of users' smart home devices. In response, Geely Geely's Agent OS system uses "end-to-end encryption + federated learning" technology, where user data is processed locally rather than stored in the cloud for sensitive information,providing a reference solution for industry privacy protection. In the future, "safety compliance" will be an implicit threshold for competition in the smart cockpit ecosystem.
3. Usher, AI Agent in the New Age of Active Service
In the next phase, smart cockpit will shift from "passive response" to "active prediction." Agent OS, developed jointly by Stepstar and Geely, is starting to show results: it can proactively plan routes and connect smart home devices based on user driving habits and phone schedule,for example by automatically delaying the start of a home water heater based on overtime schedules or turning on a home light early based on a forecast of navigation arrival time predictions. This "intelligent service without command" will be at the heart of the next round of experiential competition.
Verdict: Smart Cockpits Define the core values of "next generation of cars"
When a 0.5 second voice response eliminates the "time gap" in human-machine interaction, cross-scene connectivity breaks down the "the" space barrier between devices, and the smart cockpit is no longer an add-on to the car, but the core value carrier that defines "next generation of car." Against the backdrop of the China-led restructuring of the global new energy vehicle market, smart cockpit eco-innovation and experience upgrading have formed a "dual-drive" force with electrification technology, driving a shift in Chinese brands from "market share leading" to "technology standard leading."
Just as global sales of new energy vehicles topped 15 million in 2024, backed by the institutional advantages of China's industrial chain, every upgrade of smart cockpit is a result of "autonomous hardware development + software innovation + eco-community co-construction." In the future, with the advanced application of AI proxy technology, smart cockpits will truly become mobile smart spaces that "understand users and provide services," and Chinese brands will undoubtedly gain a head start in this new competition.
