Your message is highly valuable for us. One of our experts will follow up with you within 1-2 business days to discuss your request or to inquire for additional information if needed.
Reading time: 15 minutes
By 2022,   equipped with 5G connection will hit the roads. Major EU economies including France, Germany and the UK are expected to see the nearly 100% connected car penetration in just one year from now.
OEMs may think that they still have time to prepare. But connected cars are already a reality in some ways even today. Consider, for example, that we can now connect a phone to a car and enjoy a remote start feature, or unlock a car with an iPhone or an Android Auto app. Through built-in car apps, shipped with newer models, we can seamlessly plug our phones to the dashboard, use voice dialing and even have our calendar synced with the navigation system to plan an onward journey.
These conveniences are just the tip of the iceberg in terms of connected vehicles. And they are just the beginning of a revolution in consumer demand to transform the entire concept of transportation. Younger generations are no longer interested in speed and design. They want an in-vehicle experience that allows them to stay connected, entertained, and comfortable, with minimal to no effort and exertion on their part.
If car manufacturers are to woo consumers, they will need to transform the driving experience. They will have to become more than just builders of a physical product and turn cars into devices offering different services to drivers and their passengers.
Enter Human Machine Interface (HMI)
Just what is HMI? It is, quite simply, software that allows a human to interact with, control, and get a response from a machine. Anytime you use Alexa, HMI is in play – it is voice activated remote control of sorts.
HMI in the connected vehicle ecosystem promises to transform the driving experience, going far beyond the standard ideas of HMI (e.g., smartphone integration, using Apple CarPlay or Android Auto to stream music or make calls) turning the car into a “moving computer” so that no additional gadgets will be required.
Due to rapid technological advances, HMI in automotive is becoming multi-modal as well. That means that the technology will be able to accommodate all sorts of interactions:
- Touch screen control of a central dashboard display;
- Voice control to get digital readouts of the car’s instrument cluster (speed, outside temperature, road conditions, fuel levels, etc.);
- Gesture control to trigger a head-up display (HUD) on the windshield;
- Haptic feedback, such as strong vibration in the steering wheel when a driver’s drowsiness is detected.
In short, multi-modal HMI turns the car into a device for information, entertainment, and enables enhanced safety and functional convenience/ease. And built-in AI will ensure that all HMI functions are “behaving” properly. The end result is not the driverless car, which remains in the future, but rather, semi-autonomous vehicle experience.
5 Major HMI Technology Trends In Automotive
, a market intelligence firm that tracks emerging technology, predicts that, by 2025, the market for the vehicle hardware, software, and related services will reach $26.5 billion, compared with $1.12 billion in 2017.
For car manufacturers and OEMs, there is no going back. They will have to adapt to the new reality of “smarter” driving, powered by innovative tech solutions. Hence, embracing the next market trends in automotive, HMI will be crucial for businesses who want to capture a bigger market share.
1. Smartphone Integration Becomes a “Must”.
This is no longer a future trend. Smartphone integration is here and available on most late model vehicles. In essence, a driver can seamlessly connect a phone to the car’s infotainment system and access all of its functions via installed apps and connected car software.
For example,   apps will allow navigation, sending and responding to messages, making phone calls, playing music, and listening to podcasts or audiobooks.   provides the same features. And all of this is tap- or voice-activated, ensuring a safer environment while the driver focuses on the road.
There are  , however. Cars tend to be owned for years. Phones tend to be owned for less than two years. The integration of the technology embedded in the car and that of ever-changing phone technology is an R&D issue that should be resolved by OEMs.
One possible solution is to create an OS for the Head Unit. But then, manufacturers will have to develop new car apps or port existing ones into their own system – a costly and time-intensive process.
Keeping the applications embedded in the Head Unit is a far better solution. Infopulse team has recently helped a German Tier 1 automotive supplier create a secure, seamless and non-intrusive integration for Android and iOS smartphones. Check out the complete case study here.
2. Voice Assistants and Voice-Guided Interfaces Come to the Fore.
The average consumer expects it. He is accustomed to asking Siri or Google anything; he may have a smart speaker in his home. Expecting the same convenience in his car is only natural.
Cars represent a huge market for voice assistants. According to a  , 77 million adults in the U.S. alone use voice assistants in their cars at least once a month. What’s even more promising is in-car voice commerce. Per this year’s  , 64.9% of drivers use a voice assistant provided by the auto manufacturer (if it’s available) to place orders online. And the drivers’ spending through Google Assistant, integrated into digital dashboards, is predicted to grow by 31.9% within the next three years.
In general, voice tech in cars has actually been around a while (IBM placed   in 2004), but fast-paced HMI application development in this department has been lacking, until now.
Last year at CES,   now shipped with the A-Class hatchback in Europe and the next-generation CLA and GLA models in the US. Just like Siri, the assistant understands indirect speech and can adjust the temperature when merely told “Hey Mercedes, I’m too cold” or suggest you take an umbrella when you are asking about the weather forecast. The company also significantly updated its infotainment system to support more gestures and act as an organic extension of the voice experience. The dashboard displays now offer more comprehensive information, e.g., evaluations on Yelp for various points of interest and their position on the map.
followed suit shortly after and also unveiled their voice recognition system. Being equipped with the latest ML “wits”, the company’s in-car assistant can also recognize unstructured voice commands and respond to various questions including the philosophical ones such as “What is the meaning of life?”. Its unique feature is a level of personalization that it offers. By learning about the driver’s favorite settings and preferences, the app can activate a combination of them for better well-being. Saying something like “Hey BMW, I feel tired” can trigger a vitality program, aimed at helping the driver stay alert by using optimal lighting, music and temperature among other things.
In general, most manufacturers are now switching to developing proprietary smart assistants to avoid becoming beholden to the likes of Google, Apple, and Amazon. To date, their progress has been a bit somewhat slow, but consumer demand will speed things up over the next several years.
3. HMI Safety Functions Get Better.
Many late model cars already have built-in braking and parking sensors that provide safety features and prevent accidents. Some also come equipped with even smarter ADAS hardware systems.
But over the next decade, we should also expect to see more software systems built into cars to bring in additional safety functions. And given that   are killed in car accidents every year, auto manufacturers would do well to make safety a key priority, as well as a major selling point.
External airbags, improved emergency braking systems, and automated night vision capabilities are just a few features that have become increasingly commonplace.
But newer technologies are making a major entrance as well such innovations as anti-theft and recognition of driver distraction/drowsiness.
Embedded software, through HMI integration, will be able to offer keyless entry to vehicles, through biometrics such as fingerprint or eye scan. Or allow a remote access to unlock the car with a phone app. In case with the latter, car cybersecurity has been a major concern though. But voice recognition technology can act as an additional layer of security and prevent the intruder from starting a car, for instance.
Car manufacturers are also exploring how vehicles can be integrated with Amazon’s Alexa and connected with other smart devices the person may have in their home. In this case, owners can receive additional information about events with their vehicle even when they are not around.
Additionally, several new technologies have been developed to detect driver drowsiness and distraction and assist with driving.
For example, navigational information can be broken down into several displays to provide turn-by-turn guidance when the driver requires it. Using gaze detection techniques, the data can be displayed exactly where the driver is looking.
When it comes to detecting fatigue and drowsiness, most cars already come equipped with some systems for helping the driver stay alert. The big problem, however, is that most of them are not really effective as they just show a “rest” icon or otherwise try to gently nudge the driver without proactively fixing their behavior. But if you want to score a  , you will need to introduce a camera-based Driver Monitoring Systems to your models.
Built-in cameras can monitor driver behavior and assess their tiredness by analyzing eye pupils, yawning, the position of the head, etc. Some of these monitoring techniques can also be used for detecting distractions while a speech recognition technology can help detect changes in voice patterns that indicate drowsiness. Other  , for example, can serve as indicators of drowsiness.
Finally, conversational AI embedded in the vehicle can engage in a dialog with a driver whenever those tiredness levels build up. Nuance presented how this type of voice-activated computer control can work during  . Using emotion detection functionality, the integrated assistants in the car can proactively propose different options to the driver (stop for coffee, adjust temperature, etc.) or initiate a transfer of control when it notices that drowsiness, driver distraction or emotional stress is threatening the person’s safety…which leads us to the next trend.
4. Assisted Personalized Driving.
We are all familiar with the cruise control feature that has been available on cars for decades. This is perhaps the earliest example of assisted driving. Since then, there has been a gradual implementation of connected car technology, as HMI software development has improved the driving experience.
At the 2019 Consumer Electronics Show, Samsung and Harman International Industries introduced their   – the latest in connectivity, safety, and personalization. Among the features of their new solution are the following ones:
- The digital cockpit now has six displays, as well as two rear seat displays, so that all passengers can enjoy personalized infotainment features. And the system actually monitors occupants and adjusts things such as screen settings automatically.
- There are three screens in the front digital cockpit that provide information and settings for the driver – speed, fuel gauge, etc. – according to the driver’s needs at the time. Other basics, such as navigation and music, are on the information display.
- There is an additional screen that monitors other functions, such as air conditioning.
- Smartphones can be connected so that all features and apps of that device can be accessed hands-free while driving.
- The dual connection between car and home has also been enhanced. In addition to the ability to control home appliances from the car, now the home can be used to control the car – starting it, warming or cooling it, checking the fuel level, and more.
- Newer safety features that include an enhanced mirror replacement vision system, a front-facing camera (as well as the rear-facing one) that informs the driver of the road conditions ahead, and driver monitoring features, to detect drowsiness and distractions and activate alarms.
5. Connected In-Car Payments.
Connected commerce is estimated to be a $230 billion opportunity for brands and OEMs, per  . It’s no longer a question of whether you should consider in-car payment integrations; it’s how you will implement those.
Visa, in collaboration with SiriusXM, has just announced their plan for a  . The solution will become available to any SiriusXM enabled vehicles. Users will get an e-wallet, with identity-verification biometrics, letting them pay for virtually everything from tolls, to coffee, to other billers and creditors while on the go. The best part, Visa is actively pitching this new technology to car manufacturers.
While the use of in-car payments may not seem like a huge convenience at the moment, the future of such HMI services may be expanded beyond paying for parking and takeaways. Suppose, for example, that car insurance providers utilize some options they are considering, such as rates based on the actual driver use and behaviors. Already, some of them have monitoring devices that can be installed in a vehicle, providing information about driving behaviors. They can connect to the in-car payments platforms, and adjust rates even monthly, based on the use and behaviors. The driver can then make payment through the same connected feature.
Additionally, some savvy OEMs are teaming up with brands to create in-dashboard marketplaces for drivers. General Motors, for example, already allows drivers to place orders straight from there for different products and services including parking, hotels, dinner reservations and more. E-commerce on the wheels is catching on rapidly.
What’s Next for Automotive Brands?
The short answer is, we do not know all of the HMI trends and the resulting application we will see in the near and distant future. We do know, however, that consumer demand is going to enforce HMI software development initiatives with embedded HMI as a major focus area.
Car manufacturers may have been dragging their feet a decade or so ago, but that is no longer the case. If they are to capture a market share, they are going to have to make a paradigm shift. That shift will be away from the car’s performance in terms of speed and reliance on physical design features and towards software systems. After all, the modern buyers now demand a new type of driving experience – more efficient, more comfortable, safer, more entertaining, and the one that allows a myriad of activities and tasks to be done on the go.
And there is a myriad of vehicle software development firms out there vying for the attention of auto manufacturers, promising the latest HMI design and development tools, HMI testing tools, and even testing automation.
Any auto manufacturer will need to clearly establish own HMI goals and then, take the time to explore the development options out there.
Infopulse has extensive experience in automotive HMI software development. We understand the latest industry trends; we customize development according to the HMI requirements of each client, and we deliver secure apps using the latest technologies. Let’s have a conversation and discuss your HMI development needs.