Frankenstein and the future networked car

So what do Frankenstein and the future networked car have in common, you ask? Simple: both are compelling stories brought to life in Geneva, Switzerland.

In Mary Shelley’s Frankenstein the creature is seen climbing Mont-Salève after having fled Geneva during a lightning storm:

“I thought of pursuing the devil; but it would have been in vain, for another flash discovered him to me hanging among the rocks of the nearly perpendicular ascent of Mont-Salève.”

Mont-Salève, overlooking Geneva
Photo: Benoit Kornmann

Of course, the future networked car is a very different type of story, but compelling nonetheless. The laboratory in this story is the ITU Symposium on The Future Networked Car being held within the Geneva Auto Show on March 5 to 6, where many new ideas will be brought to life by convening leaders and technical experts from the automotive and ICT communities.

The event, organized by the International Telecommunications Union (ITU), will consist of high-level dialogues and several technical sessions; these include a session on integrating nomadic devices in cars, where I will discuss how technology standards can help minimize driver distraction. The dialogues will cover road safety and innovation for the future car, and will feature key leaders such as the presidents of Fédération Internationale de l’Automobile (Jean Todt) and Infiniti (Johan de Nysschen). The technical sessions will explore automated driving, connected car use cases, emergency services, and, of course, nomadic device integration. Speakers for these sessions come from a mix of automakers, tier one suppliers, ICT companies, standards development organizations (SDOs), industry groups, and government agencies.

The symposium also includes a session jointly organized by the ITU and UNECE Inland Transport Committee that deals with the human factors and regulatory issues introduced by automated driving. This session is an encouraging sign that the ITU and UNECE will continue the collaboration they started last June (see my previous post, “UN agencies take major step towards international standards for driver distraction”).

Hope to see you in Geneva!

QNX at CES: a key fob on steroids

Have you ever wished that your key fob could do more than lock and unlock doors, and chirp your horn? If so, you’ll be interested in some great tech that QNX Software Systems has developed in partnership with DotLinker and is demonstrating this week at CES.

To show what this technology can do, we’ve created a custom “key fob” app that connects to our Mercedes-Benz CLA45 AMG technology concept car. The app is written in HTML5, our cross-platform language of choice, so it will run on any smartphone. Here is the app’s main menu:



Remote repair, over the air
A really cool feature of this technology is that the connection to your car is hosted on a cloud service, thanks to our DotLinker integration. This approach could allow multiple devices owned by you, your spouse, or your kids to access the vehicle's state simultaneously. It could also allow your dealership to access the vehicle’s state online — with your permission of course — without having you bring the car into the shop. The dealer tech could simply pull up a management console on an iPad to see what’s wrong, order the parts you need, and book a single, quick fix-it appointment:



If the problem can be fixed by software, that same technician could make changes over the air. It might be as simple as setting a Bluetooth pairing option that you can’t find (aka remote device management), or downloading new software to the car (aka firmware over-the-air updates):



Dodging the vortex
How about a remote start from anywhere? The Buick Enclave with OnStar shows just how nice this can be when it’s bitter cold outside and you’re beyond traditional key-fob distance. This feature should come in handy this week with the dreaded “Polar Vortex”! Also, you never know when a coworker might need to borrow your ice scraper out of the trunk — stay nice and warm inside while he or she gets it. If it ever does get back to hot summer days (and it will, eventually), this same remote access could let you open your car’s sunroof or windows.

The key fob app supports remote start; remote open/close of doors, windows, roof, and trunk; and, for good measure, remote control of turn signals:




Where did I park that thing?
“Hey kids, meet me back at the car!” Finding your vehicle’s location is a modern necessity, especially when the parking lot is bigger than the state of Rhode Island. Okay, the Las Vegas Convention Center isn’t that big, but it sure feels that way by the end of the show:



Backseat DJ
Finally, what about controlling the car’s media player from the phone? Let your kids DJ the car’s playlist from the back seat from their tablets or smartphones to keep the trip to Grandma’s entertaining. Just remember you gave them that power when they dish up their favorite screamo band, “A Scar for the Wicked”.



What if?
Now imagine... what if your next car came with a key-fob app? What features would you hope to see? And what do you think would be the killer key-fob feature of all time? Over-the-air updates? Remote location tracking? Or something completely different?

The wraps are off! First look at the new QNX technology concept car

A quick tour of one of the vehicles that QNX is unveiling at 2014 CES

You know what? Writing this post isn’t easy. All I’ve got are words and pictures, and neither could ever do justice to the user experience offered by the new QNX technology concept car. They cannot, for example, recreate the rich, luminous sound of the car’s full-band and wide-band hands-free calls. Nor can they evoke how the car blends speech recognition with a touch interface and physical controls to make navigation, Internet radio, and other applications wonderfully easy to use.

But on second thought, words and pictures aren’t that bad. Especially when the car — and the in-dash systems that the QNX concept team created for it — are so downright gorgeous. So what are we sitting around for? Time for a tour!

Actually... hold that thought. I just want to mention that, if you visit our Flickr page, you can find full-resolution versions of most of the images I've posted here. Because why settle for low res? Okay, back to the tour.

The car
I've got two things to say here. First, the car is based on a Mercedes-Benz CLA45 AMG. If you guessed the model correctly based on the teaser images we published on the QNX website, I bow in homage to your eagle eye. Second, while we snapped this photo in the QNX garage, don’t think for a minute that the garage is ever this neat and tidy. On any given day, it’s chock full of drill presses, tool boxes, work tables, embedded boards, and QNX engineers joyously modding the world’s coolest cars — exactly the kind of place you expect it to be. And want it to be! But to humor the photographer, we (temporarily) made this corner clutter-free. We're nice that way.



The dash
Let's get behind the wheel, where you can see the car's custom-built digital instrument cluster and infotainment system. The bold design, the clean layout, the super-easy-to-access controls — they all add up to systems you want to interact with. Just as important, the look-and-feel of the instrument cluster and infotainment system are totally different from the corresponding systems in our previous concept car — an excellent illustration of how the QNX platform can help customers create their own branded experiences.



The multi-talented cluster
Time to zoom in on the digital instrument cluster, which helps simplify driving tasks and minimize distraction with an impressive array of features. Turn-by-turn directions pulled from the navigation system? Check. Video feed from front and rear-view cameras? Check. Notifications of incoming phone calls? Check. Alerts of incoming text messages, which you can listen to at the touch of a steering-wheel button? Check.



The Android app support
Automakers want to tap into the talents of the mobile app community, and the QNX CAR Platform for Infotainment helps them do just that, with built-in support for Android, OpenGL ES, and HTML5. In the concept car, for example, you'll find an Android Jellybean version of iHeartRadio, Clear Channel’s digital radio service, running in a secure application container. The QNX CAR Platform takes this same sandboxed approach to running HTML5 apps — perfect for protecting both the HMI and the overall system from unpredictable web content:



Helping you get there in more ways than one
We designed the QNX CAR Platform to give automotive developers the greatest possible choice and flexibility. And that’s exactly what you see when it comes to navigation. For instance, the car supports navigation from Elektrobit:



and from HERE:



and from Kotei Informatics:



If that’s not enough, a demo system in the QNX booth at CES also demonstrates a navigation system from Aisin AW — more on that in an upcoming post.

Pardon me while I barge in
As I alluded earlier, what you can't see in the new concept car is just as important as what you can see. For instance, if you look at this image, you'll see the infotainment system's media player. But what you can't see is new acoustics technology from QNX that lets you "barge in" and issue voice commands even when a song is playing. How cool is that?



When you find yourself in times of trouble...
... don't let it be, but rather, check and see. And to do that, you can use the infotainment system's virtual mechanic, which keeps tabs on your car's health, including fluid levels, brake wear, and, in this case, low tire pressure:



The cloud connection
Hold on, what's this? It looks like a smartphone app with an interface similar to that of the virtual mechanic, above. In fact, it's a lot more than that, and it touches on some cool (and very new) technology that can help cars become fully managed citizens of the cloud. More on that in an upcoming post.



That's it for now. For more details on what QNX is showcasing this week at CES, check out the press releases posted on the QNX website. And stay tuned to this channel for further updates from 2014 CES — including a profile of our very new QNX technology concept car for acoustics.

The ultimate show-me car

The fifth installment in the CES Cars of Fame series. Our inductee for this week: a most bodacious Bentley.

It's one thing to say you can do something. It's another thing to prove it. Which helps explain why we create technology concept cars.

You see, we like to tell people that flexibility and customization form the very DNA of the QNX CAR Platform for Infotainment. Which they do. But in the automotive world, people don't just say "tell me"; they say "show me". And so, we used the platform to transform a Bentley Continental GT into a unique concept car, equipped with features never before seen in a vehicle.

Now here's the thing. This is the same QNX CAR Platform found in the QNX reference vehicle, which I discussed last week. But when you compare the infotainment systems in the two vehicles, the differences are dramatic: different features, different branding, different look-and-feel.

The explanation is simple: The reference vehicle shows what the QNX CAR Platform can do out of the box, while the Bentley demonstrates what the platform lets you do once you add your imagination to mix. One platform, many possibilities.

Enough talk; time to look at the car. And let's start with the exterior, because wow:



The awesome (and full HD) center stack
And now let's move to the interior, where the first thing you see is a gorgeous center stack. This immense touchscreen features a gracefully curved surface, full HD graphics, and TI’s optical touch input technology, which allows a physical control knob to be mounted directly on the screen — a feature that’s cool and useful. The center stack supports a variety of applications, including a 3D navigation system from Elektrobit that makes full use of the display:



At 17 inches, the display is big enough to display other functions, such as the car’s media player or virtual mechanic, and still have plenty of room for navigation:



The awesome (and very configurable) digital instrument cluster
The instrument cluster is implemented entirely in software, though you would hardly know it — the virtual gauges are impressively realistic. More impressive still is the cluster’s ability to morph itself on the fly. Put the car in Drive, and the cluster will display a tach, gas gauge, temperature gauge, and turn-by-turn directions — the cluster pulls these directions from the center stack’s navigation system. Put the car in Reverse, and the cluster will display a video feed from the car’s backup camera. You can also have the cluster display the current weather and current sound track:



The awesome (and just plain fun) web app
The web app works with any web browser and allows the driver to view data that the car publishes to the cloud, such as fluid levels, tire pressure, brake wear, and the current track being played by the infotainment system. It even allows the driver to remotely start or stop the engine, open or close windows, and so on:



The awesome (and nicely integrated) smartphone support
The Bentley also showcases how the QNX CAR Platform enables advanced integration with popular smartphones. For instance, the car can communicate with a smartphone to stream music, or to provide notifications of incoming email, news feeds, and other real-time information — all displayed in a manner appropriate to the automotive context. Here's an example:



The awesome everything else
I’ve only scratched the surface of what the car can do. For instance, it also provides:

• Advanced voice rec — Just say “Hello Bentley,” and the car’s voice recognition system immediately comes to life and begins to interact with you — in a British accent, of course.
   
• Advanced multimedia system — Includes support for Internet radio.
   
• Video conferencing with realistic telepresence — Separate cameras for the driver and passenger provide independent video streams, while fullband voice technology from QNX offers expanded bandwidth for greater telepresence.
   
• LTE connectivity — The car features an LTE radio modem, as well as a Wi-Fi hotspot for devices you bring into the car.

Moving pictures
Okay, time for some video. Here's a fun look at the making of the car:



And here's a run-through of the car's many capabilities, filmed by our friends at TI during 2013 CES:

Is this the most jazzed-up Jeep ever to hit CES?

The fourth installment in the CES Cars of Fame series. Our inductee for this week: a Jeep that gets personal.

Paul Leroux

It might not be as hip as the Prius or as fast as the Porsche. But it's fun, practical, and flexible. Better yet, you can drive it just about anywhere. Which makes it the perfect vehicle to demonstrate the latest features of the QNX CAR Platform for Infotainment.

It's called the QNX reference vehicle, and it's been to CES in Las Vegas, as well as to Detroit, New York City, and lots of places in between. It's our go-to vehicle for whenever we want to hit the road and showcase our latest infotainment technology. It even made a guest appearance at IBM's recent Information On Demand 2013 Big Data conference, where it demonstrated the power of connecting cars to the cloud.

The reference vehicle, which is based on a Jeep Wrangler, serves a different purpose than our technology concept cars. Those vehicles take the QNX CAR Platform as a starting point to demonstrate how the platform can help automakers hit new levels of innovation. The reference vehicle plays a more modest, but equally important, role: to show what our the platform can do out of the box.

For instance, we updated the Jeep recently to show how version 2.1 of the QNX CAR Platform will allow developers to blend a variety of application and HMI technologies on the same display. In this case, the Jeep's head unit is running a mix of native, HTML5, and Android apps on an HMI built with the Qt application framework:



Getting personal
We also use the Jeep to demonstrate the platform's support for customization and personalization. For instance, here is the first demonstration instrument cluster we created specifically for the Jeep:



And here's a more recent version:



These clusters may look very different, but they share the same underlying features, such as the ability to display turn-by-turn directions, weather updates, and other information provided by the head unit.

Keeping with the theme of personalization, the Jeep also demonstrates how the QNX CAR Platform allows developers to create re-skinnable HMIs. Here, for example, is a radio app in one skin:



And here's the same app in a different skin:



This re-skinnability isn't just cool; it also demonstrates how the QNX CAR Platform can help automotive developers create a single underlying code base and re-use it across multiple vehicle lines. Good, that.

Getting complementary
The Jeep is also the perfect vehicle to showcase the ecosystem of complementary apps and services integrated with the QNX CAR Platform, such as the (very cool) street director navigation system from Elektrobit:



To return to the question, is this really the most jazzed-up Jeep to hit CES? Well, it will be making a return trip to CES in just a few weeks, with a whole new software build. So if you're in town, drop by and let us know what you think.

A Porsche you could talk to

The third installment in the CES Cars of Fame series. Our inductee for this week: a very connected Porsche 911.

Paul Leroux

I have a confession to make. The day before QNX Software Systems unveiled this technology concept at car at 2012 CES, I leaked the news on the On Q blog. Mind you, the leak was unintentional. I had been editing a post that described the car and, instead of hitting Save, I hit Publish by mistake. Dumb, I know.

I immediately took down the post and informed my colleagues of the error. Fortunately, my RSS feed didn't give me away, and the launch, which had been strictly under wraps, went ahead as planned. But boy, did I feel stupid.

Now that I've got that off my chest, let's see what the hubbub was about. The car, based on a Porsche 911 Carrera, came equipped with an array of features built by the QNX concept team, including one-touch smartphone pairing, high-definition hands-free calls, rear-seat entertainment, and a digital instrument cluster.

So, you ready for a tour?

The car
Let's start with the exterior. Because man, what an exterior:



The instrument cluster
Once you got behind the wheel, the first thing you saw was the instrument cluster. But
this was no ordinary cluster. It could dynamically reconfigure itself — in response to voice commands, no less. It could even communicate with the navigation system to display turn-by-turn directions. And it was designed to honor the look-and-feel of the stock 911 cluster:



The head unit
To your right, you could see the head unit. Here is the unit's main screen, from which you could access all of the system's key functions:



And here's another screen, showing the system's media player:



The front-seat control of backseat infotainment
The Porsche also showcased how a head unit could offer front-seat control of backseat entertainment — perfect for when you need to control what your kids are watching or listening to:



The voice recognition
The Porsche was outfitted with cloud-based voice recognition, which let you enter navigation destinations naturally, without having to use artificial grammars. Check out this Engadget clip, taken at an AT&T event in New York City:



The car also included features that neither words nor pictures can capture adequately. But let me try, anyway:

One-touch Bluetooth pairing — Allowed you to pair a phone to the car simply by touching the phone to an NFC reader embedded in the center console; no complicated menus to wade through.

Text-to-speech integration — Could read aloud incoming emails, text messages, and BBM messages.

High-definition voice technology — Used 48KHz full stereo bandwidth for clear, high-fidelity hands-free calls.

The car also ran a variety of apps, including TCS hybrid navigation, Vlingo voice-to-text, Poynt virtual assistant, Weather Network, and streaming Internet radio from Pandora, Nobex, Slacker, and TuneIn.

The point
The point of this car wasn't simply to be cool, but to demonstrate what's possible in next-gen infotainment systems. More specifically, it was designed to showcase the capabilities of the QNX CAR Platform for Infotainment. In fact, it did such a good job on that count that the platform took home the 2012 CES Best of Show award, in the car tech category:

Cyber security and connected cars

What does cyber security mean, what does it affect, why is it becoming critical, and what can you do about it? Those were some of the questions I addressed in a recent webcast on automotive cyber security, hosted by SAE International. I represented the software side of things and was accompanied by my hardware colleagues Richard Soja and Jeffrey Kelley, who work at Freescale and Infineon respectively.

I’ve hosted webinars on a variety of automotive and embedded software topics, but none with such an impressive range of participants. We had people from government organizations of several countries, not to mention automakers, tier 1 and tier 2 auto suppliers, telematics companies, mobile developers, concerned individuals, and even utility companies. And the range of questions and comments was equally diverse — from specific insights about elliptical encryption to sweeping “how does this affect society” musings.

My key takeaway: QNX isn’t alone in its concern for automotive cyber security. We have years of experience in building secure trusted systems and we’re excited to help customers build tomorrow’s secure cars. Nice thing is, the rest of the world is starting to get on board as well.

If you're interested, you can download the archived version of the webinar.

More QNX-powered cars and infotainment systems from 2011 CES

The second installment in our CES Cars of Fame series. Today, we look at several systems from the 2011 CES event, starting with this week's inductee, a BMW Z4.

Paul Leroux

I've led you astray — sort of. Last week I stated that the LTE Connected Car, the first QNX-powered technology concept car, appeared at 2011 CES. But I didn't mention that QNX technology was at the core of several other innovative vehicles and infotainment systems at CES that year.

So let me set the record straight. And the best place to start is the QNX booth at 2011 CES, where a BMW Z4 roadster was the front-and-center attraction.

BMW Z4 Roadster with ConnectedDrive
The Z4 wasn't a technology concept car, but a true production car straight off the dealer lot. It was equipped with the QNX-based BMW ConnectedDrive system, which offers real-time traffic information, automatic emergency calling, and a text-to-speech feature that can read aloud emails, appointments, text messages, and other information from Bluetooth smartphones. It's a cool system right at home in this equally cool cockpit:



Heck, the whole car was cool, from the wheels up:



Audi A8 with Google Earth
Mind you, the coolness didn't stop at the QNX booth. Just down the hall, Audi showcased an A8 sedan equipped with the QNX-based 3G MMI infotainment system, featuring Google Earth. This same model drove home with the 2011 Edmunds Breakthrough Technology award a short while later.

I don't have any photos of the Audi from the CES show floor, but if you head over to the On Q blog, you can see some snaps from an automotive event that QNX hosted in Stuttgart two months earlier. The photos highlight the A8's innovative touchpad, which lets you input destination names by tracing them with your finger.

Toyota Entune infotainment system
And now to another award-winning QNX-based system. Toyota Entune embraces a simple, yet hard-to-achieve concept: help drivers interact with mobile content and applications in a non-distracting, handsfree fashion. For instance, if you are searching for a nearby restaurant, Entune lets you ask for it in a conversational fashion; no need for specific voice commands.

You could tell the judges for the CNET Best of CES awards were impressed, because they awarded Entune first prize, in the Car Tech category — the first of three QNX-powered systems to do. QNX Software Systems went on to win in 2011 for its QNX CAR Platform and then Chevy won in 2012 for its MyLink system. Not too shabby.

A cluster of clusters
We've looked at just three of the many QNX-based automotive systems showcased at 2011 CES. For instance, QNX also demonstrated digital instrument clusters built by Visteon for the Land Rover Range Rover and for the Jaguar XJ sedan, below:



Freescale, NVIDIA, TeleNav, and Texas Instruments also got into the act, demonstrating QNX systems in their booths and meeting areas.

Do you have any memories of 2011 CES? I'd love to hear them.

The first-ever QNX technology concept car to hit CES

Paul Leroux

I bet you thought it was the Porsche. Or perhaps even the Bentley. But no, the first QNX-powered technology concept car to appear at CES was a digitally modded Prius — aka the LTE Connected Car. In fact, the car appeared at two CES shows: 2010 and 2011.

If you've never heard of the LTE Connected Car, it was a joint project of several companies, including QNX Software Systems and Alcatel-Lucent. The project members wanted to demonstrate how 4G/LTE networks could transform the driving experience and enable a host of new in-vehicle applications. This kind of thinking of may seem like old hat today, but when the car was created, telecom companies had yet to light up their first commercial LTE towers. The car was definitely ahead of its time.

One of the four infotainment
systems in the LTE Connected Car

Almost everyone saw the entertainment potential of equipping a car with a 4G/LTE broadband connection — the ability to access your favorite music, applications, videos, or social media while on the road had immediate appeal. But many people also saw the other value proposition this car presented: the ability for vehicles to continuously upload information they have gathered about themselves or surrounding road conditions, providing, in the words of WIRED's Eliot Van Buskirk, "a crowd-sourced version of what traffic helicopters do today." Awesome quote, that.

QNX provided the software foundation for the LTE Connected Car, including the OS, touchscreen user interfaces, media players for YouTube and Pandora, navigation system, Bluetooth connectivity, games, and handsfree integration. But why am I blabbing on about this when I could show you? Cue the screen captures...

Google local search
First up is Google local search, which displayed local points of interest to help drivers and passengers find nearby restaurants, gas stations, movie theaters, ATMs, hospitals, and so on. And because this was an LTE-enabled car, the system could fetch these POIs from a cloud-based database:



Pandora Internet radio
For those who prefer to listen to what they like, and nothing else, the car also came with a Pandora app:



Home monitoring and control
Are you the kind of person who forgets to engage the burglar alarm before going to work? If so, the car's home automation app was just the ticket. It could let you manage home systems, such as lights and thermostats, from any of the car’s touchscreens — you could even view a live video feed from home security cameras:



Vehicle diagnostics
Now this is my favorite part. If you look below, you'll see the car's main screen for accessing vehicle diagnostics. At the upper right is the virtual mechanic app, which retrieved OBD-II codes from the vehicle bus to display the status of your brakes, tires, power train, electrical systems, fluids, and so on. (The current QNX CAR Platform for Infotainment includes an updated version of this app.)



Low oil pressure... yikes!
The virtual mechanic wouldn't fix your car for you. But it could tell you when things were going south and help you take appropriate action — before the problem escalated. In this case, it's saying that the engine oil pressure is low:



What to do? Well, if you were mechanically challenged, you could tap the fuel pump icon at the bottom of the screen to display a map of local service stations. Or you could tap on the dealership icon (Toyota, in this case) and find directions to the nearest, well, dealership:



The virtual mechanic would also let you zoom in on specific systems. For instance, in the following screen, the user has tapped the brake fluid button to learn the location of the brake fluid reservoir:



On the subject of zooming, let's zoom out for a second to see the entire car:



Moving pictures
Screen captures and photos can say only so much. For the back story on the LTE Connected Car, check out this video, which digs into the "philosophy" of the car and what the project members were working to accomplish:

---

An LTE Connected Car reader

• Scientific American — Hot Spot Hot Rod: The Internet Invades the Automobile
• Wired — Next-Gen Car Dashboard Talks to the Cloud
• Engadget — LTE Connected Car redefines the 'mobile' in mobile broadband
• John Day’s Automotive Electronic News — Alcatel-Lucent launches LTE Connected Car from QNX platform
• GIGAOM — LTE Connected Car: Dude, Where’s My Display?
• AutoSpies — Is THIS The Future Of Auto Tech?
• PCMag.com Blogs — What Do You Want in a Web-Connected Car?
• The Inquirer — Alcatel-Lucent talks up connected vehicles
• Stuff.tv — ng Connect turns Prius into living room