Mitsubishi Electric Lab Applying Computer Vision to Driverless Cars

Add Mitsubishi Electric’s North American research group to the list of companies working on driverless car technologies in Cambridge, MA. The area around MIT has quickly asserted itself as one of the hotbeds of this emerging and increasingly competitive field.

Toyota Research Institute and MIT startup NuTonomy are among the local players who have made splashy announcements this year. Meanwhile, the autonomous driving initiative at Mitsubishi Electric Research Laboratories (MERL) has flown under the radar. The storied corporate research and development outfit is celebrating its 25th anniversary, and Xconomy recently visited its office near Kendall Square to learn more about its driverless car project and other endeavors.

MERL’s team of 63 researchers conduct basic research and advanced development for a variety of technologies in algorithms, electronics and communications, multimedia, data analytics, computer vision, and mechatronics. It’s an open lab that publishes papers and collaborates with outside research organizations, but it’s ultimately charged with advancing technology that might benefit MERL’s parent company, Japan-based Mitsubishi Electric. The manufacturing giant—which is separate from carmaker Mitsubishi Motors—produces automotive equipment, air conditioners, factory automation systems, network and satellite communications products, semiconductors, and more.

Driverless car systems are a new area of focus for Mitsubishi Electric. Part of its strategy involves taking the sensors and other equipment it developed for air-to-air missiles for the Japanese military, and repurposing that technology to help self-driving cars navigate obstacles, Bloomberg recently reported. Those products would reportedly hit the market by 2020.

At MERL, “we’ve been formally working on something with the title of automated driving for just a couple years,” president and CEO Richard Waters says. But, he adds, his organization has been making advances in computer vision—crucial to enabling self-driving vehicles—for about 20 years. One example is face-detection software research by Paul Viola and Michael Jones published in 2004, which MERL says has influenced smartphone cameras and photo organization software.

Around 10 to 15 percent of MERL’s research efforts are dedicated to driverless car technology, Waters says. He wouldn’t share many details about the work, but he says it’s focused on software that can quickly detect objects, plan a car’s maneuvers, and direct its actions.

Driverless car efforts by Google and others are dependent on the quality of the map and GPS data available, Waters says. The problem is that if the car enters “a dirt road in Idaho that’s not on Google’s map,” then it’s in trouble, Waters says.

Richard Waters
Richard Waters

“We’re working on [getting to] where a car can actually see well enough to drive without a map,” Waters says. “And this is a lot easier to say than to do.”

The key to good performance is accurate and lightning-fast computer vision software. The car must “be able to see you in a tenth of a second so I don’t ride over you,” Waters says.

The stakes may be higher with driverless cars, but these are the same sorts of problems MERL has been trying to solve in other areas. It has developed algorithms to make Mitsubishi Electric laser cutters operate more efficiently, Waters says. MERL also developed software for particle beam therapy machines that can speed up the process of planning a cancer treatment procedure.

“Algorithms that are doing that are the tail that is wagging the dog,” Waters says. “By making those algorithms better, it makes that piece of equipment much more valuable than it otherwise would be.”

Over the years, MERL made a name for itself with advances in collaborative computer interfaces, digital audio, digital typography, computer graphics, image recognition, and other areas. Time will tell if it can make any significant contributions to driverless car systems. This might require a long slog of methodical progress for the research group—and the overall field.

“I think we are in the midst of a phased introduction” of driverless car technologies, Waters says. He points to

Author: Jeff Bauter Engel

Jeff, a former Xconomy editor, joined Xconomy from The Milwaukee Business Journal, where he covered manufacturing and technology and wrote about companies including Johnson Controls, Harley-Davidson and MillerCoors. He previously worked as the business and healthcare reporter for the Marshfield News-Herald in central Wisconsin. He graduated from Marquette University with a bachelor degree in journalism and Spanish. At Marquette he was an award-winning reporter and editor with The Marquette Tribune, the student newspaper. During college he also was a reporter intern for the Muskegon Chronicle and Grand Rapids Press in west Michigan.