<\/p>\n
Milton Keynes, England \u2013 Autonomous vehicle (AV) start-ups have raised tens of billions of dollars based on promises to develop truly self-driving cars, but industry executives and experts say remote human supervisors may be needed permanently to help robot drivers in trouble. <\/p>\n
The central premise of autonomous vehicles \u2013 that computers and artificial intelligence will dramatically reduce accidents caused by human error \u2013 has driven much of the research and investment. <\/p>\n
But there is a catch: Making robot cars that can drive more safely than people is immensely tough because self-driving software systems simply lack humans\u2019 ability to predict and assess risk quickly, especially when encountering unexpected incidents or \u201cedge cases.\u201d<\/p>\n
\u201cWell, my question would be, \u2018Why?’\u201d said Kyle Vogt, CEO of Cruise, a unit of General Motors, when asked if he could see a point where remote human overseers should be removed from operations. \u201cI can provide my customers peace of mind knowing there is always a human there to help if needed,\u201d Vogt said. \u201cI don\u2019t know why I\u2019d ever want to get rid of that.\u201d<\/p>\n
This is the first time Cruise has acknowledged the long-term need for remote human operators. GM recalled and updated software in 80 Cruise self-driving vehicles this month after a June crash in San Francisco left two people injured. US safety regulators said the recalled software could \u201cincorrectly predict\u201d an oncoming vehicle\u2019s path, and Cruise said the unusual scenario would not recur after the update. <\/p>\n
For some, the idea that human supervisors could be here to stay raises more doubts about the technology. <\/p>\n
Truly autonomous vehicles are far behind the optimistic rollout schedules predicted just a few years ago. <\/p>\n
In 2018, GM sought US government approval for a fully autonomous car without a steering wheel, brake or accelerator pedals that would enter its commercial ride-sharing fleet in 2019. That vehicle, the Cruise Origin, now is not slated to begin production until spring 2023, Vogt said.<\/p>\n
In 2019, Tesla CEO Elon Musk promised a million robotaxis \u201cnext year for sure\u201d \u2013 though his company\u2019s \u201cFull Self Driving\u201d offering has been criticised because its cars are not capable of driving themselves without a human behind the wheel and ready to take manual control in an emergency. <\/p>\n In a June interview on YouTube, Musk said developing self-driving cars was \u201cway harder than I originally thought, by far.\u201d But when asked for a timeline, he said Tesla could make it \u201cthis year.\u201d<\/p>\n The undelivered promise of true autonomy has raised the stakes for the AV industry. <\/p>\n \u201cIf these companies don\u2019t succeed over the next two years, they\u2019re not going to exist anymore,\u201d said Mike Wagner, CEO of Edge Case Research, which helps AV companies assess, manage and insure risk. \u201cIt\u2019s a case of put up or shut up at this point.\u201d <\/p>\n Remote humans watching<\/strong><\/p>\n Many AV start-ups today use humans as remote supervisors, alongside safety drivers sitting behind the wheel.<\/p>\n Those remote humans are an additional expense, but help self-driving cars handle edge cases. These could include something as basic as an unfamiliar set of lane closures during road construction, or erratic, unpredictable behaviour by pedestrians or human drivers. <\/p>\n When a robot driver encounters an edge case, \u201cit puts its hands up and says, \u2018I don\u2019t know what\u2019s going on,’\u201d said Koosha Kaveh, CEO of Imperium Drive, which is using humans as remote operators for cars in the English city of Milton Keynes. Over time, those people will act as \u201cair traffic controllers,\u201d supervising a growing number of autonomous cars.<\/p>\n Cruise\u2019s Vogt says the company\u2019s AVs on the roads in San Francisco currently rely on humans less than 1% of the time. But across hundreds, thousands or even millions of AVs, that would add up to a significant amount of time stopped on the road waiting for human guidance. <\/p>\n Imperium Drive\u2019s Kaveh said as more self-driving cars \u2013 which are more predictable than humans \u2013 hit the roads the number of edge cases will drop, \u201cbut you will never get to zero edge cases.\u201d <\/p>\n \u201cEven decades from now you will not get to 100% truly autonomous vehicles,\u201d Kaveh added. <\/p>\n Rush to market<\/strong><\/p>\n Autonomous systems are not as capable as people because their \u201cperception and prediction algorithms are not as good as how a human brain processes and decides,\u201d said Chris Borroni-Bird, an independent consultant who previously led advanced-vehicle programs at GM and Waymo.<\/p>\n For instance, a human when seeing a ball roll into the road \u2013 harmless by itself \u2013 will assume it could be followed by a child and hit the brakes far quicker than an AV, Borroni-Bird said.<\/p>\n \u201cI am concerned that AV companies will rush to market without proving the safety is better than human-driven vehicles,\u201d he added.<\/p>\n In its track tests for cars, AB Dynamics employs a robot arm that it plans to retrofit on slow-moving mining and agricultural trucks to make them largely autonomous.<\/p>\n Routh envisages a remote team of humans supervising fleets of, for instance, self-driving mining trucks operating in closed environments. <\/p>\n He does not see that scenario working for vehicles in faster, more open environments because it could be difficult for remote human supervisors to react quickly enough to dangers.<\/p>\n Within the next 12 months, British online food delivery and technology company Ocado Group Plc will roll out a small fleet of driverless delivery vehicles with autonomous vehicle software startup Oxbotica \u2013 backed by remote human supervisors \u2013 that will operate on just a few streets on set routes in a small UK city and never drive at speeds above 48km\/h.<\/p>\n \u201cAt 30 miles an hour, if a vehicle panics, it can hit the emergency brake and seek help,\u201d Ocado\u2019s head of advanced technology, Alex Harvey, said. \u201cThis feels like a very viable strategy at low speed.\u201d <\/p>\n \u201cBut you can\u2019t play that game on a motorway,\u201d Harvey added, because hard stops in edge cases would pose a safety risk.<\/p>\n Harvey said it should take around five years for Ocado to develop a profitable driverless delivery system. <\/p>\n Related video:<\/p>\n