Autonomous vehicles will soon be safer than humans, and some already are, according to a report from IDTechEx.

“The promise of autonomous vehicles has been a long time coming,” said report author James Jeffs, senior technology analyst at IDTechEx. “While many are still waiting to see the fruits of all this work, there are some cities like Arizona and San Francisco where autonomous cars are starting to become a reality.”

The report Autonomous Cars, Robotaxis & Sensors 2024-2044 (www.idtechex.com/en/research-report/autonomous-cars-robotaxis-and-sensors-2024-2044/953) predicts a coming rapid growth in the number of cities that will offer robotaxi services in the next few years. But are they safe enough?

This year, the robotaxi industry saw more commercialisation activity, with Waymo and Cruise being given the green light by the California Public Utilities Commission (CPUC) to expand their commercial services in San Francisco. But only weeks after that announcement, San Francisco has seen protests around the deployment of autonomous vehicles, and California DMV has halved the number of vehicles that Cruise is permitted to have in testing.

Some inhabitants of San Francisco are becoming disenfranchised with the city’s perpetual status as a proving ground for this technology, with a group called Safe Street Rebel leading the protests. Their disruption mechanism is called coning and involves placing a traffic cone on the bonnet of autonomous vehicles, rendering it inoperable until the cone is removed, a somewhat embarrassing situation considering all the technology.

However, Waymo claims on its web site that it outperforms human drivers when mitigating and avoiding collisions.

Autonomous vehicle safety is an area that IDTechEx’s autonomous vehicle experts have tracked closely as autonomous car testing has proliferated. IDTechEx uses data from the California DMV to understand how autonomous vehicles are performing and improving over the years. When assessing the safety of autonomous vehicles, several metrics can be considered: how many testing kilometres has each company amassed, how often does the safety driver need to intervene with the autonomous system, and how often does the autonomous system cause a crash?

A key metric IDTechEx uses to monitor autonomous vehicle safety is distance per disengagement. This measures how frequently or infrequently the autonomous vehicle safety driver needs to intervene with the autonomous system. IDTechEx has measured this since 2015 and has seen exponential growth in the performance of autonomous vehicles.

Back in 2015, Waymo recorded 424,000 miles of autonomous testing, during which its safety drivers disengaged the system 341 times, meaning there was an average of approximately 1200 miles between disengagements. Waymo was the best company by this metric that year. For reference, IDTechEx estimates human drivers in the USA average approximately 200,000 miles between collisions. If it is assumed each of Waymo’s disengagements would lead to a collision, which is slightly unfair against the autonomous driver, then it would be around 0.5% as safe as a human driver.

However, the autonomous vehicle industry has made significant progress since then. In fact, IDTechEx has since seen the number of miles per disengagement nearly doubled year on year.

In 2022, Cruise was the leader when it came to disengagement performance, with a score of about 96,000 miles per disengagement, nearly 50% as safe as humans. During its 863,000 miles of testing, safety drivers only needed to intervene with the system nine times.

The report looked closely at the disengagements and collisions in which autonomous vehicles were involved and found four out of the nine disengagements were caused by the poor performance of other nearby drivers. If these are removed from the equation, then Cruise’s miles per disengagement score shoots up to over 170,000, 85% of the way to the rate at which humans have collisions.

Miles per disengagement is only a proxy for autonomous vehicle safety, though. Since a safety driver has intervened, it is impossible to know whether the car would have collided or not. Instead, perhaps the number of collisions autonomous vehicles are involved in should be considered.

Between January 2019 and May 2023, the autonomous vehicle companies testing across California submitted more than 450 collision reports. These reports cover a wide range of collision types, from collisions with other vehicles to hitting kerbs and even the vehicles being attacked by pedestrians. As part of the research, analysts have read and analysed each of these reports, finding only 3.4% of collisions could be attributed to the poor performance of the autonomous system. Another way to look at it is that in 2022, the autonomous driver would cause collisions at a rate of one collision per 1.3 million miles, significantly better than human drivers. But this is with a human behind the wheel monitoring the system. What about when the system has no human safety net? How much do they collide then?

Since 2020, California has allowed driverless autonomous testing on its streets, and two companies have taken advantage of this – Waymo and Cruise. Between 2021 and 2022, Waymo recorded just under 70,000 miles of driverless activity. Cruise only started recording driverless miles in 2022 but submitted 590,000 miles. During those, the vehicles were involved in 15 collisions, that is one collision every 40,000 miles, or five times more often than their human counterparts.

These miles were exclusively accumulated in San Francisco, one of the toughest driving environments in the USA for autonomous systems, but also tough for humans. With the slower speeds and increased pedestrian presence, IDTechEx estimates the collision rate among human drivers increases from one per 200,000 miles (the US average across all road types) to one in every 107,000 miles, only half as good, but still better than autonomous drivers.

Of those 450+ collisions recorded by the companies testing autonomous cars, none involved a major injury or death. In the four years of testing, from 2019 to 2022, that is nearly 14 million miles without a serious injury or fatality. NHTSA says with human drivers, a fatality happens roughly once per 75 million miles of human driving.

“So autonomous vehicles still have a way to go to catch up, but it is looking promising,” said Jeffs. “Whether you look at miles per disengagement, miles per collision or miles per fatality, humans still have a better track record than autonomous vehicles. However, human safety has been fairly stagnant. The rate at which we crash is not changing that much, and further improvement is mostly coming from crash mitigation technology, such as automatic emergency braking systems and blind spot detection. One thing that can be said for autonomous vehicles is that their safety has been improving at somewhat of an exponential rate, something that humans are very unlikely to mimic.”

IDTechEx says it does not believe autonomous vehicles are as safe as humans yet, nor are they ready for widespread unsupervised deployment. The rate of improvement autonomous technologies has shown demonstrates there is the potential for them to far exceed human levels of safety in the future, leading towards a world in which people stop questioning whether autonomous cars are ready and start questioning whether human drivers are safe enough.

To find out more, visit www.IDTechEx.com/autonomouscars.