HeadlinesBriefing favicon HeadlinesBriefing.com

Automation Complacency: The Hidden Danger of Self-Driving Cars

New York Times Business •
×

Self-driving systems are becoming increasingly capable, but experts warn that their very reliability may lead to automation complacency, where drivers overestimate the technology and fail to pay attention. This was tragically demonstrated when Kyle Shanahan, head coach of the San Francisco 49ers, crashed his Tesla in Palo Alto, Calif., after dropping his phone and assuming the system would handle driving. The system, relying on cameras, was reportedly not engaged, leading to a serious accident.

Automakers like Tesla, Rivian, General Motors, Ford Motor, and Hyundai are developing advanced driver-assistance systems that allow hands-free driving on certain roads, with the ultimate goal of fully autonomous vehicles. Tesla has even begun offering paid rides in its Cybercab, which lacks a steering wheel or brake pedals, though it is not yet legal for individual sale. The Trump administration is working on new regulations to facilitate the widespread adoption of such vehicles, driven partly by competition with Chinese companies.

These automated features are a significant revenue stream, with Tesla charging $99 a month for its Full Self-Driving (Supervised) service, which had 1.5 million active subscriptions in the second quarter. However, no current systems are designed to drive fully independently, and unlike Waymo’s driverless taxis, they require drivers to be ready to intervene. Experts like Ann Carlson, a former federal auto safety regulator and now a professor at the U.

C. L. A.

School of Law, point out the irony that as the technology improves, it may become more dangerous unless it is flawless. Guy Mangiamele of AMCI Testing notes that while Tesla has made amazing progress, the software will eventually make a mistake, and if drivers are not fully aware, they become a danger to others.