Abstract
Existing definitions and associated conceptual frameworks for computer-basedsystem safety should be revisited in light of real-world experiences fromdeploying autonomous vehicles. Current terminology used by industry safetystandards emphasizes mitigation of risk from specifically identified hazards,and carries assumptions based on human-supervised vehicle operation. Operationwithout a human driver dramatically increases the scope of safety concerns,especially due to operation in an open world environment, a requirement toself-enforce operational limits, participation in an ad hoc sociotechnicalsystem of systems, and a requirement to conform to both legal and ethicalconstraints. Existing standards and terminology only partially address thesenew challenges. We propose updated definitions for core system safety conceptsthat encompass these additional considerations as a starting point for evolvingsafe-ty approaches to address these additional safety challenges. These resultsmight additionally inform framing safety terminology for other autonomoussystem applications.