Link to this page: https://users.ece.cmu.edu/~koopman/EmbodiedAI/
If a link is dead, try it through the Wayback Machine here: https://archive.org/

Koopman, P., Embodied AI Safety: Reimagining safety engineering for artificial intelligence in physical systems, August 2025.
ISBN: 9798292384410 Trade Paperback
ISBN: 9798292384618 Hardcover
ASIN: e-book available

Book description link: https://philkoopman.substack.com/p/my-new-book-embodied-ai-safety
Author home page with more resources: https://users.ece.cmu.edu/~koopman/

Footnotes:

  1. Koopman, 2022: https://safeautonomy.blogspot.com/2022/09/book-how-safe-is-safe-enough-measuring.html
  2. https://en.wikipedia.org/wiki/Ninety%E2%80%93ninety_rule
  3. Lay et al., 1996: https://rosap.ntl.bts.gov/view/dot/38381
  4. Thorpe, Jochem & Pomerleau, 1997: https://www.ri.cmu.edu/pub_files/pub2/thorpe_charles_1997_1/thorpe_charles_1997_1.pdf
  5. Bishop, Dopart & Shladover 1997: https://web.archive.org/web/20221008220719/https://path.berkeley.edu/sites/default/files/demo97foravs17v6.pdf
  6. https://www.nrec.ri.cmu.edu/
  7. https://youtu.be/DKHa7rxkvK8
  8. Koopman et al. 2019: https://users.ece.cmu.edu/~koopman/pubs/Koopman19_WAISE_UL4600.pdf
  9. https://users.ece.cmu.edu/~koopman/ul4600/index.html
  10. https://www.youtube.com/live/-um7LWAEUTY?feature=share&t=2140
  11. https://philkoopman.substack.com/p/winter-2024-reading-and-viewing
  12. ...
  13. https://en.wikipedia.org/wiki/Embedded_system
  14. https://en.wikipedia.org/wiki/Safety-critical_system
  15. ...
  16. ...
  17. ...
  18. Prem, 1996: https://cdn.aaai.org/Symposia/Fall/1996/FS-96-02/FS96-02-021.pdf
    Brooks, 1991: https://people.csail.mit.edu/brooks/papers/representation.pdf
    https://en.wikipedia.org/wiki/Roomba
  19. https://en.wikipedia.org/wiki/History_of_artificial_intelligence
  20. https://en.wikipedia.org/wiki/Neural_network_(machine_learning)
  21. https://quoteinvestigator.com/2024/06/20/not-ai/
  22. ...
  23. ...
  24. https://en.wikipedia.org/wiki/System_safety
  25. https://philkoopman.substack.com/p/the-cruise-pedestrian-dragging-mishap
  26. Barmann, 2023: https://sfist.com/2023/04/07/gm-now-recalling-300-cruise-robocars-following-crash-into-muni-bus/
  27. ...
  28. ...
  29. ...
  30. https://en.wikipedia.org/wiki/Concept_of_operations
  31. ...
  32. ...
  33. https://en.wikipedia.org/wiki/Transformer_(deep_learning_architecture)
  34. ...
  35. ...
  36. https://www.goodreads.com/quotes/98951-here-s-a-phrase-that-apparently-the-airlines-simply-made-up
  37. Singer, 2022: https://jessiesinger.com/book.html
  38. https://users.ece.cmu.edu/~koopman/ul4600/index.html
  39. ...
  40. https://en.wikipedia.org/wiki/Automotive_Safety_Integrity_Level
  41. ...
  42. https://www.tortmuseum.org/ford-pinto/
    https://www.autosafety.org/ford-pinto-fuel-tank/
    https://en.wikipedia.org/wiki/Ford_Pinto
  43. ...
  44. ...
  45. https://en.wikipedia.org/wiki/General_Motors_ignition_switch_recalls
  46. ...
  47. https://en.wikipedia.org/wiki/Byzantine_fault
  48. https://safeautonomy.blogspot.com/2025/03/safety-architecture-redundancy-patterns.html
  49. https://en.wikipedia.org/wiki/N-version_programming
  50. ...
  51. ...
  52. https://en.wikipedia.org/wiki/Five_stages_of_grief
  53. ...
  54. https://youtu.be/JM26WB-a-f8&t=105
  55. ...
  56. https://en.wikipedia.org/wiki/DO-178C
  57. https://en.wikipedia.org/wiki/ISO_26262
  58. ...
  59. ...
  60. https://en.wikipedia.org/wiki/Automotive_Safety_Integrity_Level
  61. ...
  62. ...
  63. ...
  64. https://en.wikipedia.org/wiki/There_are_unknown_unknowns
  65. https://en.wikipedia.org/wiki/Factor_of_safety
  66. https://en.wikipedia.org/wiki/Defence_in_depth_(non-military)
  67. https://quoteinvestigator.com/2018/04/14/theory/
  68. https://en.wikipedia.org/wiki/Maneuvering_Characteristics_Augmentation_System
  69. ...
  70. https://www.wardsauto.com/software-defined-vehicles/software-related-recalls-and-the-auto-industry-s-ongoing-evolution
  71. https://arxiv.org/abs/2009.05801
  72. https://www.theregister.com/2023/04/06/can_injection_attack_car_theft/
  73. https://en.wikipedia.org/wiki/Information_security#Key_concepts
  74. https://codecurmudgeon.com/wp/iot-hall-shame/
  75. https://en.wikipedia.org/wiki/Murphy's_law
  76. https://en.wikipedia.org/wiki/Cyberattack
  77. https://en.wikipedia.org/wiki/Threat_(computer_security)
  78. Amos, 2025: https://www.riskandresiliencehub.com/how-hackers-are-targeting-embedded-systems/
  79. https://en.wikipedia.org/wiki/Ransomware
  80. https://en.wikipedia.org/wiki/Attack_surface
  81. https://en.wikipedia.org/wiki/Malvertising
  82. https://www.wired.com/2015/07/hackers-remotely-kill-jeep-highway/
  83. https://en.wikipedia.org/wiki/Vehicle-to-everything
  84. Abdallah et al., 2010: https://doi.org/10.1109/JPROC.2009.2036747
  85. https://en.wikipedia.org/wiki/Man-in-the-middle_attack
  86. https://en.wikipedia.org/wiki/On-board_diagnostics#OBD-II
  87. Buscemi et al., 2023: https://ieeexplore.ieee.org/document/10092880
  88. Mena, 2022: https://www.thesun.co.uk/motors/20392789/drivers-warned-about-shocking-car-theft-trend-takes-seconds/
  89. Cox, 2015: https://www.wired.com/2015/09/hack-brief-malware-sneaks-chinese-ios-app-store/
  90. Woodard, 2025: https://www.msn.com/en-us/autos/self-driving-cars/tesla-in-self-drive-mode-hit-by-train-after-turning-onto-train-tracks/ar-AA1GTb9g
  91. Barrett, 2020: https://www.wired.com/story/99-phones-fake-google-maps-traffic-jam/
  92. https://youtu.be/tnY7UVyaFiQ
  93. https://en.wikipedia.org/wiki/Deniable_encryption
  94. Ackerman, 2017: https://spectrum.ieee.org/slight-street-sign-modifications-can-fool-machine-learning-algorithms
  95. https://en.wikipedia.org/wiki/Air_gap_(networking)
  96. https://en.wikipedia.org/wiki/Stuxnet
  97. Cimpanu, 2018: https://www.bleepingcomputer.com/news/security/heres-a-list-of-29-different-types-of-usb-attacks/
  98. ...
  99. https://en.wikipedia.org/wiki/Denial-of-service_attack
  100. Jeans & De Puy Kamp, 2018: https://www.nytimes.com/2018/05/13/business/deadly-convenience-keyless-cars-and-their-carbon-monoxide-toll.html
    Greenberg, 2019: https://www.wired.com/story/mycar-remote-start-vulnerabilities/
  101. https://en.wikipedia.org/wiki/Authentication
  102. ...
  103. https://en.wikipedia.org/wiki/Public_key_infrastructure
    https://hackread.com/24-hacked-traffic-sigh-boards/
  104. ...
  105. Cesari, 2024: https://www.motorbiscuit.com/fake-cop-trick-urban-legend/
  106. Hawkins, 2025: https://www.theverge.com/tesla/631308/mark-rober-tesla-youtube-autopilot-lidar-fake-claims
  107. ...
  108. https://en.wikipedia.org/wiki/Buffer_overflow
  109. https://en.wikipedia.org/wiki/Digital_signature
  110. https://en.wikipedia.org/wiki/The_Princess_Bride_(film)
  111. https://www.dependability.org/?page_id=53
  112. https://nvd.nist.gov/
  113. Zhao et al., 2025: https://dl.acm.org/doi/10.1145/3729420
  114. https://en.wikipedia.org/wiki/Intelligent_agent
  115. ...
  116. https://en.wikipedia.org/wiki/Algorithm
  117. https://en.wikipedia.org/wiki/Hill_climbing
    https://en.wikipedia.org/wiki/Backpropagation
  118. ...
  119. ...
  120. ...
  121. https://en.wikipedia.org/wiki/Neural_network_(machine_learning)
  122. https://xkcd.com/1838/
  123. https://en.wikipedia.org/wiki/Transformer_(deep_learning_architecture)
  124. https://en.wikipedia.org/wiki/Loss_function
  125. https://en.wikipedia.org/wiki/Overfitting
  126. https://en.wiktionary.org/wiki/cankle
  127. ...
  128. https://youtu.be/AgY0ISipmZI&t=418
  129. BBC, 2019: https://www.bbc.com/news/technology-46357004
  130. Kuehlkamp, Becke & Bowyer, 2017: https://arxiv.org/abs/1702.01304
  131. Wilson, Hoffman & Morgenstern, 2019: https://arxiv.org/pdf/1902.11097
  132. ...
  133. ...
  134. https://en.wikipedia.org/wiki/Reinforcement_learning
  135. ...
  136. https://en.wikipedia.org/wiki/Reward_hacking
  137. https://en.wikipedia.org/wiki/Generative_adversarial_network
  138. https://en.wikipedia.org/wiki/Generative_adversarial_network
    https://www.google.com/search?q=black+cat+ai+style+picasso
  139. ...
  140. ...
  141. https://en.wikipedia.org/wiki/ChatGPT
  142. Wiggers, 2025: https://techcrunch.com/2025/04/04/openais-models-memorized-copyrighted-content-new-study-suggests/
  143. https://en.wikipedia.org/wiki/It_was_a_dark_and_stormy_night
  144. https://en.wikipedia.org/wiki/Fine-tuning_(deep_learning)
    https://arstechnica.com/science/2023/07/a-jargon-free-explanation-of-how-ai-large-language-models-work/
  145. https://quoteinvestigator.com/2019/09/02/lightning/
  146. ...
  147. https://www.linkedin.com/posts/philip-koopman-0631a4116_llm-hilarity-now-im-afraid-to-go-to-sleep-activity-7200459210998841345-mD98
  148. https://en.wikipedia.org/wiki/Hallucination
  149. The Blues Brothers, 1980. https://www.quotes.net/mquote/11355
  150. Hicks, Humphries & Slater, 2024: “ChatGPT is Bullshit,” https://link.springer.com/article/10.1007/s10676-024-09775-5
  151. https://en.wikipedia.org/wiki/Confirmation_bias
  152. Graydon & Lehman, NASA/TM-20250001849: https://ntrs.nasa.gov/citations/20250001849
  153. https://waabi.ai/introducing-copilot4d/
  154. https://en.wikipedia.org/wiki/Computer_stereo_vision
  155. https://en.wikipedia.org/wiki/Lidar
    https://youtu.be/4EsrX_f3ls4
  156. Burns, 2019: https://techcrunch.com/2019/04/22/anyone-relying-on-lidar-is-doomed-elon-musk-says/
  157. Bellan 2024:https://techcrunch.com/2024/12/31/elon-musks-promises-for-tesla-in-2024-from-robotaxis-to-optimus-bots/
  158. ...
  159. Waymo 2018: https://web.archive.org/web/20181122143931/https://storage.googleapis.com/sdc-prod/v1/safety-report/Safety%20Report%202018.pdf
  160. https://waabi.ai/waabi-world/
  161. ...
  162. https://en.wikipedia.org/wiki/Tesla_Robotaxi
  163. Crider, 2022: https://www.teslarati.com/tesla-114-removing-uss/
  164. Klender, 2023: https://www.teslarati.com/tesla-improves-camera-quality-in-quest-to-solve-full-self-driving/
  165. ...
  166. ...
  167. Agatie, 2024: https://www.autoevolution.com/news/tesla-rolls-out-fsd-with-end-to-end-highway-driving-driver-profiles-to-ai4-vehicles-240972.html
  168. Deahl, 2017: https://www.theverge.com/2017/7/3/15916076/volvo-self-driving-cars-trouble-recognizing-kangaroos
    Mikkelson 1999: https://www.snopes.com/fact-check/shoot-me-kangaroo-down-sport/
  169. Madrigal, 2017: https://www.theatlantic.com/technology/archive/2017/08/inside-waymos-secret-testing-and-simulation-facilities/537648/
  170. https://waabi.ai/waabi-world/
  171. https://99percentinvisible.org/article/red-white-sometimes-blue-how-safety-shaped-the-octagonal-stop-sign/
  172. ...
  173. ...
  174. ...
  175. https://en.wikipedia.org/wiki/AI_winter
  176. Cook, “Watson, the Computer Jeopardy! Champion, and the Future of Artificial Intelligence,” Scientific American, March 1, 2011. https://www.scientificamerican.com/article/watson-the-computer-jeopa/
    Lohr, 2021, “What Ever Happened to IBM’s Watson?”, NY Times, https://www.nytimes.com/2021/07/16/technology/what-happened-ibm-watson.html
  177. Nixon, “Last of a Breed: Postal Workers Who Decipher Bad Addresses,” NY Times, May 3, 2023. https://www.nytimes.com/2013/05/04/us/where-mail-with-illegible-addresses-goes-to-be-read.html
  178. https://en.wikipedia.org/wiki/ELIZA
  179. https://en.wikipedia.org/wiki/Sophia_(robot)
  180. https://en.wiktionary.org/wiki/stupid_is_as_stupid_does
  181. ...
  182. https://en.wikipedia.org/wiki/Existential_risk_from_artificial_intelligence
  183. Shojaee et al., 2025: https://machinelearning.apple.com/research/illusion-of-thinking
  184. https://en.wikipedia.org/wiki/Map%E2%80%93territory_relation
  185. https://en.wikipedia.org/wiki/Fusion_power
    https://en.wikipedia.org/wiki/History_of_artificial_intelligence
  186. https://quoteinvestigator.com/2013/10/20/no-predict/
  187. https://en.wikipedia.org/wiki/Ergonomics
  188. ANSI/HFES 400-2021: Human Readiness Level Scale in the System Development Process, https://www.hfes.org/publications/technical-standards
  189. Weingroff, 2021: https://highways.dot.gov/highway-history/general-highway-history/moment-time-highway-safety-breakthrough
  190. Koopman, P., "Practical Experience Report: Automotive Safety Practices vs. Accepted Principles," SAFECOMP, Sept. 2018. https://users.ece.cmu.edu/~koopman/pubs/koopman18_safecomp.pdf
  191. Koopman, 2018: https://safeautonomy.blogspot.com/2018/06/a-reality-check-on-94-percent-human.html
  192. Dalton, 2018: https://www.cjr.org/analysis/when-covering-car-crashes-be-careful-not-to-blame-the-victim.php
  193. https://en.wikiquote.org/wiki/2001:_A_Space_Odyssey_(film)
  194. https://www.gutenberg.org/files/7409/7409-h/7409-h.htm
  195. ...
  196. Widen & Koopman, 2021: https://www.jurist.org/commentary/2021/09/william-widen-philip-koopman-autonomous-vehicles/
  197. https://users.ece.cmu.edu/~koopman/j3016/
  198. ...
  199. ...
  200. ...
  201. Hawkins, 2022: https://www.theverge.com/2022/8/4/23288794/tusimple-self-driving-truck-crash-investigation
  202. https://archive.org/details/policyongeometri0000unse_q3h0
  203. Francis, Tyrrell & Owens, 2020: https://www.tandfonline.com/doi/full/10.1080/1463922X.2020.1736204
  204. Kuehn, Vogelpohl & Vollrath, 2017: https://trid.trb.org/View/1485287
  205. Ericksson & Stanton, 2017:https://trid.trb.org/view/1468236
  206. ...
  207. https://www.iota.org.uk/blog/dft-concern-over-10-second-rule-for-all-lane-keeping-systems
  208. Jagacinksi & Flach, Control Theory for Humans, CRC Press, 2003
  209. Widen & Koopman, 2023: https://www.americanbar.org/content/dam/aba/publications/Jurimetrics/fall2023/the-awkward-middle-for-automated-vehicles-liability-attribution-rules-when-humans-and-computers-share-driving-responsibilities.pdf
  210. ...
  211. Shepardson, 2025: https://www.reuters.com/business/autos-transportation/amazons-robotaxi-unit-zoox-recalls-258-vehicles-over-unexpected-braking-issue-2025-03-19/
    Hawkins, 2022: https://www.theverge.com/2022/6/3/23153241/tesla-phantom-braking-nhtsa-complaints-investigation
    Gitlin, 2024: https://arstechnica.com/cars/2024/08/feds-probe-of-hard-braking-in-cruise-robotaxi-crashes-ends-after-recall/
  212. ...
  213. ...
  214. ...
  215. https://en.wikipedia.org/wiki/Overconfidence_effect
    https://en.wikipedia.org/wiki/Dunning%E2%80%93Kruger_effect
  216. Barmann, 2023: https://sfist.com/2023/04/07/gm-now-recalling-300-cruise-robocars-following-crash-into-muni-bus/
  217. Demattia, 2024: https://www.thedrive.com/news/tech/waymo-recalls-robotaxis-to-give-telephone-poles-a-higher-damage-score
  218. ...
  219. Bote, 2023: https://www.sfgate.com/tech/article/cruise-stuck-wet-concrete-sf-18297946.php
    Eskenazi, 2024: https://missionlocal.org/2024/12/waymo-rolls-toward-san-francisco-airport-showdown-brewing/
  220. Reagan et al., 2020: https://lindseyresearch.com/wp-content/uploads/2020/10/NHTSA-2019-0037-0015-IIHS_Study_on_Driver_Disengagement_-_Reagan_et_al_2020.pdf
  221. Bainbridge, Lisanne (1983-11-01). "Ironies of automation". Automatica. 19 (6): 775–779: https://doi.org/10.1016/0005-1098(83)90046-8
    Strauch, 2017: https://doi.org/10.1109/THMS.2017.2732506
  222. https://en.wikipedia.org/wiki/Automation_bias
  223. Mackworth, 1948, “The breakdown of vigilance during prolonged visual search” https://journals.sagepub.com/doi/10.1080/17470214808416738
  224. Johnson, 2022: https://www.wired.com/story/wrongful-arrests-ai-derailed-3-mens-lives/
  225. MacMillan, Ovalle & Schaffer, 2025: https://www.washingtonpost.com/business/interactive/2025/police-artificial-intelligence-facial-recognition
  226. Siddiqui, 2024: https://www.washingtonpost.com/technology/2024/07/11/elon-musk-tesla-full-self-driving/
  227. Page 1171 of Lee et al., 2023: https://journals.sagepub.com/doi/pdf/10.1177/21695067231192860
  228. This scenario is consistent with perhaps the first Tesla Autopilot fatality, Torchinsky, 2016: https://jalopnik.com/the-first-fatal-tesla-autopilot-crash-may-have-happened-1786626985
  229. Pavlus, 2016: https://www.scientificamerican.com/article/what-nasa-could-teach-tesla-about-autopilot-s-limits/
  230. https://en.wikipedia.org/wiki/Mode_(user_interface)#Mode_errors
  231. https://static.nhtsa.gov/odi/inv/2022/INCR-EA22002-14496.pdf
  232. Butler et al., 2018: https://shemesh.larc.nasa.gov/fm/papers/butler-etal-dasc98.pdf
  233. https://99percentinvisible.org/episode/children-of-the-magenta-automation-paradox-pt-1/
  234. https://en.wikipedia.org/wiki/Alarm_fatigue
  235. Barry, 2022: https://www.consumerreports.org/cars/car-safety/driver-monitoring-systems-ford-gm-earn-points-in-cr-tests-a6530426322/
  236. ...
  237. Siddiqui, 2023: https://www.washingtonpost.com/technology/2023/07/07/tesla-fsd-autopilot-wheel-weights/
  238. ...
  239. Figure 11 of NTSB, 2017: https://www.ntsb.gov/investigations/AccidentReports/Reports/HAR1702.pdf
  240. Levine & Jin, 2024: https://www.reuters.com/business/autos-transportation/next-autopilot-trial-test-teslas-blame-the-driver-defense-2024-03-11/
  241. https://english.stackexchange.com/questions/103851/where-does-the-phrase-boredom-punctuated-by-moments-of-terror-come-from#103855
  242. ...
  243. https://en.wikipedia.org/wiki/Dunning%E2%80%93Kruger_effect
  244. https://en.wikipedia.org/wiki/Duty_of_care
  245. https://en.wikipedia.org/wiki/Reasonable_person
  246. UN R157: https://unece.org/transport/documents/2021/03/standards/un-regulation-no-157-automated-lane-keeping-systems-alks
  247. https://en.wikipedia.org/wiki/Negligence
  248. ...
  249. Oklahoma State Legislature SB 1541 enrolled final version April 27, 2022, bottom of page 7 and top of page 8. https://www.oklegislature.gov/cf_pdf/2021-22%20ENR/SB/SB1541%20ENR.PDF
  250. ...
  251. ...
  252. ...
  253. ...
  254. ...
  255. https://unece.org/transport/documents/2021/03/standards/un-regulation-no-157-automated-lane-keeping-systems-alks
  256. AP, 2024: https://apnews.com/article/ford-blue-cruise-automated-system-ntsb-fatal-crash-texas-a6b5983caf1a0737f9dafdf3c0d099a5
  257. https://www.gov.uk/government/publications/self-driving-vehicles-regaining-situational-awareness
  258. ...
  259. Dazio & Krisher, 2023: https://apnews.com/article/tesla-autopilot-los-angeles-d02769ba359cf6381dc1176c3f5a72a5
  260. https://www.ntsb.gov/investigations/pages/HWY18FH011.aspx
    https://static.nhtsa.gov/odi/inv/2022/INOA-EA22002-3184.PDF
  261. https://static.nhtsa.gov/odi/inv/2022/INCR-EA22002-14496.pdf
  262. Hawkins, 2022: https://www.theverge.com/2022/8/4/23288794/tusimple-self-driving-truck-crash-investigation
  263. Elish, 2019: https://doi.org/10.17351/ests2019.260
  264. Smiley 2022: https://www.wired.com/story/uber-self-driving-car-fatal-crash/
  265. Evans, 2021: https://www.motortrend.com/news/tesla-full-self-driving-video-allegedly-faked/
  266. Jin, 2023: https://www.reuters.com/technology/tesla-video-promoting-self-driving-was-staged-engineer-testifies-2023-01-17/
  267. Dixon, 2020: https://www.sciencedirect.com/science/article/pii/S2590198220300245
  268. Putzer, 2023: https://www.motorbiscuit.com/get-dui-drunk-tesla-autopilot-self-driving-car/
  269. ...
  270. Marquis, 2023: https://jalopnik.com/probably-drunk-tesla-owner-let-fsd-beta-take-the-wheel-1849964850
    Massie, 2021: https://www.independent.co.uk/news/world/americas/crime/tesla-self-driving-drunk-driver-b1924303.html
    Mulach, 2023: https://www.drive.com.au/news/tesla-autopilot-police-car-crash-report/
    Phillips, 2025: https://www.yahoo.com/news/lawyers-self-driving-tesla-killed-101404543.html
  271. https://www.nhtsa.gov/press-releases/consumer-advisory-nhtsa-deems-autopilot-buddy-product-unsafe
    https://www.washingtonpost.com/technology/2023/07/07/tesla-fsd-autopilot-wheel-weights/
  272. Lopez, 2021: https://gmauthority.com/blog/2021/10/new-2022-gmc-sierra-ad-declares-we-will-rock-you-video/
  273. Ingram & Piñero, 2025: https://www.nbcnews.com/news/us-news/tesla-autopilot-crash-trial-verdict-partly-liable-rcna222344
  274. ...
  275. ...
  276. ...
  277. ...
  278. ...
  279. ...
  280. NHTSA SGO report 30270-6981 from: https://www.nhtsa.gov/laws-regulations/standing-general-order-crash-reporting
    Templeton, 2024: https://www.forbes.com/sites/bradtempleton/2024/03/26/waymo-runs-a-red-light-and-the-difference-between-humans-and-robots/
  281. Lee, 2024: https://arstechnica.com/cars/2024/05/on-self-driving-waymo-is-playing-chess-while-tesla-plays-checkers/
  282. Cheng, 2025: https://www.msn.com/en-us/news/news/content/ar-AA1EKVFK
  283. IIHS, 2021: https://www.iihs.org/news/detail/evidence-mounts-for-effectiveness-of-rear-autobrake
  284. https://www.nhtsa.gov/press-releases/nhtsa-fmvss-127-automatic-emergency-braking-reduce-crashes
  285. ...
  286. https://www.reuters.com/article/technology/us-agency-slams-brakes-on-self-driving-easymile-shuttles-after-passenger-injur-idUSKCN20K0BK/
  287. Siddiqui & Merrill, 2022: https://www.washingtonpost.com/technology/2022/02/02/tesla-phantom-braking/
  288. VanderWerp 2009: https://www.caranddriver.com/features/a16576573/how-to-deal-with-unintended-acceleration/
  289. Weatherbed, 2024: https://www.theverge.com/2024/4/19/24134753/tesla-recall-cybertruck-faulty-accelerator-pedal-nhtsa-defect
  290. https://static.nhtsa.gov/odi/rcl/2024/RCLRPT-24V493-4480.PDF
  291. ...
  292. Manthey, 2023: https://www.electrive.com/2023/07/11/mercedes-benz-issues-two-recalls-for-eq-vehicles-in-the-us/
  293. https://betterembsw.blogspot.com/p/potentially-deadly-automotive-software.html
  294. https://en.wikipedia.org/wiki/General_Motors_ignition_switch_recalls
  295. Heaps, 2021: https://www.kbb.com/car-advice/blind-spot-monitors/
  296. Krisher, 2022: https://apnews.com/article/tesla-recall-full-self-driving-software-e23d252ac5164cb0e7af776625b15180
  297. https://static.nhtsa.gov/odi/rcl/2022/RCLRPT-22V037-4462.PDF
  298. ...
  299. ...
  300. ...
  301. https://en.wikipedia.org/wiki/User_interface
    https://en.wikipedia.org/wiki/Human%E2%80%93computer_interaction
  302. Liu, 2018: https://www.digitaltrends.com/home/funny-accidental-amazon-alexa-ordering-stories/
  303. Kaplan, 2024: https://www.today.com/food/news/mcdonalds-ends-ai-drive-thru-ordering-rcna157514
  304. https://www.ahrq.gov/teamstepps-program/curriculum/communication/tools/checkback.html
  305. ...
  306. ...
  307. Barry, 2021: https://www.consumerreports.org/cars/car-recalls-defects/tesla-recalls-model-s-model-x-for-faulty-screens-a1001247303/
    Tulfo, 2024: https://www.msn.com/en-us/news/us/ford-knew-about-dangerous-backup-camera-glitches-but-moved-too-slowly-to-fix-them-safety-regulator-says/ar-AA1u6pFd
  308. Reid, 2025: https://www.wired.com/story/why-car-brands-are-finally-switching-back-to-buttons/
  309. Question 11 here: https://static.nhtsa.gov/odi/inv/2024/INIM-RQ24009-12199.pdf
  310. ...
  311. Sharrow, 2025: https://softhandtech.com/why-is-it-called-beta-testing/
  312. https://en.wikipedia.org/wiki/Minimum_viable_product
  313. https://time.com/43263/gmail-10th-anniversary/
  314. ...
  315. Wilson, 2024: https://driveteslacanada.ca/news/tesla-shares-behind-the-scenes-look-at-internal-fsd-testing-scenarios/
  316. ...
  317. McFarland, 2020: https://www.cnn.com/2020/10/30/cars/tesla-full-self-driving/index.html
  318. https://en.wikipedia.org/wiki/Cosplay
  319. Abrams & Kurtz, 2016: https://www.nytimes.com/2016/07/02/business/joshua-brown-technology-enthusiast-tested-the-limits-of-his-tesla.html
  320. Krisher & Dazio, 2022: https://apnews.com/article/tesla-autopilot-fatal-crash-charges-91b4a0341e07244f3f03051b5c2462ae
    Brownell, 2024: https://www.jalopnik.com/tesla-driver-who-trusted-autopilot-charged-with-killing-1851428652/
    O’Kane, 2024: https://techcrunch.com/2024/09/04/woman-who-allegedly-killed-two-people-using-ford-bluecruise-charged-with-dui-homicide/
  321. Yoshida, 2025: https://junkoyoshidaparis.substack.com/p/has-china-just-banned-tesla
  322. ...
  323. Davies, 2017: https://www.wired.com/story/google-waymo-self-driving-car-castle-testing/
  324. ...
  325. ...
  326. https://en.wikipedia.org/wiki/Pareto_principle
  327. https://en.wikipedia.org/wiki/Long_tail
  328. ...
  329. https://www.sae.org/standards/content/j3018_202012/
  330. ...
  331. ...
  332. ...
  333. https://safeautonomy.blogspot.com/2023/05/a-liability-approach-for-automated.html
  334. Hawkins, 2022: https://www.theverge.com/2022/12/16/23512650/cruise-robotaxi-nhtsa-investigation-av-braking-traffic
  335. Chilton, 2024: https://www.carscoops.com/2024/04/nhtsa-gets-serious-about-phantom-braking-issue-now-affecting-3-million-hondas/
  336. ...
  337. ...
  338. ...
  339. ...
  340. ...
  341. https://en.wikipedia.org/wiki/The_Boy_Who_Cried_Wolf
  342. https://en.wikipedia.org/wiki/Deterministic_algorithm
  343. ...
  344. https://en.wikipedia.org/wiki/Race_condition#In_software
  345. ...
  346. ...
  347. IIHS, 2025: https://www.iihs.org/news/detail/high-visibility-clothing-may-thwart-pedestrian-crash-prevention-sensors
  348. Pezzementi et al., 2018: https://doi.org/10.1109/SSRR.2018.8468619
    https://users.ece.cmu.edu/~koopman/pubs/pezzementi18_perception_robustness_testing.pdf
  349. Su, Vargas & Kouichi, 2017: https://arxiv.org/abs/1710.08864
  350. https://en.wikipedia.org/wiki/Baffles_(submarine)#Clearing_the_baffle_area
  351. ...
  352. ...
  353. ...
  354. Snyder, 2017: https://www.autoblog.com/news/self-driving-car-sign-hack-stickers
  355. ...
  356. ...
  357. ...
  358. http://en.wikipedia.org/wiki/Twilight
  359. https://en.wikipedia.org/wiki/Fog
  360. Thadani et al., 2023: https://www.washingtonpost.com/technology/interactive/2023/tesla-autopilot-crash-analysis/
  361. ...
  362. ...
  363. https://en.wikipedia.org/wiki/Product_liability
  364. CFR §1115.6(b): https://www.ecfr.gov/current/title-16/chapter-II/subchapter-B/part-1115/subpart-A/section-1115.6
  365. ...
  366. ...
  367. Stempel & Roy, 2025: https://www.reuters.com/legal/litigation/tesla-ordered-by-florida-jury-pay-243-million-fatal-autopilot-crash-2025-08-01/
  368. ...
  369. ...
  370. ...
  371. https://www.outpost9.com/reference/jargon/jargon_33.html#TAG1455
  372. ...
  373. ...
  374. ...
  375. ...
  376. https://www.bts.gov/content/us-vehicle-miles
  377. ...
  378. https://en.wikipedia.org/wiki/Incremental_learning
    https://en.wikipedia.org/wiki/Machine_unlearning
  379. ...
  380. https://youtu.be/kIf1KZyis6g&t=385
    https://youtu.be/K45QBhOLh90
  381. ...
  382. Sha, 1998: https://ieeexplore.ieee.org/abstract/document/739777
  383. https://en.wiktionary.org/wiki/quality_fade
  384. Lee, 2024: https://www.businessinsider.com/tesla-autopilot-lane-markings-2018-fatal-crash-2024-4?op=1
  385. AP, 2017: https://apnews.com/general-news-5495a771b92342e29c46777c0dbbc6af
  386. LaCapria, 2016: https://www.snopes.com/fact-check/road-runner-tunnel-crash-rumor/
  387. https://en.wikipedia.org/wiki/Fern_Hollow_Bridge#Collapse
  388. https://youtu.be/lySzTv6bmEI
  389. Marquis, 2023: https://www.jalopnik.com/ten-cruise-robotaxis-block-traffic-just-days-after-expa-1850734633/
  390. Hickman, 2024: https://www.keyfactor.com/blog/2023s-biggest-certificate-outages-what-we-can-learn-from-them/
  391. ...
  392. Finley, 2016: https://www.wired.com/2016/04/nests-hub-shutdown-proves-youre-crazy-buy-internet-things/
  393. ...
  394. https://en.wikipedia.org/wiki/Road%E2%80%93rail_vehicle
  395. ...
  396. https://en.wikipedia.org/wiki/Concept_of_operations
  397. https://en.wikipedia.org/wiki/All_models_are_wrong
  398. https://data.usatoday.com/tornado-archive/arizona/1972/
    https://en.wikipedia.org/wiki/Tornado_Alley
  399. Rendon 2025: https://www.nbclosangeles.com/news/local/robbery-suspects-uses-waymo-vehicle-to-try-to-evade-arrest-lapd/3596012/
  400. ...
  401. https://www.snopes.com/fact-check/hoarding-gas-plastic-bags/
  402. ...
  403. Koopman, Osyk & Weast, 2019: https://arxiv.org/abs/1911.01207
  404. ...
  405. Marshall, 2022: https://www.wired.com/story/cruises-robot-car-outages/
  406. Pringle, 2023: https://finance.yahoo.com/news/roomba-photographed-woman-toilet-ended-103704196.html
  407. https://www.google.com/search?q=cats+riding+roomba
  408. Hawkins, 2021: https://www.theverge.com/2021/4/22/22397546/tesla-autopilot-consumer-report-test-no-driver
  409. Mikkelson, 2007: https://www.snopes.com/fact-check/hedge-fund/
  410. https://www.google.com/search?q=weird+road+signs
  411. https://www.dot.state.pa.us/Public/DVSPubsForms/BDL/BDL%20Manuals/Manuals/PA%20Drivers%20Manual%20By%20Chapter/English/PUB%2095.pdf
  412. Ismail, 2022: https://jalopnik.com/self-driving-cruise-taxi-is-broadsided-by-a-prius-in-sa-1849151608
  413. https://users.ece.cmu.edu/~koopman/ece849/reading.html#byzantine
  414. ...
  415. ...
  416. https://www.austintexas.gov/sites/default/files/files/342.9%20Uniform%20Traffic%20Enforcement%20Chart.pdf
  417. https://youtu.be/pYb4X5aJhgU
  418. https://en.wikipedia.org/wiki/Metric_temporal_logic
  419. https://en.wikipedia.org/wiki/Uncertainty_quantification
  420. ...
  421. ...
  422. ...
  423. Petrany, 2014: https://web.archive.org/web/20140728041934/https://www.jalopnik.com/the-ten-best-google-street-view-pranks-1595274333/
  424. https://en.wikipedia.org/wiki/Adversarial_machine_learning#Data_poisoning
  425. Roth, 2024: https://www.theverge.com/2024/12/30/24332181/volkswagen-data-leak-exposed-location-evs
  426. Widen & Wolf, 2025: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=5137559
  427. https://en.wikipedia.org/wiki/Workplace_robotics_safety
  428. https://en.wikipedia.org/wiki/Cobot
  429. ...
  430. Koopman, How Safe Is Safe Enough, 2022, ISBN: 979-8846251243. https://safeautonomy.blogspot.com/2022/09/book-how-safe-is-safe-enough-measuring.html
  431. https://www.automotivesafetycouncil.org/wp-content/uploads/2020/12/2019-Fatality-Report-Overview-of-Motor-Vehicle-Crashes-in-2019.pdf
  432. https://www.pa.gov/content/dam/copapwp-pagov/en/penndot/documents/travelinpa/safety/documents/2019_cfb_linked.pdf
  433. Part 4 of this video series: https://philkoopman.substack.com/p/truths-and-myths-about-automated
  434. https://aaafoundation.org/rates-motor-vehicle-crashes-injuries-deaths-relation-driver-age-united-states-2014-2015/
  435. https://crashstats.nhtsa.dot.gov/Api/Public/Publication/813060
  436. Groeger, 2016: https://www.propublica.org/article/unsafe-at-many-speeds
  437. Fitzgerald, 2024: https://www.caranddriver.com/news/a60882953/average-age-us-cars-trucks-suvs-rises/
  438. https://en.wikipedia.org/wiki/Accident_triangle
  439. https://www.automotivesafetycouncil.org/wp-content/uploads/2020/12/2019-Fatality-Report-Overview-of-Motor-Vehicle-Crashes-in-2019.pdf
  440. Koopman, 2024: https://philkoopman.substack.com/p/why-robotaxis-have-an-inherent-3x
  441. ...
  442. Scanlon et al., 2025: https://www.tandfonline.com/doi/full/10.1080/15389588.2024.2435620
  443. ...
  444. 16 CFR 1115.6(b) https://www.ecfr.gov/current/title-16/chapter-II/subchapter-B/part-1115/subpart-A/section-1115.6
  445. https://static.nhtsa.gov/odi/inv/2021/INIM-PE21020-85573P.pdf
  446. https://www.iihs.org/topics/fatality-statistics/detail/pedestrians
  447. ...
  448. https://www.iihs.org/topics/fatality-statistics/detail/pedestrians
  449. https://proceedings.mlr.press/v81/buolamwini18a/buolamwini18a.pdf
  450. Norton, Autonorama: the illusory promise of high-tech driving, Island Press, 2021. ISBN-13: 978-1642832402
  451. https://en.wikipedia.org/wiki/Negligence_per_se
  452. ...
  453. Scanlon et al., 2022: https://waymo.com/research/collision-avoidance-effectiveness-of-an-automated/
  454. https://en.wikipedia.org/wiki/Bounded_rationality
  455. Kusano et al., 2022, https://arxiv.org/abs/2212.08148
  456. ...
  457. ...
  458. https://www.dmv.ca.gov/portal/file/cruise_060322-pdf/
    https://static.nhtsa.gov/odi/rcl/2022/RCLRPT-22E072-8020.PDF
    Woon, 2022: https://www.retrospectav.com/products/cruise-unacceptably-risky-part-1
  459. ...
  460. https://www.sfmta.com/blog/everything-you-need-know-about-red-transit-lanes
  461. https://static.nhtsa.gov/odi/rcl/2022/RCLRPT-22E072-8020.PDF
  462. ...
  463. https://waymo.com/blog/2024/12/new-swiss-re-study-waymo
  464. ...
  465. ...
  466. ...
  467. https://pro.bloomberglaw.com/insights/litigation/contributory-and-comparative-negligence-by-state/
  468. https://www.law.cornell.edu/wex/comparative_negligence
  469. https://www.law.cornell.edu/wex/contributory_negligence
  470. ...
  471. ...
  472. https://en.wikipedia.org/wiki/Induced_demand
  473. https://injuryfacts.nsc.org/home-and-community/safety-topics/deaths-by-transportation-mode/
  474. Hawkins, 2019: https://www.theverge.com/2019/8/6/20756945/uber-lyft-tnc-vmt-traffic-congestion-study-fehr-peers
  475. ...
  476. Ingram, 2024: https://www.nbcnews.com/tech/innovation/are-taxis-safer-no-driver-women-think-rcna173936
  477. ...
  478. Quintana, 2024: https://www.nbcbayarea.com/news/local/san-francisco/waymo-robotaxis-get-vandalized/3669669/
  479. Kukura, 2024: https://sfist.com/2024/10/02/woman-in-driverless-waymo-harassed-by-bros-wanting-her-phone-number/
  480. Liedtke, 2023: https://apnews.com/article/selfdriving-cars-taxi-robotaxis-cruise-waymo-b09b2ebd5d130d48154e5f4b27f6f358
  481. Kelly, Makinen & Koehn, 2024: https://sfstandard.com/2024/02/10/waymo-robotaxi-goes-up-in-flames-in-chinatown-after-crowd-attacks-vehicle/
  482. https://en.wikipedia.org/wiki/Right_of_self-defense
  483. Marshall, 2019: https://www.wired.com/story/criminologist-uber-crime-report-highly-alarming/
    Saddiqui, 2021: https://www.washingtonpost.com/technology/2021/10/22/lyft-safety-report/
  484. ...
  485. ...
  486. https://en.wikipedia.org/wiki/Jagoff
  487. https://en.wikipedia.org/wiki/Impact_attenuator#Truck_mounted_attenuators
  488. ...
  489. Mitchell, 2023: https://finance.yahoo.com/news/san-franciscos-fire-chief-fed-120043745.html
  490. CBS News, 2021: https://www.cbsnews.com/sanfrancisco/news/dead-end-sf-street-plagued-with-confused-waymo-cars-trying-to-turn-around-every-5-minutes/
  491. ...
  492. Hawkins, 2024: https://www.theverge.com/2024/9/5/24235078/waymo-safety-hub-miles-crashes-robotaxi-transparency
  493. https://en.wikipedia.org/wiki/Illusory_superiority#Driving_ability
  494. ...
  495. ...
  496. https://safeautonomy.blogspot.com/2024/06/waymos-misleading-claim-of-saving-lives.html
  497. https://en.wikipedia.org/wiki/Hoist_with_his_own_petard
  498. ...
  499. https://en.wikipedia.org/wiki/Trolley_problem
  500. https://en.wikipedia.org/wiki/Snidely_Whiplash
  501. https://en.wikipedia.org/wiki/Trolley_problem#Original_dilemma
  502. https://en.wikipedia.org/wiki/False_dilemma
  503. ...
  504. BMVI 2017: https://www.bmvi.de/SharedDocs/EN/publications/report-ethics-commission.html
  505. ...
  506. ...
  507. ...
  508. ...
  509. ...
  510. https://en.wikipedia.org/wiki/Informed_consent
  511. Koopman, 2021: https://www.smerconish.com/exclusive-content/teslas-autonomous-vehicle-testing-makes-everyone-a-crash-test-dummy/
  512. https://en.wikipedia.org/wiki/Federal_Motor_Vehicle_Safety_Standards
  513. ...
  514. ...
  515. https://www.dmv.ca.gov/portal/vehicle-industry-services/autonomous-vehicles/
  516. NTSB, 2019: https://www.ntsb.gov/investigations/AccidentReports/Reports/HAR1903.pdf
  517. Swanson 2022: https://www.miaminewtimes.com/news/argo-ai-miamis-first-driverless-cars-hit-the-streets-14509089
  518. Hawkins, 2022: https://www.theverge.com/2022/8/4/23288794/tusimple-self-driving-truck-crash-investigation
  519. https://www.dmv.ca.gov/portal/file/proposed-regulatory-text-article-3-7-2025-0415-04-pdf/
  520. Panait, 2021: https://www.autoevolution.com/news/california-dmv-suspends-ponyai-driverless-testing-permit-after-small-crash-176549.html
  521. Bellan, 2022: https://techcrunch.com/2022/05/24/pony-ai-loses-permit-to-test-autonomous-vehicles-with-driver-in-california/
  522. ...
  523. ...
  524. ...
  525. Hsu, 2018: https://www.wired.com/story/strava-heat-map-military-bases-fitness-trackers-privacy/
  526. Key, 2025: https://www.pcmag.com/explainers/its-time-to-delete-your-period-tracker-and-use-one-of-these-alternatives
  527. ...
  528. ...
  529. Defence Standard 00-56 Issue 7 (Part 1): Safety Management Requirements for Defence Systems. UK Ministry of Defence. p. 26.
  530. ...
  531. ...
  532. ...
  533. ...
  534. Wasson, 2025: https://www.freightwaves.com/news/autonomous-trucks-have-a-triangle-shaped-problem
  535. https://en.wikipedia.org/wiki/Systems_development_life_cycle
  536. ...
  537. ...
  538. ...
  539. https://en.wikipedia.org/wiki/Arthur_M._Wellington
  540. https://en.wikipedia.org/wiki/Mathematical_optimization
  541. https://en.wikipedia.org/wiki/Analytic_hierarchy_process
  542. ...
  543. ...
  544. https://en.wikipedia.org/wiki/Prisoner's_dilemma
  545. ...
  546. Kramer, 2006: https://www.nytimes.com/2006/11/17/world/europe/17moscow.html
  547. Koopman & Widen, 2023: https://ieeexplore.ieee.org/document/10138883
  548. https://en.wikipedia.org/wiki/Satisficing
  549. Koopman & Widen, 2024: https://arxiv.org/abs/2404.16768
  550. Fearnley et al., 2025: https://philpapers.org/archive/FEAROW.pdf
  551. ...
  552. ...
  553. ...
  554. ...
  555. https://en.wikipedia.org/wiki/Defeater
  556. Gates & Baker, 2019: https://www.heraldnet.com/nation-world/boeing-pressured-faa-authorized-engineers-on-safety-testing/
  557. ...
  558. ...
  559. Krisher, 2024: https://apnews.com/article/ford-pickup-trucks-recall-sudden-downshift-first-gear-aaa03bcd5858b858f7258440a9a4a100
  560. https://www.nhtsa.gov/laws-regulations/standing-general-order-crash-reporting
  561. Hill, 2024: https://www.nytimes.com/2024/03/11/technology/carmakers-driver-tracking-insurance.html
  562. ...
  563. Gordon 2021: https://www.vice.com/en/article/tesla-drivers-say-they-can-easily-cheat-teslas-safety-score/
  564. https://en.wikipedia.org/wiki/Falsifiability
  565. Atiyeh, 2022: https://www.caranddriver.com/news/g39301678/3g-internet-sunset-cars/
  566. ...
  567. ...
  568. Davenport, 2023: https://www.howtogeek.com/854108/how-long-can-you-keep-using-an-android-phone/
  569. Evans 2024: https://www.motortrend.com/features/bankrupt-fisker-ocean-ev-owner-buying-advice-faq/
  570. ...
  571. ...
  572. Fitzgerald, 2024: https://www.caranddriver.com/news/a60882953/average-age-us-cars-trucks-suvs-rises/
  573. https://de.wikipedia.org/wiki/SOTIF (available in German only)
  574. https://de.wikipedia.org/wiki/ISO_21448
  575. https://en.wikipedia.org/wiki/Off-label_use
  576. ...
  577. ...
  578. ...
  579. https://en.wikipedia.org/wiki/AI_safety
  580. https://www.nist.gov/aisi
  581. https://en.wikipedia.org/wiki/Existential_risk_from_artificial_intelligence
  582. https://en.wikipedia.org/wiki/Machine_ethics
    https://en.wikipedia.org/wiki/Ethics_of_artificial_intelligence
  583. https://en.wikipedia.org/wiki/British_Post_Office_scandal
  584. Banim & Otter, 2024: https://www.mirror.co.uk/news/uk-news/post-office-scandals-four-suicide-31830231
  585. https://youtu.be/hBJm9ZYqL10
  586. ...
  587. Dade, 2012: https://www.npr.org/2012/02/22/147213437/whats-driving-the-backlash-against-traffic-cameras
  588. ...
  589. Golson 2025: https://www.the-sun.com/motors/14138386/drivers-face-fines-new-ticket-law/
  590. Bohm et al., 2022: https://discovery.ucl.ac.uk/id/eprint/10151259/
  591. https://www.apa.org/topics/cognitive-neuroscience/polygraph
  592. https://en.wikipedia.org/wiki/Grand_Theft_Auto
    https://en.wikipedia.org/wiki/Crazy_Taxi
  593. https://en.wikipedia.org/wiki/The_Minority_Report
  594. https://en.wikipedia.org/wiki/Unmanned_combat_aerial_vehicle
  595. https://en.wikipedia.org/wiki/AI_alignment
  596. ...
  597. Milne, 2024: https://www.washington.edu/news/2024/10/31/ai-bias-resume-screening-race-gender/
  598. Hao 2019: https://www.technologyreview.com/2019/01/21/137783/algorithms-criminal-justice-ai/
    Hamilton & Ugwudike, 2023: https://theconversation.com/a-black-box-ai-system-has-been-influencing-criminal-justice-decisions-for-over-two-decades-its-time-to-open-it-up-200594
  599. ...
  600. Sherr, 2024: https://www.cnet.com/tech/services-and-software/glue-in-pizza-eat-rocks-googles-ai-search-is-mocked-for-bizarre-answers/
  601. https://incidentdatabase.ai/
  602. ...
  603. https://youtu.be/DKHa7rxkvK8
  604. Smiley 2022: https://www.wired.com/story/uber-self-driving-car-fatal-crash/
  605. Talia 2025, https://doi.org/10.1109/MC.2024.3387012
  606. https://en.wikipedia.org/wiki/List_of_common_Chinese_surnames
  607. ...
  608. https://en.wikipedia.org/wiki/Retrieval-augmented_generation
  609. Edwards, 2023: https://arstechnica.com/information-technology/2023/08/ai-powered-grocery-bot-suggests-recipe-for-toxic-gas-poison-bread-sandwich/
  610. Nicoletti & Bass, 2023: https://www.bloomberg.com/graphics/2023-generative-ai-bias/
  611. Payne, 2024: https://apnews.com/article/chatbot-ai-lawsuit-suicide-teen-artificial-intelligence-9d48adc572100822fdbc3c90d1456bd0
  612. Alter & Harris, 2023: https://www.nytimes.com/2023/09/20/books/authors-openai-lawsuit-chatgpt-copyright.html
  613. Cho, 2024: https://www.hollywoodreporter.com/business/business-news/artists-score-major-win-copyright-case-against-ai-art-generators-1235973601/
  614. ...
  615. https://www.snopes.com/collections/images-photos-2024-snopes/
  616. Paul & Matthews, 2016: https://www.rand.org/pubs/perspectives/PE198.html
  617. https://en.wikipedia.org/wiki/Big_lie
  618. https://en.wikipedia.org/wiki/Content_farm
  619. https://www.clrn.org/how-much-of-the-internet-is-ai-generated-content/
  620. Limbong, 2024: https://www.npr.org/2024/03/16/1238983175/authors-push-back-on-the-growing-number-of-ai-scam-books-on-amazon
  621. https://en.wikipedia.org/wiki/Model_collapse
  622. Tufekci, 2025: https://www.nytimes.com/2025/05/17/opinion/grok-ai-musk-x-south-africa.html
  623. Gervais et al., 2024: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4963711
  624. Brittain, 2023: https://www.reuters.com/legal/john-grisham-other-top-us-authors-sue-openai-over-copyrights-2023-09-20/
    Sarokhanian et al., 2025: https://natlawreview.com/article/federal-courts-issue-first-key-rulings-fair-use-defense-generative-ai-copyright
  625. Crawford, 2024: https://www.nature.com/articles/d41586-024-00478-x
  626. Astor, 2017: https://www.nytimes.com/2017/07/25/technology/roomba-irobot-data-privacy.html
  627. Willcox, 2023: https://www.consumerreports.org/electronics/privacy/how-to-turn-off-smart-tv-snooping-features-a4840102036/
  628. https://en.wikipedia.org/wiki/Nineteen_Eighty-Four
  629. ...
  630. https://en.wikipedia.org/wiki/Extreme_value_theory
  631. ...
  632. ...
  633. ...
  634. ...
  635. ...
  636. ...
  637. ...
  638. ...
  639. ...
  640. https://en.wikipedia.org/wiki/Data_dredging
  641. ...
  642. https://en.wikipedia.org/wiki/Clever_Hans
  643. Hawkins, 2024: https://www.theverge.com/2024/6/12/24175489/waymo-recall-telephone-poll-crash-phoenix-software-map
  644. https://en.wikipedia.org/wiki/Verification_and_validation
  645. Kuehlkamp, Becker, & Bowyer, 2017: https://arxiv.org/abs/1702.01304
  646. https://en.wikipedia.org/wiki/Adder_(electronics)
  647. https://en.wikipedia.org/wiki/Binary-coded_decimal
  648. https://en.wikipedia.org/wiki/Pentium_FDIV_bug
  649. ...
  650. ...
  651. ...
  652. https://www.ctvnews.ca/canada/moment-lightning-strikes-albertans-truck-caught-on-camera-1.1856292
  653. ...
  654. https://www.autosafety.org/firestone-500-steel-belted-radials/
  655. ...
  656. ...
  657. ...
  658. Faulkner, 2019: https://ecori.org/2019-8-2-little-roady-shuttle-reaches-milestone-hits-speedbumps
  659. Heinz, 2023: https://cowboystatedaily.com/2023/07/14/cow-plummeting-off-200-foot-cliff-inspired-viral-watch-for-falling-cows-road-sign/
  660. https://en.wikipedia.org/wiki/Wienermobile
  661. ...
  662. https://en.wikipedia.org/wiki/Traffic_light
  663. https://en.wikipedia.org/wiki/Pok%C3%A9mon_Go
  664. https://en.wikipedia.org/wiki/Heavy-tailed_distribution
  665. ...
  666. ...
  667. https://en.wikipedia.org/wiki/Software_reliability_testing
  668. ...
  669. https://en.wikipedia.org/wiki/Configuration_management
    https://en.wikipedia.org/wiki/Change_management_(engineering)
    https://en.wikipedia.org/wiki/Change_control
  670. https://en.wikipedia.org/wiki/Bug_compatibility
  671. ...
  672. ...
  673. https://www.federalregister.gov/documents/2020/12/03/2020-25930/framework-for-automated-driving-system-safety
  674. https://en.wikipedia.org/wiki/Stinking_badges
  675. ...
  676. https://en.wikiquote.org/wiki/Star_Wars_(film)
  677. https://unece.org/transport/documents/2021/03/standards/un-regulation-no-157-automated-lane-keeping-systems-alks
  678. https://en.wikipedia.org/wiki/Regulatory_agency
  679. ...
  680. ...
  681. https://www.gov.uk/government/consultations/ai-regulation-a-pro-innovation-approach-policy-proposals/outcome/a-pro-innovation-approach-to-ai-regulation-government-response
  682. https://www.legislation.gov.uk/ukpga/2024/10/enacted
  683. https://support.google.com/waymo/answer/9184909
  684. Medintz, 2020: https://www.consumerreports.org/mandatory-binding-arbitration/forced-arbitration-clause-for-concern/
    Treisman, 2024: https://www.npr.org/2024/10/02/nx-s1-5136615/uber-car-crash-lawsuit-uber-eats-arbitration-terms
  685. https://en.wikipedia.org/wiki/Captain_Phillips_(film)
  686. https://www.usaa.com/inet/wc/insurance_life_military_benefits
  687. https://www.ul.com/about/history
  688. https://www.iihs.org/about-us
  689. https://crashstats.nhtsa.dot.gov/Api/Public/ViewPublication/812979
  690. https://policyscout.com/auto-insurance/learn/motorcycle-insurance-vs-car-insurance
  691. ...
  692. ...
  693. https://web.archive.org/web/20250117111229/https://www.iihs.org/topics/advanced-driver-assistance/autonomous-vehicle-laws
  694. https://law.justia.com/codes/arkansas/2010/title-27/subtitle-2/chapter-22/27-22-104/
  695. https://www.transportation.gov/office-policy/transportation-policy/revised-departmental-guidance-on-valuation-of-a-statistical-life-in-economic-analysis
  696. ...
  697. Brewer & Young, 2021: https://www.cnbc.com/2021/03/24/rise-in-nuclear-verdicts-in-lawsuits-threatens-trucking-industry.html
  698. Burn, 2024: https://sfstandard.com/2024/05/15/cruise-settlement-san-francisco-woman-dragged/
  699. https://en.wikipedia.org/wiki/Value_of_life
  700. Higham, 2024: https://www.newsweek.com/florida-exodus-home-insurance-crisis-1976454
  701. https://www.pa.gov/services/dep/apply-for-department-of-environmental-protection-mine-subsidence-insurance
  702. https://en.wikipedia.org/wiki/No_such_thing_as_a_free_lunch
  703. ...
  704. ...
  705. Loftus-Otway, and Gallun, 2024: https://nap.nationalacademies.org/catalog/27867/multistate-coordination-and-harmonization-for-av-legislation
    Hubbard & Starger, 2024: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4916418
  706. https://safeautonomy.blogspot.com/2022/02/kansas-av-regulation-bill-hearings.html
  707. https://youtu.be/DKHa7rxkvK8
    https://users.ece.cmu.edu/~koopman/lectures/2014_toyota_ua.pdf
  708. https://en.wikipedia.org/wiki/Heisenbug
  709. Widen, 2024: https://youtu.be/WhtxTDRvTOE
  710. ...
  711. ...
  712. Koopman & Widen 2024: https://scholar.smu.edu/scitech/vol27/iss1/5/
  713. ...
  714. Widen & Wolf, 2025: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=5182711
  715. ...
  716. https://en.wikipedia.org/wiki/Airbnb
    https://en.wikipedia.org/wiki/Turo_(company)
  717. Koopman, 2025: https://open.substack.com/pub/philkoopman/p/a-holistic-approach-to-av-regulation
  718. Loftus-Otway & Gallun, 2024: https://nap.nationalacademies.org/catalog/27867/multistate-coordination-and-harmonization-for-av-legislation
  719. ...
  720. ...
  721. ...
  722. ...
  723. ...
  724. ...
  725. Hawkins, 2023: https://www.theverge.com/2023/5/18/23729229/hyundai-kia-settlement-car-theft-challenge-tiktok
  726. https://xkcd.com/1559/
  727. https://static.nhtsa.gov/odi/rcl/2021/RCLRPT-21V944-3861.PDF
    https://static.nhtsa.gov/odi/rcl/2019/RCLRPT-19V148-7536.PDF
    https://static.nhtsa.gov/odi/rcl/2017/RCLRPT-17V713-9720.PDF
    https://static.nhtsa.gov/odi/rcl/2014/RCLRPT-14V293-9980.PDF
  728. https://static.nhtsa.gov/odi/rcl/2025/RCLRPT-25V392-9729.pdf
    https://static.nhtsa.gov/odi/rcl/2020/RCLRPT-20V748-6218.PDF
    https://static.nhtsa.gov/odi/rcl/2019/RCLRPT-19V540-5478.PDF
    https://static.nhtsa.gov/odi/rcl/2019/RCLRPT-19V351-6562.PDF
  729. Greenberg, 2015: https://www.wired.com/2015/07/hackers-remotely-kill-jeep-highway/
  730. ...
  731. ...
  732. https://en.wikipedia.org/wiki/Vehicle_bus
  733. https://en.wikipedia.org/wiki/Firewall_(computing)
  734. ...
  735. https://en.wikipedia.org/wiki/Information_security_standards#ISO%2FSAE_21434
  736. https://www.nist.gov/itl/applied-cybersecurity/nist-cybersecurity-iot-program
  737. Holtzer 2022: https://www.brookings.edu/articles/understanding-the-impact-of-automation-on-workers-jobs-and-wages/
  738. ...
  739. ...
  740. https://en.wikipedia.org/wiki/Luddite
  741. https://en.wikipedia.org/wiki/John_Henry_(folklore)
  742. https://en.wikipedia.org/wiki/Jacquard_machine
  743. https://en.wikipedia.org/wiki/Mike_Mulligan_and_His_Steam_Shovel
  744. ...
  745. https://en.wikipedia.org/wiki/Elevator_operator
  746. https://www.misterrogers.org/articles/factory_visits/
  747. https://www.snopes.com/fact-check/know-where-man/
  748. ...
  749. Merken, 2024: https://www.reuters.com/legal/government/texas-lawyer-fined-ai-use-latest-sanction-over-fake-citations-2024-11-26/
    Ambrogi, 2025: https://www.lawnext.com/2025/05/ai-hallucinations-strike-again-two-more-cases-where-lawyers-face-judicial-wrath-for-fake-citations.html
    Ashcraft, 2025: https://www.ksl.com/article/51324994/utah-attorneys-sanctioned-by-appeals-court-for-using-ai-to-write-legal-brief
    Claburn, 2025: https://www.msn.com/en-us/news/crime/georgia-court-throws-out-earlier-ruling-that-relied-on-fake-cases-made-up-by-ai/ar-AA1Icexd
  750. Huddleston 2025: https://www.cnbc.com/2025/03/26/bill-gates-on-ai-humans-wont-be-needed-for-most-things.html
  751. https://en.wikipedia.org/wiki/Player_piano
  752. https://www.eurekalert.org/news-releases/685378
  753. ...
  754. ...
  755. https://developers.google.com/machine-learning/crash-course/fairness/types-of-bias
    https://en.wikipedia.org/wiki/Inductive_bias
    https://en.wikipedia.org/wiki/Algorithmic_bias
  756. Gutoskey, 2023: https://www.mentalfloss.com/article/625404/equity-vs-equality-what-is-the-difference
  757. Simonite, 2019: https://www.wired.com/story/best-algorithms-struggle-recognize-black-faces-equally/
  758. https://en.wikipedia.org/wiki/Digital_divide
  759. ...
  760. ...
  761. https://www.forbes.com/sites/katharinabuchholz/2024/08/23/the-extreme-cost-of-training-ai-models/
  762. https://www.geeksforgeeks.org/artificial-intelligence/top-10-open-source-llm-models/
  763. Krisher, 2024: https://apnews.com/article/average-vehicle-age-record-prices-high-5f8413179f077a34e7589230ebbca13d
  764. ...
  765. Zipper 2024, https://www.vox.com/future-perfect/369695/used-cars-electric-vehicles-buy-exports
  766. https://en.wikipedia.org/wiki/Chop_shop
  767. https://en.wikipedia.org/wiki/Openpilot
  768. ...
  769. Rivers 2025, https://www.carscoops.com/2025/01/evs-evolved-rapidly-now-last-just-as-long-and-are-more-reliable-than-ices/
  770. AP, 2023: https://www.npr.org/2023/01/11/1148483758/ntsb-heavy-electric-vehicles-safety-risks
  771. Dempsey, 2024: https://www.bbc.com/news/business-68238330
  772. https://en.wikipedia.org/wiki/Induced_demand
  773. https://en.wikipedia.org/wiki/Mark_60_CAPTOR
  774. https://en.wikipedia.org/wiki/The_Terminator
  775. Edwards, 2024: https://arstechnica.com/gadgets/2024/05/robot-dogs-armed-with-ai-targeting-rifles-undergo-us-marines-special-ops-evaluation/
  776. Jammot 2023: https://techxplore.com/news/2023-06-human-extinction-threat-overblown-ai.html
  777. ...
  778. https://en.wikipedia.org/wiki/Phalanx_CIWS
  779. https://en.wikipedia.org/wiki/Loitering_munition
  780. US DoD, 2023: https://www.esd.whs.mil/portals/54/documents/dd/issuances/dodd/300009p.pdf
  781. https://en.wikipedia.org/wiki/Unexploded_ordnance
  782. Weichert, 2025: https://www.msn.com/en-us/news/technology/technological-warfare-introducing-ai-to-killer-drones-in-ukraine/ar-AA1J8jwO
  783. Zafra et al. 2024: https://www.reuters.com/graphics/UKRAINE-CRISIS/DRONES/dwpkeyjwkpm/
  784. Kullab, 2025: https://apnews.com/article/what-to-know-ukraine-drone-attack-russia-bombers-2d01b23341e2289882760b9f121431d4
  785. ...
  786. https://en.wikipedia.org/wiki/British_Post_Office_scandal
  787. Daniels & Parsons, 2025: https://scsc.uk/r3004 (presentation slides) and https://scsc.uk/index.php/publications/download?ref=3005 (video)
  788. https://en.wikipedia.org/wiki/Post-truth
  789. ...
  790. https://www.goodreads.com/quotes/11666815-trust-is-earned-in-drops-and-lost-in-buckets-unwavering
  791. Mitchell, 2023: https://www.yahoo.com/news/teslas-response-dmvs-false-advertising-163237175.html
  792. Hawkins, 2024: https://www.theverge.com/2024/9/5/24235078/waymo-safety-hub-miles-crashes-robotaxi-transparency
  793. Chakravori, 2024: https://hbr.org/2024/05/ais-trust-problem
    Henrique & Santos, 2024: https://www.sciencedirect.com/science/article/pii/S2949882124000033
  794. https://en.wikipedia.org/wiki/Technological_utopianism
  795. US NRC: https://www.nrc.gov/reading-rm/basic-ref/students/history-101/too-cheap-to-meter.html
    Reid, 2025: https://www.wired.com/story/theres-a-very-simple-pattern-to-elon-musks-broken-promises/
  796. IDTechEx, 2025: https://www.idtechex.com/en/research-report/autonomous-vehicles-markets-2025/1045
  797. ...
  798. https://en.wikipedia.org/wiki/Venture_capital
  799. https://tvtropes.org/pmwiki/pmwiki.php/Main/PullARabbitOutOfMyHat
  800. Forbes, 2023: https://www.forbes.com/sites/forbesunder30team/2023/11/28/hall-of-shame-the-10-most-dubious-people-ever-to-make-our-30-under-30-list/
  801. https://en.wikipedia.org/wiki/Elizabeth_Holmes
  802. Mickle, Metz & Lu, 2023: https://www.nytimes.com/2023/11/03/technology/cruise-general-motors-self-driving-cars.html
  803. Kolodny, 2023: https://www.cnbc.com/2023/11/06/cruise-confirms-robotaxis-rely-on-human-assistance-every-4-to-5-miles.html
  804. ...
  805. https://en.wikipedia.org/wiki/American_Automobile_Association#AAA_Roadside_Assistance
  806. https://en.wikiquote.org/wiki/The_Wizard_of_Oz_(1939_film)#The_Wizard
  807. ...
  808. ...
  809. Bohn, 2016: https://www.theverge.com/2016/10/19/13341306/elon-musk-negative-media-autonomous-vehicles-killing-people
  810. ...
  811. ...
  812. Serani, 2011: https://www.psychologytoday.com/us/blog/two-takes-depression/201106/if-it-bleeds-it-leads-understanding-fear-based-media
  813. https://www.tesladeaths.com/
  814. ...
  815. ...
  816. ...
  817. https://www.phrases.org.uk/meanings/there-is-no-such-thing-as-bad-publicity.html
  818. ...
  819. ...
  820. https://www.quotes.net/movies/a_christmas_story_2134
  821. ...
  822. https://en.wikipedia.org/wiki/DARVO
  823. ...
  824. https://waymo.com/blog/2024/02/voluntary-recall-of-our-previous-software/
  825. ...
  826. ...
  827. Li & Eskenazi, 2024: https://missionlocal.org/2024/08/waymo-cruise-ticket-phil-ting/
  828. ...
  829. ...
  830. ...
  831. ...
  832. ...
  833. https://www.pa.gov/agencies/dmv/driver-services/pennsylvania-drivers-manual.html
  834. https://en.wikipedia.org/wiki/Jaywalking
  835. ...
  836. ...
  837. ...
  838. ...
  839. ...
  840. ...
  841. ...
  842. Tolentino, 2025: https://www.kron4.com/news/bay-area/8-victims-reported-in-fatal-multi-vehicle-crash-in-soma-sffd/
  843. ...
  844. ...
  845. https://en.wikipedia.org/wiki/Whataboutism
    https://en.wikipedia.org/wiki/Tu_quoque
  846. https://en.wikipedia.org/wiki/False_dilemma
  847. https://knowyourmeme.com/memes/why-not-both-why-dont-we-have-both
  848. ...
  849. Fowler, 2024: https://www.washingtonpost.com/technology/2024/12/30/waymo-pedestrians-robotaxi-crosswalks/
  850. California Vehicle Code 21950: https://leginfo.legislature.ca.gov/faces/codes_displaySection.xhtml?sectionNum=21950&lawCode=VEH
  851. https://www.imdb.com/title/tt0137523/quotes/
  852. https://en.wikipedia.org/wiki/Perfect_is_the_enemy_of_good
  853. ...
  854. https://en.wikipedia.org/wiki/Whistleblowing
  855. ...
  856. ...
  857. https://quoteinvestigator.com/2021/02/08/assume/
  858. ...
  859. ...
  860. ...
  861. ...
  862. ...
  863. ...
  864. ...
  865. https://en.wikipedia.org/wiki/Primum_non_nocere

Revisions: