In my latest Guardian column, The problem with self-driving cars: who controls the code?, I take issue with the "Trolley Problem" as applied to autonomous vehicles, which asks, if your car has to choose between a maneuver that kills you and one that kills other people, which one should it be programmed to do?
The problem with this formulation of the problem is that it misses the big question that underpins it: if your car was programmed to kill you under normal circumstances, how would the manufacturer stop you from changing its programming so that your car never killed you?
There’s a strong argument for this. The programming in autonomous vehicles will be in charge of a high-speed, moving object that inhabits public roads, amid soft and fragile humans. Tinker with your car’s brains? Why not perform amateur brain surgery on yourself first?
But this obvious answer has an obvious problem: it doesn’t work. Every locked device can be easily jailbroken, for good, well-understood technical reasons. The primary effect of digital locks rules isn’t to keep people from reconfiguring their devices – it’s just to ensure that they have to do so without the help of a business or a product. Recall the years before the UK telecoms regulator Ofcom clarified the legality of unlocking mobile phones in 2002; it wasn’t hard to unlock your phone. You could download software from the net to do it, or ask someone who operated an illegal jailbreaking business. But now that it’s clearly legal, you can have your phone unlocked at the newsagent’s or even the dry-cleaner’s.
If self-driving cars can only be safe if we are sure no one can reconfigure them without manufacturer approval, then they will never be safe.
The problem with self-driving cars: who controls the code?
[Cory Doctorow/The Guardian]
Steven Boyett writes, “Humble Bundle has released a unicorn-themed Bundle, with proceeds to benefit the World Wide Fund for Nature and Fauna & Flora International. For as little as $1.00, you can get Ariel, by Steven R. Boyett (full disclosure: that’s me); Unicorn Mountain, by Michael Bishop; Homeward Bound, by Bruce Coville; and Unicorn Triangle, […]
Brewster Kahle, who invented the first two search engines and went on to found and run the Internet Archive has published an open letter describing the problems that the W3C’s move to standardize DRM for the web without protecting otherwise legal acts, like archiving, will hurt the open web.
The Just Net Coalition — whose membership roll includes leading human rights organisations from across the global south — have written urgently to the World Wide Web Coalition and its founder, Tim Berners-Lee, calling on him to intervene to stop the Consortium from publishing its first-ever DRM standard, a system for restricting video streams called […]
“Gets stuff done,” is a good way to be described by anybody. Especially by coworkers or bosses. Because whether you’re in finance or a children’s librarian, stuff needs to get done. But how do you make sure stuff gets done? You definitely can’t do all the stuff yourself, unless your company/organization/government office consists entirely of you. And […]
Even the most expensive pair of hi-fi headphones can’t match the feeling of bass rumbling through your body at a live show. That’s why music aficionados designed The Basslet, an accessory that reproduces that sensation from your wrist. Does it make your whole body shake with deep subs? Not really, because that would be terrifying, but […]
They probably just sleep a lot. But still, you can remotely keep an eye on them when you’re at work and missing them deeply with this HD monitor from Kodak.If you have a new puppy that destroys everything in sight, or you just want to be a little more security-conscious, this WiFi camera is a […]