Riffing off of Jason's recent post on progress safety . . .

I was trying to classify unintended negative consequences of new technologies, with the idea that this would help predict what they might be for current and future innovations. With a better understanding of potential downsides we might have better chance at solving or addressing them in advance. 

Kevin Kelly wrote a good post putting the effects into 2 classes: "Class 1 problems are due to it not working perfectly. Class 2 problems are due to it working perfectly."

What are the categories one level down? Here are the ones I could come up with but I'd love to hear other thoughts:

  • Large scaling effects -- no issue at small scale usage but at large scale bad
  • Harmful waste product
  • Over reliance on use (makes users fragile) -- probably true of most tech
  • Unsustainable inputs
  • Maladaptive health -- adds or removes something our bodies aren’t used to and can’t adapt to over 1 generation
  • Increases mimetic rivalry
  • Destroys existing stable social systems
New Answer
Ask Related Question
New Comment

3 Answers

Early adopter influence is one in some cases, I think when the tech plays a part in providing infrastructure, perhaps also elsewhere.

Kelly talks about crypto, and this is my motivating example here:

Today, though decentralised in name, most of the biggest organisations in crypto are controlled by tiny groups of people, typically single digits (for the orgs where voting takes place on the blockchain, you can verify this yourself).

Such concentration isn't really a problem when a space is small, like crypto is today (relatively: <1 million active users by far; etc). But it becomes significant when the tech becomes widely adopted. For example, Ethereum, the most important blockchain right now, is de facto (could argue de jure) controlled by Vitalik Buterin. If trillions of dollars of industries are moved onto Ethereum (like, perhaps the $14tr securities mkt), then that becomes problematic (specially if people less -minded then Vitalik are influential!)

New infrastructure technology creates new elites from the people who were there first. I suppose trains are a historic example. That concentration of power only comes when blockchain works really well, but it can be problematic

The existence of most of the ones you listed sounds questionable.  

How about economic risk exposure (for a given person/city/state)? I think there is already a ton of research on this.

E.g. funding some new nuclear power research could provide a 10000x ROI but .0000X% danger of destroying the city/area of the research facility.

As I was writing that post, I was thinking in the back of my mind about this distinction:

  • Operational safety: safety from things that are already happening, where we can learn from experience, iterate on solutions, and improve safety metrics over time
  • Development safety: safety from new technology that hasn't been developed yet, where we try to mitigate the harms ahead of time, by theoretical models of risk/harm, or by early small-scale testing ahead of deployment, etc.