17 Comments
User's avatar
Nadège Lejeune, PhD's avatar

Amazing post! So detailed and thoughtful. There’s so much to think about, it’s a little mind boggling…

Expand full comment
Joanna Milne 🏺's avatar

Thank you so much Nadege. And I left so much out too … it was a little on the long side, and I could have gone on much more. Mind boggling is the exact word for it.

I didn’t want to make it too scary without hope, or too preachy or teachery so I hope I got some kind of balance. It is an enormous subject. I discovered yet another useful link after I posted. For those who want all the possible risks … 😆

https://airisk.mit.edu

Expand full comment
Anh K. Quach's avatar

You had me dying at the Oedipus line. This was such a great look at what’s here, what’s ahead, and the potential ramifications some of which we’re already seeing. There was a time when I was obsessed with reading futurists like Ray Kurzweil, and I truly believe we are only seeing the tip of the iceberg in terms of how ethics will play out as the tech progresses. I think you also mentioned some time back about how your husband is skeptical about the actual achievements with LLMs, and how far away we are from actual AGI—I would agree, but at the same time I think what we’re already seeing is extending far beyond hypothetical trolley problems in 101 courses.

P.S. I’m always super impressed with the level of research you put into your articles, even down to finding appropriate pictures to include.

Expand full comment
Joanna Milne 🏺's avatar

Thank you so kind ❤️

Expand full comment
Susan Dirmikis's avatar

Very impressive article which has given us so much to think about.

Expand full comment
Joanna Milne 🏺's avatar

Thanks - I missed out speed in what I said above. That’s another factor too I think as you mentioned.

Expand full comment
Dom de Lima's avatar

Thank you for this fascinating piece, Joanna.

It made me reflect on how, with each major technological shift, we seem to revisit the same core concerns: job loss, inequality, misuse, surveillance, loss of control. It feels like we’re always saying, ‘here we are again.’ But it leaves me wondering, does AI make it fundamentally different this time? Is it the speed, the opacity, the reach into democratic systems, or something else entirely? I’d love to hear thoughts on this :)

Expand full comment
Joanna Milne 🏺's avatar

A big question. Lots to say. It feels different this time. A few initial thoughts on why:

-The proportion of people who have the power to decide how AI should be doing things in comparison with the rest of the population (and who don’t necessarily have a vested interest in doing what’s best for large groups of people) is smaller. The monopolies were seeing are unprecedented this time and it’s likely to be linked to the snowball effect because of data hordes which is also new

-the huge potential for errors

-how widely it will seep into every aspect of life (again I think this is different to what we’ve seen before - people are looking to use it in health, the justice system, publishing, education, entertainment, business etc)

- the fact the government have less control than ever before

- the greater opacity this time

Possibly more to add, and maybe I should do a follow up on this because I have lots more info, but those are my initial thoughts

Expand full comment
Dom de Lima's avatar

This gives me a lot to think about already Joanna. Thank you. I look forward to your upcoming articles !

Expand full comment
A Horseman in Shangri-La's avatar

Great post this Joanna 🙏

You've got a new follower! (welcome to support me too) BTW what would you say of the creative idea for an AV-like tool that enable laypersons to make this "human rights" choice on his/her devices e.g.

Android, iPhone

Windows PC, iOS Mac

Linux variants

And then voila

NO MORE DEVASTATION ☠️

Your thoughts?

horseman 👋

Expand full comment
Joanna Milne 🏺's avatar

Yes given there wasn’t consent obtained in the past, it does make one inherently suspicious about whether it is ever possible to withhold it - he’s asleep now but I’ll ask him when he wakes up :)

Expand full comment
Joanna Milne 🏺's avatar

I recommend the LSE course on AI and Ethics - available to people all over the world. People on the course did care about the ethics, which I suppose should give us some hope. But most of us don’t currently get much say on the legislation or the governance.

Definitely a case of watch this space I think

Expand full comment
Joanna Milne 🏺's avatar

I’ve followed back - AI is a subject I’m interested in too but which is also depressing me a lot!

I don’t see how we can opt out of it like this because we are constantly engaging with others who are opting in. Recruitment is one example. Once they have your cv on their device they will do what they want in terms of how they choose to analyse it. Government surveillance or surveillance by others in public places or work places is another.

Any application made which is then reviewed on someone else’s device. I just don’t see a way of opting out unless the other side also opts out

Expand full comment
A Horseman in Shangri-La's avatar

Thank you Joanna. I've now read your essay a second time. I missed the fact that you are a Barrister, therefore you have a legal, ethical, etc. insight that others don't have.

Forget what I mentioned in my first comment about a AV-like tool. I would rather value your feedback on my recent posts about what I sarcastically called, Abolition Imagined.

The biggest soft belly I see on this jaggernaut relates to governance, and that is obviously a legal thing. You, and other legal minds like you, may be uniquely gifted to bring the necessary "checks and balances."

I'm a veteran ICT professional, using a pseudonym to protect myself in this digital maze of surveillance and risk. Perhaps people should go undercover to collaborate on this, cause big brother is watching us.

Yours sincerely

horseman 👋

Expand full comment
Joanna Milne 🏺's avatar

Not heard about this yet but sounds interesting.

One thing which also marginally helps according to my tech husband if people are going to use it is to download the AI locally so you’re not sharing confidential information in the cloud. But some of them are so huge you can’t do this.

Expand full comment
A Horseman in Shangri-La's avatar

I'm not so sure sbout the feasibility of that local "containment" idea. Thing is unfortunately recent history shows us as that big tech has been quite unscrupulous, even deviously, in siphoning our data into their big data models.

Recently it was disclosed that Microsoft installed its latest AI (copilot) on millions or possibly billions of devices without asking for any consent. This is what is driving people up the wall, not the AI per se, but the **way** this is being done - with absolutely no respect for ethics, moral principles, privacy, etc.

Expand full comment
Demos's avatar

A brilliant introduction to a hugely important subject. Looking forward to any more of your thoughts on the issues discussed

Expand full comment