What Happens to Trust in the Age of AI?

I attended an interesting seminar at the residence of the Swedish Consul General in New York (Camilla Mellander) this past Tuesday. It was part of the consulate’s Transformative Talks series, and the topic of the night was The Future of Trust in the Age of AI. 

Kimberly Springer, curator at Columbia University moderated a discussion with Swedish panelists Martin Gelin (journalist and author) and Martin Adolfsson (artist and photographer) – both based in New York. The discussion was lively and there were many questions from the audience reflecting both a curiosity and a healthy skepsis about the impact of the explosive growth of AI in the aftermath of the 2022 launch of ChatGPT 4.0 based on Large Language Models (LLMs). 

What happens to trust when we seem to be surrounded by an ever-growing stream of manipulated stories and enhanced or fake images? What and who can we trust? Is more regulation the answer, or even feasible? Is media education the answer? Will the emerging AI-world self-regulate in the interest of the common good? Big questions, which nobody knows the answer to today. But it's not only a matter of what the AI-researchers and companies do. 

The deeper question is how we as human beings react in this new environment. Will we cynically take a huge step back and seek comfort in tribalism and conspiracy theories? Will we find a way to navigate a world where confusion grows despite the explosion of facts and theories? 

I put together a couple of links to articles that provide a background to those and other questions.

Why Facts Don’t Change Our Minds - New discoveries about the human mind show the limitations of reason. By Elizabeth Kolbert

Don’t Believe What They’re Telling You About Misinformation. By Minvar Singh

The Fake Fake-News Problem and the Truth About Misinformation. By Minvar Singh

Thoughts on “The Enigma of Reason”.  By Arthur Juliani

The cerebral mystique. By Arthur Jasanoff

Will A.I. Be a Creator or a Destroyer of Worlds? By Thomas B. Edsall

Da Capo, Dr. Strangelove! This Time With Artificial "Intelligence"

Just around the corner, it seems, are autonomous killer drones, killer robots and killer whatever. And of course we have to have them to make sure that the other side doesn't get them first. Not to mention the fact that miscellaneous terrorists near and far will one day get their hands on them too.

"Almost unnoticed outside defense circles, the Pentagon has put artificial intelligence at the center of its strategy to maintain the United States’ position as the world’s dominant military power. It is spending billions of dollars to develop what it calls autonomous and semiautonomous weapons and to build an arsenal stocked with the kind of weaponry that until now has existed only in Hollywood movies and science fiction, raising alarm among scientists and activists concerned by the implications of a robot arms race.
The Defense Department is designing robotic fighter jets that would fly into combat alongside manned aircraft. It has tested missiles that can decide what to attack, and it has built ships that can hunt for enemy submarines, stalking those it finds over thousands of miles, without any help from humans. 

'If Stanley Kubrick directed ‘Dr. Strangelove’ again, it would be about the issue of autonomous weapons,' said Michael Schrage, a research fellow at the Massachusetts Institute of Technology Sloan School of Management."

Matthew Rosenberg and John Markoff: The Pentagon's 'Terminator Conundrum': Robots That Could Kill on their Own. (New York Times, October 25, 2016)

Hoping for a Hollywood ending?

Dream on!

P.S. I noted the coming of autonomous killer robots in a blog post from 2013.

Have a Wonderful Day Writes Barnes & Noble’s Eliza, Who Is Not Quite "Her"

My wife Lisa bought me the audiobook version of Miguel de Cervantes’ wonderful novel Don Quixote for Christmas. The recording was based on Emily Grossman’s excellent translation, which I have wanted to listen to since I bought the softcover version in 2003. The price was rather steep, so I never bought it, but now I had it, and I began to listen to this wonderful story. The weeks passed and I listened to the story in the car almost every day. After about a month, something funny, or actually sad happened while listening on what turned out to be file 11 of the audio-download. The spoken book skips ahead, leaving the reader confused. At first I thought it was my mistake as a listener, but when I listened closely and compared the audio to the printed version I discovered that file 11 of the audiobook was messed up.

I wrote to Barnes & Noble and told them about the error, and a representative from Nook – the tablet area of B&N answered with an apologetic email where they explained that they would get in touch with the publisher of the audiobook and get back to me. A month later I remembered their unfulfilled promise and wrote back to Barnes & Noble. Here is a quote from my letter:

We had an exchange earlier this year, after my complaint that the file Part 11 contained an error as several pages of the book had been mixed up. The audio skips from line 11 on pg 281 in the printed book (Harper Collins,2003) to line 2 from the bottom on pg 297 and then the reading continues on line 12 on pg 281 and goes on the end of the chapter on pg 288.

On February 20, I got an email from Mark, a Customer Service Rep at B&N/NOOK support:

We understand that you are concerned about the status of fix for audio book. We are happy to help you. To protect your privacy and before we can send our answer to you, we need your order number, which you can find in the subject line of your order confirmation email or within the body of the email.

If you no longer have your order number, one of the following pieces of information will be helpful:
-The last 4 digits of the credit card used on the order, or
-Your billing address AND the title of one of your items. 

We also need the email address you used to place your order if it is different than the one you are using to respond to this email.  (If you reply to this email from another email address, please include your original inquiry.)

I searched my email folders, but couldn’t find the order number, so I provided them with the last four digits of the card they asked for, as well as the billing address and title of the book.
The next morning I received a new email from NOOK support.

Dear Hans,  

Warm greetings from Barnes & Noble!  

Thank you for writing back to us. We understand that there is a content issue with the Audio book which was sent to you as an eGift and you were informed that it would be investigated and fixed. We apologize for the inconvenience caused as this issue was not resolved upon your initial contacts with us and we will do our best to resolve this issue for you. In order for us to check your account about the Audio book we need the email address which was used to purchase the book as we did not find it in your account, or if you have the service request number of the initial interactios with us when you were informed about investigating on the issue. This would help us in checking the records and the status of the issue. Just to confirm, please visit the link below:
http://www.barnesandnoble.com/w/don-quixote-by-miguel-de-cervantes/1100547792?ean=2000003448296
Are you referring to the same book in the above webpage? We feel that this could be resolved best by contacting us through our phone support line or you could also write back to us with the required information.

Warm greetings ... that felt nice! But the sentence where Ethan, another Customer Service Representative, writes that “we understand that there is a content issue” reminds me of “talking” to Eliza, one of the first chatterbots, i.e. a computer program that mimics a human being. Joseph Weizenbaum's virtual psychotherapist Eliza took excerpts from a persons sentences and restated them in order to get the person to tell more. In her email, Ethan asks for my wife’s email address, and wants me to confirm if the book she provides a link to is the one I have complained despite the fact that I already told Mark that I was referring to Grossman’s translation.  I wrote back, supplied my wife’s email address, and explained the situation again. Later the same day, I got another email from NOOK support, this time from Vicky at Customer Support.

Thank you for writing back to us. We understand that you're still receiving incorrect Audio book. We apologize for the inconvenience caused. We are ready to issue a full refund for the Audio book, please get back to us with the confirmation.

By now I’m seriously suspecting that I am not communicating with persons at all, but with a sloppy chatterbot. The emails are ill written, but not the way a human errs, unless the writer behind the digital curtain is just cutting and pasting in a hurry.  “Vicky” also ignores my answer to “Ethan’s” question about the link he provided.  To be fair, I should say that I was offered to chat with "one of our Digital representatives for further assistance,” but my trust in the digital team had by now extended to “Chat Team,” so I kept writing to Mark, Ethan and Vicky, but my frustration was showing.

To: NOOK@BARNESANDNOBLE.COM
Sent:02/24/14 06:29:12 

Subject: RE: RE: RE: FW: Problem with Don Quixote audiobook

Hi Mark, Ethan and Vicky, Are you guys real or an algorithm? Or did NOOK support repurpose ELIZA for customer support?

You are rephrasing my previous emails, but it seems like you are not really reading them. I have given you the information you asked for, so you should be able to answer my question about the error in file 11 of the Don Quixote audiobook (the Emily Grossman translation). I was previously promised that you would investigate with the publisher, but you have asked about other editions and now offer a refund, something I never asked for. What’s going on?

It didn’t take long before I got an answer, this time from “Chase.”

RE: RE: RE: RE: FW: Problem with Don Quixote audiobook 

Dear Customer,  

Thank you for writing to us. We understand that there is a content issue with the Audio book which was sent to you as an eGift and you were informed that it would be investigated and fixed. We apologize for the inconvenience caused and will be glad to assist you with this issue.  

We have checked with your BN account and found that the credit card information status shows unverified. If you have further questions or inquiries, please feel free to contact us again and we would be glad to assist you.  

Wishing you a wonderful day!  

Sincerely,  

Chase  

Customer Service Representative - Digital Support  

**{SrvReqNo:[8007760501]} ** DO NOT DELETE**

To which I just answered:

Dear “Chase,” “Vicky,” “Ethan,” and “Mark,” or “Eliza” for short,

The content issue is the simple fact that you are selling a product with an error in the recording/editing that leaves the listener confused at one point. My reason for writing to you in the first place was concern that other customers may not realize that the confusion in file 11 of the audiobook is due to a production error, and that Barnes & Noble might be interested in correcting this error and provide a correction in the form of a replacement file, but I get no sense that you are interested in supporting your customers on this issue, which disappoints me as a long time B&N customer.   

As for the credit card, this is totally irrelevant as 1) I am not purchasing anything, 2) not asking for a credit, and 3) don’t store my account number in your system, but only enter it when I shop.    

Best, 

Hans    

PS. I wonder how many turns we are going to take in this waltz before a human is called in.

Addendum, February 25, 2014.

Today I got an answer from B&N that looks like it was written by a human being.

Dear Hans Sandberg,

We understand that you are concerned about the contents of the purchased NOOK book. We can see how that would annoy you and apologize for the inconvenience. As the issue is not resolved and our content management team is working to make necessary corrections on the file. We request that you wait for 2 more weeks or we would go ahead and refund for the order

It's like somebody finally took a step back, or maybe a supervisor stepped in, and said that we may need to actually read what the customer is writing. It's going to be interesting to see what will happen next. In the meantime, I have found the order number, which I will send to NOOK/B&N.

It's Complicated, In Fact, It's so Complicated That You May Never Be Able to Understand

This essay (almost) blew my mind, and connects nicely (if nice is the word for a rather scary concept) with Samuel Arbesman's essay "It's Complicated" in Aeon Magazine. In the essay "The Algorithms of Our Lives" for the Chronicle of Higher Education, Lev Manovich raises fundamental questions about how we study (and can study) a reality that is becoming entangled in a world of dynamic and ever-changing data flows and updates. His focuses on the study of humanities, but the argument is much broader than that, and he sees implications for how research is done, what we measure or even can measure.

"We need to be able to record and analyze interactive experiences, following individual users as they navigate a website or play a video game; to study different players, as opposed to using only our own game-play as the basis for analysis; to watch visitors of an interactive installation as they explore the possibilities defined by the designer — possibilities that become actual events only when the visitors act on them. In other words, we need to figure out how to adequately represent 'software performances' as 'data.' "

Much of this kind of research is done within companies like Google, Facebook and Amazon.com.

"Therefore, if you are one of the few social scientists working inside giants such as Facebook or Google, you have an amazing advantage over your colleagues in the academy. You can ask questions others can't. This could create a real divide in the future between academic and corporate researchers."

Not only that, much of this research is done by "machine-learning technology that often results in 'black box' solutions." If complexity makes understanding impossible, what does that mean for education? Could simulation games like SimCity be part of the answer? Here is a quote from the essay:

"For example, the computer game SimCity, a model of sorts, gives its users insights into how a city works. Before SimCity, few outside the realm of urban planning and civil engineering had a clear mental model of how cities worked, and none were able to twiddle the knobs of urban life to produce counterfactual outcomes. We probably still can’t do that at the level of complexity of an actual city, but those who play these types of games do have a better understanding of the general effects of their actions. We need to get better at ‘playing’ simulations of the technological world more generally. This could conceivably be geared towards the direction our educational system needs to move, teaching students how to play with something, examining its bounds and how it works, at least ‘sort of’."

A Global Mind Or Just Interconnected Ones?

Can a company be intelligent? An organization? A country? One could say that a culture embodies and transfers accumulated wisdom and knowledge, but cultures evolved slowly until transportation and communication technology allowed for faster migration of people and ideas. Today we have cloud computing, instant communication and cultural flux. I don't think we will ever fuse our minds into a "hive mind", but our minds are becoming ever more extended and interconnected, allowing mental winds (trends, memes) to shake up organizational structures built on established social, intellectual and political patterns.

Exploring Humanity’s Evolving ‘Global Brain’

V.S. Ramachandran Talks About Qualia and the Self

This is a brilliant discussion of consciousness, qualia, and self by Dr. V.S. Ramachandran, director of the Center for Brain and Cognition at University of California in San Diego. You could connect this to the old debate about computers and the human mind (John R. Searl's critique of Strong AI). It's comforting to think that HAL will never be one of us...