Back

Challenging #ParadigmX · Podcast · 2020

Artificial Intelligence and Rethinking the Principles of Society

De Kai on machine learning, AI ethics and rethinking the founding principles of society

· 64 min · Hosted by Xerxes Voshmgir

Can we program ethics into artificial intelligence, or do we have to teach AIs the way we teach children? AI pioneer De Kai, who helped lay the machine learning foundations of web translation, argues that real AI learns, that creativity is a basic building block of any intelligence, and that the AIs behind social media and search engines are already learning their values by watching us.

We talk about how music and language shaped human intelligence, the shift from hand-coded logic to machine learning, conscious and unconscious mental processes, why we are all artificial intelligences, his visual simulation for universal mask wearing during Covid, why rule-based AI ethics will fail, algorithmic censorship, and why we need to rethink the founding principles of society in an AI era.

In this episode

  1. 00:00Introduction
  2. 02:19Who De Kai is
  3. 04:47Why he does what he does
  4. 07:28Music, language and intelligence
  5. 11:00From hand-coded logic to machine learning
  6. 17:16Conscious and unconscious mental processes
  7. 23:19Creativity, emotion and AI
  8. 28:24Are we all artificial intelligences?
  9. 33:49The mask simulation and Covid
  10. 42:22Why ethical rules cannot be programmed into AI
  11. 49:26Raising our artificial children
  12. 51:09AI already decides what we see
  13. 54:30Rethinking the founding principles of society
  14. 61:39How he wants to be remembered

About De Kai

De Kai is Professor of Computer Science and Engineering at HKUST and Distinguished Research Scholar at Berkeley's International Computer Science Institute. He is among only 17 scientists named Founding Fellow by the Association for Computational Linguistics, for his pioneering contributions to machine learning foundations of machine translation that led to the Google/Microsoft/Yahoo/etc translators. De Kai was recruited as founding faculty of the University of Science and Technology in Hong Kong directly from UC Berkeley, where his PhD thesis was one of the first to argue for the paradigm shift toward machine learning based natural language processing. He holds a Kellogg-HKUST Executive MBA and a BS in Computer Engineering (Phi Beta Kappa, cum laude, Revelle College honors) from UCSD.

For his work on AI, machine learning, machine translation, natural language processing, music technology, computational creativity, Debrett's HK 100 recognized De Kai as one of the 100 most influential figures of Hong Kong.

For his work on AI ethics and society, De Kai was one of eight inaugural members selected by Google in 2019 for its AI ethics council.

Bio as published with the episode in 2020.

De Kai's work

Transcript

Edited for readability from the automatic transcript: filler words and false starts removed, names and titles corrected. Words in square brackets were added for clarity. The archived transcript had no timestamps, so the times shown are approximate.

00:00Xerxes Voshmgir

Welcome to Challenging #ParadigmX. My name is Xerxes Voshmgir, and in my podcast I interview people who challenge the status quo.

Can we have artificial intelligence without consciousness, creativity or mindfulness? Language and music are the only things that humans do better than any other species. And what would that mean for the development of artificial intelligence? Can we program ethical rules into the AIs, or can we only teach them like we teach children? And if so, what would that mean for us as societies, as humanity? Do we need to rethink the founding principles of society in an AI era?

Today, my guest is De Kai. De Kai is one of the world's leading experts in the field of artificial intelligence and one of the early pioneers of machine learning and that paradigm shift in AI. He has worked on AI, machine learning and machine translation, as well as natural language processing, music technology and computational creativity. He was recognized as one of the 100 most influential figures of Hong Kong, where he is also professor of computer science and engineering at the Hong Kong University of Science and Technology. Furthermore, he is a distinguished research scholar at Berkeley's International Computer Science Institute.

Apart from that, he is a musician and is involved in the field of social impact, to enhance the dialogue between different cultures. This is also reflected in his work: he used his intercultural skills and knowledge, as well as his deep understanding of music and creativity, to develop the world's first AI for web translation, which led to the Google, Yahoo and Microsoft translators. And for his work on AI ethics and society, De Kai was one of eight inaugural members selected by Google in 2019 for its AI ethics council.

So if you're interested in artificial intelligence from a cross-disciplinary and paradigm-shifting perspective, stay tuned.

02:19Xerxes Voshmgir

Hi, my name is Xerxes, and today I'm here with De Kai. It's good to have you here, De Kai.

02:27De Kai

Great to be here. Thanks for having me.

02:31Xerxes Voshmgir

Thank you. So, could you please introduce yourself? Who are you? What do you do?

02:38De Kai

Well, on the one hand, I'm an AI professor. If you know things like Google Translate or Yahoo Translate or Microsoft Translate, I pioneered those sorts of things. I built the first web translation AI and developed a bunch of the machine learning foundations for them. I also work on music technology, AI for computer music, and computational social science.

I was one of the people who pushed machine learning approaches into the field of AI at a time, 30-some years ago, when the field was dominated by what we call good old-fashioned AI: rule-based, manually coded, logic-based systems that were really impossible to scale up. We fought this battle to move away from logic, to stop trying to model the world by writing everything we knew about the world by hand, and instead to model the mind, which is not a logic machine. To model these massively parallel distributed units that fire different activation levels at each other, and from that complex system emerges a learning behavior. I've been pushing on that the whole time.

I've pretty much focused on things that have to do with getting cultures to relate better to each other, to understand each other better. That extends also to my work as a musician, having formed one of Hong Kong's world music groups, as well as my social impact work, fighting discrimination, looking to enhance dialogues between different cultures, and looking at ways to decrease the alarming amount of polarization, divisiveness, fear and hatred that we're seeing, both domestically in many countries and globally in the geopolitical situation.

04:47Xerxes Voshmgir

Okay, great. And please tell us: why do you do what you do?

04:53De Kai

I think I've had the privilege of being shown a lot of the world since I was a child. My parents took us all over the US. They had come to the US as teenagers from war-torn China and Hong Kong and Japan and so on. And they landed literally smack in the middle of the country, in St. Louis, which, as you know, is on the Mississippi River, which separates the East and the West in the US, and on the Mason-Dixon line, which separates the North and the South. So literally right in the middle.

I grew up in the Midwest, in Illinois, the next state over, and it was very mind-opening to see the cultural differences and how they weighed on perceptions of people. And then my parents took us not only to almost every state in the union, but to other countries. We saw things about the developing world that were very, very different. We saw extreme poverty. We saw things that made me question from an early age whether all of the assumptions that were mainstream around where I was growing up maybe were relative to the environment, the economic level, the education level, and of course the cultural background.

I think that these are things that, as we've seen in the last decades, have led to enormous stresses in humanity. And that has really driven me to look for ways, between the technology, the arts, music and social dialogue. There are things that are urgent upon those of us who are able to look at how we can enhance [this], to really ramp that up, so that we don't end up with humanity literally tearing itself apart and destroying itself and the planet in the process.

07:28Xerxes Voshmgir

I'd be very interested in your perspective on what influence music has in your life. And specifically, do you see a connection to your work in artificial intelligence, and in how it lets you perceive artificial intelligence?

07:47De Kai

Oh, very definitely. The thing about human intelligence is that language and music are basically the only things that we humans do better than other species. We don't run faster. We don't fly. We're not very good at climbing trees anymore. We're not stronger. We don't see more sharply. We don't smell more sharply. We're pretty lame as a species, except for our unique abilities in language and music.

And really, music was the foundation of a lot of human language abilities. Our ancestors were singing before they were talking, and early speech probably evolved from using our song abilities to be able to represent ideas about the world. Once we evolved stronger linguistic abilities, we turned around and applied those to music, and so we've been developing more sophisticated types of music using musical languages. So this has co-evolved through a million years, and it leaves us with brains that are supremely evolved for music and language. Those fundamental building blocks underneath are how we implement intelligence.

Therefore, studying music is heavily related to studying language. The same areas of the brain are used, except that music is activating many of them in parallel. It's like exercising those linguistic abilities on steroids. And the kind of creativity, the kind of improvisation and expression in traditional music, teaches us a lot about how the mind creates. Not just how the mind interprets new things that it's never experienced before, but also how it learns and then is able to generalize, to take what it's learned previously and then express new things in real time.

Not in the sense of the very recent aspect of music, especially in the Western European symphonic tradition, where somebody writes out a complex score and then you have trained musicians that do nothing but read and execute that score. That's actually a very artificial, recent form of music that only happened in the last few hundred years. Traditionally, music is improvisational. It has conventions, but it's not the same twice in a row. And you have a conversation between the musicians, who are typically sitting there bouncing off of each other, just like you and I are talking. That tells us a lot about how the brain works, about what kinds of facilities there are with which to learn and to express and to create.

11:00Xerxes Voshmgir

I have a thought now while we're talking, maybe it's far off. Do you think that artificial intelligence, the way it has been created in the last couple of decades, up to the time when deep learning was introduced, and you will know better than me when that point was, had a switch? Compared to music: from the Western type of music, the artificial intelligence before, to, through the work of certain people including you, this more linguistic, improvised, creative approach to programming artificial intelligence? Was there such a change at all, when you look at deep learning, for example, or other stages in the development of artificial intelligence?

11:57De Kai

Yes and no. I think the major change was what I was referring to earlier, when we moved from rule-based, logic-based systems that were coded by hand, so that all the knowledge of the system was written by humans rather than learned by the machine, to machine learning models. Deep learning models are one family of machine learning models.

To be honest, I started playing with what we now call deep learning in the late 1980s, early 1990s. In fact, my postdoctoral year in 1992 at the University of Toronto, I spent happily playing in Geoffrey Hinton's [lab]. Geoff is the granddaddy of deep learning, and I was literally working on what we now call deep learning models at the time. But there are also many other machine learning approaches. Deep learning is not the be-all and end-all. Even Geoff Hinton himself has said on the record: I think we need to throw it all away and start from scratch.

It's a phase. There's a lot of media hype about deep learning these days that is fairly shallow. Those of us who are really working in AI research have already moved on. That's one of the tools in our toolkit, but we're looking at deeper problems, like the issues that I've spoken about on modeling awareness, mindful AIs. You can't really have an AI that is just mindlessly doing deep learning. All that is, is glorified regression, and it's not aware of what it's doing. That's a very important distinction between human-level intelligence and the instinctive, automatic, reflexive types of learning that other species also have.

So when we look at music, you get the same dichotomies. For those of us who grew up playing musical instruments: I don't even remember not playing. My family tells me that I was picking out melodies when I was two years old on the little kiddie [piano]. Nobody had taught me to read music. Nobody had taught me technique. This was just something that you learn by associative pattern recognition, the same way kids learn language. Nobody says to a kid: hey, you're not allowed to speak until I've taught you the rules of grammar and how to read, and once I've done that, you're only allowed to say things when you're reading from the page, written by some poet.

It's done automatically, below the level of consciousness. As you're hearing someone speak, you're not saying: oh, that was a verb, that was the agent that was speaking. You're not doing that. It's all happening at the unconscious level. And it's very much the same thing with music. If you've learned music in this natural way, as opposed to the recent artificial way, that teaches us a lot about how the mind works.

But at the same time, once you've done that, and you start creating, and you start thinking: how would I compose a piece? Or if I'm a DJ, how would I construct this track? Now you're applying the linguistic side. Now you're really thinking the way that a poet would think. So you've got all those different types of mental processes going on, and studying music helps us also to understand that about the nature of human intelligence.

16:28Xerxes Voshmgir

Okay. And the way artificial intelligence is programmed today, and the research that's done today, goes also more into this direction?

16:38De Kai

I think it's going to, increasingly. It is not very much out in the popular awareness, the popular press, yet. But people who are at the forefront of AI research are thinking about these problems and are making proposals. Our lab is certainly integrating both the automatic, unconscious, fast pattern recognition and associative types of processing with more mindful styles of consciously controlled understanding of what it is I'm doing.

17:16Xerxes Voshmgir

And how can we imagine this? What does consciously controlled mean, for example?

17:23De Kai

Well, psychologists have for many decades now been studying the differences between automatic mental processes and controlled or conscious mental processes. Daniel Kahneman, who wrote the bestseller Thinking, Fast and Slow, calls it System 1 versus System 2. There's an enormous amount of empirical data on the characteristics of System 1, or automatic mental processing, versus System 2, or controlled, conscious mental processing, where you're aware of what you're thinking.

The thing is that if you're able to introspect, if you're able to describe your thoughts, that is conscious, controlled reasoning. But something like the fact that you're not thinking, oh, hearing was a verb: that's not conscious, that's unconscious processing. Or if I ask you, for example: do you know what the difference is between walking and running?

18:31Xerxes Voshmgir

I think so. Well, the way you ask it, I wonder if perhaps I don't. But walking is a slow type of movement compared to running, which is a fast type of movement.

18:48De Kai

Sure, that's true. But you've probably also seen these competitive speed walking races, right? So they're walking very fast. And you can run slower than you can [walk]. There is actually a technical difference. Now let me just make sure: you do know how to walk, right? And you do know how to run, right?

19:16Xerxes Voshmgir

Yes.

19:17De Kai

And yet you don't know what the difference is. The difference is that if you're running, both feet leave the ground at the same instant. Most of us know how to walk. Most of us know how to run. And most of us have no idea that that is the difference. That is unconscious mental processes. But now that we've talked about this, you'll have conscious knowledge of it.

19:49Xerxes Voshmgir

Okay. And does it mean there's a way to program artificial intelligence in a way that it becomes conscious about the processes?

19:59De Kai

Yes. That is exactly what needs to happen for AI to actually reach human level.

20:07Xerxes Voshmgir

Okay. Well, I also believe that, but do you believe it's possible? Because some people say it's not possible.

20:16De Kai

Well, I think people get confused about what it means. As soon as you drop in a word like consciousness, there are like nine different definitions of consciousness, and they all depend on assumptions, on some small group of core axioms that you have to take on what you mean. First of all, are we talking about mind-body dualism? Are we looking at issues of the soul, which a lot of people fold into what they are casually thinking consciousness means?

But in the sense that I'm talking about, the consciousness that I'm speaking of is empirically measurable. We're not attempting to say things about the metaphysical soul. We're looking at things that you can actually read from brain scanners, from MRI or EEG. We're looking at speed issues. There's a lot of experimental psychology, cognitive psychology, that you can do with everything from eye tracking to just how fast people can process things and what kinds of mistakes they make. So there's a lot of empirical stuff that has been observed about unconscious versus conscious mental processes.

21:49Xerxes Voshmgir

Okay. All right. And how do you see the connection between consciousness and intelligence? And maybe before you tell me that, could you tell me what your definition of intelligence is?

22:02De Kai

Well, there are different approaches toward defining intelligence. One of them, in the style of Turing, of course, is more of a behavioral definition. If it looks like a dog and it smells like a dog and walks like a dog, it probably is a dog. That's basically the style of definition Turing had in his famous Turing test.

I think from a science point of view, that is a reasonable definition. If you can drop an AI into a new situation that it has never experienced, if it's had the same kinds of environmental upbringing as a human, and if it reacts the same way as a human, then you've produced human-level AI. Again, not ascribing any metaphysical qualities of having a soul to that definition, but that would have achieved human-level AI. And beyond that, if it becomes more powerful in its learning capabilities or its reaction speed, then it starts becoming a superintelligence.

23:19Xerxes Voshmgir

Okay. And in the context of creativity, do you see one there as well, a connection between intelligence, consciousness and creativity?

23:29De Kai

Oh, absolutely. I think creativity is basic. There are a couple of very common clichés that you hear as soon as people start talking about AI casually: oh yeah, these machines are getting incredible, but they'll never be able to have human qualities like creativity and emotion and those sorts of things. And I think that's actually misleading.

When it comes to emotion, that is actually simpler, more primitive and easier to model than truly intelligent human processes like language understanding. Anybody who's had a dog knows that emotion is very basic. You don't need human-level intelligence to have emotion. It's far easier to model. People didn't start doing it until recently, but it's easy to do compared with a lot of other things.

And as for creativity, it is pretty much impossible to have any kind of intelligence without creativity. You cannot have a learning system without creativity, by definition. What does it mean to learn? It doesn't mean to memorize. Memorization requires no creativity, that's true. But to actually be intelligently learning is not just to memorize, like a database does. It's to have been exposed to a few examples, but then you leap to generalizations and you are making inferences in situations you've never encountered before. That by definition is a creative process. To be able to speak a sentence in a new situation, like we're doing now, that we've never done before, requires creativity. These are fundamental building blocks of machine learning, and you cannot have intelligence without those creative building blocks.

So I think it's a comforting myth for a lot of people that machines can't replace humans because we're uniquely creative, and emotion and all of these things cannot be replaced. It's a sentimental notion that doesn't have any scientific basis. I understand very much the human yearning for that, but I think we need to redirect that human yearning to: how do we, with positivity, with the best of the human qualities for creating empathetic societies, deal with the fact that these new machines are already creative and are already, especially in social media, reflecting emotion? Those things are altering our societies in drastic ways.

If we look at the kinds of polarization that I was talking about at the outset: the reason that so much of my work in the last several years has been directed at AI ethics and AI in society is that AI-powered social media and media and search engines are ripping apart our societies, as an unintended consequence of the fact that they're actually amplifying all these natural, evolutionarily hardwired human qualities that cause us to be biased, to believe things that we probably shouldn't believe, and to react in ways that are irrational. In the old days, your tribe would be killed by another tribe if you didn't react that way. But in a modern era, where weapons of mass destruction are being democratized so that ordinary people can be carrying really dangerous weapons of mass destruction, it's no longer tenable. It is no longer survivable for society to be that way.

So we need to figure out how to redirect those sentiments about human emotions, about taking care of each other, and love, and understand how, in our new era where society is already heavily populated by AIs today, we bring those qualities to bear in that mixed society of humans and AIs, rather than allowing fear and hatred and stronger emotions to be learned and propagated by the AIs.

28:24Xerxes Voshmgir

In this context, I wonder what your perspective actually is when it comes to the term artificial, when we talk about intelligence. I mean that in the way that I have the impression that when we call artificial intelligence artificial, of course it means it's not natural. But at the same time, you could also get the impression that it is not equal, because it's just artificial, it's not real.

This could be an interpretation, and when I talk to people and hear people talk about artificial intelligence, it seems to me that this gives them some safety: because it's not real, it cannot be a real threat. I don't necessarily believe that artificial intelligence is the ultimate threat or something, but I believe it's important how we go forth, the way we program it. So what's your take when it comes to the term artificial? Do you think it is the proper term when we talk about this type of intelligence?

29:44De Kai

Well, sure, I actually do. And here's why: you are an artificial intelligence. Look at the Oxford definition of artificial. Pretty close to word for word: made or created by human beings, roughly as a copy of something occurring naturally. I think we can agree that you would not exist unless you were made by human beings, and that you were made as a rough copy of something that occurred naturally. And since obviously you're intelligent, by definition you're an artificial intelligence, and we all are. So I think it's actually a very appropriate term.

30:29Xerxes Voshmgir

Okay, but this is a perspective that most people don't take, of course, because most people don't consider themselves artificial intelligences.

30:40De Kai

Yeah. So I'm working [on that].

30:45Xerxes Voshmgir

Okay. I see. All right. But you could then also say, if you turn it around, that computer-based artificial intelligence might in a way be similar to human intelligence, or what we call natural intelligence.

31:06De Kai

Yeah, indeed. I think we're getting closer and closer to models in the field of AI that are getting more natural. We're still quite a distance off, but I think that for AI to progress, it has to get more natural. AIs cannot be mindless; they'll never be intelligent that way.

Today's AIs, because they're mindless, require exponential amounts of data. And so people have confused AI with big data. If you're going to process big data, you also need exponential amounts of computation power, which is why you have these enormous farms of CPUs and GPUs these days. But when we look at a human brain, it's being powered by less electricity than a 100-watt light bulb. You don't need that much computation or that much data if you have human-level intelligence. A true AI is actually small data: it is able to make those intelligent generalizations from the same amount of small data that a three-year-old kid learns from. So it is inevitable that progress in AI will drive us closer to natural intelligence.

32:34Xerxes Voshmgir

Okay. And is there a timeframe that you personally believe is realistic?

32:39De Kai

I am always reluctant to say this, because one of the terrible things about the field of AI is that it has a long history of always predicting that the problem would be solved in 20 years. And so if I say the problem will be solved in 20 years, 20 years later people will still be saying that.

That said, progress has been incredible, going back about 30 years, to when I was finishing my PhD and still fighting the battle against good old-fashioned AI, which was hand-coded logic rules. We have made enormous progress in what AI can do today. For the people back then, what we are doing today would be mind-blowing. I have no doubt that that will continue to be the case.

33:40Xerxes Voshmgir

Okay, so maybe let me rephrase: do you believe it will be in less than 200 years?

33:48De Kai

Yes.

33:49Xerxes Voshmgir

I've got another question I'm really interested in. Your work on coronavirus prevention was all over the media. Even President Obama retweeted an article with your statements. Please give us some background.

34:04De Kai

Oh, this was something that happened like for many people. Obviously, we've been really struggling with how to deal with the horrible effects of the coronavirus. Because I have joint appointments at the Hong Kong University of Science and Technology and at Berkeley, I see very regularly what's going on both in the East and the West.

By February, it was really alarming me. Hong Kong was paying attention to the WHO warnings and the warnings from China, and it was already locking down in January. There was an immense amount of [discussion] about what happens on February 1st, when the semester was supposed to begin: should we not physically open up? And indeed, we never opened up physically. We converted to all online teaching for the entire semester.

By mid-February, it was really alarming to me that not only was that discussion not really happening seriously in the West, in the US or Europe, but even face mask wearing was not being discussed. In Hong Kong, literally 99% of the population masked up. I could not go into town without wearing a mask without hearing about it and getting dirty looks, because you're not doing your part to prevent spreading your possible Covid viruses to the other people around you. It was not just about protecting yourself. It was about protecting those around you, the community around you.

But when you looked at the WHO data, or at other datasets, Johns Hopkins or whatever, even though they were listing which countries had social distancing and which countries had testing and contact tracing, they didn't even bother listing which countries had masking. And this was alarming to me, because masking costs far less than testing and tracing and many other measures, and there is no more evidence for social distancing than there is for masking.

So we formed a team rapidly, in late February, with not only me in Hong Kong and at Berkeley, but also people in London, Paris, Helsinki and Tallinn in Estonia, across disciplines: from a medical doctor in London on the front lines of treating Covid, to an economist in Paris, to someone who is actually a senior advisor to the ministry in Finland looking at public policy, and a computational biologist out of Cambridge. We looked really broadly at this, and we built two new theoretical models.

I built an AI-inspired model that combined agent-based modeling, from the long tradition in AI where you have intelligent agents walking about and interacting when they meet each other, to do the predictive modeling. And I made it highly visual, so that you could actually see these agents walking around. You can just take your browser, go straight there and play with it yourself if you like. You can set your own assumptions about how many people are infected, how many people there are, and how effective your masks are at blocking transmission of viruses versus blocking absorption from other people into your system when you inhale, and you can see what happens.

And so I made this four-minute video to explain, as a tutorial, how to use it. The video got a huge amount of interest and led to a cover story in Vanity Fair, which really raised a lot of awareness amongst European and North American states.

Basically, we found that you need 80 or 90% of the population to wear face masks, and you need them to do it fast, before the virus spreads to too much of the population. If only half the population wears masks, it has almost zero impact. And the reason the visual simulation is so good is that this is counterintuitive for most people. Most people think if half the population is wearing masks, then it'll stop half the infections. And that's simply not true, it turns out, because of the exponential behavior of virus spread. Half the population wearing masks has almost zero effect. 80 to 90% is needed in order to have significant impact.

And if you do that, and you combine it with other sensible measures, social distancing, and we do need testing and tracing, then you can control the spread long enough for the scientists to develop the vaccines and the treatments, and prevent the hospitals from getting overloaded. Otherwise we create thousands of unnecessary deaths a day.

So that project was a really cool application of various concepts from AI and computer science to tackle the social problem that is urgent upon us right now, that we're still grappling with: how to save as many lives as possible, and how to be able to exit from extreme lockdowns without risking lives in an excessive way.

In Hong Kong, because we put on masks really early, we have never had to have a strict lockdown. The restaurants have never been closed. We can go out and shop. We do sensible social distancing and we wear masks. To this day, we have had a grand total of four deaths. You're talking about a place with a population of seven and a half million, approximately New York City. In total, we've only had a couple of hundred local transmission cases. Almost all of our cases were imported cases, from people coming back from Europe or the US or other places, and they got tested and quarantined.

So, talking about AI ethics: there are a lot of things that we can do with AI to really have a positive impact on society as a whole, and that's an excellent example.

41:28Xerxes Voshmgir

That's very interesting. And there's a website up where you can [try it]?

41:33De Kai

Absolutely, yes. The best place to start is that explainer video. It's only four minutes long, and you can find it easily at dek.ai, that's my name with the dot in it, slash maskvideo. So dek.ai/maskvideo.

41:50Xerxes Voshmgir

Okay. All right, then I'll also put it into the show notes.

41:56De Kai

Super. In the video description, there are links to the rest of it. There's a website with all the resources, dek.ai/masks4all, with the number four. There's a white paper that is highly visual and easy to read. There's a research paper. There are a number of other related videos, and a list of news stories from around the world.

42:22Xerxes Voshmgir

Okay. I'm very much interested in the topic you also talked about before: ethics and artificial intelligence. Part of my studies was also philosophy, and when I talk about artificial intelligence, it's mostly from the philosophical point of view. Reading about the example of AlphaGo Zero, I got the impression that once the artificial intelligence only needs the rules, it's really important which rules we give or program into the artificial intelligence.

My personal response is: there are the three laws of robotics, of course. And then I go a step further, as a lot of people do, and say: well, maybe we have to look at the big religions to see what the rules are that we should program into artificial intelligence. So my question is not whether you believe that's true or not. My question goes rather in the direction of: do you think it makes a difference if we program ethical rules into the artificial intelligence, and then it's a black box and we don't know what happens? Because, for example, when I talked to Roman Yampolskiy, the way I understood him at least, it does make a real difference, because the moment it reaches superintelligence [it does its own thing].

What's your perspective on that? Do you think it makes a difference which type of ethical rules, so to say, we program into the artificial intelligence? Or once it becomes a superintelligence, will it do its own thing anyway, and it doesn't matter what we program it with beforehand?

44:19De Kai

I don't even think it's possible to program it in, honestly. The kinds of systems that you can program ethical rules into are not even true AI. They're very, very simple systems. Today there's a tendency, a marketing tendency, for everybody to label what they're building as AI. It might be just some if-then rules. Real AI includes learning capability. The machines are learning in the same way that human children learn.

And the three laws of robotics don't really make any sense in that context, because even when you have only three rules, they're constantly in contradiction with each other. Isaac Asimov wrote dozens of highly entertaining stories, and every single one of them was based on a situation where, gee, these two rules create a logical conflict. And imagine now if you try to write an AI system that has several hundred ethical rules in it. The robot will just be paralyzed, because it will constantly be in a state of contradiction.

So how do human children manage this? They learn, right from childhood. You're taught values, you're taught principles, but you also learn trade-offs, and you learn the difficult situations. And it's highly cultural. There are a few ethical rules that are probably universal, like the golden rule: almost every culture has some form of the idea that you should treat others the way that you would like them to treat you. But other than that, different cultures have a lot of variation.

One of the things that makes machine translation hard is that it turns out that language encodes this very deeply. Some of the earliest words that children learn already encapsulate highly culture-dependent values, and you can't even translate three-year-old language because of that. It's really tough to do. And because of that, we have a situation where the ethical rules that an AI would have to operate with would be just as culture-dependent, just as contextual, just as much in shades of gray as for a human. They would be learning those things. They would not be something that you can program in, because modern AI by definition learns.

So you can no more program ethical rules into a real AI than you can hardwire them into a child. There's no way you can unscrew the head of a child and solder in some logical rules. There's no place to connect them in that architecture. A modern AI is the same. So we are going to have to, as a society, come to grips with the fact that we have to teach our AIs in the same way that we teach humans: what are the ethics, what are the values. And we have to set examples, because they're learning from us.

The AIs at Google, the AIs at Facebook and at Twitter, the AIs at Apple and at Microsoft and Amazon: they are learning by watching what you do. You are the training data. You are the example. You are the one teaching the ethics and the values to the AIs, and we all are. And ultimately, just as with humans, there is no substitute for the fact that all of us bear collective responsibility for teaching the AIs, in the same way that we do with humans.

This is one of those things where, because AI has come upon society so rapidly, we are not wrapping our heads around it. We are still thinking about machines as dumb, passive mechanical tools, as slaves. And we don't realize that everything changes when machines actually have opinions and thoughts and can influence our opinions and thoughts. The metaphor of treating machines as mechanical slaves that we can control and program is a dangerously obsolete metaphor that we need to get humanity to throw away as fast as we can.

49:26Xerxes Voshmgir

Okay. So if I understand you correctly, in a way it means that we as humanity need to become a role model for the artificial intelligences, as parents need to be, or are, role models for their children. As a parent, you cannot tell your children not to do this or that. Maybe in the short term you can, but you cannot implement it. And in the same way, we as humanity cannot implement certain rules and paradigms into artificial intelligences, but rather lead by example. Which, if I understand this correctly, the way you say it, means that we actually have to perhaps even make a quantum leap in our development as humanity, so that artificial intelligence will develop in a healthy way.

50:25De Kai

Absolutely, yeah. And that's what my TEDx talk was: it was challenging the audience to ask: how is your parenting? And it turns out that when you actually dive in and look at it, we are violating pretty much every principle of good parenting that we all believe in. And that's why AI-powered tech today is tearing apart our societies. If we all abandoned responsibility for raising human children, society would fall apart. And that is what we're doing now with our artificial children. And that's what's so dangerous.

51:09Xerxes Voshmgir

Okay. So what do you think are the paradigms that need to be challenged in the field of artificial intelligence, but perhaps even more broadly than artificial intelligence, for us as humanity to develop in a healthy way, and to develop our artificial children in a healthy way?

51:29De Kai

To me, that is the paradigm that we need to challenge and to shift. This is a change that is already upon us. This happened while we weren't watching; it snuck up behind us. And we are still living as if we were in the 20th century. We are still pretending that things can go on.

A lot of AI ethics is still, I think, unconsciously trapped in a mindset of thinking: how can we preserve the status quo in society? How can we design AI so that it doesn't change the structure of society? And I think that that is impossible, even with the weak AIs of today. We are seeing how impossible it is, even if we just look at the news from the last week: Twitter finally deciding that they are going to slap labels on what they consider to be dangerous or false statements, even from a US president, and the pushback on that, and Facebook still refusing to do it.

We are already today living in a situation where we are grappling with the consequences of the fact that the AIs are already deciding, based on imitating humans and learning from human behaviors, which ideas to spread and which ideas to censor, to filter out.

I want to be sensitive about the wording here, but an AI that is working for a social media or search engine company: its job is to decide what are the top 10 or top 20 posts or hits to display to you. You don't get to see the other billion. 99.99% of people never look past the first 20 options. That is, in reality, de facto algorithmic censorship. And there's no way to get around that. You have a lot of useless discussion saying: oh, AIs shouldn't be censoring. It's impossible, because you cannot read a billion posts. That algorithm is going to decide what you don't see.

So AIs are already, by necessity, the deciders of what you do and don't see. And how we teach those AIs is not a question that we can continue to avoid if we want our societies to survive. That is the major paradigm shift that needs to happen, not just among tech developers. That is a major paradigm shift that needs to happen for every member of 21st-century societies.

54:30Xerxes Voshmgir

Okay. And is there anything more you would like to elaborate on about the structures you talk about, how this is structurally affecting us? You said the way we approach it is that we want to maintain the social status quo. So do you have an idea in which direction it ideally goes, how artificial intelligence will fundamentally change [society]? Is there a utopia that you see? Or is it just that you can say: well, the way it develops now is not healthy and we need to rethink, but this needs to be a creative process where there is no obvious solution yet?

55:15De Kai

First of all, I think the concepts of utopia, and maybe dystopia as well, are like fairytale metaphors from certain cultural traditions. They tend to be absolutist traditions, the same kinds of traditions that give rise to the idea of universal truths, that sort of absolute. Those are myths. They don't exist in the real world. The real world is a process. It's a continually evolving flow, and I think the sooner we realize that, the better. It's a convenient metaphor, we can talk about utopia versus dystopia, but we shouldn't get too hung up on that, because it's not real.

What is real is how we evolve our cultures, how we evolve our civilizations, and whether we avoid extinction. What is real is how much we can do away with human suffering, which is still at unethically large levels, given the wealth of our planet today.

I think we need to focus on the fact that it's inevitable that human intelligence and artificial intelligence are merging. That is already happening today. Half of my brain is already in my phone over here. I can no longer remember numbers; I used to be legendary at doing it. I have no sense of spatial orientation anymore. I mean, it was bad enough to begin with, but now I'm basically lost without my GPS.

To me, there's a little bit of nostalgia: oh, it was nice to be able to do that. But it's also incredible freedom, because I have offloaded dreary tasks to the machine, freeing up so much of my cognitive capacity for creative things and other aspects of thinking. And this synergy, this coupling of processing between my primitive artificial intelligence here in my phone and my human intelligence, is the tip of the iceberg.

We are going to rapidly see, in the coming decade, various forms of AR, of augmented reality, that will make the interface with my phone screen look clumsy. It will become much more instantaneous: what I want, what I'm thinking, what I'm retrieving, just in my field of vision or in my ears. And that's before we even get to, eventually, inevitably, brain implants.

So all of this is going to happen. There are going to be older generations that resist kicking and screaming and say: oh my God, we're losing what it means to be human. The younger generations aren't going to care at all. Let's be honest. The kids of today are doing things with TikTok and everything else, and the older generations can yell until they're blue in the face, and it's not going to change what the younger generations do with the technology, because it is freeing. The natural tendency to be nostalgic and to sentimentally want to hold on to what we were familiar with when we were kids just doesn't carry enough weight against the additional power that AI and tech are able to give to the creativity of the younger generations.

So acknowledging that, and using that to rethink how we need to reform our societies, is essential. I'm American, and the founding fathers in the US, 250-ish years ago, thought long and hard about how to define the constitutional principles. They did a lot of what we today would call systems thinking: trying to figure out all of the interplay in a complex dynamic system and how to keep balances. And it sort of worked for a while. But it still led to an awful, bloody civil war, the effects of which we are still grappling with, even this week in the news, as everybody is saying. And the situation is being made much worse, spiraling out of control, by all the amplification of AI-driven tech, social media, et cetera.

So once again, it is time to rethink the way our founding fathers thought, in the US, and in parallel in many other countries as well. It is actually long past time for us to rethink, in a modern era with AI at the core of so much transfer of knowledge and information: what are the complex system dynamics? We cannot just blindly assume that principles defined 250 years ago, or even 50 years ago, still apply. They don't. It's a brave new world. We need to do that rethinking.

I don't think we can survive doing that through another revolution. The weapons that we have today are far too dangerously destructive. We're not just talking about unreliable muskets. We really cannot afford a revolution, in a hard sense, to do this. We have to raise enough public awareness to be able to understand the absolute need to reframe the founding principles of society in an AI era.

61:39Xerxes Voshmgir

So my last question is: when you imagine yourself looking back at your life from your deathbed, at everything you've done, what's the impact that you want to have had on your life and on humanity?

61:57De Kai

I would just like to have made contributions to get humans to overcome their natural, unconscious biases against having greater understanding between different peoples, between different cultures, between different neighborhoods.

Our biggest danger, with all of this AI-driven amplification of fear and hatred and divisiveness, is our own natural tendency to divide everything into our in-groups and out-groups. That is a process that dehumanizes the out-groups. If we're going to struggle with the question of what the artificial does to our society, then we need to really focus on those biases that cause us to dehumanize too much of our society.

62:45Xerxes Voshmgir

Okay, thank you very much. Thank you for your time and the interview.

62:52De Kai

Pleasure.

62:53Xerxes Voshmgir

It was a pleasure for me. Have a nice day then.

62:58Xerxes Voshmgir

Thank you for staying tuned for this edition of Challenging #ParadigmX. If you liked this episode with De Kai, feel free to share it with your community, so De Kai's message gets spread even further. In the show notes, you'll find links to his work and his multiple TEDx talks.

Please hit subscribe and rate my podcast. If you like it, I'd also be glad if you write me a review. You can support this podcast through Patreon. And if you have any questions or comments, feel free to contact me. Next week we're up with another edition of Challenging #ParadigmX. So until then, I wish you a great week and say ciao.

Back to top