TED2019
Arnav Kapur: How AI could become an extension of your mind
Filmed:
Readability: 4.9
601,116 views
Try talking to yourself without opening your mouth, by simply saying words internally. What if you could search the internet like that -- and get an answer back? In the first live public demo of his new technology, TED Fellow Arnav Kapur introduces AlterEgo: a wearable AI device with the potential to let you silently talk to and get information from a computer system, like a voice inside your head. Learn more about how the device works and the far-reaching implications of this new kind of human-computer interaction.
Arnav Kapur - Technologist
TED Fellow Arnav Kapur invents wearable AI devices that augment human cognition and give voice to those who have lost their ability to speak. Full bio
TED Fellow Arnav Kapur invents wearable AI devices that augment human cognition and give voice to those who have lost their ability to speak. Full bio
Double-click the English transcript below to play the video.
00:13
Ever since computers were invented,
0
1917
1767
00:15
we've been trying to make them
smarter and more powerful.
smarter and more powerful.
1
3708
3601
00:19
From the abacus, to room-sized machines,
2
7333
2768
00:22
to desktops, to computers in our pockets.
3
10125
2851
00:25
And are now designing
artificial intelligence to automate tasks
artificial intelligence to automate tasks
4
13000
3434
00:28
that would require human intelligence.
5
16458
1834
00:31
If you look at the history of computing,
6
19542
1934
00:33
we've always treated computers
as external devices
as external devices
7
21500
3226
00:36
that compute and act on our behalf.
8
24750
2333
00:40
What I want to do is I want to weave
computing, AI and internet as part of us.
computing, AI and internet as part of us.
9
28167
5892
00:46
As part of human cognition,
10
34083
2560
00:48
freeing us to interact
with the world around us.
with the world around us.
11
36667
2250
00:51
Integrate human and machine intelligence
12
39833
2643
00:54
right inside our own bodies to augment us,
instead of diminishing us or replacing us.
instead of diminishing us or replacing us.
13
42500
4833
01:00
Could we combine what people do best,
such as creative and intuitive thinking,
such as creative and intuitive thinking,
14
48583
4185
01:04
with what computers do best,
15
52792
1392
01:06
such as processing information
and perfectly memorizing stuff?
and perfectly memorizing stuff?
16
54208
3768
01:10
Could this whole be better
than the sum of its parts?
than the sum of its parts?
17
58000
2833
01:14
We have a device
that could make that possible.
that could make that possible.
18
62167
2809
01:17
It's called AlterEgo,
and it's a wearable device
and it's a wearable device
19
65000
2643
01:19
that gives you the experience
of a conversational AI
of a conversational AI
20
67667
3017
01:22
that lives inside your head,
21
70708
1601
01:24
that you could talk to in likeness
to talking to yourself internally.
to talking to yourself internally.
22
72333
3584
01:29
We have a new prototype
that we're showing here,
that we're showing here,
23
77279
2239
01:31
for the first time at TED,
and here's how it works.
and here's how it works.
24
79542
3000
01:36
Normally, when we speak,
25
84292
1267
01:37
the brain sends neurosignals
through the nerves
through the nerves
26
85583
2810
01:40
to your internal speech systems,
27
88417
2142
01:42
to activate them and your vocal cords
to produce speech.
to produce speech.
28
90583
3459
01:47
One of the most complex
cognitive and motor tasks
cognitive and motor tasks
29
95107
2286
01:49
that we do as human beings.
30
97417
1458
01:52
Now, imagine talking to yourself
31
100125
2059
01:54
without vocalizing,
without moving your mouth,
without moving your mouth,
32
102208
2601
01:56
without moving your jaw,
33
104833
1601
01:58
but by simply articulating
those words internally.
those words internally.
34
106458
2667
02:02
Thereby very subtly engaging
your internal speech systems,
your internal speech systems,
35
110208
4768
02:07
such as your tongue
and back of your palate.
and back of your palate.
36
115000
2625
02:11
When that happens,
37
119000
1768
02:12
the brain sends extremely weak signals
to these internal speech systems.
to these internal speech systems.
38
120792
4392
02:17
AlterEgo has sensors,
39
125208
1726
02:18
embedded in a thin plastic,
flexible and transparent device
flexible and transparent device
40
126958
4226
02:23
that sits on your neck
just like a sticker.
just like a sticker.
41
131208
2209
02:27
These sensors pick up
on these internal signals
on these internal signals
42
135542
2642
02:30
sourced deep within the mouth cavity,
43
138208
1893
02:32
right from the surface of the skin.
44
140125
1708
02:35
An AI program running in the background
45
143910
1858
02:37
then tries to figure out
what the user's trying to say.
what the user's trying to say.
46
145792
3309
02:41
It then feeds back an answer to the user
47
149125
3393
02:44
by means of bone conduction,
48
152542
1767
02:46
audio conducted through the skull
into the user's inner ear,
into the user's inner ear,
49
154333
3643
02:50
that the user hears,
50
158000
1268
02:51
overlaid on top of the user's
natural hearing of the environment,
natural hearing of the environment,
51
159292
3101
02:54
without blocking it.
52
162417
1250
02:58
The combination of all these parts,
the input, the output and the AI,
the input, the output and the AI,
53
166542
3809
03:02
gives a net subjective experience
of an interface inside your head
of an interface inside your head
54
170375
3809
03:06
that you could talk to
in likeness to talking to yourself.
in likeness to talking to yourself.
55
174208
3125
03:11
Just to be very clear, the device
does not record or read your thoughts.
does not record or read your thoughts.
56
179750
3976
03:15
It records deliberate information
that you want to communicate
that you want to communicate
57
183750
2934
03:18
through deliberate engagement
of your internal speech systems.
of your internal speech systems.
58
186708
3060
03:21
People don't want to be read,
they want to write.
they want to write.
59
189792
2726
03:24
Which is why we designed the system
60
192542
1934
03:26
to deliberately record
from the peripheral nervous system.
from the peripheral nervous system.
61
194500
3708
03:31
Which is why the control
in all situations resides with the user.
in all situations resides with the user.
62
199750
3500
03:37
I want to stop here for a second
and show you a live demo.
and show you a live demo.
63
205042
2750
03:40
What I'm going to do is,
I'm going to ask Eric a question.
I'm going to ask Eric a question.
64
208875
2809
03:43
And he's going to search
for that information
for that information
65
211708
2101
03:45
without vocalizing, without typing,
without moving his fingers,
without moving his fingers,
66
213833
3893
03:49
without moving his mouth.
67
217750
1268
03:51
Simply by internally asking that question.
68
219042
2892
03:53
The AI will then figure out the answer
and feed it back to Eric,
and feed it back to Eric,
69
221958
3185
03:57
through audio, through the device.
70
225167
1625
03:59
While you see a laptop
in front of him, he's not using it.
in front of him, he's not using it.
71
227917
3101
04:03
Everything lives on the device.
72
231042
2351
04:05
All he needs is that sticker device
to interface with the AI and the internet.
to interface with the AI and the internet.
73
233417
3791
04:11
So, Eric, what's the weather
in Vancouver like, right now?
in Vancouver like, right now?
74
239458
3959
04:22
What you see on the screen
75
250917
1684
04:24
are the words that Eric
is speaking to himself right now.
is speaking to himself right now.
76
252625
4517
04:29
This is happening in real time.
77
257166
1500
04:31
Eric: It's 50 degrees
and rainy here in Vancouver.
and rainy here in Vancouver.
78
259875
3393
04:35
Arnav Kapur: What happened is
that the AI sent the answer
that the AI sent the answer
79
263292
2726
04:38
through audio, through
the device, back to Eric.
the device, back to Eric.
80
266042
2250
04:41
What could the implications
of something like this be?
of something like this be?
81
269125
2542
04:44
Imagine perfectly memorizing things,
82
272542
3351
04:47
where you perfectly record information
that you silently speak,
that you silently speak,
83
275917
2953
04:50
and then hear them later when you want to,
84
278894
2040
04:52
internally searching for information,
85
280958
2393
04:55
crunching numbers at speeds computers do,
86
283375
2601
04:58
silently texting other people.
87
286000
1917
05:00
Suddenly becoming multilingual,
88
288917
2309
05:03
so that you internally
speak in one language,
speak in one language,
89
291250
2268
05:05
and hear the translation
in your head in another.
in your head in another.
90
293542
2666
05:09
The potential could be far-reaching.
91
297125
2125
05:12
There are millions of people
around the world
around the world
92
300708
2101
05:14
who struggle with using natural speech.
93
302833
2476
05:17
People with conditions such as ALS,
or Lou Gehrig's disease,
or Lou Gehrig's disease,
94
305333
3310
05:20
stroke and oral cancer,
95
308667
1684
05:22
amongst many other conditions.
96
310375
1708
05:25
For them, communicating is
a painstakingly slow and tiring process.
a painstakingly slow and tiring process.
97
313917
3625
05:30
This is Doug.
98
318667
1601
05:32
Doug was diagnosed with ALS
about 12 years ago
about 12 years ago
99
320292
2309
05:34
and has since lost the ability to speak.
100
322625
1917
05:37
Today, he uses an on-screen keyboard
101
325292
1976
05:39
where he types in individual letters
using his head movements.
using his head movements.
102
327292
3351
05:42
And it takes several minutes
to communicate a single sentence.
to communicate a single sentence.
103
330667
2916
05:46
So we went to Doug and asked him
104
334583
1851
05:48
what were the first words
he'd like to use or say, using our system.
he'd like to use or say, using our system.
105
336458
4334
05:54
Perhaps a greeting, like,
"Hello, how are you?"
"Hello, how are you?"
106
342292
2851
05:57
Or indicate that he needed
help with something.
help with something.
107
345167
2208
06:01
What Doug said that he wanted
to use our system for
to use our system for
108
349125
2434
06:03
is to reboot the old system he had,
because that old system kept on crashing.
because that old system kept on crashing.
109
351583
3643
06:07
(Laughter)
110
355250
1750
06:10
We never could have predicted that.
111
358083
1709
06:12
I'm going to show you a short clip of Doug
using our system for the first time.
using our system for the first time.
112
360917
3750
06:22
(Voice) Reboot computer.
113
370417
1625
06:26
AK: What you just saw there
114
374375
1309
06:27
was Doug communicating or speaking
in real time for the first time
in real time for the first time
115
375708
3601
06:31
since he lost the ability to speak.
116
379333
1834
06:34
There are millions of people
117
382125
1559
06:35
who might be able to communicate
in real time like Doug,
in real time like Doug,
118
383708
3393
06:39
with other people, with their friends
and with their families.
and with their families.
119
387125
3000
06:43
My hope is to be able to help them
express their thoughts and ideas.
express their thoughts and ideas.
120
391125
3458
06:48
I believe computing, AI and the internet
121
396875
2226
06:51
would disappear into us
as extensions of our cognition,
as extensions of our cognition,
122
399125
3726
06:54
instead of being external
entities or adversaries,
entities or adversaries,
123
402875
3601
06:58
amplifying human ingenuity,
124
406500
2309
07:00
giving us unimaginable abilities
and unlocking our true potential.
and unlocking our true potential.
125
408833
3875
07:05
And perhaps even freeing us
to becoming better at being human.
to becoming better at being human.
126
413833
3834
07:10
Thank you so much.
127
418500
1268
07:11
(Applause)
128
419792
5767
07:17
Shoham Arad: Come over here.
129
425583
1375
07:23
OK.
130
431083
1250
07:25
I want to ask you a couple of questions,
they're going to clear the stage.
they're going to clear the stage.
131
433917
3517
07:29
I feel like this is amazing,
it's innovative,
it's innovative,
132
437458
3518
07:33
it's creepy, it's terrifying.
133
441000
3476
07:36
Can you tell us what I think ...
134
444500
2059
07:38
I think there are some
uncomfortable feelings around this.
uncomfortable feelings around this.
135
446583
2726
07:41
Tell us, is this reading your thoughts,
136
449333
2310
07:43
will it in five years,
137
451667
1267
07:44
is there a weaponized version of this,
what does it look like?
what does it look like?
138
452958
2917
07:48
AK: So our first design principle,
before we started working on this,
before we started working on this,
139
456833
3268
07:52
was to not render ethics
as an afterthought.
as an afterthought.
140
460125
3518
07:55
So we wanted to bake ethics
right into the design.
right into the design.
141
463667
3434
07:59
We flipped the design.
142
467125
1268
08:00
Instead of reading
from the brain directly,
from the brain directly,
143
468417
2059
08:02
we're reading from
the voluntary nervous system
the voluntary nervous system
144
470500
2226
08:04
that you deliberately have to engage
to communicate with the device,
to communicate with the device,
145
472750
3191
08:07
while still bringing the benefits
of a thinking or a thought device.
of a thinking or a thought device.
146
475965
3204
08:11
The best of both worlds in a way.
147
479183
1626
08:12
SA: OK, I think people are going to have
a lot more questions for you.
a lot more questions for you.
148
480833
3601
08:16
Also, you said that it's a sticker.
149
484458
1685
08:18
So right now it sits just right here?
150
486167
1976
08:20
Is that the final iteration,
151
488167
1684
08:21
what the final design you hope looks like?
152
489875
3333
08:26
AK: Our goal is for the technology
to disappear completely.
to disappear completely.
153
494167
4726
08:30
SA: What does that mean?
154
498917
1267
08:32
AK: If you're wearing it,
I shouldn't be able to see it.
I shouldn't be able to see it.
155
500208
2643
08:34
You don't want technology on your face,
you want it in the background,
you want it in the background,
156
502875
3351
08:38
to augment you in the background.
157
506250
1643
08:39
So we have a sticker version
that conforms to the skin,
that conforms to the skin,
158
507917
2601
08:42
that looks like the skin,
159
510542
1267
08:43
but we're trying to make
an even smaller version
an even smaller version
160
511833
2268
08:46
that would sit right here.
161
514125
1292
08:49
SA: OK.
162
517167
1266
08:50
I feel like if anyone has any questions
they want to ask Arnav,
they want to ask Arnav,
163
518457
2976
08:53
he'll be here all week.
164
521457
1269
08:54
OK, thank you so much, Arnav.
165
522750
1433
08:56
AK: Thanks, Shoham.
166
524207
1376
ABOUT THE SPEAKER
Arnav Kapur - TechnologistTED Fellow Arnav Kapur invents wearable AI devices that augment human cognition and give voice to those who have lost their ability to speak.
Why you should listen
At the MIT Media Lab, Arnav Kapur is inventing a device called Alter Ego, which lets users converse with machines, AI assistants and other people by articulating words internally. Utilizing bone conduction to transmit and receive streams of information, the result is a totally discreet and completely internal method of communication.
As Kapur says: "This work is about enabling people and extending human intelligence. Can we weave artificial intelligence and computing into the human condition, as an extension of our cognition -- combining human creativity and intuition with the power of AI, computation and information? Can we build technology that enables us, not distracts us; that augments us, instead of replacing us; that disappears into the background of the human experience, raising us to new levels of curiosity and creativity?"
Arnav Kapur | Speaker | TED.com