TEDWomen 2015
Nonny de la Peña: The future of news? Virtual reality
Filmed:
Readability: 3.8
1,291,722 views
What if you could experience a story with your entire body, not just with your mind? Nonny de la Peña is working on a new form of journalism that combines traditional reporting with emerging virtual reality technology to put the audience inside the story. The result is an evocative experience that de la Peña hopes will help people understand the news in a brand new way.
Nonny de la Peña - Virtual reality pioneer
Nonny de la Peña uses new, immersive media to tell stories that create empathy in readers and viewers. Full bio
Nonny de la Peña uses new, immersive media to tell stories that create empathy in readers and viewers. Full bio
Double-click the English transcript below to play the video.
00:12
What if I could present you a story
0
785
1880
00:14
that you would remember
with your entire body
with your entire body
1
2689
2414
00:17
and not just with your mind?
2
5127
2157
00:19
My whole life as a journalist,
I've really been compelled
I've really been compelled
3
7308
2675
00:22
to try to make stories
that can make a difference
that can make a difference
4
10007
2311
00:24
and maybe inspire people to care.
5
12342
2570
00:26
I've worked in print.
I've worked in documentary.
I've worked in documentary.
6
14936
2326
00:29
I've worked in broadcast.
7
17286
1269
00:30
But it really wasn't until
I got involved with virtual reality
I got involved with virtual reality
8
18579
3062
00:33
that I started seeing
these really intense,
these really intense,
9
21665
2841
00:36
authentic reactions from people
10
24530
1984
00:38
that really blew my mind.
11
26538
1675
00:40
So the deal is that with VR,
virtual reality,
virtual reality,
12
28237
4673
00:44
I can put you on scene
13
32934
3000
00:47
in the middle of the story.
14
35958
1801
00:50
By putting on these goggles
that track wherever you look,
that track wherever you look,
15
38148
3484
00:53
you get this whole-body sensation,
16
41656
2928
00:56
like you're actually, like, there.
17
44608
2207
00:59
So five years ago was about when
I really began to push the envelope
I really began to push the envelope
18
47209
3402
01:02
with using virtual reality
and journalism together.
and journalism together.
19
50635
3250
01:05
And I wanted to do a piece about hunger.
20
53909
2548
01:08
Families in America are going hungry,
food banks are overwhelmed,
food banks are overwhelmed,
21
56481
3159
01:11
and they're often running out of food.
22
59664
2055
01:14
Now, I knew I couldn't
make people feel hungry,
make people feel hungry,
23
62330
3619
01:17
but maybe I could figure out a way
to get them to feel something physical.
to get them to feel something physical.
24
65973
3817
01:22
So -- again, this is five years ago --
25
70726
3064
01:25
so doing journalism
and virtual reality together
and virtual reality together
26
73814
3176
01:29
was considered
a worse-than-half-baked idea,
a worse-than-half-baked idea,
27
77014
2983
01:32
and I had no funding.
28
80021
1355
01:33
Believe me, I had a lot
of colleagues laughing at me.
of colleagues laughing at me.
29
81400
2499
01:35
And I did, though,
have a really great intern,
have a really great intern,
30
83923
3790
01:39
a woman named Michaela Kobsa-Mark.
31
87737
2238
01:41
And together we went out to food banks
32
89999
1818
01:43
and started recording
audio and photographs.
audio and photographs.
33
91841
3072
01:46
Until one day she came back to my office
34
94937
1920
01:48
and she was bawling, she was just crying.
35
96881
2395
01:51
She had been on scene at a long line,
36
99300
2602
01:53
where the woman running the line
was feeling extremely overwhelmed,
was feeling extremely overwhelmed,
37
101926
3945
01:57
and she was screaming,
"There's too many people!
"There's too many people!
38
105895
2968
02:00
There's too many people!"
39
108887
1896
02:02
And this man with diabetes
doesn't get food in time,
doesn't get food in time,
40
110807
3555
02:06
his blood sugar drops too low,
and he collapses into a coma.
and he collapses into a coma.
41
114386
3555
02:10
As soon as I heard that audio,
42
118695
1532
02:12
I knew that this would be
the kind of evocative piece
the kind of evocative piece
43
120251
3245
02:15
that could really describe
what was going on at food banks.
what was going on at food banks.
44
123520
3104
02:19
So here's the real line.
You can see how long it was, right?
You can see how long it was, right?
45
127290
3616
02:22
And again, as I said, we didn't
have very much funding,
have very much funding,
46
130930
2627
02:25
so I had to reproduce it
with virtual humans that were donated,
with virtual humans that were donated,
47
133581
3750
02:29
and people begged and borrowed favors
to help me create the models
to help me create the models
48
137355
4126
02:33
and make things as accurate as we could.
49
141505
2159
02:35
And then we tried to convey
what happened that day
what happened that day
50
143688
2609
02:38
with as much as accuracy as is possible.
51
146321
2794
02:41
(Video) Voice: There's too many people!
There's too many people!
There's too many people!
52
149680
4198
02:54
Voice: OK, he's having a seizure.
53
162340
2721
03:11
Voice: We need an ambulance.
54
179023
2849
03:14
Nonny de la Peña: So the man on the right,
55
182181
2017
03:16
for him, he's walking around the body.
56
184222
1872
03:18
For him, he's in the room with that body.
57
186118
2697
03:21
Like, that guy is at his feet.
58
189355
1817
03:23
And even though,
through his peripheral vision,
through his peripheral vision,
59
191601
2207
03:25
he can see that he's in this lab space,
60
193832
2071
03:27
he should be able to see
that he's not actually on the street,
that he's not actually on the street,
61
195927
4213
03:32
but he feels like he's there
with those people.
with those people.
62
200164
2896
03:35
He's very cautious not to step on this guy
63
203084
2010
03:37
who isn't really there, right?
64
205118
1666
03:39
So that piece ended up
going to Sundance in 2012,
going to Sundance in 2012,
65
207506
3103
03:42
a kind of amazing thing,
and it was the first virtual reality film
and it was the first virtual reality film
66
210633
3921
03:46
ever, basically.
67
214578
1960
03:49
And when we went, I was really terrified.
68
217062
1961
03:51
I didn't really know
how people were going to react
how people were going to react
69
219047
2437
03:53
and what was going to happen.
70
221508
1389
03:54
And we showed up
with this duct-taped pair of goggles.
with this duct-taped pair of goggles.
71
222921
2897
03:57
(Video) Oh, you're crying.
You're crying. Gina, you're crying.
You're crying. Gina, you're crying.
72
225842
3985
04:01
So you can hear
the surprise in my voice, right?
the surprise in my voice, right?
73
229851
2720
04:04
And this kind of reaction ended up being
the kind of reaction we saw
the kind of reaction we saw
74
232595
3595
04:08
over and over and over:
75
236214
2770
04:11
people down on the ground
trying to comfort the seizure victim,
trying to comfort the seizure victim,
76
239008
3706
04:14
trying to whisper something into his ear
77
242738
1920
04:16
or in some way help,
even though they couldn't.
even though they couldn't.
78
244682
3958
04:20
And I had a lot of people
come out of that piece saying,
come out of that piece saying,
79
248664
2684
04:23
"Oh my God, I was so frustrated.
I couldn't help the guy,"
I couldn't help the guy,"
80
251372
2724
04:26
and take that back into their lives.
81
254120
1721
04:28
So after this piece was made,
82
256999
1866
04:32
the dean of the cinema school at USC,
the University of Southern California,
the University of Southern California,
83
260198
3809
04:36
brought in the head of the World
Economic Forum to try "Hunger,"
Economic Forum to try "Hunger,"
84
264031
4207
04:40
and he took off the goggles,
85
268262
1341
04:41
and he commissioned
a piece about Syria on the spot.
a piece about Syria on the spot.
86
269627
3040
04:44
And I really wanted to do something
about Syrian refugee kids,
about Syrian refugee kids,
87
272691
2913
04:47
because children have been the worst
affected by the Syrian civil war.
affected by the Syrian civil war.
88
275628
4292
04:52
I sent a team to the border of Iraq
to record material at refugee camps,
to record material at refugee camps,
89
280809
3958
04:56
basically an area I wouldn't
send a team now,
send a team now,
90
284791
3151
04:59
as that's where ISIS is really operating.
91
287966
2468
05:02
And then we also recreated a street scene
92
290458
2706
05:05
in which a young girl is singing
and a bomb goes off.
and a bomb goes off.
93
293188
3523
05:09
Now, when you're
in the middle of that scene
in the middle of that scene
94
297340
2079
05:11
and you hear those sounds,
95
299443
2554
05:14
and you see the injured around you,
96
302021
2293
05:16
it's an incredibly scary and real feeling.
97
304338
3000
05:19
I've had individuals who have been
involved in real bombings tell me
involved in real bombings tell me
98
307362
4540
05:23
that it evokes the same kind of fear.
99
311926
3475
05:28
[The civil war in Syria may seem far away]
100
316211
4519
05:34
[until you experience it yourself.]
101
322078
6266
05:41
(Girl singing)
102
329062
6951
05:48
(Explosion)
103
336037
2778
05:50
[Project Syria]
104
338839
4237
05:55
[A virtual reality experience]
105
343988
1997
05:58
NP: We were then invited to take the piece
106
346653
2068
06:00
to the Victoria and Albert
Museum in London.
Museum in London.
107
348745
2054
06:02
And it wasn't advertised.
108
350823
1357
06:04
And we were put in this tapestry room.
109
352204
2324
06:06
There was no press about it,
110
354552
1342
06:07
so anybody who happened to walk
into the museum to visit it that day
into the museum to visit it that day
111
355918
3737
06:11
would see us with these crazy lights.
112
359679
1763
06:13
You know, maybe they would want to see
the old storytelling of the tapestries.
the old storytelling of the tapestries.
113
361466
3675
06:17
They were confronted
by our virtual reality cameras.
by our virtual reality cameras.
114
365165
2467
06:20
But a lot of people tried it,
and over a five-day run
and over a five-day run
115
368513
3127
06:23
we ended up with 54 pages
of guest book comments,
of guest book comments,
116
371664
4540
06:28
and we were told by the curators there
117
376228
2336
06:30
that they'd never seen such an outpouring.
118
378588
2589
06:33
Things like, "It's so real,"
"Absolutely believable,"
"Absolutely believable,"
119
381201
4627
06:37
or, of course, the one
that I was excited about,
that I was excited about,
120
385852
2460
06:40
"A real feeling as if you were
in the middle of something
in the middle of something
121
388336
2849
06:43
that you normally see on the TV news."
122
391209
2262
06:46
So, it works, right? This stuff works.
123
394463
3476
06:50
And it doesn't really matter
where you're from or what age you are --
where you're from or what age you are --
124
398297
3795
06:54
it's really evocative.
125
402116
2203
06:56
Now, don't get me wrong -- I'm not saying
that when you're in a piece
that when you're in a piece
126
404343
3952
07:00
you forget that you're here.
127
408319
2880
07:03
But it turns out we can feel
like we're in two places at once.
like we're in two places at once.
128
411223
3175
07:06
We can have what I call
this duality of presence,
this duality of presence,
129
414422
3150
07:09
and I think that's what allows me
to tap into these feelings of empathy.
to tap into these feelings of empathy.
130
417596
4857
07:14
Right?
131
422477
1151
07:16
So that means, of course,
132
424041
3191
07:19
that I have to be very cautious
about creating these pieces.
about creating these pieces.
133
427256
4895
07:24
I have to really follow
best journalistic practices
best journalistic practices
134
432175
4262
07:28
and make sure that these powerful stories
135
436461
2135
07:30
are built with integrity.
136
438620
1586
07:32
If we don't capture
the material ourselves,
the material ourselves,
137
440230
2373
07:34
we have to be extremely exacting
138
442627
4968
07:39
about figuring out the provenance
and where did this stuff come from
and where did this stuff come from
139
447619
3301
07:42
and is it authentic?
140
450944
1308
07:44
Let me give you an example.
141
452276
1357
07:45
With this Trayvon Martin case,
this is a guy, a kid,
this is a guy, a kid,
142
453657
2937
07:48
who was 17 years old and he bought
soda and a candy at a store,
soda and a candy at a store,
143
456618
4103
07:52
and on his way home he was tracked
by a neighborhood watchman
by a neighborhood watchman
144
460745
3476
07:56
named George Zimmerman
who ended up shooting and killing him.
who ended up shooting and killing him.
145
464245
2865
07:59
To make that piece,
146
467657
1152
08:00
we got the architectural drawings
of the entire complex,
of the entire complex,
147
468833
3602
08:04
and we rebuilt the entire scene
inside and out, based on those drawings.
inside and out, based on those drawings.
148
472459
4769
08:09
All of the action
149
477252
1295
08:10
is informed by the real 911
recorded calls to the police.
recorded calls to the police.
150
478571
4919
08:16
And interestingly, we broke
some news with this story.
some news with this story.
151
484411
2777
08:19
The forensic house that did the audio
reconstruction, Primeau Productions,
reconstruction, Primeau Productions,
152
487212
3975
08:23
they say that they would testify
153
491211
1946
08:25
that George Zimmerman,
when he got out of the car,
when he got out of the car,
154
493181
2675
08:27
he cocked his gun before he went
to give chase to Martin.
to give chase to Martin.
155
495880
2832
08:32
So you can see that
the basic tenets of journalism,
the basic tenets of journalism,
156
500013
3405
08:35
they don't really change here, right?
157
503442
1873
08:37
We're still following the same principles
that we would always.
that we would always.
158
505339
3404
08:40
What is different is the sense
of being on scene,
of being on scene,
159
508767
3303
08:44
whether you're watching
a guy collapse from hunger
a guy collapse from hunger
160
512094
2341
08:46
or feeling like you're
in the middle of a bomb scene.
in the middle of a bomb scene.
161
514459
2485
08:48
And this is kind of what has driven me
forward with these pieces,
forward with these pieces,
162
516968
4948
08:53
and thinking about how to make them.
163
521940
1723
08:55
We're trying to make this, obviously,
beyond the headset, more available.
beyond the headset, more available.
164
523687
4195
08:59
We're creating mobile pieces
like the Trayvon Martin piece.
like the Trayvon Martin piece.
165
527906
2927
09:02
And these things have had impact.
166
530857
3549
09:06
I've had Americans tell me
that they've donated,
that they've donated,
167
534430
2572
09:09
direct deductions from their bank account,
money to go to Syrian children refugees.
money to go to Syrian children refugees.
168
537026
4394
09:13
And "Hunger in LA," well,
it's helped start
it's helped start
169
541444
2333
09:15
a new form of doing journalism
170
543801
2429
09:18
that I think is going to join
all the other normal platforms
all the other normal platforms
171
546254
3096
09:21
in the future.
172
549374
1151
09:22
Thank you.
173
550549
1164
09:23
(Applause)
174
551737
2412
ABOUT THE SPEAKER
Nonny de la Peña - Virtual reality pioneerNonny de la Peña uses new, immersive media to tell stories that create empathy in readers and viewers.
Why you should listen
As the CEO of Emblematic Group, Nonny de la Peña uses cutting-edge technologies to tell stories — both fictional and news-based — that create intense, empathic engagement on the part of viewers. She has been called “The Godmother of Virtual Reality” by Engadget, while Fast Company named her “One of the People Who Made the World More Creative” for her pioneering work in immersive journalism.
A former correspondent for Newsweek, de la Peña has more than 20 years of award-winning experience in print, film and TV. Her virtual-reality work has been featured by the BBC, Mashable, Vice, Wired and many others, and been screened around the globe at museums and gaming conventions. De la Peña is an Annenberg Fellow at the University of Southern California’s School of Cinematic Arts.
More profile about the speakerA former correspondent for Newsweek, de la Peña has more than 20 years of award-winning experience in print, film and TV. Her virtual-reality work has been featured by the BBC, Mashable, Vice, Wired and many others, and been screened around the globe at museums and gaming conventions. De la Peña is an Annenberg Fellow at the University of Southern California’s School of Cinematic Arts.
Nonny de la Peña | Speaker | TED.com