Tip:
Highlight text to annotate it
X
My name is Sywert van Lienden - normally I am a student
but I acted as moderator on the MWG congress
entitled the experiment.
Being only 18 as moderator, quite the experiment
did you like it?
Well, I quite liked it. It was very inspiring ...
15 to 16 speakers, each with their own story
It's been a mind-setting seminar
in which the people are challenged to look beyond
their own professional boundaries.
In this respect, I hope that the attendees
will take their time to reflect on the topics.
I consider it a great experience.
What was the most inspiring experiment you've seen?
Dan Germain and especially Tex Gunning were outstanding
but Tex Gunning served as keynote speaker.
His speech was great.
Also experimental was Sophie
the visual character which interacted live on screen
with the moderator and the speakers.
This headset has an infrared camera
with infrared illumination
And then the actor has little markers
on their face.
These reflective silver markers.
Depending on their character there can be upto 32 markers
The computer tracks the movement of those markers
and applies it to the face of the character.
That is motion tracking?
Yeah. It´s real-time motion tracking.
Then I have a 3D mouse here
and then I control the position on the screen and the eyes.
As the actor - or actress - speaks
the face moves together with the voice.
Based on the 3D camera ...
Yeah. And then I control the position of the model
on the screen, and the position of the eyes -
where they are looking.
That´s why she´s able to do real-time ... eh ...
Yeah. It´s real-time.
So the camera tracks the face
the tracking data is applied to the model
and then that goes out onto the screen
and it is synchronised with the voice.
It actually takes about 2 frames to do the processing
so we delay the voice by 2 frames
so the lips are in-sync.
Which makes it pretty difficult for her
because she hears her own voice - only later.
No, no. We don´t feed her voice back to her.
That´s one of the reasons we´re in a sound-proof booth.
She´s fed the voices of the other participants
but she is not fed her own voice.
That would be too complicated.
And would make you stutter... probably
Have you done more than this example?
Yeah, yeah. It´s one of the things our company does.
These are all different characters.