Machine Learning Experts Have Found A Way To Edit Videos Of People Saying Words They've Never Said!

views
241,072
date submitted
DESCRIPTION

Abstract:

Editing talking-head video to change the speech content or to remove filler words is challenging. We propose a novel method to edit talking-head video based on its transcript to produce a realistic output video in which the dialogue of the speaker has been modified, while maintaining a seamless audio-visual flow (i.e. no jump cuts). Our method automatically annotates an input talking-head video with phonemes, visemes, 3D face pose and geometry, reflectance, expression and scene illumination per frame. To edit a video, the user has to only edit the transcript, and an optimization strategy then chooses segments of the input corpus as base material. The annotated parameters corresponding to the selected segments are seamlessly stitched together and used to produce an intermediate video representation in which the lower half of the face is rendered with a parametric face model. Finally, a recurrent video generation network transforms this representation to a photorealistic video that matches the edited transcript. We demonstrate a large variety of edits, such as the addition, removal, and alteration of words, as well as convincing language translation and full sentence synthesis.



Ethical Considerations:



Our text-based editing approach lays the foundation for better editing tools for movie post production. Filmed dialogue scenes often require re-timing or editing based on small script changes, which currently requires tedious manual work. Our editing technique also enables easy adaptation of audio-visual video content to specific target audiences: e.g., instruction videos can be fine-tuned to audiences of different backgrounds, or a storyteller video can be adapted to children of different age groups purely based on textual script edits. In short, our work was developed for storytelling purposes.



However, the availability of such technology — at a quality that some might find indistinguishable from source material. Posted By Ghost

nextvideos

Work Smarter Not Harder: Dude Found A Way To Cheat The Claw Machine!

Work Smarter Not Harder: Dude Found A Way To Cheat The Claw Machine!

views
155,261
date submitted
"I'm Going To Jail" Dude Said He Found A Way To Get Free Gas!

"I'm Going To Jail" Dude Said He Found A Way To Get Free Gas!

views
188,255
date submitted
Cam’ron Responds To LiAngelo Ball! “I Have 12 Million Records On My Resume.. The NBA Season Just Started Where You At”

Cam’ron Responds To LiAngelo Ball! “I Have 12 Million Records On My Resume.. The NBA Season Just Started Where You At”

views
144,050
date submitted
Ray J Confirms Sex Tape With Kim Kardashian Was A Deal Orchestrated By Her Mother Kris Jenner!

Ray J Confirms Sex Tape With Kim Kardashian Was A Deal Orchestrated By Her Mother Kris Jenner!

views
176,174
date submitted
SMH: Couple Gave A Child Up After Learning They Can’t Include Them In Their Videos!

SMH: Couple Gave A Child Up After Learning They Can’t Include Them In Their Videos!

views
219,062
date submitted
These Folks Found A Way To Gentrify Prison!

These Folks Found A Way To Gentrify Prison!

views
156,209
date submitted
The Internet Never Forgets: Clip Resurfaces Of Diddy Saying This To Meek Mill While At A Pool Party!

The Internet Never Forgets: Clip Resurfaces Of Diddy Saying This To Meek Mill While At A Pool Party!

views
485,493
date submitted
People Are Saying This Video Is How They Found 6ix9ine At The Gym!

People Are Saying This Video Is How They Found 6ix9ine At The Gym!

views
179,149
date submitted
You Be The Judge: Man Found Dead After Uploading Videos Of Alleged Giant He Spotted On Top Of A Mountain In Canada!

You Be The Judge: Man Found Dead After Uploading Videos Of Alleged Giant He Spotted On Top Of A Mountain In Canada!

views
399,793
date submitted
People Will Find A Way To Whip Anything Moving... Never Seen A Fish Get Whooped In My Whole Entire Life!

People Will Find A Way To Whip Anything Moving... Never Seen A Fish Get Whooped In My Whole Entire Life!

views
136,652
date submitted
Goals Or Nah? People Said They Would Never Work Out Because He's 5'2!

Goals Or Nah? People Said They Would Never Work Out Because He's 5'2!

views
239,996
date submitted
Genius: Dude Figured Out A Way To Never Get Caught Having His Sidechick Over!

Genius: Dude Figured Out A Way To Never Get Caught Having His Sidechick Over!

views
527,717
date submitted
Quick Thinging Chick Found A Unique Way To Stop A Robber!

Quick Thinging Chick Found A Unique Way To Stop A Robber!

views
144,982
date submitted
Georgia Football Trainer Gets Exposed For Being Racist ASF!

Georgia Football Trainer Gets Exposed For Being Racist ASF!

views
111,224
date submitted
Nicest Female Cop Lets Homeless Man Slide And Now She Gone Too Soon… Showing Himself Visiting Her Tombstone After Hearing The News!

Nicest Female Cop Lets Homeless Man Slide And Now She Gone Too Soon… Showing Himself Visiting Her Tombstone After Hearing The News!

views
94,324
date submitted
Dude Does An Experiment To Show That Most People Have A Herd Mentality!

Dude Does An Experiment To Show That Most People Have A Herd Mentality!

views
475,186
date submitted
SMH: Dude Who Lost His 7 Year Old Daughter (Jaslyn Adams) Said He Wouldn’t Die For His Kids But Would Die For His Guys!

SMH: Dude Who Lost His 7 Year Old Daughter (Jaslyn Adams) Said He Wouldn’t Die For His Kids But Would Die For His Guys!

views
352,006
date submitted
U.S. Coast Says Missing Submersible Imploded Near Titanic Wreckage!

U.S. Coast Says Missing Submersible Imploded Near Titanic Wreckage!

views
140,168
date submitted
Somebody Getting Punished For This: 9,000 Pounds Of Cocaine Found In Semi-Submersible During Rescue Search Off Colombia!

Somebody Getting Punished For This: 9,000 Pounds Of Cocaine Found In Semi-Submersible During Rescue Search Off Colombia!

views
55,393
date submitted
Fail: Contestant On 'Wheel Of Fortune' Gave An Extremely Wrong Answer In The Most Confident Way Possible!

Fail: Contestant On 'Wheel Of Fortune' Gave An Extremely Wrong Answer In The Most Confident Way Possible!

views
248,473
date submitted
She's Blessed Back Thurr: Pastor Found A Way To Bring More Men To Church!

She's Blessed Back Thurr: Pastor Found A Way To Bring More Men To Church!

views
226,107
date submitted
Man Who Wore Horns During U.S. Capitol Riot Turns On Donald Trump! "I'm Disappointed, He Was Not Honorable"

Man Who Wore Horns During U.S. Capitol Riot Turns On Donald Trump! "I'm Disappointed, He Was Not Honorable"

views
319,915
date submitted
Very Sus: This Is How They're Testing For Coronavirus Now In Some Hospitals In China!

Very Sus: This Is How They're Testing For Coronavirus Now In Some Hospitals In China!

views
242,977
date submitted
The Size Of The Rim Tho: Korean Players Found A Way to Stop Steph Curry!

The Size Of The Rim Tho: Korean Players Found A Way to Stop Steph Curry!

views
68,115
date submitted
Came Up Big Time: Thieves Steal $80,000 In 20 Seconds From An ATM Machine!

Came Up Big Time: Thieves Steal $80,000 In 20 Seconds From An ATM Machine!

views
349,285
date submitted
Jamaican Legend 'Sizzla' Burns DJ Khaled’s Platinum Plaques! "Yuh Insult Me DJ Khaled'

Jamaican Legend 'Sizzla' Burns DJ Khaled’s Platinum Plaques! "Yuh Insult Me DJ Khaled'

views
145,664
date submitted
Piers Morgan Tells Kanye He's Being Racist After Saying Jewish Business People Have Raped His People!

Piers Morgan Tells Kanye He's Being Racist After Saying Jewish Business People Have Raped His People!

views
78,925
date submitted
Flexing Gone Wrong: Dude Made It Seem Like He Hopped Out The Chopper But They Forgot To Edit It The Right Way!

Flexing Gone Wrong: Dude Made It Seem Like He Hopped Out The Chopper But They Forgot To Edit It The Right Way!

views
193,176
date submitted
She Workin With A Whopper: Shawty Said A Customer Complained About Her Uniform.. Had Her Husband Feeling Some Type Of Way!

She Workin With A Whopper: Shawty Said A Customer Complained About Her Uniform.. Had Her Husband Feeling Some Type Of Way!

views
326,122
date submitted
Agree Or Nah? Fans Are Speculating Eminem Is Taking A Shot At Kendrick Lamar On The Intro Of His Album!

Agree Or Nah? Fans Are Speculating Eminem Is Taking A Shot At Kendrick Lamar On The Intro Of His Album!

views
74,708
date submitted
Spoke His Mind: Stephen A. Smith On Jake Paul's Boxing Career! "You're Not Fighting Boxers"

Spoke His Mind: Stephen A. Smith On Jake Paul's Boxing Career! "You're Not Fighting Boxers"

views
124,949
date submitted
Missing Woman Whose Father Took His Own Life After Trying To Find Her Is 'Found Safe'

Missing Woman Whose Father Took His Own Life After Trying To Find Her Is 'Found Safe'

views
74,230
date submitted
The Future Scary: Engineered Arts Unveils Ameca Humanoid Robot!

The Future Scary: Engineered Arts Unveils Ameca Humanoid Robot!

views
155,165
date submitted
Bro Hit Harder Than Tyson: This Punch Machine Never Stood A Chance!

Bro Hit Harder Than Tyson: This Punch Machine Never Stood A Chance!

views
80,185
date submitted
Facts Or Nah? The Quickest Way To Have Stoners Put Hands On You!

Facts Or Nah? The Quickest Way To Have Stoners Put Hands On You!

views
462,063
date submitted
Not Having It: Protesters Show Up Outside Of U.S. Army Sergeant's House For Harassing The Young Black Man!

Not Having It: Protesters Show Up Outside Of U.S. Army Sergeant's House For Harassing The Young Black Man!

views
546,574
date submitted
RIP To The Little Ones... Kentucky Mother Shot And Killed Her Two Sons!

RIP To The Little Ones... Kentucky Mother Shot And Killed Her Two Sons!

views
122,897
date submitted
Twin Brothers Miss Flight… Found Shot Dead On Georgia Mountain 24 Hours Later... Police Call It Suicide, Family Says ‘No Way!’

Twin Brothers Miss Flight… Found Shot Dead On Georgia Mountain 24 Hours Later... Police Call It Suicide, Family Says ‘No Way!’

views
54,634
date submitted
Nothing But Gibberish: What On Earth Is Joe Biden Talking About Here?

Nothing But Gibberish: What On Earth Is Joe Biden Talking About Here?

views
128,340
date submitted
“I Have No Regrets” 30-Year-Old Nigerian Gospel Singer Shares Disturbing Details In Interview After Beh**ding His 24-Year-Old Girlfriend For Cheating

“I Have No Regrets” 30-Year-Old Nigerian Gospel Singer Shares Disturbing Details In Interview After Beh**ding His 24-Year-Old Girlfriend For Cheating

views
80,449
date submitted