Machine Learning Experts Have Found A Way To Edit Videos Of People Saying Words They've Never Said!

views
241,075
date submitted
DESCRIPTION

Abstract:

Editing talking-head video to change the speech content or to remove filler words is challenging. We propose a novel method to edit talking-head video based on its transcript to produce a realistic output video in which the dialogue of the speaker has been modified, while maintaining a seamless audio-visual flow (i.e. no jump cuts). Our method automatically annotates an input talking-head video with phonemes, visemes, 3D face pose and geometry, reflectance, expression and scene illumination per frame. To edit a video, the user has to only edit the transcript, and an optimization strategy then chooses segments of the input corpus as base material. The annotated parameters corresponding to the selected segments are seamlessly stitched together and used to produce an intermediate video representation in which the lower half of the face is rendered with a parametric face model. Finally, a recurrent video generation network transforms this representation to a photorealistic video that matches the edited transcript. We demonstrate a large variety of edits, such as the addition, removal, and alteration of words, as well as convincing language translation and full sentence synthesis.



Ethical Considerations:



Our text-based editing approach lays the foundation for better editing tools for movie post production. Filmed dialogue scenes often require re-timing or editing based on small script changes, which currently requires tedious manual work. Our editing technique also enables easy adaptation of audio-visual video content to specific target audiences: e.g., instruction videos can be fine-tuned to audiences of different backgrounds, or a storyteller video can be adapted to children of different age groups purely based on textual script edits. In short, our work was developed for storytelling purposes.



However, the availability of such technology — at a quality that some might find indistinguishable from source material. Posted By Ghost

nextvideos

Work Smarter Not Harder: Dude Found A Way To Cheat The Claw Machine!

Work Smarter Not Harder: Dude Found A Way To Cheat The Claw Machine!

views
155,282
date submitted
"I'm Going To Jail" Dude Said He Found A Way To Get Free Gas!

"I'm Going To Jail" Dude Said He Found A Way To Get Free Gas!

views
188,266
date submitted
Cam’ron Responds To LiAngelo Ball! “I Have 12 Million Records On My Resume.. The NBA Season Just Started Where You At”

Cam’ron Responds To LiAngelo Ball! “I Have 12 Million Records On My Resume.. The NBA Season Just Started Where You At”

views
144,069
date submitted
These Folks Found A Way To Gentrify Prison!

These Folks Found A Way To Gentrify Prison!

views
156,228
date submitted
The Internet Never Forgets: Clip Resurfaces Of Diddy Saying This To Meek Mill While At A Pool Party!

The Internet Never Forgets: Clip Resurfaces Of Diddy Saying This To Meek Mill While At A Pool Party!

views
485,879
date submitted
SMH: Couple Gave A Child Up After Learning They Can’t Include Them In Their Videos!

SMH: Couple Gave A Child Up After Learning They Can’t Include Them In Their Videos!

views
219,090
date submitted
People Are Saying This Video Is How They Found 6ix9ine At The Gym!

People Are Saying This Video Is How They Found 6ix9ine At The Gym!

views
179,170
date submitted
Ray J Confirms Sex Tape With Kim Kardashian Was A Deal Orchestrated By Her Mother Kris Jenner!

Ray J Confirms Sex Tape With Kim Kardashian Was A Deal Orchestrated By Her Mother Kris Jenner!

views
176,205
date submitted
Goals Or Nah? People Said They Would Never Work Out Because He's 5'2!

Goals Or Nah? People Said They Would Never Work Out Because He's 5'2!

views
240,022
date submitted
People Will Find A Way To Whip Anything Moving... Never Seen A Fish Get Whooped In My Whole Entire Life!

People Will Find A Way To Whip Anything Moving... Never Seen A Fish Get Whooped In My Whole Entire Life!

views
136,669
date submitted
Genius: Dude Figured Out A Way To Never Get Caught Having His Sidechick Over!

Genius: Dude Figured Out A Way To Never Get Caught Having His Sidechick Over!

views
527,738
date submitted
Quick Thinging Chick Found A Unique Way To Stop A Robber!

Quick Thinging Chick Found A Unique Way To Stop A Robber!

views
145,015
date submitted
You Be The Judge: Man Found Dead After Uploading Videos Of Alleged Giant He Spotted On Top Of A Mountain In Canada!

You Be The Judge: Man Found Dead After Uploading Videos Of Alleged Giant He Spotted On Top Of A Mountain In Canada!

views
399,832
date submitted
Flexing Gone Wrong: Dude Made It Seem Like He Hopped Out The Chopper But They Forgot To Edit It The Right Way!

Flexing Gone Wrong: Dude Made It Seem Like He Hopped Out The Chopper But They Forgot To Edit It The Right Way!

views
193,210
date submitted
Georgia Football Trainer Gets Exposed For Being Racist ASF!

Georgia Football Trainer Gets Exposed For Being Racist ASF!

views
111,273
date submitted
She's Blessed Back Thurr: Pastor Found A Way To Bring More Men To Church!

She's Blessed Back Thurr: Pastor Found A Way To Bring More Men To Church!

views
226,123
date submitted
The Size Of The Rim Tho: Korean Players Found A Way to Stop Steph Curry!

The Size Of The Rim Tho: Korean Players Found A Way to Stop Steph Curry!

views
68,124
date submitted
She Workin With A Whopper: Shawty Said A Customer Complained About Her Uniform.. Had Her Husband Feeling Some Type Of Way!

She Workin With A Whopper: Shawty Said A Customer Complained About Her Uniform.. Had Her Husband Feeling Some Type Of Way!

views
326,146
date submitted
Dude Does An Experiment To Show That Most People Have A Herd Mentality!

Dude Does An Experiment To Show That Most People Have A Herd Mentality!

views
475,204
date submitted
Nicest Female Cop Lets Homeless Man Slide And Now She Gone Too Soon… Showing Himself Visiting Her Tombstone After Hearing The News!

Nicest Female Cop Lets Homeless Man Slide And Now She Gone Too Soon… Showing Himself Visiting Her Tombstone After Hearing The News!

views
94,358
date submitted
Very Sus: This Is How They're Testing For Coronavirus Now In Some Hospitals In China!

Very Sus: This Is How They're Testing For Coronavirus Now In Some Hospitals In China!

views
243,020
date submitted
Fail: Contestant On 'Wheel Of Fortune' Gave An Extremely Wrong Answer In The Most Confident Way Possible!

Fail: Contestant On 'Wheel Of Fortune' Gave An Extremely Wrong Answer In The Most Confident Way Possible!

views
248,496
date submitted
SMH: Dude Who Lost His 7 Year Old Daughter (Jaslyn Adams) Said He Wouldn’t Die For His Kids But Would Die For His Guys!

SMH: Dude Who Lost His 7 Year Old Daughter (Jaslyn Adams) Said He Wouldn’t Die For His Kids But Would Die For His Guys!

views
352,020
date submitted
Piers Morgan Tells Kanye He's Being Racist After Saying Jewish Business People Have Raped His People!

Piers Morgan Tells Kanye He's Being Racist After Saying Jewish Business People Have Raped His People!

views
78,955
date submitted
Facts Or Nah? The Quickest Way To Have Stoners Put Hands On You!

Facts Or Nah? The Quickest Way To Have Stoners Put Hands On You!

views
462,125
date submitted
Somebody Getting Punished For This: 9,000 Pounds Of Cocaine Found In Semi-Submersible During Rescue Search Off Colombia!

Somebody Getting Punished For This: 9,000 Pounds Of Cocaine Found In Semi-Submersible During Rescue Search Off Colombia!

views
55,409
date submitted
U.S. Coast Says Missing Submersible Imploded Near Titanic Wreckage!

U.S. Coast Says Missing Submersible Imploded Near Titanic Wreckage!

views
140,204
date submitted
Man Who Wore Horns During U.S. Capitol Riot Turns On Donald Trump! "I'm Disappointed, He Was Not Honorable"

Man Who Wore Horns During U.S. Capitol Riot Turns On Donald Trump! "I'm Disappointed, He Was Not Honorable"

views
319,948
date submitted
Pentagon Releases Video Of UFO Flying Over Combat Zone In Middle East, Leaves Experts Baffled!

Pentagon Releases Video Of UFO Flying Over Combat Zone In Middle East, Leaves Experts Baffled!

views
151,915
date submitted
This Is Just Madness: Dude Found A Unique Way To Get Ultra High!

This Is Just Madness: Dude Found A Unique Way To Get Ultra High!

views
81,487
date submitted
Entrepreneur In The Making: Little Dude Found A Way To Hustle While Having The Time Of His Life!

Entrepreneur In The Making: Little Dude Found A Way To Hustle While Having The Time Of His Life!

views
66,739
date submitted
Ain No Way: This Level Of Gatekeeping Is Never Needed!

Ain No Way: This Level Of Gatekeeping Is Never Needed!

views
63,098
date submitted
Agree Or Nah? Fans Are Speculating Eminem Is Taking A Shot At Kendrick Lamar On The Intro Of His Album!

Agree Or Nah? Fans Are Speculating Eminem Is Taking A Shot At Kendrick Lamar On The Intro Of His Album!

views
74,727
date submitted
Jamaican Legend 'Sizzla' Burns DJ Khaled’s Platinum Plaques! "Yuh Insult Me DJ Khaled'

Jamaican Legend 'Sizzla' Burns DJ Khaled’s Platinum Plaques! "Yuh Insult Me DJ Khaled'

views
145,668
date submitted
Jason Luv Said He Would Never Allow His Wife To Sleep With Anyone Else "Me Personally, Ion Think I Have It In Me"

Jason Luv Said He Would Never Allow His Wife To Sleep With Anyone Else "Me Personally, Ion Think I Have It In Me"

views
79,752
date submitted
"His Own People Said He's Never Made A Good Decision" Donald Trump Calls Out Biden & Global Elites!

"His Own People Said He's Never Made A Good Decision" Donald Trump Calls Out Biden & Global Elites!

views
66,254
date submitted
Bro Hit Harder Than Tyson: This Punch Machine Never Stood A Chance!

Bro Hit Harder Than Tyson: This Punch Machine Never Stood A Chance!

views
80,195
date submitted
Cool Way To Take Care Of A Mice Problem!

Cool Way To Take Care Of A Mice Problem!

views
335,571
date submitted
These Kids Nowadays Have No Chill: Teacher Reveals Things Her 8th Grade Students Have Said To Her!

These Kids Nowadays Have No Chill: Teacher Reveals Things Her 8th Grade Students Have Said To Her!

views
122,058
date submitted
Not Having It: Protesters Show Up Outside Of U.S. Army Sergeant's House For Harassing The Young Black Man!

Not Having It: Protesters Show Up Outside Of U.S. Army Sergeant's House For Harassing The Young Black Man!

views
546,604
date submitted