Machine Learning Experts Have Found A Way To Edit Videos Of People Saying Words They've Never Said!
240,800
Jun 07, 2019
DESCRIPTION
Abstract:
Editing talking-head video to change the speech content or to remove filler words is challenging. We propose a novel method to edit talking-head video based on its transcript to produce a realistic output video in which the dialogue of the speaker has been modified, while maintaining a seamless audio-visual flow (i.e. no jump cuts). Our method automatically annotates an input talking-head video with phonemes, visemes, 3D face pose and geometry, reflectance, expression and scene illumination per frame. To edit a video, the user has to only edit the transcript, and an optimization strategy then chooses segments of the input corpus as base material. The annotated parameters corresponding to the selected segments are seamlessly stitched together and used to produce an intermediate video representation in which the lower half of the face is rendered with a parametric face model. Finally, a recurrent video generation network transforms this representation to a photorealistic video that matches the edited transcript. We demonstrate a large variety of edits, such as the addition, removal, and alteration of words, as well as convincing language translation and full sentence synthesis.
Ethical Considerations:
Our text-based editing approach lays the foundation for better editing tools for movie post production. Filmed dialogue scenes often require re-timing or editing based on small script changes, which currently requires tedious manual work. Our editing technique also enables easy adaptation of audio-visual video content to specific target audiences: e.g., instruction videos can be fine-tuned to audiences of different backgrounds, or a storyteller video can be adapted to children of different age groups purely based on textual script edits. In short, our work was developed for storytelling purposes.
However, the availability of such technology — at a quality that some might find indistinguishable from source material. Posted By Ghost
nextvideos
Machine Learning Experts Have Found A Way To Edit Videos Of People Saying Words They've Never Said!
240,800
Jun 07, 2019
Yah Riggght! Big Foot Found?
148,608
Aug 16, 2008
Lupe Fiasco - Skylar Grey “Words I Never Said”
17,106
Apr 28, 2011
Dondald Trump Hires Woman On Stage Based On The Size Of Her Breasts! (2007)
439,697
Oct 22, 2016
CMR - #WINS (Words I Never Said Remix) [Unsigned Artist]
93,493
May 01, 2016
Work Smarter Not Harder: Dude Found A Way To Cheat The Claw Machine!
153,914
May 17, 2023
One Of Lil Uzi Vert's Unseen Music Videos Have Been Found!
188,256
Oct 30, 2017
Flashback Fridays: Lupe Fiasco Feat. Skylar Grey - Words I Never Said
31,645
May 12, 2017
New Study Shows Smoking Marijuana Can Triple Your Chances Of Dying From High Blood Pressure!
137,790
Aug 11, 2017
Guys Found A Brilliant Way To Hack Mcdonald's Self-Service Machine To Get Free Food!
548,391
Apr 08, 2019
Girl Got Bullied On Social Media For Looking Totally Different Without Her Makeup On!
256,293
Dec 13, 2017
Kangaroo’s Have A Weird Way Of Saying “I Love You” Back!
168,300
Nov 27, 2021
"I'm Going To Jail" Dude Said He Found A Way To Get Free Gas!
187,168
Mar 11, 2022
No Retirement: The Game Says "I Growed A Beard Like Rick Ross. 50 Cent Might Get Mad At Me" Live On Stage In California + 4th Album Coming Soon!
211,740
Feb 22, 2009
Found Out The Hard Way: Never Use A Lighter At A Gas Station
536,832
May 16, 2012
Compilation Of News Anchors Forced To Say "Deez Nuts"
809,969
Aug 22, 2015
Young Marqus (11 Year Old Houston Rapper) - Words I Never Said (Tribute Song To Lupe Fiasco) [Label Submitted]
105,143
Apr 18, 2011
Savages: Thieves Find A New Technique Called Push Pocketing!
366,884
Oct 27, 2018
Speaking Facts? Waka Flocka Got A Few Words For The People Saying Being A Rapper Is Dangerous!
222,087
Feb 27, 2020
Thoughts? Dude Has Words For People Going Out Their Way To Buy An IPhone 12!
315,133
Dec 30, 2020
Fox News Host Says Black People Have Told Her Ice Detention Centers Are Nicer Than The Projects They've Grown Up In!
109,248
Jun 25, 2018
16-Year-Old Girl Who’s Racist Against Her Own Race Says “Women’s Opinions Don’t Matter & Trump Is A Magnificent Leader”
175,920
Oct 28, 2018
Uber Murder Suspect "Jason Dalton" Dragged Out Of Courtroom After Outburst!
359,332
May 20, 2016
Well Damn: Vontae Davis Up And Retired From Football During Half Time Game Vs The Chargers!
288,739
Sep 16, 2018
Ray J Confirms Sex Tape With Kim Kardashian Was A Deal Orchestrated By Her Mother Kris Jenner!
171,437
May 05, 2022
Jury Selection Begins In Lil Boosie Murder Trial!
191,998
Apr 30, 2012
Carmelo, This Is What You Gotta Deal With Now: NYPD Stopped Over 600K People In 2010! (85 Pecent Of Them Black & Latino)
126,227
Feb 26, 2011
Well Damn: Tourists Are Snorting Cocaine Off Pablo Escobar’s Grave!
297,619
Apr 22, 2018
These Folks Found A Way To Gentrify Prison!
154,852
Jul 16, 2022
Nigerian Officer Tackles Man Who Reportedly Killed 50 People!
122,146
Jun 05, 2022
Crazy: Canadian Artificial Intelligence Company Can Clone Any Voice Within 60 Seconds!
120,557
Jun 09, 2018
Dude Found A Unique Way To Stop A Girl Fight!
626,139
Sep 07, 2019
Boxing Experts Are Saying Tyson Fury Cheated Wilder To Win.. Shows 1st Fight Footage In Slow Motion!
880,166
Feb 25, 2020
Afrika Bambaataa Denies Sexual Abuse Allegations!
117,581
May 12, 2016
Chick Found An Ingenious Way To Get Out Get Out Of A Headlock!
141,243
Nov 21, 2023
Woah: U.S. Navy Confirms Leaked "UFO Videos" Are Real & Never Should Have Been Released To The Public!
556,226
Sep 18, 2019
Deal Or No Deal (Prod. By AraabMUZIK) [Unsigned Artist]
89,449
Nov 17, 2012
Dave East - Found A Way
1,514,608
Oct 25, 2018
YBS Skola - Found A Way
721,587
Oct 03, 2016
Well Damn: Guy Runs A Group Of People Over For Trying To Move His Car Out Of The Way!
229,840
Aug 08, 2019