Two Minute Papers: Perfect Virtual Hands – But At A Cost! Two Minute Papers: Virtual Characters Learn To Work Out … and Undergo Surgery Two Minute Papers: This is What Abraham Lincoln May Have Looked Like! Two Minute Papers: This AI Learned Boxing … with Serious Knockout Power! Two Minute Papers: Everybody Can Make Deepfakes Now! Two Minute Papers: AI Learns To Compute Game Physics In Microseconds! Two Minute Papers: DeepFake Detector AIs Are Good Too! Two Minute Papers: This AI Clones Your Voice After Listening for 5 Seconds Two Minute Papers: This AI Does Nothing In Games … And Still Wins! Two Minute Papers: OpenAI Five Beats World Champion DOTA2 Team 2-0! Two Minute Papers: 6 Life Lessons I Learned From AI Research Two Minute Papers: DeepMind’s AlphaStar Beats Humans 10-0 (or 1) Two Minute Papers: OpenAI Plays Hide and Seek … and Breaks The Game! Two Minute Papers: 4 Experiments Where the AI Outsmarted Its Creators Two Minute Papers: AI Learns to Animate Humanoids Two Minute Papers: Ken Burns Effect, Now In 3D! • Two Minute Papers: This AI Creates Human Faces From Your Sketches! • Two Minute Papers: Google’s New AI Puts Video Calls On Steroids! • Two Minute Papers: New AI Research Work Fixes Your Choppy Videos! • Two Minute Papers: Can an AI Learn Lip Reading? • Two Minute Papers: Two Shots of Green Screen Please! • Two Minute Papers: This AI Creates Dessert Photos … and more! • Two Minute Papers: NVIDIA’s AI Dreams Up Imaginary Celebrities #207 • Two Minute Papers: Beautiful Gooey Simulations, Now 10 Times Faster • Two Minute Papers: DeepMind’s New AI Dreams Up Videos on Many Topics • Two Minute Papers: How Do Genetic Algorithms Work? #32 • Two Minute Papers: AI Makes 3D Models From Photos #122 • Two Minute Papers: What is De-Aging? • Two Minute Papers: This AI Made Me Look Like Obi-Wan Kenobi! • Two Minute Papers: DeepMind’s AI Learns Locomotion From Scratch | Two Minute Papers #190 Two Minute Papers: DeepMind’s WaveNet, 1000 Times Faster | Two Minute Papers #232 Two Minute Papers: This is How You Hack A Neural Network Two Minute Papers: We Can All Be Video Game Characters With This AI ★★★★★ Two Minute Papers: DeepMind’s New AI Helps Detecting Breast Cancer • Two Minute Papers: Artistic Style Transfer For Videos #68 • Two Minute Papers: OpenAI’s Whisper Learned 680,000 Hours Of Speech! Two Minute Papers: Ubisoft’s New AI: Breathing Life Into Games! Two Minute Papers: How To Get Started With Machine Learning? #51 Two Minute Papers: Google’s New AI: Fly INTO Photos! Two Minute Papers: NVIDIA’s AI Removes Objects From Your Photos | Two Minute Papers #255 Two Minute Papers: Stable Diffusion Is Getting Outrageously Good! Two Minute Papers: OpenAI Dall-E 2 – AI or Artist? Which is Better? Two Minute Papers: Google’s New AI Learns Table Tennis! Two Minute Papers: NVIDIA’s New AI: Video Game Graphics, Now 60x Smaller! Two Minute Papers: New AI Makes Amazing DeepFakes In a Blink of an Eye! Two Minute Papers: This New AI Is The Future of Video Editing! Two Minute Papers: How Does Deep Learning Work? #24 •

Two Minute Papers: This New AI Is The Future of Video Editing!

Dear Fellow Scholars, this is two Minute Papers with Dr. Karo Jorna Ifehir. Today we are going to have a look at this magical AI from scientists at the Wisement Institute of Science and Nvidia which promises magical video editing powers. So let’s see four of my favorite things it can do together. One, we can make this unremarkable video of a car passing by and my goodness! To look at that, it has completely revamped the scene. First, it made sure that it is nighttime and has given the car a nice neon cyberpunk look. So this talk quite a bit of work for someone, right? Well, not quite. To achieve this, all we need to do is give the AI a video and two text prompts. One for the foreground and one for the background. And if we are looking for an example, that is a little less out there, we can also ask that the car is made rusty instead. So cool! Two, once again if we did not show up in the right outfit for a day, or would like to see what we would look like wearing something else before buying it, look no more. Yes, this is also just one text prompt away. I particularly like this example because this outfit has lots of wrinkles and geometry changes over time and the new technique can follow them really well. Now, if you look closely, you see that there is also a price to be paid for this. Look, the new synthesized results are not as detailed as the original video. Now, we said that it can do foreground and background editing separately. And that was the foreground. But what about the background? Oh yes, let’s make this environment a little fogier. Look at that! I love this one! Even the shadows have become fogier. So cool! And the shadows are even taken away for the nighttime shot because of the different lighting setup. I would like these results a great deal for images, but for video. Such an amazing result for video. Wow! Now, of course, this kind of layered editing concept can be applied to images too and the results are outstanding. For instance, 3, if we have this boring cake, we can re-imagine it if it were made of Oreos instead or if we wish to let our imagination run wild. Or we are light transport researchers, we can ask the AI to make it out of ice. Loving it! Now, if you aren’t hungry enough yet, here is a piece of bread that can be converted to the legendary Red Velvet Bread 2 or once again, ice. And 4, the authors call these semi-transparent effects, where we can choose a small part of an already existing image, add the text prompt, for instance, fire, and then bam! We suddenly have a fire-breathing bear or a beautiful cup of coffee. This technique can truly do so much. Now, I would like to send a huge thank you to the authors of the paper because the source code for this project is also available. So, AI-driven, layered image editing is possible for free and for everyone. And just imagine what this technique will be able to do just a couple more papers down the line. What a time to be alive! So, what do you think? What would you use this for? Let me know in the comments below. This video has been supported by weights and biases. Look at this, they have a great community forum that aims to make you the best machine learning engineer you can be. You see, I always get messages from you fellow scholars telling me that you have been inspired by the series, but don’t really know where to start. And here it is. In this forum, you can share your projects, ask for advice, look for collaborators and more. Make sure to visit www.me-slash-paper-forum and say hi or just click the link in the video description. Our thanks to weights and biases for their long-standing support and for helping us make better videos for you. Thanks for watching and for your generous support and I’ll see you next time.

AI video(s) you might be interested in …