New AI Video Editor – Text to Video is Mindblowing!
Hello viewers from across the interwebs and welcome back to another video I know it’s been a little bit of time since my last video and that’s mainly due to the fact that I am in University so it takes up a lot more of my time and In turn, I have less time to make videos which is very unfortunate But nevertheless I am here right now to deliver you some AI news a lot is going on this space of Evolving so crazy fast. I’m sure all of you know that especially those of you that are in my discord server Which is linked to down in the description below by the way it seems like almost every day There’s some new little project being worked on or some new update to an existing AI And this one was brought to my attention about a week ago And I just think I really have to talk about it because it is promising So so much and it’s kind of a viral tweet as you can see we had 2000 retweets on this over 13,000 likes so this is definitely Allowing up and this was September 9th Okay, so it wasn’t a week ago exactly but yeah about five days ago or so this was announced and I will link it down in the description By the way, but this Promises to be a text to video coming soon to runway and we’re gonna break this whole a minute long video down because I think it’s very Important to distinguish and break down stuff like this. It’s just crazy. They say make any idea real just write it Text to video coming soon and then they link this website which we will also take a look at in this video Of course, I’ve already signed up for the beta waitlist as I do with every single beta waitlist Anyways, let’s observe and comment with our AI eyeballs on this Particular video here. Okay, so I will play this video. This is a box a magical box. This box can make any idea real So already breaking that first little bit down it says it’s a magical box where you can type anything I mean we all know the text prompt box. It’s with so many a eyes any of the text to image Generators as a matter of fact they have that magic box where you know, it’s just text to whatever and of course This is promising to be text to video. However, I want you to notice here What it says it doesn’t say generate like it says import so this means that They’re importing the city street. They’re not actually generating this city street So you know, I’m in the belief here that the city street we’re looking at in this video is not an AI generated city street It’s a video that they’ve recorded at some point and it just is a file on the computer So maybe what the AI is doing is it’s analyzing the fact that that is a city street or you know It’s it’s getting it from somewhere else on the web and grabbing it and just putting it in either way It does seem like a really cool concept even if it the video This particular one isn’t fully a I generated being able to just type in a box say I want a city street footage and then having it just Automatically splash right onto your screen. So moving on with the video We can continue to play it and we see now they’re typing something else make it looks cinematic and it automatically Adjusts the color of the video to look more cinematic So really what they’re displaying to us right now is not necessarily AI video generation we’re just looking at AI video editing So the AI is interpreting the text and adjusting specific settings on the video clip Which is still really really cool, and I actually really love this idea and Now this next part is really particularly interesting it highlights this entire poll and says removed this object So that is some serious AI work right there You know, not only the technology capabilities to just highlight an object like that really simply But the AI’s capabilities to completely remove it from the rest of the video footage and obviously that should take some processing time So it’s not gonna be so seamless as they displayed in here But still that is another really cool concept and definitely one that’s I think a lot more difficult to implement than just Adjusting some settings or grabbing a video clips from somewhere full object removal and video is not an easy task by any means Object removal and photos which we already see with stuff like dolly twos in painting or stable diffusion in painting You know, that’s that’s something that’s a lot easier, but you know frame after frame to keep it look consistent That is some powerful AI stuff right there and is shockingly mind blowing We’ll have to see how well it actually works So next they follow up and says generate a lush garden So the fact that they said generate here means that now we’re seeing something that is AI Generated and as you can see there’s four different tabs that they scroll through so you can pick between The lush gardens and yeah, these are all obviously very much AI generated photos and in fact I would like to say that you know, this isn’t some in-house image generation AI that they are using for this technology This is definitely an AI that’s different. I don’t know. Maybe some of these are dolly too Maybe some of them are stable diffusion. We don’t really know exactly what they are using But it’s definitely not something in-house at least in my opinion. We don’t really know But it definitely seems as though that is the case as they scroll through these and also it’s important to note that what we’re seeing here When you say generate a lush garden. It’s not generating actual video. It’s generating just straight-up images So I’m not seeing any moving and generated video so far with this Although, you know, these are some nice generations This is scale it over time again similar to the color thing when you say scale it over time The AI is interpreting that text and just zooming the image in. It’s not actually you know generating anything Based off of this image is just adjusting some settings in the video editor I just think that some people might be a little misled by this and fade in infinite worlds again That’s just adjusting settings Still really cool stuff now they’re showing off something again that is very very impressive a lot more impressive than just Adjusting basic settings. So they import another video and then it says green screen character. That’s pretty much all they say here Fully green screens the character that’s in there. So that’s that’s really cool technology if it really works that well I say just make this guy a green screen do it for me that would be awesome and definitely would be a lot easier than trying to do it in any Normal video editing software below the background and then they show off a little bit more of the image generation And then they give us a little sneak peek of what the app might look like so I think this is already something they do I’m not sure we’re gonna go take a look at the runway website But I’m pretty sure it already is some video editing software So you know, they’re just integrating a basic AI feature into their video editor software it seems Edit video using text generate video using text make video using text So again, they use that word generate in there not just editing So we will see if they’re really doing text to video and they say get early access at their website Of course, I signed up when I first found out about this and they say fade out. Yes, talk about something that is very intriguing Especially to me as a youtuber who edits videos almost every day I actually already do use an AI to help edit my videos. It’s called Descript you can find an affiliate link down in the description for it Basically what it does is it transcribed your entire video of you talking and then edits out all the little pauses and stuff And you can remove specific words and stuff like that So yeah, I already do actually use an AI to edit videos or help me edit videos But this looks like it’s something a lot more powerful and can do stuff like green screen So let’s take a look at the website It’s a box. It’s already started playing again Let’s take a look at the website as you can see it’s called the runway here text to video early access So they really are just calling it text to video. It really is text to video editing from what I can tell from that little video And they also have a clip here of it working in real time You know, it definitely does still look like it’s really cool But is it really generating video text to video generation is that isn’t that going to be available and they have Join the wait list here. So yeah, then it’s like this Google form and I’ve already filled all this out But it will be linked down below so you guys can sign up for early access Here we can take a little bit more of an in-depth look here edit video in Seconds powered by mind blowing AI tools. So remove video backgrounds here. Apparently I think this one is already working and in painting as you can see is also a feature down in here paint out objects Yeah, that is the in-painting and it says try it for free So yeah, they already have an editing program that works in browser apparently So if we click create your first project and then go to in-painting which is AI stuff Let’s try out some of these demo assets So we’ve got this moose video I’m gonna go ahead and just drop in here and brush over an area to begin in-painting Let’s give this a shot going to increase this size. Let’s delete this moose. Goodbye moose. We’ll see how well this works I’m surprised that we already have access to in-painting in here. This is very surprising By the way, this is a very very difficult in-painting task here for an AI to do This is not easy by any means so if it’s not perfect I’m not gonna really be giving it too much crap for that. Oh, all right. We’ve erased the full moose here and Now we can see it’s really trying to do some in-painting here and we’ll take a brief of this So wow that actually is working Shockingly well. I am genuinely shocked by that. Wow. So it’s processing and as it’s going here We can still see the moose is shadow in there, but yeah for the most part I mean that works pretty darn good especially with this really really highly difficult use case here of Deleting an entire moose from the scene which is the subject the leading a subject from a scene like this That is hard and I mean obviously it’s not perfect or anything It’s not gonna be able to pick up on all this but that is really really good. Wow I am actually blown away. That’s very very good. It’s completely In-painted a moose. I mean you can see it’s definitely not perfect play the video here though You can see the moose is shadow moving and it was able to track the moose as well as he bends down or moose around And everything but that’s pretty good for for deleting an entire character from a background there Shocking let’s try this dancer clip here. Let’s see if we can do anything fun with this So they’ve got a cool they’ve got cool filters in here as well I don’t think all of these are AI or anything like that. So this is the AI magic tools here The motion tracking is coming soon, but we’ve got green screen So let’s green screen this guy out again. This is gonna be very difficult like this is not an easy task to green screen a Guy out of something that shouldn’t even be green screen in the first place. Okay, so it’s actually doing a pretty decent job So far So can we get the shoe there? It’s doing a pretty good job selecting the correct areas We just sort of click around here and now we can preview and see if it green screens this guy out Wow, okay, it’s doing a darn good job. This is very shocking. Look at it. That’s pretty darn good You can put whatever you want in there or I guess we can remove the back and put this guy wherever we want He’s not even against a green screen. You know, we’ve got settings for feathering and stuff You guys familiar with actual stuff like this. Wow. Yeah, there we go. We can fully green screen this guy out done masking Okay, we’ll be done masking here. So now let’s overlay this clip of this dancer where the moosh should be So we’ve removed the moosh and replaced him with a dancer And it’s taking a little long to load, but it does it pretty quickly. There we go. He’s here. Man, this is incredible There he is. He’s doing some dancing with a moosh. Wow, okay, that’s pretty incredible. That’s very very impressive So yeah text to video editing. I mean, it’s already starting to become here That was incredibly easy to just mask this guy out and delete the moosh and it worked pretty darn well And these are both very difficult use cases. So yeah, this looks actually very promising I was a little skeptical. I knew the AI video editing would be pretty decent I wasn’t expecting it to be this good though. That is shockingly good and Yeah, this video editor in software using AI looks very very promising indeed. Yeah, sign up for this if you guys are interested and Yeah, please join my discord if you want the latest in AI news definitely gets a Subscribe to the channel if you like my content and definitely check out some of my other videos I try my best to produce great videos for you guys covering all sorts of AI topics Talking about the latest cutting edge AI stuff definitely some other very interesting AIs on the horizon as well that are coming up in some future videos. So yeah, get subscribed Thanks for watching and goodbye.