Free and Local Real-Time AI Animation - NVIDIA MotionBricks.cpp transcript

Earlier this year Nvidia open sources Motion Bricks, which is real -time AI motion system that you can plug into your game But now we have CPP which allow you to run it on low VRAM or even on CPU And that is crazy. I tested it and plugged it to Unreal Engine. So I have something to share with you I'm talking about Motion Bricks CPP and this is again port from official open source library from Richard Pillington Same going behind Kimoto CPP and there's also skin token CPP basically a whole universe of tools for AI animation But first what is Motion Bricks?

Why it's different from Kimoto which you may heard of? So Motion Bricks originally It's not creating an animation from prompts. It's about motion system that replaces classic animation system in games Like you give it a space you give it controls and this AI system predicts movements like basically the animation sequence For your character in real time. There is no prompt that you need to type. It basically happens in real time There is of course some control we're going to talk about it right now.

Mostly it is about pose style This is the control that we have right now in the current version of Motion Bricks However, Nvidia showcased that there will be so -called smart primitives and much more built around it So you basically will be able to define in your game Like say this is a box that you can take or this is a sword that you can equip And it will be able to predict the movement how it takes the sword how it takes the boxes and move them around And complex motions such as crouching etc.

Sounds cool in it. So how do we install it? So basically that's pretty simple again the whole instruction is here But to be honest with GPT-6 and Claude and any other capable models I don't really bother myself going through this instruction So what I did really I just created a folder went to chat gpt Astra which is just recently released and just gave it like this git repository and say like please install it for me And with Astra also I created a demo in Unreal engine So I can actually play it and speaking of GPT-6 It's absolutely insane.

I was able to do crazy things such as build complete scene from one image or rig and animate Characters like literally gpt 6 rigged my character and did a set of animations But that of course was possible only with right MCP tools and skills and here I really want to recommend you Hicksfield's Blender plugin, which is absolutely crazy thing First of all, it's free and exposes a lot of tools for your agents to work with Blender second You can connect your accounts and get access to any 3d gen .i image generation video generation all at once And actually in my animation workflow I used Tripo p2 to generate the wolf and I also used cdance 2 .5 to generate video references Then I provided it to GPT-6 and made this animation happen I actually gonna make complete video about that until then link to the Hicksfield Blender plugin will be in the description and thanks Hicksfield to sponsor this video.

Probably the only thing that you might not have by default is the Unreal engine mcp So I was using native Unreal engine mcp combining with ybu e 5 .8 mcp So I do have a video on my main channel like about how I do this setup for me And just before I show you how it works in Unreal engine need to mention that again This same guy also did Kimoto, which is actually text to prompt There's a complete video on my channel with some instructions and use cases It's there very powerful because again you can generate animation and then like use that animation export that animation Map it like to Unreal engine any other engine etc.

And there's also skin tokens, which is for rigging So you basically put a mesh there and it will be able to predict the skeleton and the weights distribute the weights Like quite difficult thing and it's still work in progress I guess like for all these ports but it's already looking quite quite good and the cool thing again Like they pretty much this is going to work together kimoto animations work with the characters that you rig in Skin token cpp and you can see the experience mixing kimoto with motion bricks like animation sequences Anyway, all links will be in the description.

Take a look And if you guys still not follow me on x this is about the time to fix it because when anything important such as motion bricks App happens i'm gonna post it there right away. I can't do youtube videos that fast as x post So consider following me really appreciate your trust and support now. Here's the result that I got Well, that was actually quite fast. I don't know like less than an hour So I have motion bricks running in the background and it connected by a bridge to Unreal engine and there's like prediction of animation when I do the inputs and I mean that's insanely fast It is possible to run it on cpu.

That is absolute truth But they're probably gonna be some delay because it needs to compute predict the animation and put it in the Unreal engine, etc So it definitely gonna work but I think like that's more like a research use case better It's gonna work on vram at least I don't know like 8 gigabyte vram will probably give you like this 30 frames animation overall Motion bricks able to produce up to 30 frames But in Unreal engine you still can scale it to 60 frame and that will pretty much look okay So what you see doesn't look bad, of course, like there's not much of animation I mean like I switch some of them but again that's still limited So I was actually holding on this video before because I remember you guys was asking a lot like do the video about motion bricks We were hoping with my team that they will drop some smart primitives, etc So we can show like more use cases, but the timeline is not really clear I think that's the only frustrating thing here from nvidia I mean like when they're gonna drop other weights other possibilities that we can use here It will be much cooler like to add more stuff like jumps crouches taking object interacting with objects That will be absolutely insane.

And by the way, we have all of this thanks to robotics I mean, it's it's just like that, you know, because robotics is advancing We have these data sets predicting like the robot movements and we can also use that in games and other stuff So that is absolutely insane. Like I would not expect it to work this way I mean, I was thinking like maybe first we develop something and then it pushes robotics No, the robotics actually pushes game dev like to the next level So probably in one year maybe a little bit more we'll have animation systems real time in engines Without you having to do anything you'll just gonna prompt it, right?

Like I mean you do this this this if I input this this and that's it There will be you know hundreds tracks of animation, etc And honestly, this is probably one thing that I will not miss because that is such a big nightmare Like dealing all of these animations and stuff. So that is all for today guys like and subscribe and I see you the next video