I Spent 100 Hours Using GPT-6 Astra (This Feels Like AGI) transcript

You probably have already heard by now, but OpenAI released Astra or GPT6. And I'm going to be honest with you, I am genuinely shook by how good this model is. So, I had access to this model for about a week before it came out. And since the release, I've spent around $1,500 worth of credits using it, and I've been using it for everything. I built a Call of Duty game in just four prompts. And then on the fifth prompt, I made it multiplayer and immediately started using it on stream with 20 different people.

This model GPT6 Astra simply feels different. And in this video, I want to talk about the seven reasons why I feel this way. So, let's hop over to the board. And so, the first realization that I had while using this new model is that AI is better at 3D graphics than humans. Now, straight up. And many of you have probably already seen the demos regarding Blender, but let me show you what I was working on. So yesterday I found this PDF online of this estate.

And this shows this massive house on this estate. And then it shows the entire estate. It even has a floor plan for this estate. So, I thought, why don't I just pass this whole PDF to Codeex and why don't we just use the brand new GPT6 Astra inside Codeex, get it to control Blender and create this house right here or this estate. This is what it created after about 20 minutes. It went off and created this inside Blender.

It created this house. And like look at this shot right here. Like look at this shot versus this shot. Maybe it got the color slightly wrong, but look at this house right here. But I didn't just have it create the Blender file. I said once you're done with creating the Blender file and you've checked it and it looks good, create a new map in our Call of Duty game. This new map should be called Estate. I want you to make this a new map that you can play in the same format as the other maps that we've created in the video game that we created yesterday, which is Call of Singularity.

Then after an hour, it sent the Blender scene, but it also sent this. This is our Modern Warfare game that we created called Modern Singularity. There was a map on here called Estate, and I could play it. Here is the estate that we've created >> FOR ALL OH, COME ON. >> OH, there it is. But I want to show you something. >> You lost the lead. That is the house that it created on Blender and it immediately added it to my Call of Duty game.

And it even added this helicopter. I can fly in this helicopter and I can shoot people in it. And they can shoot me out of it, too. >> Tango down. It's pretty overpowered, not going to lie. Oh, they shot me out of it. Just to fully illustrate my point, I do want to show you a few more examples. This is a render someone posted on X created by Astra. It's not just that kind of video game look, which is what I was going for.

It can create photorealistic 3D renders. Another trend that I've been seeing on Twitter is people are using codecs with Astra to create these educational 3D websites. So this is like an engine and someone wanted to learn how to use the engine and it created this realistic 3D representation. I'm not sure how accurate this is because I'm not an expert in engines, but I found this to be extremely interesting. This person actually took apart an entire Tesla part by part so you can see how they all fit together.

I mean, look at how cool that is. And it can show you every single part. And you can actually zoom in on each part. It tells you what each part is and what it does. And you can go back and forth between the car being put together and all of the materials being spread apart. And so that is my main realization. And it is the most viral realization that we've had collectively about this model, which is GPT6 is a baller at using Blender, Unreal Engine, Unity.

It is great at creating digital 3D assets. And one of my takeaways that I thought during this whole thing is I want to get into 3D printing. I think that is a massive opportunity right now and something I'm going to dabble in on the side for some of my side projects. I'm fascinated by this because creating digital assets is no longer like hard or a scarce skill. You can just do it now. How do you actually turn that into something that looks cool in real life or is useful in real life?

That is what I would focus a lot of my attention on. If you're kind of looking at this and you're like, "Okay, what do I do with this information?" 3D printing because it's so good at these things. I would definitely get into 3D printing. And then I would also just focus on using this tech for learning. And then I want you to really think about this deeply, right? Think about the fact that AI can now create highquality 3D multiplayer video games in a matter of 30 minutes to an hour.

Right? People are creating full Rocket League clones and customizing it to make it the game more fun. The exact feature that they wanted. They're just creating it. and people are creating Fortnite-l like games. I created Call of Duty, right? I could have put a lot more time into it and I might still do that, but you could just create these games. And so I think that this is going to lead to the next vibe coding boom.

I think there will be a platform out there that focuses only on games and maybe it's just a hosting platform, right? on chat GBT. You could just at@mentionhostmygame.com and it just hosts the game there and and it's free to host your game there and you can maybe create some in-game currency where there's transactions and I think that com a company to figure out how to allow people to host their games and then sell things within that game, they will become billionaires for sure.

It's a little bit like Roblox in a way, but I do think there should be no limitations on what you could create. And then also the next thing is like I just think creators are going to start creating games for their audience the same way that they create PDFs, courses, communities, all of these things are very like low fidelity. Like imagine if you could just create a video game or a little world people can go and interact with.

It's kind of like the metaverse, but I think it's if it's just a link people can go to to play a game to enter the creators world. I definitely think this could be a huge trend in the future. So the third realization that I had while using GPT Astra that made me feel the AGI was that vibe coding is just solved. And I'm kind of I'm serious about this, right? You can just spawn software on command. The level of knowledge that you need to just create your own personal software is zero.

Let me show you an app that I created this morning when I had like this minor urge to create an app. So, the problem that I had while I was at coffee this morning is I was making this presentation and I got sick of going to Google images and then taking on images and then looking up AI video game uh Astra as a visual and then I would like copy it and then I would I would come to back to the tab that I need to be on and then I would paste it in my Excaladraw diagram or whatever presentation that I'm working on.

And so I had this idea for an app that would look a lot like Raycast. And so Raycast is my clipboard manager and it's my app finder. It's a very cool app. I love how it just kind of pops up when you need it. And so I just went to Codeex, right? I just said, I want to create a desktop app that I can use via shortcut. And it's a raycast style app that lets me have Google images and remove the background. And all of them that I copy or save get saved to the saves folder.

And then I just like had a bunch of ideas for the app. And then literally after 16 minutes it created this app right here. Command shift space. I can open this up and I can type codeex logo. And notice here if I press enter it searches for my the codeex logo and I could copy this right here and we could paste this in whatever it is that I'm working on. Here's the codeex logo. But once you put it on Excaladraw, you can't remove the background.

So I wanted the app to be able to remove the background just like this. I also wanted to be able to look search multiple things. So I could go open AI logo and I could do a semicolon Microsoft logo semicolon Bing logo semicolon Google logo enter. And this would automatically create four Google image searches. So I can search a bunch of things at once. And so while one is loading I can move to the other one. And then I also added this AI feature which does that through AI.

Microsoft logo, uh, Santia Nadella, Sam Alman, Daario Amodai, Steve Balmer, and Gavin, Jensen Hang, all separate searches. So I can just paste this in and I can press command enter and this will use AI to automatically create the right searches. So it'll search Satia. So, if I need a ton of images for whatever it is that I'm working on, right, I can remove the background of Satia. There we go. Copy it and paste it on the board here.

And because I saved or I copied it, it automatically gets saved to my clipboard or it automatically gets saved to this file here. So, in the future, as soon as I start typing it, it'll show up here. So, I can use an existing one that I've already had. Anyway, super niche app, but I made it for myself and now it's a keyboard shortcut that just lives on my computer, right? This is a desktop app. This would have taken me a long time and I created it in a single prompt using codecs.

And this trend is just going to continue. Like the trend of being able to just spawn whatever software you need for your business or for your personal life is only going to exponentially get better. OpenAI and Enthropic and all these companies see the value in creating it and that's why they're adding this sites feature. They've already added this sites feature which adds hosting database storage baked into it, authentication, all of these things are baked into sites.

I can just create a sites and it will host it on chatgbt on like chatgbt.site site and then you can share it with your team and they could and you could require that they sign in with their team account and you can just spawn apps really easily. One thing that I made clear on Twitter yesterday, I was talking about sites publicly is I was saying that I think one of the best use cases right now are creating these lead magnets.

So like I wanted people to be able to sign up for uh Call of Singularity and very easily I can just require like I can put up this site. I said hey create in the style of my modern singularity game please create a site where people can upload their information so I can message them and then it created this right it created this really quickly hosted it on chat GBT sites. I also specified that I wanted an admin dashboard for only my email.

And then it created this. And now on the website, I can just click on this right here. And if I sign in with my account, I can see the admin dashboard. Only I can see the people who've entered the information. So you can create these secure sites and you can give yourself admin access. Like whatever your GPT account is, just make yourself the admin. you're the one who can see behind the scenes. I think this trend is only going to continue as like you can create any app you want, just host it on chatb sites and share it with other people, right?

That's how you should get feedback. And so this is just a really easy way to vibe code and get it in other people's hands. And pretty soon people are going to be vibe coding full games directly on Chat GBD sites, which I think is going to be pretty cool. Okay, my fourth realization which left me feeling the AGI when using GPT6 Astra was that computer use is simply just insane. It is accelerating so quickly at how good these models, especially when you use it inside codecs, are getting at controlling a computer.

And I thought this test was actually really telling. So, this guy pinned Fable against GPT6 Astra, put a photo of himself, and then opened up Microsoft Paint and had both of them draw him. And then I think this is sped up like 10x or something. But the point is, look at the difference between GPT6 Astra and Fable 5.1 at computer use specifically. And so right now like it is using computer use. And if you go to like if you go to chat GBT if you were to use this at computer please control my computer this is a skill or a plugin that's built into codecs.

It can just fully control your computer which is actually really useful when you're using it on the remote. So, if you're controlling codecs from your phone, which you can, which you can basically control the desktop app from your phone, while you're away, you can get it to fully control your computer. And this is getting better exponentially. And we're starting to see OpenAI, at least it seems like they're pulling away from anthropic a little bit on the computer use side.

And like look at this. So, it used Microsoft Paint for a period of time. And you know, this is about average. You know, this is actually above average from 2 weeks ago if you got AI to try and draw you from computer use. But like look at how much better it is now with GPT Astra. It is insane that it can just control a computer. It can have that level of spatial awareness and create it can like recreate an image. That's pretty insane.

And when I say that this computer use trend will only continue to get better, right? These models will only continue to get exponentially better. I mean, look at this. OpenAI reportedly bought tens of thousands of Mac minis and Mac Studios for re reinforcement learning and training computer use agents, while Anthropic rents Mac minis through AWS. Both Anthropic and OpenAI have tens of thousands of Mac minis and Mac Studios running all the time, training AI, evaluating how good AI is at controlling a computer.

And this kind of leads me to my next realization that I've had while using GPT6 Astra. And it's that it is getting significantly better at self- testing. Meaning when you ask it to do something, no matter how long it is, it'll do the thing. It'll evaluate how good it is at doing the thing, it will then decide what changes it needs to make and then it will make changes and then it will re-evaluate the thing over and over and over again.

And we've been talking about this for a long time, right? Even back to like the early cloud code days, it would actually be able to do this, especially when vibe coding. But it's just getting a lot better at it now. I realized this when I was using it to create something in Blender. Remember earlier when I had that Blender game get created? I was creating that Blender game and I wanted to put it in my Call of like that entire map into my Call of Duty game and the AI went off forever and it would create the map and then it created this image, right?

It had Blender open on the computer and it took a screenshot. It looked at it, it evaluated it and it says the state now builds successfully as the third map on the game. I'm extending uh the vehicle system to helicopter boarding. And then it started playing the game. You can see here it started a match. It was moving around the map as one of the characters. So, it started playing a game, got in the helicopter, started flying the helicopter to test it for the game, and it was just playing these games and making sure that the map looked good.

Here you can see it's checking in on the house. And so, we asked it to take that PDF, turn it into a 3D model, and then turn it into a video game. And at every stage of that process, it was checking its work by actually playing the game and then viewing the images and evaluating it. Is this supposed to be or is it supposed to look like this? And the house was actually like really white at the beginning and it didn't look like the right texture.

And so it basically saw that and then it reprompted the AI. It's basically reprompting itself in this loop. And I've never felt so confident in AI than I do with this model. I know that it's just going if I specify the end result that I want and it is realistic in the sense that it is it can be done on my computer, the AI will just work until it gets there. Unless it hits like a hard payw wall, maybe you haven't paid for a software that it needs, in which case it'll tell you to pay for it. end result.

The agent just iterates, iterates, iterates, tests, tests, tests until it reaches that end state. And it's truly, it is insane. It is playing a video game that it created. Anyway, I I just think it's it's we're at an insane point in the world of AI. And then my final two realizations that I have about this model uh kind of go hand in hand. The first realization is that this model is much better with codecs. I don't know if it's much better, right?

You can use it in other tools like you can use GBT6 inside cursor for now, right? But something about using it in the codec app makes it significantly better. This model is made for the codec harness and it's made for the tools that are available inside codec. You know, Codeex has a ton of useful tools like computer use, like browser use, right? This browser, it's able to spin up like whatever it is and run it locally in the computer and then it can fill out forms really quickly.

It can test websites really quickly. It's made for this application. And so all I will say for this kind of realization here, I do not think there is a more important tool. Like this is the number one thing that I would learn right now. I would learn how to use codeex because the UI is so nice. It's like chat GPT except it can fully control your entire computer. It can do anything you want as long as you have full access on.

And that's what makes this so powerful is it it has full access over your computer. It can just use Blender when it needs to use Blender. It can view Blender if it needs to view Blender. It can take screenshots, send it back to codecs. It can create a game. It can build a website. It can edit files. It can delete files, remove files, do anything on your computer. It has full access and that's what makes it so powerful.

And the fact that you're signed in to all of your applications on code access like especially GitHub and tools like Verscell, it has all of my API keys uh on the system. So, it's able to just do things much quicker because it's running on my computer. It has full access over my computer. I'm signed in on all of my browser tabs because it's my computer. And that brings me to the final one. And the biggest realization that I had while using GPT6 Astra with codecs is that the Mac Mini setups remain supreme.

I just bought a Mac Mini. In fact, I just bought another Mac Mini right here. I'm going to be using this as well as this Linux machine. I'm going to get codecs running on these computers because I want to have access to codecs wherever I go because right now I use codecs on my laptop and whenever I'm traveling or moving around, which is quite frequently, I can't use codecs on my computer. And so I've been talking to some of my really good friends, my really smart friends, and we are going to talk about and make a video this week on the absolute best setup to run codecs remotely and the other agents too.

Like you can uh run Anthropic, you can run Grock, you can run all of the different super apps I like to call them on your Mac Mini and you can control them from your phone. And if you have an iPad or your MacBook Pro, you can actually remotely control your Mac Mini if you leave it running at your house so that it never turns off. And so I'm actually going to be talking about that setup. If you can fully and remotely control your Mac Mini and it can run codecs and you can have a version of Codeex running at all times 247 that you can access.

I think that's incredibly powerful. And so I'm going to be setting that up this week and I think that's going to be really fun. I've been using GBT work a lot and it's really useful for automations with work stuff, but a lot of my coding stuff is also related to the documents and presentations that I'm creating and all of them I want them all on one machine. And so I at least want one instance or version or computer of codecs running 24/7 and I'm going to be setting that up.

And that was my biggest realization after all of this, right? If AI can have full control over a computer, create 3D assets, can create video games, can vibe code any app you want on command, it can host them very easily, and then it can use everything on the computer to self- test so that it can improve until it reaches a a point where the AI is like, "Yep, that's good enough. We did it." It'll self- test and it's much better with codecs.

Why wouldn't I want a computer that runs codecs 24/7? That's kind of my biggest realization after all of this. And yeah, I'm really excited about this new model. I'm excited for these models to get better. I know that Anthropic coming up to their IPO, they're going to try and release a model that's better than GBT6. It's going to be very important to raise enough money to get to that $2 trillion valuation that they want.

And then OpenAI is going to quickly try and come back and release another model as well. We are in the era of exponentials. AI is going to get significantly better at controlling a computer. It'll continue to get smarter. It'll get better at vibe coding. It'll get better at everything that you can do on a computer. And so I'm feeling it now. I'm feeling the age of AGI. We are in a different era of AI. I think the first threshold was clawed code when it released early 2025. uh and we didn't feel it until mid 2025.

I think we've crossed the era into kind of the AGI era and I will keep you updated on everything. I will be making a ton of videos going forward. Thank you guys so much for watching. I'll see you here in the next one.