I Built JARVIS with GPT-6 Astra… It's Insane transcript

I just pulled up Jarvis with GPT-6 Astra, and the results are incredible. >> Good evening. I'm ready to assist. >> Hey there, Jarvis. Could you take me over to the memory section, please? >> We're now in the memory section. >> Create a new codex session and ask it how we can improve this entire Jarvis OS, please. >> The codex session is now running and working on improving the OS. >> And this doesn't just look cool. It actually connects to your entire world and has hands to do things for you, and it has capabilities that you will not have seen before.

And also, I built for you an agentic OS starter kit that you can literally grab down below in the description, and I'll show you exactly how to build your own. Now, I'm going to show you exactly everything that this is capable of and why this agentic OS with GPT Astra 6 is incredible. It needs to be able to, first of all, connect to your world. So, we want to be able to have all the information about you, your business.

We need to understand everything from Claude, from Codex, from ChatGPT, your emails, your meetings, your skills, Hermes, photos. You name it. This requires the context to go ahead and do it. Secondly, it needs to be able to organize all of that into something that's easy. It needs to be able to reason from that stuff. And then, crucially, actually do things for you, not just be something that you could have done by yourself in ChatGPT.

So, let's start by looking at the memory core. Here is the memory core of my entire system. Effectively, it is the entire memory of my system. It contains everything from ChatGPT, from Claude. And Astra built this entire thing. I've even got new memories adding now in the background. Of course, now I can go from light mode to dark mode. It just depends on your point of view and your preference. Now, before I show you some interesting things that we can do about building this incredible AI brain and what that looks like.

One of the cool things that I really built out here, and it's greatly have clients, is this idea of building your own operating system. We give it a name, and crucially, we give it some information about you and your business. Because the most important thing on here is context. So, we want a business profile and a life profile. This explains everything about you, what you're focusing in on, and then your business profile.

Who are your customers? What does it look like? You give essentially this prompt to ChatGPT Astra, it will interview you, and it provides unbelievable contacts that you need to power your operating system. Now, this is a really cool part. Is that you don't want to have to spend 16 years, you know, and growing out a huge mustache to add everything to it. You want it to be one click and go. So, the idea with this is that we can connect to your entire world.

And one of the things that GPT Astra 6 did, came up with the idea of what if we connected to basically your Claude and your Codex. And effectively, instead of you having to rewire like a bazillion things into one system, what this will do is just use the existing connections that you already have. And look at this. It's come down and identified essentially all the different coding editors I've got. So, look at this. I've got Codex, Claude, Hermes, Open Claude, and you can even add in other ones here.

Then for memory, I can one-click select Granola, Notion, Obsidian, as well as my photos. We can import those, too. And then we've got Gmail, we can talk about Outlook, we can bring in Slack, we can even bring in school and manage everything there, including our YouTube. And I even add in all social media profiles, just like that. And then finally, we can even connect all of our financial information. So, essentially, once that's done, we can then go ahead and set goals.

Now, in my view, the point of an agentic OS with GPT 6 Astra, it isn't really worth its salt unless it can actually help us achieve personal and business outcomes, right? So, if I come over, for example, to let's go to progress here. We want to have these goals and strategies. So, when you're getting things like daily briefs, explaining exactly what you need to focus in on every single day based on all of that memory, all of that context, everything you want to.

It knows what you're doing this week, what your goals are for this month, and where you're trying to get to this quarter. So, wherever you're at, the operating system is actually working for you and taking action. Now, our memory system here is going to be dynamic. So, we can actually automatically, anytime you have a chat in Claude or Codex or you have an email, it's already available to your Agentic OS running completely locally on your computer.

So, essentially it becomes the place where you can go to. We can come down and ask it any questions there. Like I could say, "Hey, name one participant from my last meeting, please." Or I might even just say something like, "What was the title of my last meeting?" I can come down, I can even ask it questions, I can pick the harness and have wonderful conversations. And as you can see, my chat window has now gone ahead and pulled that together for me explaining what my latest meeting was.

Now, what I think is most interesting with memory is the fact that we can come down and drop memories in. So, I could say here, "Hey, Jack Roberts' favorite color is green and his favorite animal is the English Springer Spaniel." So, one of the ideas is you're in a meeting, you see an article you think is interesting. Now, you can just drop it in here and literally click save to memory. And effectively, this is now saved on your computer.

So, for example, I can come back over to chat and ask it. Let's open up a new chat and again, you see over here, guys, we've got full context. This is context for absolutely everything. Now, what's really cool is you can come down here and I can select what I want for an actual model itself, right? I can ask anything. I've got GPT-6 Astra. Again, I can chat with the Claude harness, Hermes harness, open router, local, wherever I really want to have those conversations.

Let's Let's actually ask Astra and I can say, "Hey there, what is Jack Roberts' favorite color and what is his favorite animal?" As you can see, now it's going to be Codex. It's searching all of the different systems. And just like that, guys, Jack Roberts' favorite color is green and his favorite animal is an English Springer Spaniel. So, I'm saying that's half Spanish, half none. Little bit of a typo there, but that's not exactly how this system works.

If I see any YouTube videos, guys, I can come down, I can drop it in here, I can upload files, I can do anything. And the exact same thing with photos. And I can chat with that anytime that I want. So, one of GPT Astra's best features is the fact that it did that. And GPT Astra built this entire thing. And you'll notice at the top, guys, it's not the Claude code operating system anymore. It's an Agentic operating system because it literally brings together your entire world.

The next thing is your dashboard. As you can see, it's connected all the different systems. These of course are demo numbers. It shows you at a glance all the metrics that matter. You will get a daily brief based on everything. Now, the daily brief is guided on your goals. You can prompt this again and you've got interesting things. You can even chat with this, understand what your priorities are because it has access to your calendar.

You've access and full overview of your finances, so where does your business sit, how you getting on month by month in terms of your systems, where you are income by month, what is that entire breakdown, all the financial intelligence has been completely built into the system. I can see my progress based on the goals here. And really importantly, I can come down and have a look at my audience to see how I'm growing with that.

Now, some of the features that I'm going to show you soon are even crazier, so you need to be aware of that. But let's say for example, we're in the calendar here. And I say, "Do you know what, dude? I really want to add a call in tomorrow." Well, what I could do, I can come down and ask a question if I like, but actually, maybe I just want to bring the voice up and ask it to do ourselves. >> Good evening. I'm here and ready to assist. >> Awesome.

Could you do me a favor? I'd like to book a call tomorrow do with myself. Call it Jack Brunch Lock-in. Do it from 11:00 till 12:00 uh in Budapest, please. >> I've added the event for tomorrow from 11:00 a.m. to 12:00 p.m. in Budapest time titled Jack Brunch Lock. >> Excellent. And you can see just like that, it's now added in and then it can do all these actions for you. Now, bear in mind, you don't have to do any annoying connections with this stuff because it's just using the existing stuff that's already connected in with Claude and ChatGPT.

But then we get to one of the coolest updates in here and this is a bit of a change that we've seen. Now, down in the bottom left, you can see I've got this design system. This now lets us connect to image and video generation using Higgs Field API, which is ridiculous. So, just explain what that is and why that is a really big deal. You might have seen it blowing up on the internet right now. So, I need to explain what's going on here.

We can build our own apps now and instead of having a subscription on Higgs Field, which a lot of people didn't really want anyway, we just connect by an API. Now, with that API, lets us create images, videos, essentially anything that we want to. And you get, I believe in your first week, the lowest prices available for all of this incredible stuff, right? So, for example, let's say that we're in our dashboard. And again, the whole point about dashboard, guys, it's the one-stop shop for everything.

All we're going to do is come down and select Higgsfield. Let's select the API right here, for example, and all we need to do is connect to Higgsfield. So, let's go ahead and click on this. But, we need to grab what API, guys? So, you come over to I'll put a link down below. Just literally click this link. This is going to open up so many possibilities for you in your own system. And what we're going to do is come down on the left-hand side to API keys.

And all we're going to do is drop in the API key here, and essentially you can build your own version of Higgsfield wherever you want. And once you've added that in, you can build anything. So, I got Higgsfield down here. Why don't I come down and say something like, "Hey, build for me a beautiful English spring of spinal. Uh let's have him drinking a protein shake in the gym." Cool. And all I'm going to do is come down and select the model.

So, we've got Sol 2. We've got these different models you can pick. It's completely up to you. It shows you all the pricing. I built this into the OS. Again, like ChatGPT Astra can do all of this freaking stuff. It's so cool, right? And then I'm going to come down here. Let's go 4 16 by 9. Let's do four images, and they'll tell me exactly how much I'm paying per image there. That's absolutely fine. Go ahead and generate that.

Now, I can do this with images. I can do this with video. Doesn't make a difference. But, this is where it gets even better. And what I love about Astra, now if I come over to library, for example, this is every image on my computer. Now, not every image on your own laptop or desk desktop has an app. So, for example, I come down here. I can search for something like burger. Now, what my system does, it has intelligently indexed every I call this magic search every photo on my entire computer.

So, let's say this image here doesn't have burger anywhere. It's just called a double cross. Well, I had an AI, and this is built into my OS, that scans these images and kind of writes down keywords of what it's describing. So, now I can get this. I can even use this as a reference, and all of a sudden it I can build it, right? And I can amend the burger and say, "Hey, make this burger even more, you know, double the size.

Double the size of this burger." Whatever I want to do, right? It's crazy. I can pick even 1080p actual, whatever I want to. And look at the price of this, guys. It's ridiculously cheap. Obviously depends on model. And then we've got our beautiful English Springer Spaniel in the gym drinking some all cool whey protein. That one's not quite an English Springer though. This one's a little bit more Springer-looking. But you get the idea.

It is really genuinely really sick. From this we can generate videos. We can do anything we want to. On top of that, we've got insights in terms of how much money we're spending on everything that we're using and just helps us crush it. Then if you want to, we've got the studio where we can build out different tools, carousels, edit footage, anything we like. Then what makes this even crazier that I can come to my inbox, I can check out my school or my school DMs, actually send DMs in here, and then pass it over.

I won't show you just cuz I don't want to breach any privacy with people. Same with Slack, Gmail, Outlook. I get my full overviews here as well. Then on top of that, guys, I can even come down to my website design system, which is crazy. And it do some in ridiculous stuff over here. And here for example, when you build with Astra, you can come down here and just enter in any localhost you want to. Open up and preview.

And that entire website will appear for you here. Now, what's really cool with this and let's get to light mode, guys, just to see what this looks like. And I might just go full screen on this for my website OS here. I can see what it looks like on tablet, on mobile, whatever I want to. Come down, scroll. And again, this website here was built with I just had Astra go ahead and build this, do this, do this, do that. Now as you can see, it's got my footer down at the bottom.

Now I can look at things like the design. I can look at the graphics. In fact, if I even come back and just exit this full screen for a second here. Come back to dark mode. And one of the things I want to show you here, guys, if I come over to copy, again, it runs it through Slop Monster. I can amend the graphics. It will generate that stuff for me. I can look at the design, even edit bits on the website. So where the pricing is at right now with the Hexfold API, it's definitely worth grabbing and having a play around with, especially if you're building websites or you want to build them a gigantic OS like this.

Now the other cool thing to bear in mind here, and this is where it gets really interesting. On the memory section, you see that I'm connected to everything. Now if you have different connections scattered across different systems, one of the things I personally love using, and that's using Zapier. Now, almost any app that you want to connect to, you can almost guarantee that Zapier will give you access. Cool, YouTube, Microsoft.

Now, what Zapier does here is functions as the connection layer. So, you could, if you wanted to, with your Agentyc operating system, guys, is just connect to Zapier, and Zapier will connect anything else that you want to. Now, what's really cool with our Agentyc OS, guys, is we can issue commands to Claude and Codex all inside our OS. Now, connecting to Zapier itself is unbelievably simple to do. You can come down, select the skills, everything you want to add in there, and you can connect it.

Unbelievably simple. You definitely want to have this in your stack. I'll put a link down below, so you can grab this. Funny story, actually, I actually built my first tech startup using Zapier. How cool is that? So, this is a really, really cool piece of software. I highly recommend that you check it out. And of course, you can use this to connect to anything else that you want to, as well. And so, I'll also put a link down below, guys, so you can come ahead and grab the full setup guide.

But if you just want to grab mine, for example, and download it just in one shot, to build this, get the full Agentyc memory systems, as well as learn exactly how to build uh beautiful AI systems with ChatGPT, with Claude. I'll put a link down below for the community. You can join, grab this, get it downloaded just right away. Go through the beautiful onboarding, and make some magic happen. And I'll be updating this constantly, so you'll always have the latest version.

You can improve this as you go. This is a really incredible piece of software. We can get AI news in here, guys. It's pretty outrageous. And you can honestly build essentially anything you want to now with ChatGPT Astra.