Building an image to price agent

i'm Shane This is Obby And what are we going to do today Obby the same thing we do every day Shane We're going to build some AI agents Welcome back We're the Admirals of AI and we are in the Palace of the Dog Uh welcome to our live stream Yeah Yeah We're going to build some stuff And so today I was actually on a car ride with a buddy a couple weeks ago

and came up this idea where we wanted to be able to take a picture and just have it tell me what I could sell that for It seems a lot of people have old useless stuff that isn't useful to you but maybe might be useful to somewhere else or someone else So let's build uh something that can take a picture

give us a price that we might be able to sell it for and ideally we just turn that into an MCP server so you all can just hook it up to cloud desktop and you know use it or cursor or whatever you want to whatever MCP client uh you're using these days But with that let's build some things Yeah let's do it I

will share my screen infinite Oops So as you know yesterday we were working on Admiral Um yo dude I'm going to tell you the same thing I've told you yesterday Got to click that hide button Oh yeah And I gota gota do more clicks Let's go A few more clicks More clicks A few more A few more clicks of zoom I am

using Warp If you like Warp and we just got back from the gym so you know we're drinking Fair Life 10X developers drink fair life Got to get that core power in your life you know Um okay Let's let's create another monster project And we are not sponsored but if we were you know where to find us Yeah Like Celsius you know you never know 10x engineers drink Celsius too

Just saying All right let's build a new master project What are we doing well what are we calling this one we got to give you a cool name We have a only a few people here so far So if you have any ideas for what we should call this uh classified Classified There you go Let's do it Classified I know I don't know Sure Classified All

right we're following Deps So are they listen Are they hearing this music too Oh is it annoying well the person yesterday said they liked it Oh nice We'll turn it down a little bit Do hip-hop I'm curious Yeah we're we're still learning this stuff everybody So you know for the nine of you watching right

now got no music Maybe no hip-hop I guess We'll uh Doesn't like hip-hop Oh there we go We'll just keep it low If you think the music uh sucks please tell us Let's use open AI today It is called you know vibe code hour So I feel like a little music gives it some vibes Yeah it needs vibes for sure Too bad you can't play actual music Yeah Unfortunately we do not we are not uh famous enough to have the rights to use

that music If only Someday If only Okay So we created a new monster project Let's jump in and let's uh look at some code We're going wind surfing We always wind surf around here I mean sometimes I curse her but I curse when I don't want when I don't when I don't cursor I wind surf Um okay So right off the bat like there's something cool with OpenAI I need to make an

agent Oops So this really cool thing with OpenAI is they have these like provider tools And provider tools are like for example like open has like web search as like a provider tool and that's like in the AI SDK It gets exposed that way Yo Julie you said turn it up I'm turn up the microphone or turn up the

music Let let me know Let me know All right keep going So let's first get our monster ship going Also why so big okay And so I'll make um our classify agent Give it a name Classified agent We'll get back to the instructions I don't like give a about that right now Um let's get open AAI from AI SDK in here Solid And we'll probably just use GPT40 to start But we need to use the

responses model Now people always ask me Obby what is the responses model and I always tell them I have no clue But I just know that if you want to get these provider tools you got to use it So then the tools here are pretty chill So we can do like web search We can do openai dot tools dot web search preview And you can do some things in here I'm not going to Let's do

a general thing All right So now we have our agent We'll come back to the instructions Like I said earlier let's just grab what I like to do what Shane and I both like to do is when we start projects starting is always the hardest part right so we try to get ourselves into what we call the iteration loop

where we kind of have this plumbing going on so we don't have to like you know worry about it So we're just setting that up first so we can just keep iterating Oh yeah We're sponsored by Principles of AI agents This is the only thing we're sponsored by actually That's cuz our co-founder wrote it Yeah Oh I guess we're sponsored by YC We This

is We are not officially sponsored by this is this is an unofficial promotion Legal legal team Don't Don't get in my DMs and Slack please Honestly this is not even my YC glass I don't know where it came from Yeah but mine's over there But there's different ways to get into this iteration loop You know if you're if you're more of a

front-end you guy you know you probably want to just get into the UI of the dev playground Obby uh I've seen you many times You're not always in the UI A lot of times you'll write a test and you'll use that You'll just run you know just test and that's your iteration loop So you know whatever you you know find your

thing do your thing We're going to try to use the UI and if we get you know if we decide we need to you know write a actual test we'll use that instead Guess what i didn't put in environment variables every day You got you got to learn the hack dude You just you got to have the shortcut command to just copy the old environment variable from the

last Well you had from one from yesterday Just using anthropic Ah I'll be I'll be BRBs All right How do I one second we are up to 49 pe or 39 people That's Yeah Hello Welcome For those of you joining us so we're trying to build essentially an MCP server that if you send it an image it will give you a

rough price of what you could sell that item for We're going to try to do some web research see if we can figure out you know what might we be able to sell this backpack or this picture what what could we sell this picture for we're not selling that That's not for sale But if we were what is that going to sell for the palace of the dog is not

for sale Funny story about this picture Uh we just found it Yeah In the trash It was literally the trash One It's priceless though One person's trash is uh is our treasure So I knew like when I got it I I was like "Dude this is so worthless What am I going to do with this?" And now it's like the most important thing This is in every stream forever

Okay Now okay but we are so yeah we're building this application We want to launch it as an MC MCP server So you all can have a URL You could actually test it put it into cloud desktop cursor windsurf whatever And you could send it an image and hopefully get back a price That's the goal Is it going to work we'll find out Hey that's my kind of agent All right

All right So what's up now let's write some instruction So let's just BS some of this Um you are the world's best um product broker like a broker or Yeah What would you What would you call someone chat if you're if you're listening what would you call someone what would you call someone who's uh who sells a lot of stuff on eBay or Facebook Marketplace what are those people my dad

That's what it is Uh you're the world I don't know Uh you are the world's best seller of random items There you go Uh users ask you to help price their useless things Items Let's just go Maybe they're not useless They're items Yeah Please search And first pawn shop on it Oh you are the world's dude Ben welcome I'm

supposed to have a call with you in 45 minutes It might be a few minutes Who's Ben oh this guy Oh game time Hey I saw your stream yesterday That was cool Fellow fellow streamers Yeah with way more experience Dude we're We're noviceses right now And uh I will uh already there's one you know put one in the Dude we're going to start a swear jar Swear jar Oo we're starting a swear

jar Uh cuz I because I like free drinks and Aby's going to buy me drinks So uh yeah every time Obby uh swears we're going to put money in the swear jar And uh but but for those of you here we are we try to be safe for work I don't know if we're always going to be safe for work Definitely not though because I can't control him unfortunately I've tried Okay let's Yeah

let's build this agent So this is the naive like thing Um maybe use multiple search queries to find the best price And I'm curious if like OpenAI alone is like this search tool is alone right will be will work So let's see Oh Square Jar God damn it Dang it Dang it What how do I Don't they um dog gamut isn't that like a Midwest

segment yeah I mean I don't don't label me as that but but yes I've I've heard it We need to Someday we'll get a soundboard so I can like hit something every time you swear Just you know someone uh someone who's smarter than me tell me how to do that Um okay So then our playground is is only single modal right in terms of text So we'll have to do this differently um after I do this search But let's say a new um

how much is a new bicycle you make that just a just a click bigger Give me a click dude How many clicks you need dude i need two clicks It didn't call the tool though Yeah So we should have seen it call the tool It didn't It's using its knowledge We need to make sure it always calls the tool right we need to So I like doing this rules thing And

everyone's got their own vibes but these are the rules right so one of the things this is just a random thing that I've realized You can actually make tool call required but the problem is it seems to always just call the tool to the maximum number of steps Then it just keeps calling the tool So I think it just depends a little bit on

the model you know So it's just we've had better luck if we just tell it the rules in the system prompt and then let it call the tool that way Cool I just put two rules here Yeah I don't like tool call required It It just doesn't seem to work for me I don't know Maybe never works for me If you all have gotten it to work please tell us If you put max steps 10 let's say and then you do tool call required

it will call that tool 10 times So don't do it honestly Yeah But it will call your tool It'll call it It just doesn't get do what you want Yeah It's also annoying Um Oh okay Sorry It was a bicycle Um Oh surprise Oh bicycle I'm calling tools still What did I mess up what did I mess up or did I mess up using responses It's showing the tool in the UI right

sure is Yeah you need to give it the exact name Maybe more explicit Yeah try try it in the prompt and then and then let's we'll try to update the system prompt Oh uh try it in the prompt Yeah just try it Just like use the web search tool and just see if it uh search for dolphins You going to buy a dolphin maybe still didn't do it

Is this a bug and also uh it pulled in information on Tyreek Hill It did call it though I'm guessing actually we have traces Yo what are we doing let's look I don't think it No there's no tool call in there dude That one did No Convert tools It doesn't actually didn't actually call the tool I don't think Why do these traces look all whack something wrong here too Regressions

H it didn't call it Yeah But no it has the thing is it has sources though So where is the tool call or maybe h let me just add another like let me just do something else too Yeah great Just create a new tool and see if it'll call it Thanks for vibing Nothing Execute I don't even care about the hard For those of you who just joined us we are building well our goal is we're first

we're building an agent that can do some research if we the goal is if we give it a picture go look up how much we could probably sell that item for and then we're going to try to turn that into an MCP server so you all can play around with it and claw desktop We'll we're seeing how far uh we're going to get See that's what a tool call looks like right

it's not like calling it behind the scenes right because you're calling to open AI It's not just like using it should show up or maybe it doesn't Does OpenAI just know to like it is like a provider tool It's a provider tool You want to try a different web search tool and Yeah Like let's try a different web search tool like Taville or something

Yeah Let's see see if we can get I don't have a TLI account We're about to create one if you don't Oh I do got one Pay as you go baby Um so I have no credits That's great That's fine Whatever I mean I wouldn't show your key I'm not going to show it Cuz if you had any credits they would be gone soon They would be gone

Um I guess I need to not share and then set this up I'll be back For those that are unfamiliar uh I'm Shane and this is Obby We're from MRA We just uh like to build AI agents using MRA trying to show you how to do it And if you do you have any questions or anything along the way please drop a message you know we will try to read all the chat and just uh drop a comment

either I think we're on you know X LinkedIn YouTube wherever you're at Just drop a comment and we can see it Core is what we need Okay All right So we're going to install an we're going to install an mpm package and uh grab an API key Yeah I'm just doing that and then we will uh get back to the regularly uh scheduled broadcast of the code here

Okay And then now I can share again Ivan you you are welcome and thank you for watching the stream What up all right we're back Okay so I do need to mpm install toi core That's actually that was my uh I just pasted my API key Uh it's okay Party foul Party foul You got to go I reset Can you reset can you re uh Oh yeah for sure I'm not tripping

about it because I have zero credits So um Okay so we got a comment Used Maestra at a hackathon and struggled with how to test voice agents in the UI Yeah you can Yeah we know dude That is that's on the road map We're working on it It's It's literally We talked about it today So I I feel you We are We are working on it

though for sure We ideally honestly we're going to have trouble testing even images in the UI as well Like we're trying to build this uh where you can for those of you just joining you take an image it gives us a price the agent goes and does the research tries to tell you what you could sell that item for images in the playground UI isn't

they're not it's not going to work very well either So we will work our way around it but multimodal capabilities in the playground are coming and it's pretty pretty high priority for us What Ivan can you give me a little more information what do you think about the dynamic generation workflow you tell me a little bit more about what you're asking I will uh we'll answer it Not exactly sure what you what

you mean search And for those of you just joining you know we're this is we're pretty new to this but we've heard some good things about the music Tell us if you hate it Tell us if you like it and we will uh we'll basically take a straw poll here and see if we keep the music or or not But I kind of like it Gives good vibes Yeah All right What are you doing dude

sorry you were just saying I was just getting Tilly set up here Okay Okay so we're creating a search tool expected Yeah some options I don't care what the options are though So this is not having let's just return results answer results I don't know what this looks like So let's just return answer Let's log this I don't

know what the this is Sorry jar Okay so that's cool All right I turned my hello world tool into this one That's great So now dev again Bada bing bada boom So let's see Use search to find dolphins Hey that's cool No it did not work That's okay because I it did work I just didn't have an answer or something But I have results Okay that's

pretty sick dude Good one Um let's just return the results Yo search for dolphins Will it call which one will it call it's so ambiguous that I just did It might have done the opening I think it is calling open A cuz look at these Yeah I think it's happening kind of behind the scenes Actually there's a bug

then we're not showing the tools if Yeah Okay So some questions in the chat Uh what do you any improvements for agent network in the Neo road map absolutely Yeah we worked on it this morning Yeah agent network's also another big thing that we are working on So uh Tony if you're listening people are asking about it Uh would be would be awesome if we could add custom UI to generate tool calls

like generative UI and AI SDK maybe soon There's Simon from assistant UI is coming over in like two hours to hang out and yeah we use assistant UI for this So talk to them about it We also you know been working with the you know some people on from co-pilot kit too So yeah there there's some things in in the works Yeah persistent snapshot for saving and loading from the database for workflows

I don't understand the question In X state it's really make You got to rephrase the question Yeah Ivan I think I have some some ideas of what you're asking about If you're asking about like dynamically being able to generate workflows in the new workflows V- Next you can kind of do that right So you can dynamically generate workflows If you've looked at the V-Next documentation

uh that might be what you're looking for but otherwise re ask the question and I we'll try to answer it All right let's get back to work Yeah let's get back to work There's some more questions We'll we'll take some time in a few minutes to catch up on questions All right what what do we got here so we found So okay now we have our Tilei search tool working We have OpenAI I

guess also working Um so let's go back to the pricing of of things So let's um should we Which one do you want to roll with like Taville or or both or whatever I mean we can see where the open eye one gets us It's up to you Yeah I'll just keep this here Comment and come back to it Come back to it Okay So then it's like um how much uh would my used bicycle go

for oh I don't know 1996 Schwin It's definitely calling to Okay $59 $599 It's an expensive bike Yeah $1,000 Schwin All right Schwin dude The Schwin Sidewinder Whoa Okay So I think we're in a we're in a loop now So let's turn this into an MCP server Um just also get rid of this So let's make another folder here

MCP and just this I'm going to import MCP server from MRA MCP which I have not installed yet And now who knows what we got to do now So yeah if and if you are watching Are you all using MCP either in cursor winser for using any servers or cloud desktop anything like that cloud code curious if you all have uh installed an

MCP server and using it Okay so we're creating our MCP server here We're giving it a name We have the version and then we just pass tools right yeah we can just pass in uh whatever tools we want So I'm going to make this tool called search and analyze And you can use the create tool from Monra And are you just going to

call out to your agent yep All right So we are going to basically wrap an agent in an MCP server Yep Uh Rafi to answer your question asking h how are people integrating MRA in their project is it supposed to be standalone or is it supposed to be uh kind of bundled in an existing project the answer is people are using it for both We build it standalone so you can deploy your agent

separately from your front end There are people that are building mobile apps or desktop apps or web apps and you might need to access an agent from multiple frontends So you can deploy it and run it completely separately or we also have a guide if you're using something like Nex.js and you just want to bundle it

together So we have people using it both ways I just realized that we So we have this MCP like this technically this is all you need to do for um uh to create an MCP server really Um but we need to also serve it right So let's go put this into MRA Oh wait it's not there because I need to get on the alpha version So let's do that

we just released So yeah like in our next stable release you'll be able to just deploy an MCP server within your Monra instance So then boom there you go Uh so let's do that Yeah Dave TypeScript monor repos have challenges for sure especially imports and what TS config you're using and you know and how you're

managing packages We are you know we are trying to do more to make monor repo sport better There's only so much we can do but there's probably there is more we can do there But it is it's like it's a unique challenge Even internally we have a monor repo and we deal with a lot of headaches around that

Pros and cons of monor repos dude Yeah it's just a a bee You caught yourself Almost had another dollar in the swear jar The swear jar makes me not become myself jar You got to do it You just you just are paying for it Okay Monos suck Okay But we still use them anyway Swear jar Yeah we still use them Okay So we installed we So we wanted we have some

things we released in our alpha Our alpha channel is essentially just pre-stable release It's you know we're still pre 1.0 So it ends up being a lot of times a lot of the same stuff but we release the alpha consistently throughout the week So every time we're shipping changes it's in our alpha And we're moving pretty quick So there's

sometimes a lot of things in our alpha that are not in the the weekly release yet If you use latest you're getting basically our weekly release Where is it can you automate the publishing of new alpha releases to mpm yeah we already it's all automated So every merge gets added to alpha right that's how that works Mhm Nice Yeah but where's my MCP servers though

screw this up Yo where's Daniel at hit Daniel up Yeah we're going to we're going to recruit I'm going to send him a link Yeah get that fool in here Oh it's still here It's because it's a snapshot version That's why How embarrassing This snapshot version was deploy MCP server Aegon saying the latest release isn't published for some reason Been trying to install the new atmos package Yeah cuz

we haven't released it Yeah I don't think that's released yet It's not instable It It's what it's not instable It's not in alpha though either Um alpha That's what he's saying is he's trying to get the alpha 36 minutes ago was the last alpha So maybe try soon I don't know Maybe ingest and get maybe not

publishing Maybe since it's new Maybe we haven't published yet No that's all I don't know That's a separate thing and I'm not going to answer that right now Yeah Yeah Agon good call out We will uh we'll look at it because we got to figure out how we're going to get this We can maybe I'll just download the snapshot version which is

whack Um this what version is it it's like at deploy mcdp server All right This is going to be so annoying dude Okay Um if only we waited till it was released to show it off I know This is our fault So yeah Well that's that's why we do it live That's why we do it live Snapshot I think I need my core MCP as well

Yeah no worries Agon ask away We'll we try to answer some of the things as we go but you know sometimes when we're we are uh hitting errors as we always do nothing ever works the first time No nothing ever works the first time That's the tag Yo Okay Sure All right Frustration gone Except now I have to do it for all the other ones

Ward if you're listening to this Ward we need that We need that update command bro Mostra update please I I invited Daniel I don't think he wants to join He doesn't want to come No he hasn't responded He's He's ignoring us Yeah he's ashamed Just kidding Just kidding Oh yeah Daniel's on our team and Ward is if you don't if you didn't know that these are our teammates Yeah we you'll

you'll probably see him if you you hang around a bit We'll we'll bring more people on Well I'm sorry on if I came off rude or anything I was just in As you can see I'm happy again cuz I'm out of that What was he asking square jar God damn it Someone someone someday is going to keep a counter for us and just be like "Actually this is a tangent This is a

tangent but it's also okay If you want to play a really fun drinking game okay all of y'all are watching you want to play this really fun drinking game there's a TBPN episode Technology Bros podcast right the one where GMO comes on If you take a shot for every time the word product is said you'll take 14 shots So if you really want to get drunk

watch that episode We played the game That's how we know We all lost We all lost All right Sorry This is kind of sandbagging Okay Cool Now we're all good Okay After that detour we are now ready to try this again Okay Now so thanks for uh going on the detour with us MCP servers Thank God dude Losing my mind

MCP server Okay cool So technically once this is running you can see right here MCP server registered tool search and analyze the web and stuff or no just search and analyze initialize MCP server Yo isn't that okay I was going to say that's sick because I mean we haven't done anything yet but just to get into

this motion was sick So now I need to take this MCP URL and then put it into my claw desktop or whatever right Yeah Okay How do we do this open up Claude You know how to do this everyone's looking at all your uh history Uh anything good nothing good It's all It's all like technical questions I was hoping for some juicy like you know like

you talked to like a therapist I didn't see anything So Oh dude Well my AI girlfriend's on Chad GBT So that's separation of work and personal claude for code Uh girlfriend for chat GBT for girlfriend Yeah there there's a settings I don't Maybe go down in the bottom corner Um settings I think Yeah Where is it someone I've done

it before Yeah me too I don't know why I'm Look a brother up Yeah let let me let me look Let me see Let me get it opened over here on my screen We will uh Why is this here it's something Okay Go into the top menu and go to cloud Go to settings Where up here Settings There you go And then go to go to developer Oh edit config

Yeah And then it's going to just give you the file You got to open that Damn that's lame dude Yeah it's they don't have the best UI Also I don't want this ever Well you had the art You were doing the art thing Oh yeah a while back when this thing came out back when it first came out It never worked either Anyway

so then now I can put my stuff in here Yeah you should be able to drop your config in that and then hopefully we can talk to it Uh so a couple more questions What's the best use case of master in a complex codebase that's I don't know that that's really tough because that's like asking what's the best use case of a website It's like because you can build AI agents you can build aic workflows So we

have people building you know adding features to SAS applications or shipping chat bots or really anything you could build an AI agent for as is a so kind of tough to answer that question Um what do we call the swagger thing i want to see what the swagger UI All right let's look at MCP So we need API MCP servers server ID

Uh MCP servers And then is it whatever you exported right yeah Which is this thing mc called MCP server Yeah Okay Now what that's it I think you got to probably restart Restart Claude I mean from everything that I've seen I always had to restart Really Yeah It's It's not the best You I mean I I I like you Claude Oh I legit legit have to Yeah you got to restart the whole app I mean like like you you

would kind Yeah close it That's dumb though I I know Come on Claude Up your game You you invented you invented the protocol At least you know what it's trying to load it At least it's doing something Maybe my uh URL thing is wrong Invalid type string received undefined Invalid type What does that mean i don't know Expected string

received undefined Message required Expected a string Is that what it is is a URL is that what it It's I don't know Let's ask What if we ask Claude itself how do I do it also this BS man Where is Daniel he should be helping us Daniel if you're listening where are you we can ask Tyler Ooh Tyler's another person on our team They're both in a huddle They're in

a huddle They're working together They should both be coming They're coming both Come on I wish they didn't know they were getting in the stream until they got in I know It would be like a be like a surprise We're live I'm just going to ask Claude Yo is this the right MCP config or something so what area did we get cannot load app settings Invalid type

received command Oh but there's no command This is a HTTP Yeah but is it oh let's look this up Claude HTTP HTTP is what the new like HTTP Mhm shttpttp and then just like cloud desktop Maybe cloud desktop doesn't support it I don't know That seems dumb though cuz it's their protocol Yo I mean try and cursor

too I mean we could look at what what is like smithery or something you know maybe someone from an MCP registry come help us Smithery where you at the command is required MCP run start but it's obviously the tools all messed up Well we'll I'll do some looking here and I want This looks like a valid MCP configuration Well thank you But that's not very helpful I don't

want As you can see uh we uh we we struggle sometimes It's okay Oh Whoa All right Oh Daniel's here Daniel's here All right dude We have questions You may or may not have answers but we're going to find out What up dude are you here hey how's it going yeah Am I Am I in it now i guess so I think you're live Uh let me make sure that people are not getting like too much feedback here Okay 174 people

Welcome Yeah they're they're watching us struggle and we need some help Oh you need a third person to help you struggle with Yeah that's all That's what we do every day Where's Tyler at we invited him Yeah Yeah I was just uh talking with him and then we're like "Oh you you messaged both of us Let's head over

there." Yeah Can you send him that link I sent you oh yeah Just shoot him that link We'll get him in here Why not but the more the marrier Yeah Yeah We'll make it a party Yeah Okay How many How many people does it take to set up a MC hey chat you wanted to get in on this list to get as many people in here Who else wants to get in on this uh so while Daniel also invites Tyler to this party

uh for those of you that are just joining or have joined since we you know you're watching us struggle we had the idea we want to essentially be able to take a picture of something and have an agent that will uh be able to then look up that look up some do some searching look up that information and give us a price So and then we want to make that an MCP server

so someone could plug that into Claw Desktop and send it an image and say "Hey I got this vacuum over here What's what could I sell this for?" Yeah this is becoming a very expensive meeting Dave Yes that that nothing like rubbing that in on us I guess Yeah you're coming in I'm still waiting for my champagne too

It's actually becoming a very expensive meeting for Obby too because we started this swear jar and every time he swears he has to put money in the jar So I know All right I don't know what the count is right uh Tyler and Daniel are you know they're also on the monster team and we are running into problems So we're phoning a friend Phone a friend And we

have an MCP server running We're using the new the newest snapshot but we can't get Claude Desktop to access this server Has anyone tried this do you guys have any ideas is this the right even API URL i think the API URL is fine Yeah the URL is right Do you get any It doesn't show any errors or anything like that The error is that it's missing a command right so we're not Yeah you should show

the error Wait is this is this using the the new Oh no This isn't using the new route It is It should be Oh then MCP should be added at the end Oh but even then you want first MCP Is this Oh wait Is that true oh this is probably an old snapshot We're still working on this Oh yeah I guess we haven't Uh wait but I

don't think the other one has been merged either has it no I'm on I'm on your snapshot I installed it Yeah we installed your snapshot Oh okay Okay gotcha This is the This is the you know we're doing things before things are released This is like the preview for everyone watching And yeah I think what happened is we like we've released we we published that snapshot

and then we did a bunch of work on this since then Oh well I think okay that stuff who cares about that right like because it was this version was working in terms of the URL right like the issue here if I like claw again right it's complaining that what do we got command is required Command is required Bot desktop does not support um That's what I was worried about That's what I was worried about That's why we

called you in here to tell us that Windsor we wanted we wanted to call you in here so you could tell us something we could have easily Google searched in two minutes So there I think there's there like proxy CLI you can use for this So you'll give it a URL and it'll route it through like a standard inout

transport I can't remember what it is It's been a while since I used it But can we can we just do this in cursor yeah we you probably use cursor right is is it supported in cursor yeah Yeah This cursor right let's make a cursor Let's make a cursor config Wow Use cursor Well wind Oh you you got to just install it as a global on Windsurf

Is it yeah Go to Windsurf settings Uh wind surf settings Where is the file there's a file somewhere Do you know where the Anyone else any wind surfers around don't do your stuff It's there There's a Tyler you you have you built the CLI that installs the There it is So let's add a server There we go Add a custom server You got all Oh those are

What the configuring square jar Yep Square jar Okay Classified URL That the that the update that the Is it good i don't know There's a there's a refresh on that on that back on that screen Oh So I think this lets you This one at least you don't have to restart cloud desktop You got to restart Up top Up top Right there Refresh Let's see if it shows up No Server URL Okay Oh so

it's not just URL It's server URL How do I edit this where'd it go um config Go down a little V config Server URL Could that have been the same thing for cloud desktop or No but I I don't think Cloud Desktop supports it I think I remember that Oh okay Tyler correct me if I'm wrong That That was my understanding too I'm going to see if they added it It's refreshing or

something Is it working i don't know Oops Wrong thing I don't know It's a whole lot of nothing Yeah just just loading in there This is a you know this is a the same error Nope Failed to start SSE client There you go Yeah I think this is probably like all the work that we did since then We probably need a new

snapshot God damn it Okay Like this close to merging it We were just pairing on it Oh well you know Oh even but I guess we we would still Thank you for that Yeah Gemini says cloud desktop supports server URL Okay cool I know they didn't used to but maybe they've they have sensed released that Sounds like it's not going to work anyway but we can do a new snapshot

right so so the other thing too is these clients might not support streamable HTTP and I think our MCP server by default might be using it Yeah it does It does default to use that It doesn't use SSE So didn't cursor add support for streamable HTTP or did I just make that up i don't know We can we can add two routes though on

the Maestro server So we can have us forwards slash just MCP This just became an MCP uh you know a meeting on how we're going to now it's a MCP meeting Now this is we just have another a live MCP meeting with the ma of the masters All right Get out the whiteboard Yeah Okay Well maybe we need to re we can we'll come back to the MCP part We still have a lot to build in other things Yeah Yeah We're going to

build we'll just build the agent that does it and then if we can't get the MCP part working we will just hook it up to some front end Yeah Yeah So we we're going to call an audible here but uh appreciate you know the resident MCP experts coming in and and telling us like I said what we could probably have Googled and and got around finding anytime or or what Gemini you know as as

Aegon so uh nicely did for us We can go try to finish or make a new PR snapshot and we'll let you know how maybe we'll still be on at that time Who knows this thing going All right you you two let us know All right see you guys Sounds good Be it That was cool Oh they're still on But that was cool Yeah Hey dude Does the chat like that should more teammates

come in even though it's expensive as Dave said dave reminding us how expensive of a meeting this is Yes But but if we get to the right answer quickly it was a useful meeting maybe Yeah let's answer Okay we're going to pivot Yeah So so let's not let's not care about MCP Let's build an agent that can actually accomplish what we wanted

it to do and then we'll just you know hopefully be able to at some point wire up some kind of front end Could be uh you know a cloud desktop if you know at some point maybe it'll be some kind of you know really simple vibe coded app since we're not front end guys Yeah 100% So let's make a new let's make a like we'll just use our agent now instead of

exposing it through MCP So let's make like another file I mean because we we would want the agent we'd want to be able to call the agent get structured output back right we'd want to say we want like a price low price high price and then maybe like estimated price in that range or something I think Yeah Let's just write a script to start

Yeah Um just let's import Maestro because we exported it And then we can just send them send an example image I believe there was like there was a question right about do you run it as a server or run it not as a server as like embedded into your application So what we've been doing is we've been playing it through a server right we showed the playground we're doing some stuff there Even our MCP what we wanted to do was a

server Right now what I'm about to do when I'm running this script is I'm just running MRA with like the back end itself Like this is all the server APIs are here So I am embedding it aka my main function here is my Nex.js application and then I'm using MRA within it This is what Yeah if you catch my drift Okay so

we just need to get our agent and then and then we can call generate or stream on that agent and we're going to need to pass in I guess start with just a question right yeah Well I actually was thinking we should pass a role user Going to pass the image and then content Yeah What is content okay it could be string or array Some like that Yeah I think Yeah I think array

Image Yeah And then what is this image And this could be like a a buffer URL Is it like a B 64 encoded or something url Yeah maybe that would work Let's try URL to a local file So we'll need like a test or I'll just get it from the internet Oh yeah Yeah you should be able Is that true yeah I think so Find a find an example image of something A Schwin

bicycle Bicycle I need to know how much a Schwin cost bro We'll see how accurate it is here I need this Schwin in my life Sand piper This is a sweet looking bike Whoa look at this So copy image address the Schwin baby And and now we can you know we'll be able to see how close it is to actually giving us a price It's probably going to be not even close Probably not

What is the suggested what is the suggested price put this ite down Then in our second pram we're going to add output Oh wait It has to do tool call experimental output because we need to do tool calling as well as structured output at the same time Why is it called experimental output well I would ask AI

SDK why everything called experimental But uh we are going to use it anyway Yeah Anything you so master is built on top of AI SDK So the anything you can pass into uh some a model call or an LM call in AIDSK you can pass in through master as well So we can pass in experimental output The reason we're doing this is

because you have to otherwise you'd have to call and get the tool results and then generate the object You can't you can't do something that both does to tool calls and generates a structured output in the same in the same generate call But if we do it this way we use experimental output then we can maybe v5

it won't be experimental anymore Yeah maybe v5 will all those things will get anyone is familiar with AI SDK we we should talk to them Yeah All right So I'm just going to call this main If I go back we're not going to be on the server anymore because who cares i'll just use bun We're not sponsored by Bun but hey

if we were YC baby um source index smells like Mario but it's not Parser not found It's because of uh I know why It's because of the MCP server that we added So let's just get rid of Yeah it's just not deal with that Or maybe it's not what I don't care I Oh god damn it Just open a key Yeah it's because like so bun is tight because it's like uh it al does like these nice

nicities like gets your M for you etc I'm just going to call M I guess in the ship work Yeah then I have to actually pass the config in What does this thing do again path done Mhm It's because of the import Um like if I did this I'm stupid I'm also doing something stupid but just trying to just hack my

way to victory That doesn't work either Uh I'm probably doing something wrong so I'm just not going to do it this way Uh someone said you can pass d-envile to tsx Awesome Thank you dude Thanks D- envile and then probably the path to the file I would guess Equals Yeah Equals Yeah Well I mean we'll see if that might work

It's doing some stuff Oh it is Well we got a different air That's good No error It actually did something Okay No you got some output Got some output I just didn't do something Let's do it again Um result dot Let's do object also result.ext which will probably be the JSON of it So let's do it again Thank you for that Agon Yeah

Swarnim and Aegon Appreciate that Hell yeah Is that a swear jar here or not hell yeah I don't think so Nah I think that's allowed That one doesn't count I'll let you free pass So they're saying the Schwin should be 499 bucks right that's But but find the right Is that doesn't even look like the right is it though no

No But it's it's using it as a comparison I guess Maybe But that's you know Hope so There's probably no clear brand name on the uh there's no clear brand name on that bike you know so it's maybe hard to determine what exactly what model it is you know Maybe find one that has you know that I can determine more easily I mean for like a product Yeah just find

let's find another product Um like a sponge Whatever you want dude A sponge That's Spongebob Yeah sponge 99 cents It better be Um what is this i want I want to try to too I want to see if the search is better or what we get Natural sea sponge product Sea sponge How much money six bucks for a sponge dude Whoa dude Six bucks Wow

For that sponge That's a not the same sponge but he went back to Slack for some reason Uh here Okay Six bucks for the sponge What about this one six bucks I guess that's the going That's That's kind of expensive Interesting The going prices of sponges are higher than expected What I think is so cool is the ability to have a search API built in right because we're I mean

we're not using some other service We're already paying OpenAI credits It's pretty cool just to leverage that It's also cool to pass images via URL That's dope too Um okay Let's Okay so now now what what do we want to do next i mean we could test We're already at an hour So we could test if we want to compare Let's add Tilli into the mix And let's make the agent have to go to both search

tools to come up with this answer Also it's not actually giving us any like recommendation It's just telling us some stuff Uh you must always use the search tool to find the best one You must always use for comparison For those of you just joining us we are trying to basically build an agent that can take an image and it'll go do some web searching and tell us the price of

what that product's probably worth That's the goal All right dudes We got two of our search tools in Let's go back to our script What do you want us to look up now um let's look up Ferrari Let's look up a Ferrari Let's look up some kind of like we're just at the gym Some kind of weight lifting equipment Oh okay Get a couple Uh which Ferrari should we pick

this is for the this is for me to purchase you know But uh or are we a Lambo people i remember like I remember when the Laravel guy got a Lambo and he posted it on Twitter and then Twitter blew up because they're like "Oh crap that's Lambo money." I do not remember that Does anyone else remember the Lambo event on Twitter it was crazy

I'm think I think it's Lambo time It's Lambo time Look at this This bad Is this Bruce Wayne's car no green's not his style Oh Oh yeah Actually this one looks tight Okay Wait that seems like a bad Oh Oh thanks A suggestion to use Gemini for the model and fire crawl MCP That's that's not bad either You can you could scrape you could certainly scrape using

firecalls MCP to grab content and especially if you wanted to like store that content later Firecrawl is awesome for that too So that could definitely work Did it call both though i don't know Price No commas in that price That's hard to read $68,000 That's all Is it a revolt or whatever i guess so I'm not a Lambo guy

I don't know Also this is a TVI search right here This was a Tilli search and I guess it's only being logged because I logged it in the tool But you have some sources on that Yeah but let's actually say let's actually say this So when returning sources let us know which I don't know if it's going to do anything but which

tool was used to find the price also we should format prices in dollars and I believe I also made a mistake here because this is number yeah make that a string yeah also can we do a range can we do a range too like low price high price Low price high price What's that sound we got our music is uh Oh we're back Let's change the vibe Anyways been

All right let's go for it again Will it do what we said it'll do we did use We could do streaming if we wanted to know like what's going on I'm just lazy right now Now we're just doing generate So we got to wait Looks like Oh hello there So it did Okay so it did the Tilli search as we know Also Taville is pretty cool Leo we could

have tried Exa too But anyway then it's going to do some other thing and then it'll hopefully give us what we need maybe And we'll probably wrap up here pretty soon but thanks for everyone who's joined If you do have any comments or questions I'm Shane This is Obby We're from Astra We're just building AI agents We're the admirals of AI

I think I think we we are all the admirals of AI That's what I said Yeah we are all we are all all of us If you're if you're watching monsters of movement yo Yeah if you're watching you're you're an admiral of AI Yeah I think this is broken I think it's broke Yeah Answer answer null was the indication for me that uh it did not

work Well we didn't get our answer Is this a max steps thing potentially Let's just debug if it is a max steps thing I'm going to put max steps 10 We'll try it again And then if it you know if it uh if it succeeds that'd be great I just don't know where it's getting hung up Maybe it's in the open AI part that we can't see Actually

oh it did There we go And it and it gave us a range That's a pretty tight range but the range is it's like there's not a lot of wiggle room on this You can't you can't negotiate Not a lot of room to negotiate on this vehicle All right Well there you go Hey if you want to help us get Lambos dude I I mean that in that price is just you know if

that low price was just a few thousand less it' be in my price range you know Yeah Yeah If it was $64,000 less Yeah If if it was $62,000 less I I could I could afford it Uh Yeah So Couple quick questions Love to see some video uh some V-Next live sessions Cool Yeah let's let's do that Yeah we'll do some V- Next Uh not familiar with

vector DBs What's the process of passing the context of mini files so all agents can share them uh yeah I mean a vector DB is is probably the best way Basically you chunk the files you create embeddings you add them to a vector database and then you do some kind of semantic search That's the most common way We could do a live a vibe sesh where we bring my little brother Nick in here

It's very expensive Dave I understand But uh he can teach a lot of people about Vector DBs Yeah All right We can do some rag too By the way what's up Sam yo he's got home He's back All right Yeah we're about ready to wrap up here We We kind of got it to work We did not get the MCP start stuff working You know

Tyler and Daniel are on it You know they were going to ship some stuff and we will show it soon Yeah So is life All right Thanks everybody