Figure's Robotics Breakthrough for Humanoids

0:00I just finished recording this full podcast episode and realized that my microphone was not turned on. So I get to record it again and maybe I'll be more practiced or I'll add a little bit of extra insights in this. Hopefully it's even better. If I talk really fast, I've already said this all once. So that's probably why today on the podcast, I want to talk about the one of the biggest unlocks in humanoid robotics that we've seen to date, a massive technological breakthrough. So honestly, something that I'm very excited about and this is all coming from figure one of the biggest humanoid robot companies that's competing against Tesla's humanoid robot. There's a handful of others, but figures one of the big leading ones right now. They've created basically a massive breakthrough that allows their robots to do generalist work. Basically, you take it and put it in a new environment and it's able to adapt now. So I want to break down how they're able to accomplish this. They built some really incredible solutions to problems that no one else, I guess maybe other people had these problems. But before we get into all of that, I wanted to mention that if you haven't already,

1:02I would love for you to go check out aibox.ai, which is my very own startup where you can get access to over 90 different AI models and you can work with them all in the same chat thread. If you're sick of paying subscriptions, $20 a month to 10 different platforms for audio, image, video, generation, you can get all of the best models from Google, OpenAI, and Therophic all in one place. And if you're using something like Claude for working something like Claude Co-Work, you can actually get it to generate images right inside of Claude or video or audio with the aibox connector. So it starts at $8.99 a month. We have higher tiers if you have really big projects, but I hope this is something that saves you a ton of time. I recently had a project where I got it to generate 1,300 images right inside of Claude. It was able to do the whole project for me. I didn't have to mess around with it because it was using the aibox connector. And when it did that, I saw a massive spike in traffic to my website from that product and from that project that worked on. So if you want to give it a try, there's a link in the description to aibox.ai. All right, let's talk about what's going

2:02on with figure. So yesterday, there's CEO put out a tweet where he said, hey, we have a massive basically unlock that we're going to be sharing soon. I was on pins and needles and today we got the drop about an hour ago. And by the way, if you're watching this on or if you're listening on Apple podcasts, you can watch this on video. We have video on Apple podcasts and I'll be sharing some clips from their actual robot, what it's actually doing, etc. But for everyone else, I'll explain. So they released a new thing called helix 2.5. This is their new AI model that is an a new update to their robots that let it do general purpose cleaning, meaning in the past, the biggest problem that they had was that they could get the robot to clean a house in a familiar environment that had been trained on right and seen training data of this particular house. And with particular objects that had already been trained on. So if you threw a bunch of objects on the floor and the training data had those objects in it, it could it knew how to pick up those objects off the floor. But if you had new objects, if you had new environments that it was unfamiliar with, it was unable to do

3:02this. So there's kind of this generalized issue where you could get it trained on specific environments, but it didn't go to all environments. They came up with a really creative solution, which I will explain in a second, but first I want to tell you the results of the solution. The results of the solution were that they were able to take this and they they did a big update to and to test this out, they rented 30 different Airbnb's across the Bay Area. So all homes that this robot that the figure robot had never seen before, had never been trained on before, and they threw new objects in the home. So they would throw toys all over the floor. They would go mess up the beds beds, had never seen, they would go put piles of like laundry down. It was able to go clean the house, pick up all the toys, make all the beds, fold all the laundry in completely different environments, where it had never seen these different objects before. So this is the generalized cleaning they were able to do this on 30 different homes to validate that this model actually works. How are they able to get this result? This is what I was really excited about. So the way that these models get their training data typically and traditionally has been specifically for these robots. There's a

4:05couple different ways. One of them is through motion capture. So essentially that's a person wearing a special kind of suit. You use the same technology for a lot of animation, but it's got little dots on the suit and you even have special gloves you can wear and you go and do a task with a camera watching how you do everything with all of the sensors. So it understands exactly how you move. That can transfer to a robot really well. The problem is what I mentioned earlier where it's just specific environments with specific objects that it's really good at. And if you wanted to get better, you'd need a much bigger data set. So figure actually went to a bunch of different suppliers and requested data sets from them. One of the biggest is probably scale AI that you might be familiar with. Scale AI is a company that was purchased by Meta. And they I think were purchased about 50% of the company was purchased for $2 billion. They had the CEO of Scale AI. Moveover is now the CEO of Meta AI. And so this was a huge company that did a lot of training data for OpenAI and Theroppyc, Google and a lot of Meta and a lot of other players. And of course,

5:07it was all the drama where when they had so acquisition and OpenAI said, hey, look, we're not buying any more data from them because they're purchased by Meta and it's a competitor. Yeah, yeah, so there's a bunch of stuff that went on. Scale AI specifically though wasn't just perhaps buying data. What they were doing was annotating and labeling the data and they were doing it in bulk. So the reason why the company was worth so much money, they would go and get data. And for example, they would go and get like legal data, then they would have lawyers go and annotate the data and mark it up and say this thing means this, this thing means this and kind of go and label it. And they would do this with a lot of different industries, a lot of different types of data. Figure went to companies like Scale AI and tried to say, hey, look, we need a whole bunch of egocentric data. egocentric data just means you wear basically a baseball cap and a camera that's pointing down. Usually just your smartphone works. It points down. It has to be able to see your hands if your hands are outside of the lens and the footage won't work, but it's going to see your hands and you go and do tasks. So you would go and you know, clean your dishes, you would go and you know, do the laundry, whatever. And if your camera can see your tasks, you can use this egocentric footage

6:10to train robot models. Companies like Scale AI would go and gather this from people, build little data sets and sell them. This is an industry that I'm quite familiar with because I'm working on a project for my own company. It's called FIND.com FIUND. So by the way, if you have any sort of, we specifically work with podcasting, audio and video and image data sets. So if you have any of those types of data sets, if you have a podcast you've run for years, let us know. Go, you know, reach out to me. I'll leave a link in the description to my website FIND. And we license that and we help you monetize it if you, you know, have data sets. But in any case, a figure went to these companies, lots of third party vendors, including Scale, and said they said, hey, look, like we need to buy this data. And they said they couldn't get enough quantity. So they were basically bottlenecked by not being able to get enough supply of this data. So what did they do figure decided to go and just build their own product, which is called index. And figures index program is essentially where they will send you like a special, a special camera and hat that you wear. And if you're looking at

7:15this on on Apple, you can see like what this looks like. It's kind of it's not really like a VR headset. It's more like a band that goes around your head, but there's a camera on the band. I mean, it's basically just the way I mentioned it earlier with like the baseball cap and your, and your phone is sort of a crude example that does work. But like if you get bumped the wrong way, it could mess it up. And so with this headband, it's able to, you know, just film you and they'll say, hey, go to your laundry, go to your dishes and they'll pay you for doing that. Now, there's a lot of different monetization methods with this and they had a lot of different types of places that are capturing this data for them. But the, but essentially what they were able to do with this index programs, they now have 4,000 people a day that are submitting content to their data set. They couldn't get a big enough data set. So they literally had to go build their own custom solution where you can order one of these headbands, go to your work and you get paid for them. I've heard about programs like this from a number of different companies that are shift that went viral recently because they said, hey, look, we're cleaning your house for free. If you let the cleaners wear one of these hats with a camera on it so that, you know, it's training data for cleaning, there's a lot of different ways

8:18to do this. But at the end of the day, no one was able to get it at the volume that figured you needed. So they built their own solution, the figure index, and now they have 4,000 contributors. They took all of that data. I think they said they have 264,000 app downloads. They have 16 million videos that have been uploaded from 108 different countries. And they said that they've paid out $15 million to creators. So you could go today and join the index program and make money. As far as the payments, and I mean, I would say go, go look into this. This is interesting. There's all sorts of tasks people doing, you know, bring in other groceries, doing the, taking out the trash, washing their car, washing their stove, like raking rocks. I mean, there's all sorts of tasks that are picking strawberries on their website inside of machine shops, folding pizza boxes, doing laundry, making case ideas. Like all sorts of tasks are demoed on their website. So there's a lot of different things that you can do here. That being said, from a lot of the estimates that I was seeing, they're paying like a dollar for a five minute video. So if you're like, you know, if you go take out your trash, it's like a dollar. If you go do this, it's a dollar. In some cases, it could be worth

9:22a lot of money. I saw other places that were just kind of paying $20 an hour, which by the way, they would go to find like warehouse workers and say like, hey, you know, your warehouse worker making $25 an hour will pay you another $20 an hour just to wear this like headband camera around with you while you do it. And I think a lot of people would take that out now. They're making $45 an hour. And so it makes, you know, a lot of sense. So figure was able to take all of this data that they now have. And the model is, you know, not being trained. There's not like some big breakthrough and how they're doing it. They were just able to get better data. They put all of this data in. And this is basically what the big unlock was for them. So now the figure robots are able to go around and clean houses in completely new environments that they've never seen before and they've got they've basically unlocked this generalized cleaning. So where does or generalized work? Where does this go in the future? I think a lot of the data set that they have right now is people around their house just random people. I think they're going to get more into specialized data sets. This is where they're going to have to focus. So they might say like, hey, we're going to,

10:23it's theoretically possible that they could say, hey, look, we're saturated on cleaning the house. Our robot is the greatest house cleaner in the world. We don't want any more laundry folding videos. We beg you, please stop. There's a chance it would say that I think they'll just keep collecting data and just making an absolutely astronomical data set. I think the cost for them is nominal compared to what this what this could unlock for them. And so, but I think where this will go in the future is they're going to, you know, inevitably put a bigger focus on like trying on board people into their index program that are like mechanics, a bunch of mechanics shops on. Maybe they'll make a deal with O'Reilly auto parts and have O'Reilly mandate that all of the mechanics need to wear this or they'll go in with, you know, like Walmart shelf stalkers or you can imagine that they would have kind of like some corporate partnerships that they would create. And then I think they'll just go and find specialized industries where people are doing very specialized things like an AC and HVAC person. They'll have electricians go in eventually with this method. They'll be able to train humanoid robots to be able to do a lot of this work. Where does this go in the future? This is something I've been talking about for about two years.

11:25Like if you know me, I've been saying that this is coming that AI and a chatbot is not the end of it, the end of it is humanoid robots because up until now robots have always had this problem where, you know, they got wheels on their feet or they zip around a warehouse picking up pallets and crates and you train the robot based off of, you know, basically, basically for a very specific task and a very specific environment. And it's hard to get it to do much more than that. This generalized, it's kind of like artificial general intelligence. It's we've got that for robots now and how they've been able to unlock it. It's just way more training data because these humanoid robots, I also heard people say like, surely you can come to the better form factor. Why are we doing humanoid robots? Why don't we just make robots that are like special shapes? It's because of the training data. We can just give them videos about humans do things and humans have built the entire world for humans, right? Like the way that the the height of a doorknob, the way that you open your car, like everything is built for a human. So it would make perfect sense that a robot that's the most useful, it just looks and acts exactly like human. It can be trained off of the exact same data set. So I think they're going

12:27to be purchasing more, I mean, they're going to be putting more investments into this. They said specifically on all of this that they're going to budget over two billion dollars a year on compute for training these models and training these robots. So there's going to be a way, there's going to be some massive investments that are coming into it from that end. And I think we can just expect all of this to accelerate what these robots are going to be capable of doing and the industries that they will go into. Now, what does this mean? I know a lot of people have kind of said like, I don't know, in alarmist ways, it's kind of the end of jobs and what are we going to do when the robots, you know, take over and they're doing everything for us. This is my opinion is yes, we'll have a lot of robots doing a lot of things, but at the end of the day, just like chat GPT in and of itself isn't doing your job for you. It's not running your business for you. You're still sitting there managing it. Even if you have agents doing things, you have to monitor your agents. You have to set up your workflows. You have to optimize them when something breaks. It's going to be the same thing with robots, I think in, you know, at the end of the day, that you're always going to need a person

13:28and an organization to oversee the robots to manage what they're doing. I think there's a lot of interesting concepts that I've been talking about for a long time and it feels like they're getting a lot closer. One of them being, you can imagine something like a landscaping company, where you have a Tesla cyber cab. Again, getting very, you know, or just a Tesla has self-driving, you have a robot go into there with like imagine you just give an electric lawnmower to one of these robots, you have it go into a cyber cab and is this economically viable, better question, but also is all of the tokens that a lot of these companies spend on anthropic credits to rebuild software economically viable. There's also a debate there that maybe people are overspending, but regardless, you could give an electric lawnmower to one of these robots, stick it in a cyber cab, have it drive around and let's say you had a lawn care business, it could go do your lawn care route for you. So, I mean, this is pretty interesting now. What, you know, who's liable if something goes wrong, if it actually mows over your rose bed, you know, there's like a bunch of theoretical problems where you might want to have a real human there and maybe you just have your robot to go and do things

14:29quickly while you're going and managing and watching it. So I don't know what the oversight of these things are. I don't know how remote control works. I don't know where this gets to, but you can imagine there will be full businesses that are running with these robots. To the point where I think there's a lot of the boomer generation or there's a lot of the baby boomer generation right that is retiring and selling businesses. I mean, it's kind of a famous joke or a famous like thing in private equity where you know, you're going to go and buy some some guys, you know, HVAC company where he's got a, you're going to roll up like 100 HVAC guys companies into like a big HVAC conglomerate in the specific city and you're going to run them all more efficiently. Yada, Yada. I mean, there's a lot of these people that have run companies for a long time and they're retiring. You can imagine the new business move here would be go take over someone's HVAC company and if you don't want to go do preventative maintenance on AC units yourself, you don't want to go and get on the roof of red robin with a hose and spray out all their air filters, you could just get a robot

15:29to go do that. So you could acquire this company and have the robot go and do a lot of the work. You probably have a camera on that thing where you can review the work at the end of the day make sure everything looks good, send out the bill and it could be like this a new kind of sort of automated business and this isn't for every industry and there's a lot of things that you probably, you know, are very tricky complex problems that you want human solving. But there's a lot of the mundane stuff that that these robots could actually do. So I think this is a fascinating time in to be alive. I mean, undoubtedly there is so much more that's going to be coming out at the cutting edge. I mean, no one has these robots yet. These are just the concepts and the tools that are being built. But you can imagine this is a absolutely colossal. I mean, when we talk about when we talk about like productivity being unlocked, humanoid robots are going to be it. I mean, you get the AI, the intelligence from something like Astra or OpenAI or or or Claude and you stick it into these robots. There is, you know, that I mean that unlocks so much and you kind of get past this

16:32issue that I think we have where you need to where you need to hire mass amounts of people to do like low skill labor or low pay labor, right? Like you think of like warehouses and factories. I think a lot of that will be done by robot. So what happens to jobs? What happens to the people that gets displaced by this? I mean, there's a lot of questions that go into it. But at the end of the day, when the washing machine, when the dishwasher was invented, I'm sure people that were washing it by hand complained. But at the end of the day, now they run the big industrial dishwasher and the restaurant can make more money and have more profits and, you know, jobs shift around. So it'll be interesting to see what happens in the shift. But at the end of the day, we will as a society undoubtedly become more productive with all of this. Guys, this is a fascinating episode. Thank you so much for tuning in. If you enjoyed this episode, number one, if you have any sort of data set, if you have a podcast, if you know someone with a podcast, send them my way to find fiund.fund.com. I would love to help evaluate it and help them monetize their data set if that's

17:34something that they're interested in. And number two, go check out my startup AIbox.ai. If you want to get access to every AI model in one place, $48.99 a month. All right, I'll catch you guys all in the next episode.