- Emergent Behavior
- Posts
- 2024-04-10: Try It On At Home
2024-04-10: Try It On At Home
solving clothes fitting
đź”· Subscribe to get breakdowns of the most important developments in AI in your inbox every morning.
Here’s today at a glance:
đź‘— Try It On At Home
Background
In 2018, a Japanese entrepreneur by the name of Yusaku Maezawa paid Elon for the right to the first tourist moon flyby and also announced that he’d invented the Zozosuit, a 3D size capture suit that would allow you to size the clothes you bought from his Zozotown online store accurately.
It was named one of Time Magazine’s Best Inventions of 2018, and since then neither the suit nor Time Magazine has been heard from again.
E-commerce returns are a $1 trillion problem, specifically in the apparel, accessories, and footwear category, which comprises a whopping $250 billion of that. Closing the gap between online promise and physical product would do a lot to narrow that, but Zozotown failed.
But never doubt Zuck, the Lord of the Milennials, who has solved this as a side quest on his way to AGI/Metaverse.
Base Reality
Read in to 3D model
And play with it
Who: Researchers from Meta Reality Labs, including Nikolaos Sarafianos, Tuur Stuyck, Xiaoyu Xiang, Yilei Li, Jovan Popovic, and Rakesh Ranjan.
Why:
Current methods for creating virtual clothing are time-consuming and require specialized software and expertise
The team aimed to develop a method that allows users to quickly generate 3D textured clothes from a single image
Enabling rapid asset generation could unlock virtual applications at scale and assist in the design process
How:
They developed Garment3DGen, which transforms a base garment mesh into a simulation-ready asset directly from images or text prompts
The method leverages recent progress in image-to-3D diffusion models to generate 3D garment geometries
They propose using the generated geometries as pseudo ground-truth and set up a mesh deformation optimization procedure
Carefully designed losses allow the base mesh to freely deform toward the desired target while preserving mesh quality and topology
A texture estimation module generates high-fidelity texture maps that faithfully capture the input guidance
What did they find:
Garment3DGen can generate high-quality simulation-ready stylized garment assets complete with associated textures
The method outperforms prior work across all metrics while producing physically plausible and high-quality garment assets
The output geometries can be used for physics-based cloth simulation, hand-garment interaction in a VR environment, and going from a simple sketch to a drivable 3D garment
What are the limitations and what's next:
The method requires a template mesh, which limits the types of garments that can be generated while maintaining good mesh quality
Estimated textures sometimes do not fully preserve fine-level details
Future work could focus on providing a more diverse template library and tuning the texture enhancement module to better preserve details
Why it matters:
Garment3DGen enables rapid generation of 3D garments from a single image or text prompt without the need for artist intervention
The method could significantly reduce the time and expertise required to create virtual clothing assets
Enabling low-friction asset creation could be a key enabler for unlocking virtual applications at scale and facilitating faster exploration and creation of new designs
Additional notes:
The paper is set to be published in future conference proceedings (CVPR 2024)
Meta presents Garment3DGen!
A method that can stylize the geometry and textures from 2D image and 3D mesh garments, which can be fitted on top of parametric bodies and be simulated 🔥
More examples ⬇️
— Dreaming Tulpa 🥓👑 (@dreamingtulpa)
8:13 AM • Apr 3, 2024
🌠Enjoying this edition of Emergent Behavior? Send this web link with a friend to help spread the word of technological progress and positive AI to the world!
Or send them the below subscription link:
🗞️ Things Happen
Terrific tale of safety, innovation, regulation, intellectual property, and competition.
Back in 2009, a man named Steve Gass invented a system that sensed flesh and allowed the blade to stop and retract before it could cut into hands and fingers.
This wasn't some gimmick. It actually worked. 40,000 people in the US alone end up in the ER because of table saw injuries. When a human makes contact with a 2lb blade spinning at 5000rpm, the outcome is never a couple of stitches and a bandaid. This is when you go to hospital with your fingers in a zip bag and beg doctors to reattach them. Or when the blade goes between your fingers and bifurcates your hand in two. Nasty catastrophic injuries.
Gass' invention fixed this. The brake worked fast enough to prevent almost all these bad injuries. What could be a major catastrophe turns into a small scratch and a $150 brake and blade replacement.
And it was commercially viable too. The tech worked with any regular metal blade, and the brake mechanism could be made for under $100. The brake was just a consumable item that could be replaced quickly with no tools.
Initially Gass tried to license this technology to all the major saw manufacturers. But they all turned him down. The speculation is that manufacturers couldn't afford to put this on their low end saws because of the added cost of the brake and the need to make the saw sturdy enough to support the energy absorbed from the brake. Some low end saws retail for $150-$300, so even though the brake was cheap, it would have made that product segment unviable. And if manufacturers chose to put the brake only on their higher end models, they were afraid they'd open themselves up for lawsuits if they possessed the safety technology and intentionally omitted it on the cheaper models. So they didn't want anything to do with this.
Then Gass went to the government and lobbied for regulators to compel the use of this technology. But back then there was no appetite for that kind of intervention and Gass got a lot of bad PR for trying to impose this on the public.
So Gass decided to go with the free market approach, and started a company called SawStop which made table saws using this technology. And he proved that a lot of people were willing to pay an extra $200 to save their fingers. Who knew?
In time, the other manufactures lost almost all market share to SawStop for the medium to high end saws. Almost any new saw sold in the US over $800 was a SawStop.
And miraculously, the manufactures had a change of heart! Now they wanted this technology. So a few of them began developing their own versions. Almost none managed to bring anything to market, but at one point Bosch developed a similar technology called Reaxx and started selling these saws in the US. But SawStop sued them for infringing on their patent.
In the end, the court ruled that Bosch couldn't sell these saws in the US, and this ticked consumers off because they said this was further proof that SawStop was more interested in money than safety.
But shortly after SawStop won that lawsuit, they changed their mind. They gave Bosch a free license to use their technology. But Bosch still didn't bring back their Reaxx products. Some say that Bosch never managed to implement a reliable solution and they realized their solution would be compared to SawStop's and it would harm their brand if it didn't work as well.
Fast forward to today, 25 years after Gass invented this system. The political situation is very different, and now it's looking very likely that SawStop technology will be mandated for all new table saws sold in the US.
SawStop still have a patent for this technology until 2033, and if this regulation passes the other manufactures would theoretically have to pay license fees for every saw they sell in the US.
But in a shocking move, SawStop said that if the regulation passes, it will release the patent for free to the public. The US public safety commission, prepared for a fight, was baffled by this news. When the news sunk in, they concluded that at this point there are no more barriers for any other company to match SawStop safety.
This means that SawStop will give their rivals permission to use their technology. It doesn't mean that it will sell the parts to them, but they are not going to sue anyone who tries to make their own version. They are basically giving up their monopoly on this technology.
But the manufactures are still unanimously opposed to this regulation (except SawStop of course). They claim that this will put them out of business and that cheap affordable saws are going to be a thing of the past. The cheapest SawStop table saw costs $899, while most manufactures sell saws under $300. Since they're not selling any high end saws anymore (SawStop took all of their business), the low end is what's making them money at the moment, and now this regulation will force them out of the market completely.
If this regulation passes, we're likely not going to see saws on the market for under $700 anymore. And this will be a real obstacle for people looking to get started in woodworking, carpentry, and other construction trades that need to buy table saws. The regulation will also likely incentivize manufacturers to recall all the old saws, and that would make it hard for consumers to find cheap used saws without this safety feature. (This already happened with Craftsman's radial arm saws in the early 2000s.)
But what about the saved fingers? 400,000 catastrophic injuries and amputations over the next 10 years could be saved if this regulation passes. That seems substantial. This feels like progress. This is what an advanced society does. The end consumer will ultimately pay for it, but would you want the cabinet maker of your next kitchen remodel risk fingers and permanent catastrophic injury just to save a $100 part? Hell no!
The blade of a saw carries a small electrical signal. When skin contacts the blade, the signal changes because the human body is conductive and the change to the signal activates the safety system.
[đź“ą SawStop]
— Massimo (@Rainmaker1973)
4:34 PM • Apr 8, 2024
🖼️ AI Artwork Of The Day
Feature Villains, Lego Edition - u/Thing1_Tokyo from r/midjourney
That’s it for today! Become a subscriber for daily breakdowns of what’s happening in the AI world:
Reply