Home
Li Feifei’s Team Unveils Method to Generate Infinite Robot Training Grounds From Single Video
In embodied intelligence, bridging the gap from simulation to reality—known as "Sim2Real"—has long been a persistent hurdle. Simulation setups are expensive, and models frequently lose performance when deployed in physical settings. A recent collaborative study from Li Fei-Fei’s team, NVIDIA GEAR Lab, and Georgia Tech introduces a novel solution: Real2Sim.
Named "SimFoundry," this system creates interactive, trainable, and testable robotic simulations using simple real-world video. Going beyond traditional 3D reconstruction, SimFoundry performs deep scene analysis to automate environment creation, drastically reducing the effort required to build simulations.
SimFoundry’s core innovation involves a closed loop between "digital twins" and "digital cousins." The system extracts geometric, physical, and interactive data from videos to build high-fidelity digital twins. It then automatically varies appearance, layout, and tasks to generate diverse digital cousins. This allows developers to derive virtually unlimited training data from a single video, enabling end-to-end strategy learning and evaluation within the simulation.
Experiments confirm SimFoundry’s strong predictive power, with simulated robot performance closely matching real-world outcomes. Crucially, strategies trained on this synthetic data transfer effectively to reality without fine-tuning ("zero-shot"), excelling in complex tasks like multi-step operations and dual-arm coordination.
Co-authored by leading robotics experts, including key members of NVIDIA GEAR Lab and Li Fei-Fei’s team, this open-source system promises to transform embodied AI development. By replacing costly manual data collection with generative technology, robots can now transition from lab to real-world applications much faster.
Paper link: https://arxiv.org/pdf/2606.28276v1
Related article
Senate Demands Data Centers Reveal Power Bills
Two U.S. senators have escalated their campaign against data centers and their energy consumption, sending a letter to the U.S. Energy Information Administration (EIA) on Thursday. Senators Josh Hawley and Elizabeth Warren requested that the agency g
Mira Murati Steps Back Into Spotlight With Careful Approach
Mira Murati has never been a natural fit for the conference circuit. As OpenAI’s CTO, she remained largely behind the scenes, rarely serving as the company’s public face. Now leading her own venture, Thinking Machines Lab, she has been even more elus
Adobe Creator Report: 80% Say AI Drives Fan and Business Growth
As artificial intelligence accelerates its global expansion, the content creation sector is experiencing a fundamental shift. Creative AI tools are no longer just workflow enhancers; they are driving business growth and helping creators build larger
Related Special Topic Recommendations
Business
AI Business Plan Tools for Startup Validation
2026 Latest Best AI Business Plan Tools for Startup Validation! XIX.AI has curated a top-rated list of powerful game-changing tools that go through real-world tests to deliver accurate results. You’ll find a free vs paid comparison, detailed rankings, and easy-to-understand insights to help you choose the perfect solution and boost your startup’s success rate. Explore now to Unlock your AI edge!
9 tools
xix.ai
chatbot
AI Chat Apps for Roleplay and Conversation Practice
2026 Latest Best AI Chat Apps for Roleplay and Conversation Practice! XIX.AI curates a top-rated list of powerful must-try tools that go through rigorous real-world tests to deliver exceptional results. You’ll find detailed free vs paid comparison, comprehensive rankings, and insights into how these apps can boost your language skills and communication confidence effectively. Explore now to discover your perfect tool for practice!
10 tools
xix.ai
design
Best AI Wireframe Tools for Product Teams
2026 Latest Best Top-rated AI Wireframe Tools for Product Teams! This curated list showcases powerful, game-changing solutions that significantly boost productivity through real-world tests and rigorous rankings. It includes a detailed free vs paid comparison to help you find the perfect fit. XIX.AI provides expert insights to guide your decision. Explore now to Discover your perfect tool and Unlock your AI edge in product development!
8 tools
xix.ai
Software Development
Best AI DevOps Tools for Deployment Monitoring
2026 Latest Best Top-Rated AI DevOps Tools for Deployment Monitoring are featured here in our carefully curated list. These powerful tools help teams boost productivity significantly through real-world tests and rigorous rankings. Get a free vs paid comparison to find the perfect option that suits your needs. Explore now to unlock your AI edge!
11 tools
xix.ai
Data Analysis
Best AI Data Analysis Tools for Excel and SQL
2026 Latest Best Top-rated AI Data Analysis Tools for Excel and SQL are here on XIX.AI! Our curated list includes powerful, game-changing solutions that help you speed up data processing, boost productivity, and overcome analysis challenges. We’ve conducted real-world tests to deliver accurate rankings based on performance, ease of use, and value. Explore now to find the must-try tool that fits your needs perfectly and Unlock your AI edge in data work.
10 tools
xix.ai
Text-to-speech
AI Podcast Voice Cloning Tools for Long-Form Episodes, Host Ads, and Audio Courses
2026 Latest Best Top-rated AI Podcast Voice Cloning Tools for Long-form Episodes Host Ads and Audio Courses are curated here. These powerful game-changing solutions undergo real-world tests to ensure reliability. You can find a free vs paid comparison along with detailed rankings. XIX.AI offers a must-try selection that boosts productivity significantly. Explore now to discover your perfect tool and unlock your AI edge.
9 tools
xix.ai
Comments (0)
0/500
In embodied intelligence, bridging the gap from simulation to reality—known as "Sim2Real"—has long been a persistent hurdle. Simulation setups are expensive, and models frequently lose performance when deployed in physical settings. A recent collaborative study from Li Fei-Fei’s team, NVIDIA GEAR Lab, and Georgia Tech introduces a novel solution: Real2Sim.
Named "SimFoundry," this system creates interactive, trainable, and testable robotic simulations using simple real-world video. Going beyond traditional 3D reconstruction, SimFoundry performs deep scene analysis to automate environment creation, drastically reducing the effort required to build simulations.
SimFoundry’s core innovation involves a closed loop between "digital twins" and "digital cousins." The system extracts geometric, physical, and interactive data from videos to build high-fidelity digital twins. It then automatically varies appearance, layout, and tasks to generate diverse digital cousins. This allows developers to derive virtually unlimited training data from a single video, enabling end-to-end strategy learning and evaluation within the simulation.
Experiments confirm SimFoundry’s strong predictive power, with simulated robot performance closely matching real-world outcomes. Crucially, strategies trained on this synthetic data transfer effectively to reality without fine-tuning ("zero-shot"), excelling in complex tasks like multi-step operations and dual-arm coordination.
Co-authored by leading robotics experts, including key members of NVIDIA GEAR Lab and Li Fei-Fei’s team, this open-source system promises to transform embodied AI development. By replacing costly manual data collection with generative technology, robots can now transition from lab to real-world applications much faster.
Paper link: https://arxiv.org/pdf/2606.28276v1
Senate Demands Data Centers Reveal Power Bills
Two U.S. senators have escalated their campaign against data centers and their energy consumption, sending a letter to the U.S. Energy Information Administration (EIA) on Thursday. Senators Josh Hawley and Elizabeth Warren requested that the agency g
Mira Murati Steps Back Into Spotlight With Careful Approach
Mira Murati has never been a natural fit for the conference circuit. As OpenAI’s CTO, she remained largely behind the scenes, rarely serving as the company’s public face. Now leading her own venture, Thinking Machines Lab, she has been even more elus
Adobe Creator Report: 80% Say AI Drives Fan and Business Growth
As artificial intelligence accelerates its global expansion, the content creation sector is experiencing a fundamental shift. Creative AI tools are no longer just workflow enhancers; they are driving business growth and helping creators build larger
2026 Latest Best AI Business Plan Tools for Startup Validation! XIX.AI has curated a top-rated list of powerful game-changing tools that go through real-world tests to deliver accurate results. You’ll find a free vs paid comparison, detailed rankings, and easy-to-understand insights to help you choose the perfect solution and boost your startup’s success rate. Explore now to Unlock your AI edge!
9 tools
xix.ai
2026 Latest Best AI Chat Apps for Roleplay and Conversation Practice! XIX.AI curates a top-rated list of powerful must-try tools that go through rigorous real-world tests to deliver exceptional results. You’ll find detailed free vs paid comparison, comprehensive rankings, and insights into how these apps can boost your language skills and communication confidence effectively. Explore now to discover your perfect tool for practice!
10 tools
xix.ai
2026 Latest Best Top-rated AI Wireframe Tools for Product Teams! This curated list showcases powerful, game-changing solutions that significantly boost productivity through real-world tests and rigorous rankings. It includes a detailed free vs paid comparison to help you find the perfect fit. XIX.AI provides expert insights to guide your decision. Explore now to Discover your perfect tool and Unlock your AI edge in product development!
8 tools
xix.ai
2026 Latest Best Top-Rated AI DevOps Tools for Deployment Monitoring are featured here in our carefully curated list. These powerful tools help teams boost productivity significantly through real-world tests and rigorous rankings. Get a free vs paid comparison to find the perfect option that suits your needs. Explore now to unlock your AI edge!
11 tools
xix.ai
2026 Latest Best Top-rated AI Data Analysis Tools for Excel and SQL are here on XIX.AI! Our curated list includes powerful, game-changing solutions that help you speed up data processing, boost productivity, and overcome analysis challenges. We’ve conducted real-world tests to deliver accurate rankings based on performance, ease of use, and value. Explore now to find the must-try tool that fits your needs perfectly and Unlock your AI edge in data work.
10 tools
xix.ai
2026 Latest Best Top-rated AI Podcast Voice Cloning Tools for Long-form Episodes Host Ads and Audio Courses are curated here. These powerful game-changing solutions undergo real-world tests to ensure reliability. You can find a free vs paid comparison along with detailed rankings. XIX.AI offers a must-try selection that boosts productivity significantly. Explore now to discover your perfect tool and unlock your AI edge.
9 tools
xix.ai
