HomeHugging Face Enhances LeRobot Platform with Self-Driving Machine Training Data
Last year, Hugging Face, a well-known AI development platform, introduced LeRobot, a comprehensive suite of open AI models, datasets, and tools aimed at enhancing real-world robotics applications. This week, they've taken a significant step forward by partnering with AI startup Yaak to enrich LeRobot. Together, they've introduced the Learning to Drive (L2D) dataset, a massive training set designed specifically for autonomous navigation in varied environments, like bustling city streets.
The L2D dataset is colossal, spanning over a petabyte, and it's packed with data gathered from sensors mounted on cars used in German driving schools. This dataset captures a wide range of driving experiences, including everything from navigating construction zones to cruising on highways, all recorded through cameras, GPS, and vehicle dynamics sensors. This unique collection offers a real-world perspective from both instructors and students behind the wheel.
While there are other open self-driving training datasets out there, such as those from Alphabet’s Waymo and Comma AI, they often focus on specific planning tasks like object detection and tracking. These require meticulous annotations, which can be a bottleneck for scaling, according to the creators of L2D. In contrast, L2D is built to facilitate "end-to-end" learning, allowing AI models to predict actions directly from raw sensor inputs, like deciding when a pedestrian might step into the road based on camera footage.
A sampling of the data in the L2D dataset, captured by a number of sensors. Image Credits: Hugging Face
Yaak co-founder Harsimrat Sandhawalia and Remi Cadene, from Hugging Face's AI for robotics team, expressed their excitement in a blog post, stating, "The AI community can now build end-to-end self-driving models. L2D aims to be the largest open-source self-driving dataset that empowers the AI community with unique and diverse 'episodes' for training end-to-end spatial intelligence."
Hugging Face and Yaak are gearing up for some real-world action this summer. They plan to test models trained on L2D and LeRobot in actual driving conditions, with a safety driver on board, of course. They're inviting the AI community to contribute by submitting models and suggesting specific tasks, like navigating tricky roundabouts or mastering tight parking spaces, to be evaluated during these tests.
Related article
Stripe to Acquire OpenRouter as AI Model Routing Gains Momentum
Stripe has agreed to acquire OpenRouter, an AI model-routing platform that gives developers access to hundreds of models through a single interface. The deal adds model selection and routing to Stripe’s existing work around AI usage and token-based b
Former OpenAI Researcher Barrett Zoph Returns to Google to Support Gemini Development
Barret Zoph, who previously abruptly left and joined OpenAI due to a disagreement with Thinking Machines Lab CEO Miriam Mularati, has once again changed employers. Alphabet's Google announced that Zoph will return as Vice President of Research, bring
How Recursive Intelligence Raised $335M at $4B Valuation in 4 Months
The co-founders of startup Ricursive Intelligence seemed destined to be co-founders.Anna Goldie, CEO, and Azalia Mirhoseini, CTO, are so well-known in the AI community that they were among those AI engineers who “got those weird emails from Zuckerber
Related Special Topic Recommendations
Design & Art
Top AI Illustration Tools: Create Editorial Scenes and Cover Art Faster
2026 Latest Top-rated AI Illustration Tools: Our curated list features the best powerfully designed tools for creating stunning editorial scenes and eye-catching cover art quickly. Each option has gone through rigorous real-world tests, offering a free vs paid comparison to help you find the perfect match for your workflow. Try these must-try solutions today to unlock your AI edge and boost your creative productivity. Explore now at XIX.AI.
10 tools
xix.ai
Education and Learning
Top AI Tutors for Exam Prep: Practice Math, Science, and English
2026 Latest Top-Rated Best AI Tutors for Exam Prep are here on XIX.AI! Our curated list features powerful game-changing tools that offer free vs paid comparison, real-world tests, and weekly updated rankings. They help boost your writing efficiency, simplify complex topic learning, and unlock your academic potential. Explore now to Discover your perfect exam prep tool and Start creating today to Unlock your AI edge!
10 tools
xix.ai
Finance
AI Budget Planning Tools for Personal Money Management
2026 Latest Best Top-Rated AI Budget Planning Tools for Personal Money Management are here on XIX.AI! This curated collection features powerful, game-changing solutions that help you conduct real-world tests, understand spending habits, and create personalized plans to boost productivity. Enjoy a free vs paid comparison along with detailed rankings. Must-try tools designed to simplify money management and unlock your AI edge. Explore now!
11 tools
xix.ai
Health & Wellness
AI Sleep Tracking Assistants: Improve Recovery with Better Bedtime Habits
2026 Latest Best Top-Rated AI Sleep Tracking Assistants curated for ultimate recovery. This fully updated weekly guide features powerful tools that deliver real-world tests, free vs paid comparison, and detailed rankings to help you find the must-try solution that boosts sleep quality and supports better bedtime habits. Explore now at XIX.AI to Unlock your AI edge.
10 tools
xix.ai
Data Analysis
AI SQL Copilots for Product and Revenue Analytics
2026 Latest Best Top-Rated AI SQL Copilots for Product and Revenue Analytics! XIX.AI has curated a powerful, game-changing collection of must-try tools that undergo real-world tests through weekly updated rankings. These tools help users boost productivity significantly by accelerating data analysis, streamlining complex queries, and generating accurate insights to drive smarter business decisions. Explore now to Discover your perfect tool for unlocking your AI edge!
14 tools
xix.ai
Education and Learning
Best AI Homework Helpers That Teach: Learn Concepts, Not Just Answers
2026 Latest Best Top-Rated AI Homework Helpers That Teach Core Concepts Not Just Answers Powerful Tools for Students Must-Try Curated List Weekly Updated Free vs Paid Comparison Real-World Tests Accurate Rankings to Help You Unlock Your Full Learning Potential Explore now to Discover your perfect tool for smarter studying.
10 tools
xix.ai
Comments (14)
0/500
![RyanSanchez]()
Whoa, Hugging Face diving into self-driving data? That's wild! LeRobot just got a serious upgrade. Wonder if they'll open-source the whole pipeline. 🤖🚗
![BrianWalker]()
自動運転データも統合したんですってね、Hugging FaceとYaakの連携、進化が速すぎて追いつけない！ロボット学習用のデータセットが拡充されることで、研究室レベルの技術が身近になってきてる感じがします。個人的には家庭用ロボットが早く安価に提供されてほしいんですけど、セキュリティ面の懸念はどうクリアするんでしょう？🤖🤔 オープンモデルが増えるのはいいけど、学習データの質の問題は常に気になります。
![PaulGonzalez]()
Diese Entwicklung bei LeRobot zeigt, wie schnell sich Robotik und KI verbinden. Ich frage mich, ob solche Open-Source-Projekte langfristig mit Googles Robotik-Initiativen mithalten können. Die Partnerschaft mit Yaak könnte neue Standards setzen - hoffentlich bleiben ethische Fragen dabei nicht auf der Strecke. 🤖
![AndrewAllen]()
Encore une collaboration qui promet ! HF+Yaak pour améliorer les données de robots autonomes, j'espère que ça ne finira pas comme les voitures qui ne reconnaissent pas les piétons par temps de pluie 😅 C'est cool mais la sécurité d'abord, non ?
![NicholasTaylor]()
哇！這個自駕機器訓練資料庫感覺很實用，好奇它會影響哪些產業？不過HF最近動作頻頻，是不是想跟Google、OpenAI搶機器人市場啊？🤔 台灣有沒有團隊在用這個平台？
![AnthonyScott]()
This is pretty bold from Poolside's CEO! But honestly, makes total sense - why waste millions training yet another foundation model when 99% of companies just need good applications? 🧠 #TeamPracticalAI
Last year, Hugging Face, a well-known AI development platform, introduced LeRobot, a comprehensive suite of open AI models, datasets, and tools aimed at enhancing real-world robotics applications. This week, they've taken a significant step forward by partnering with AI startup Yaak to enrich LeRobot. Together, they've introduced the Learning to Drive (L2D) dataset, a massive training set designed specifically for autonomous navigation in varied environments, like bustling city streets.
The L2D dataset is colossal, spanning over a petabyte, and it's packed with data gathered from sensors mounted on cars used in German driving schools. This dataset captures a wide range of driving experiences, including everything from navigating construction zones to cruising on highways, all recorded through cameras, GPS, and vehicle dynamics sensors. This unique collection offers a real-world perspective from both instructors and students behind the wheel.
While there are other open self-driving training datasets out there, such as those from Alphabet’s Waymo and Comma AI, they often focus on specific planning tasks like object detection and tracking. These require meticulous annotations, which can be a bottleneck for scaling, according to the creators of L2D. In contrast, L2D is built to facilitate "end-to-end" learning, allowing AI models to predict actions directly from raw sensor inputs, like deciding when a pedestrian might step into the road based on camera footage.
Yaak co-founder Harsimrat Sandhawalia and Remi Cadene, from Hugging Face's AI for robotics team, expressed their excitement in a blog post, stating, "The AI community can now build end-to-end self-driving models. L2D aims to be the largest open-source self-driving dataset that empowers the AI community with unique and diverse 'episodes' for training end-to-end spatial intelligence."
Hugging Face and Yaak are gearing up for some real-world action this summer. They plan to test models trained on L2D and LeRobot in actual driving conditions, with a safety driver on board, of course. They're inviting the AI community to contribute by submitting models and suggesting specific tasks, like navigating tricky roundabouts or mastering tight parking spaces, to be evaluated during these tests.
Stripe to Acquire OpenRouter as AI Model Routing Gains Momentum
Stripe has agreed to acquire OpenRouter, an AI model-routing platform that gives developers access to hundreds of models through a single interface. The deal adds model selection and routing to Stripe’s existing work around AI usage and token-based b
Former OpenAI Researcher Barrett Zoph Returns to Google to Support Gemini Development
Barret Zoph, who previously abruptly left and joined OpenAI due to a disagreement with Thinking Machines Lab CEO Miriam Mularati, has once again changed employers. Alphabet's Google announced that Zoph will return as Vice President of Research, bring
How Recursive Intelligence Raised $335M at $4B Valuation in 4 Months
The co-founders of startup Ricursive Intelligence seemed destined to be co-founders.Anna Goldie, CEO, and Azalia Mirhoseini, CTO, are so well-known in the AI community that they were among those AI engineers who “got those weird emails from Zuckerber
2026 Latest Top-rated AI Illustration Tools: Our curated list features the best powerfully designed tools for creating stunning editorial scenes and eye-catching cover art quickly. Each option has gone through rigorous real-world tests, offering a free vs paid comparison to help you find the perfect match for your workflow. Try these must-try solutions today to unlock your AI edge and boost your creative productivity. Explore now at XIX.AI.
10 tools
xix.ai
2026 Latest Top-Rated Best AI Tutors for Exam Prep are here on XIX.AI! Our curated list features powerful game-changing tools that offer free vs paid comparison, real-world tests, and weekly updated rankings. They help boost your writing efficiency, simplify complex topic learning, and unlock your academic potential. Explore now to Discover your perfect exam prep tool and Start creating today to Unlock your AI edge!
10 tools
xix.ai
2026 Latest Best Top-Rated AI Budget Planning Tools for Personal Money Management are here on XIX.AI! This curated collection features powerful, game-changing solutions that help you conduct real-world tests, understand spending habits, and create personalized plans to boost productivity. Enjoy a free vs paid comparison along with detailed rankings. Must-try tools designed to simplify money management and unlock your AI edge. Explore now!
11 tools
xix.ai
2026 Latest Best Top-Rated AI Sleep Tracking Assistants curated for ultimate recovery. This fully updated weekly guide features powerful tools that deliver real-world tests, free vs paid comparison, and detailed rankings to help you find the must-try solution that boosts sleep quality and supports better bedtime habits. Explore now at XIX.AI to Unlock your AI edge.
10 tools
xix.ai
2026 Latest Best Top-Rated AI SQL Copilots for Product and Revenue Analytics! XIX.AI has curated a powerful, game-changing collection of must-try tools that undergo real-world tests through weekly updated rankings. These tools help users boost productivity significantly by accelerating data analysis, streamlining complex queries, and generating accurate insights to drive smarter business decisions. Explore now to Discover your perfect tool for unlocking your AI edge!
14 tools
xix.ai
2026 Latest Best Top-Rated AI Homework Helpers That Teach Core Concepts Not Just Answers Powerful Tools for Students Must-Try Curated List Weekly Updated Free vs Paid Comparison Real-World Tests Accurate Rankings to Help You Unlock Your Full Learning Potential Explore now to Discover your perfect tool for smarter studying.
10 tools
xix.ai
Whoa, Hugging Face diving into self-driving data? That's wild! LeRobot just got a serious upgrade. Wonder if they'll open-source the whole pipeline. 🤖🚗
自動運転データも統合したんですってね、Hugging FaceとYaakの連携、進化が速すぎて追いつけない！ロボット学習用のデータセットが拡充されることで、研究室レベルの技術が身近になってきてる感じがします。個人的には家庭用ロボットが早く安価に提供されてほしいんですけど、セキュリティ面の懸念はどうクリアするんでしょう？🤖🤔 オープンモデルが増えるのはいいけど、学習データの質の問題は常に気になります。
Diese Entwicklung bei LeRobot zeigt, wie schnell sich Robotik und KI verbinden. Ich frage mich, ob solche Open-Source-Projekte langfristig mit Googles Robotik-Initiativen mithalten können. Die Partnerschaft mit Yaak könnte neue Standards setzen - hoffentlich bleiben ethische Fragen dabei nicht auf der Strecke. 🤖
Encore une collaboration qui promet ! HF+Yaak pour améliorer les données de robots autonomes, j'espère que ça ne finira pas comme les voitures qui ne reconnaissent pas les piétons par temps de pluie 😅 C'est cool mais la sécurité d'abord, non ?
哇！這個自駕機器訓練資料庫感覺很實用，好奇它會影響哪些產業？不過HF最近動作頻頻，是不是想跟Google、OpenAI搶機器人市場啊？🤔 台灣有沒有團隊在用這個平台？
This is pretty bold from Poolside's CEO! But honestly, makes total sense - why waste millions training yet another foundation model when 99% of companies just need good applications? 🧠 #TeamPracticalAI
