HomeHugging Face Enhances LeRobot Platform with Self-Driving Machine Training Data
Last year, Hugging Face, a well-known AI development platform, introduced LeRobot, a comprehensive suite of open AI models, datasets, and tools aimed at enhancing real-world robotics applications. This week, they've taken a significant step forward by partnering with AI startup Yaak to enrich LeRobot. Together, they've introduced the Learning to Drive (L2D) dataset, a massive training set designed specifically for autonomous navigation in varied environments, like bustling city streets.
The L2D dataset is colossal, spanning over a petabyte, and it's packed with data gathered from sensors mounted on cars used in German driving schools. This dataset captures a wide range of driving experiences, including everything from navigating construction zones to cruising on highways, all recorded through cameras, GPS, and vehicle dynamics sensors. This unique collection offers a real-world perspective from both instructors and students behind the wheel.
While there are other open self-driving training datasets out there, such as those from Alphabet’s Waymo and Comma AI, they often focus on specific planning tasks like object detection and tracking. These require meticulous annotations, which can be a bottleneck for scaling, according to the creators of L2D. In contrast, L2D is built to facilitate "end-to-end" learning, allowing AI models to predict actions directly from raw sensor inputs, like deciding when a pedestrian might step into the road based on camera footage.
A sampling of the data in the L2D dataset, captured by a number of sensors. Image Credits: Hugging Face
Yaak co-founder Harsimrat Sandhawalia and Remi Cadene, from Hugging Face's AI for robotics team, expressed their excitement in a blog post, stating, "The AI community can now build end-to-end self-driving models. L2D aims to be the largest open-source self-driving dataset that empowers the AI community with unique and diverse 'episodes' for training end-to-end spatial intelligence."
Hugging Face and Yaak are gearing up for some real-world action this summer. They plan to test models trained on L2D and LeRobot in actual driving conditions, with a safety driver on board, of course. They're inviting the AI community to contribute by submitting models and suggesting specific tasks, like navigating tricky roundabouts or mastering tight parking spaces, to be evaluated during these tests.
Related article
WordPress.com now allows AI agents to write and publish posts, plus more
WordPress.com, the popular web hosting and publishing platform, is now embracing AI agents—a move that could reshape the look and feel of the web. The company announced Friday that it will allow AI agents to draft, edit, and publish content on custom
Anthropic's experimental AI Claude completes negotiations and transactions in e-commerce test
As artificial intelligence advances rapidly, Anthropic quietly rolled out an internal experiment called "Project Deal" last Friday, showcasing AI's potential in e-commerce. The experiment had its AI model Claude autonomously handle buying, selling, a
DeepSeek Code poised for launch
As AI technology accelerates, DeepSeek is at a thrilling juncture. The AI company recently revealed it has secured over 70 billion yuan in funding. Leadership has emphasized a commitment to groundbreaking AI research over immediate commercial gains.
Related Special Topic Recommendations
Business
Best AI Expense Trackers: Scan Receipts & Categorize Corporate Spend Automatically
2026 Latest Best AI Expense Trackers: Top-rated tools to scan receipts & categorize corporate spend automatically. Discover powerful, game-changing solutions for effortless expense management, accurate financial tracking, and streamlined compliance. Our curated, weekly-updated comparison of free vs paid options helps you find the perfect fit. Unlock your AI edge with XIX.AI's expert picks.
10 tools
xix.ai
Business
Best AI Recruiting Tools: Screen Resumes & Automate Candidate Interview Scheduling
Discover the 2026 latest top-rated AI recruiting tools on XIX.AI. Our curated list features powerful, game-changing solutions for screening resumes and automating candidate interview scheduling. Compare free vs paid options with real-world tests and weekly updated rankings. Find your perfect hiring assistant and streamline your recruitment today!
10 tools
xix.ai
Productivity
AI Personal Wellness & Focus Coaches: Manage Burnout & Boost Mental Energy Levels
Discover the 2026 best AI personal wellness and focus coaches on XIX.AI. Our curated rankings feature top-rated, game-changing tools to manage burnout and boost mental energy. Compare free vs paid options with real-world insights. Unlock your path to peak productivity and well-being today.
10 tools
xix.ai
chatbot
Top-Rated AI Romantic Chatbots: Build Long-Term Relationships with Consistent Personalities
Discover the 2026 latest top-rated AI romantic chatbots for building genuine, long-term connections. Our curated list features powerful, consistent personalities, free vs paid comparisons, and real-world tests. Find your perfect companion and start building today at XIX.AI.
10 tools
xix.ai
Education and Learning
Best AI Data Science Mentors: Master SQL, Pandas & Machine Learning Workflows
Discover the 2026 best AI data science mentors to master SQL, Pandas & ML workflows. Explore our top-rated, curated selection at XIX.AI for powerful, game-changing guidance. Compare free vs paid options with real-world insights. Unlock your data science mastery today.
10 tools
xix.ai
chatbot
Best AI Flirting & Conversation Trainers: Improve Social Charisma and Confidence in Real-Time
Discover the 2026 best AI flirting and conversation trainers on XIX.AI. Our curated, top-rated selection helps you build social charisma and confidence in real-time. Explore must-try, game-changing tools with free vs paid comparisons and weekly updated rankings. Unlock your social edge today.
10 tools
xix.ai
Comments (14)
0/500
![RyanSanchez]()
Whoa, Hugging Face diving into self-driving data? That's wild! LeRobot just got a serious upgrade. Wonder if they'll open-source the whole pipeline. 🤖🚗
![BrianWalker]()
自動運転データも統合したんですってね、Hugging FaceとYaakの連携、進化が速すぎて追いつけない！ロボット学習用のデータセットが拡充されることで、研究室レベルの技術が身近になってきてる感じがします。個人的には家庭用ロボットが早く安価に提供されてほしいんですけど、セキュリティ面の懸念はどうクリアするんでしょう？🤖🤔 オープンモデルが増えるのはいいけど、学習データの質の問題は常に気になります。
![PaulGonzalez]()
Diese Entwicklung bei LeRobot zeigt, wie schnell sich Robotik und KI verbinden. Ich frage mich, ob solche Open-Source-Projekte langfristig mit Googles Robotik-Initiativen mithalten können. Die Partnerschaft mit Yaak könnte neue Standards setzen - hoffentlich bleiben ethische Fragen dabei nicht auf der Strecke. 🤖
![AndrewAllen]()
Encore une collaboration qui promet ! HF+Yaak pour améliorer les données de robots autonomes, j'espère que ça ne finira pas comme les voitures qui ne reconnaissent pas les piétons par temps de pluie 😅 C'est cool mais la sécurité d'abord, non ?
![NicholasTaylor]()
哇！這個自駕機器訓練資料庫感覺很實用，好奇它會影響哪些產業？不過HF最近動作頻頻，是不是想跟Google、OpenAI搶機器人市場啊？🤔 台灣有沒有團隊在用這個平台？
![AnthonyScott]()
This is pretty bold from Poolside's CEO! But honestly, makes total sense - why waste millions training yet another foundation model when 99% of companies just need good applications? 🧠 #TeamPracticalAI
Last year, Hugging Face, a well-known AI development platform, introduced LeRobot, a comprehensive suite of open AI models, datasets, and tools aimed at enhancing real-world robotics applications. This week, they've taken a significant step forward by partnering with AI startup Yaak to enrich LeRobot. Together, they've introduced the Learning to Drive (L2D) dataset, a massive training set designed specifically for autonomous navigation in varied environments, like bustling city streets.
The L2D dataset is colossal, spanning over a petabyte, and it's packed with data gathered from sensors mounted on cars used in German driving schools. This dataset captures a wide range of driving experiences, including everything from navigating construction zones to cruising on highways, all recorded through cameras, GPS, and vehicle dynamics sensors. This unique collection offers a real-world perspective from both instructors and students behind the wheel.
While there are other open self-driving training datasets out there, such as those from Alphabet’s Waymo and Comma AI, they often focus on specific planning tasks like object detection and tracking. These require meticulous annotations, which can be a bottleneck for scaling, according to the creators of L2D. In contrast, L2D is built to facilitate "end-to-end" learning, allowing AI models to predict actions directly from raw sensor inputs, like deciding when a pedestrian might step into the road based on camera footage.
Yaak co-founder Harsimrat Sandhawalia and Remi Cadene, from Hugging Face's AI for robotics team, expressed their excitement in a blog post, stating, "The AI community can now build end-to-end self-driving models. L2D aims to be the largest open-source self-driving dataset that empowers the AI community with unique and diverse 'episodes' for training end-to-end spatial intelligence."
Hugging Face and Yaak are gearing up for some real-world action this summer. They plan to test models trained on L2D and LeRobot in actual driving conditions, with a safety driver on board, of course. They're inviting the AI community to contribute by submitting models and suggesting specific tasks, like navigating tricky roundabouts or mastering tight parking spaces, to be evaluated during these tests.
WordPress.com now allows AI agents to write and publish posts, plus more
WordPress.com, the popular web hosting and publishing platform, is now embracing AI agents—a move that could reshape the look and feel of the web. The company announced Friday that it will allow AI agents to draft, edit, and publish content on custom
Anthropic's experimental AI Claude completes negotiations and transactions in e-commerce test
As artificial intelligence advances rapidly, Anthropic quietly rolled out an internal experiment called "Project Deal" last Friday, showcasing AI's potential in e-commerce. The experiment had its AI model Claude autonomously handle buying, selling, a
DeepSeek Code poised for launch
As AI technology accelerates, DeepSeek is at a thrilling juncture. The AI company recently revealed it has secured over 70 billion yuan in funding. Leadership has emphasized a commitment to groundbreaking AI research over immediate commercial gains.
2026 Latest Best AI Expense Trackers: Top-rated tools to scan receipts & categorize corporate spend automatically. Discover powerful, game-changing solutions for effortless expense management, accurate financial tracking, and streamlined compliance. Our curated, weekly-updated comparison of free vs paid options helps you find the perfect fit. Unlock your AI edge with XIX.AI's expert picks.
10 tools
xix.ai
Discover the 2026 latest top-rated AI recruiting tools on XIX.AI. Our curated list features powerful, game-changing solutions for screening resumes and automating candidate interview scheduling. Compare free vs paid options with real-world tests and weekly updated rankings. Find your perfect hiring assistant and streamline your recruitment today!
10 tools
xix.ai
Discover the 2026 best AI personal wellness and focus coaches on XIX.AI. Our curated rankings feature top-rated, game-changing tools to manage burnout and boost mental energy. Compare free vs paid options with real-world insights. Unlock your path to peak productivity and well-being today.
10 tools
xix.ai
Discover the 2026 latest top-rated AI romantic chatbots for building genuine, long-term connections. Our curated list features powerful, consistent personalities, free vs paid comparisons, and real-world tests. Find your perfect companion and start building today at XIX.AI.
10 tools
xix.ai
Discover the 2026 best AI data science mentors to master SQL, Pandas & ML workflows. Explore our top-rated, curated selection at XIX.AI for powerful, game-changing guidance. Compare free vs paid options with real-world insights. Unlock your data science mastery today.
10 tools
xix.ai
Discover the 2026 best AI flirting and conversation trainers on XIX.AI. Our curated, top-rated selection helps you build social charisma and confidence in real-time. Explore must-try, game-changing tools with free vs paid comparisons and weekly updated rankings. Unlock your social edge today.
10 tools
xix.ai
Whoa, Hugging Face diving into self-driving data? That's wild! LeRobot just got a serious upgrade. Wonder if they'll open-source the whole pipeline. 🤖🚗
自動運転データも統合したんですってね、Hugging FaceとYaakの連携、進化が速すぎて追いつけない！ロボット学習用のデータセットが拡充されることで、研究室レベルの技術が身近になってきてる感じがします。個人的には家庭用ロボットが早く安価に提供されてほしいんですけど、セキュリティ面の懸念はどうクリアするんでしょう？🤖🤔 オープンモデルが増えるのはいいけど、学習データの質の問題は常に気になります。
Diese Entwicklung bei LeRobot zeigt, wie schnell sich Robotik und KI verbinden. Ich frage mich, ob solche Open-Source-Projekte langfristig mit Googles Robotik-Initiativen mithalten können. Die Partnerschaft mit Yaak könnte neue Standards setzen - hoffentlich bleiben ethische Fragen dabei nicht auf der Strecke. 🤖
Encore une collaboration qui promet ! HF+Yaak pour améliorer les données de robots autonomes, j'espère que ça ne finira pas comme les voitures qui ne reconnaissent pas les piétons par temps de pluie 😅 C'est cool mais la sécurité d'abord, non ?
哇！這個自駕機器訓練資料庫感覺很實用，好奇它會影響哪些產業？不過HF最近動作頻頻，是不是想跟Google、OpenAI搶機器人市場啊？🤔 台灣有沒有團隊在用這個平台？
This is pretty bold from Poolside's CEO! But honestly, makes total sense - why waste millions training yet another foundation model when 99% of companies just need good applications? 🧠 #TeamPracticalAI
