Skip to content

Sim2Real Training

Jim Liefer
By Jim Liefer CEO, Ambi Robotics
ambi_768x432.jpg

The simple act of picking up a cup of coffee or a bag of chips is something we do without much thought. Our brains process a multitude of information in the background, analyzing an object’s shape, weight, friction and its known position, allowing us to easily grasp it. While this may seem like a trivial task for humans, teaching a robot to do the same is remarkably challenging.

In the world of logistics and supply chain automation, training robots to efficiently perform such tasks is a critical goal. The advent of deep-learning-based artificial intelligence (AI) has revolutionized everything from image and speech recognition to mastering chess and other complex games. However, when it comes to teaching robots to pick and place objects, there is one major obstacle—data.

The Challenge: Training Takes Time

The key to training robots effectively lies in vast amounts of data. In the past, a deep convolutional neural net was successfully trained using more than a million images to recognize 1,000 object categories. However, this data-intensive approach has its limitations.

Self-labeling training data with reinforcement learning can be time consuming, often requiring thousands of real-world hours for a robot to master a simple pick.

In the realm of research, this approach might be acceptable, but it becomes impractical when deploying robots in real-world production environments. Customers cannot wait thousands of hours for a robot to become functional; they need it to work seamlessly from the start.

The Solution: Virtual Training That’s Reality Ready

This is where “simulation-to-reality” (Sim2Real) training comes into play. By simulating real-world interactions in a virtual environment, we can drastically reduce the time it takes to train a robot effectively. Before deployment, the warehouse sorting environment is meticulously reconstructed within a computer simulation, ensuring a reasonable degree of physical accuracy.

The dynamic part of the simulation lies in the objects themselves, as a diverse range of items are modeled and tested to mimic real-world conditions.

In a Sim2Real environment, an AI robotic system is immersed in a vast simulation library that exposes it to a wide variety of items, randomization and challenges. By experiencing a range of scenarios in the virtual world, the robots become adept at handling physical-world complexities with ease. This includes dealing with deformable, fluid-shaped items such as poly bags, as well as accounting for geometric considerations and camera “noise” issues that can prove problematic in actual warehouse settings.

By closing the Sim2Real gap, robots perform seamlessly in both research and production environments. Consequently, on day one of deployment, they are fully capable of efficiently handling a multitude of tasks, elevating working conditions and empowering human workers to focus on higher-level responsibilities.

Sim2Real training is revolutionizing the field of robotics, particularly in logistics and supply chain automation. By harnessing the power of virtual simulations and data-driven learning, the gap between the virtual and actual world lessens, allowing robots to navigate challenges with unprecedented adeptness and accuracy.

As this technology continues to be refined, we get closer to realizing the full potential of robotics to optimize warehouse management.

  • View All Articles
  • Connect With Us
    TwitterFacebookLinkedInYouTube

Always Stay Informed

Receive the latest manufacturing news and technical information by subscribing to our monthly and quarterly magazines, weekly and monthly eNewsletters, and podcast channel.