Synthetic Data for Perception in Autonomous Driving

Synthetic Data for Perception in Autonomous Driving

A broad variety of real-world scenarios require autonomous navigation systems to rely on machine learning-based perception algorithms. Such algorithms are knowingly data-dependent, yet data acquisition and labeling is a costly and tedious process. It is associated with manual labor, must handle rare "long tail" corner case events, and could be hard constrained by ethical aspects e.g. in case of near-accident scenarios.

One of the common alternatives to real data acquisition and annotation is represented by simulation and synthetic data. Simulation has a long history in driver assistance systems, but with the renaissance of neural networks the research community strengthened efforts in this direction and many synthetic datasets and simulation systems appeared.

Image synthesis driven by computer graphics achieved recently a remarkable realism. Yet synthetic image data generated in such a way reveals a significant domain gap with respect to real-world data. This is especially true in autonomous driving scenarios, representing a critical aspect to overcome to utilize synthetic data for the training of neural networks.

In this presentation, we discuss recent progress in the area of synthetic data for perception in autonomous driving, challenges associated with it, and methods to overcome the hurdles.

Talk is based on the speaker's papers:

Content Disentanglement for Semantically Consistent Synthetic-to-Real Domain Adaptation (IEEE IROS'21)
https://arxiv.org/abs/2105.08704

Unsupervised Traffic Scene Generation with Synthetic 3D Scene Graphs (IROS 2021)
Links will be added during August

Presenter BIO:
Artem Savkin studied Mathematics in Kaliningrad, Russia. He is currently a researcher at BMW and PhD candidate at TUM supervised by Federico Tombari. Artem's research focuses on sim2real domain adaptation for images and point clouds.
-------------------------
Find us at:

Newsletter for updates about more events ➜ http://eepurl.com/gJ1t-D
Sub-reddit for discussions ➜ https://www.reddit.com/r/2D3DAI/
Discord server for, well, discord ➜ https://discord.gg/MZuWSjF
Blog ➜ https://2d3d.ai

AI consultancy Abelians ➜ https://abelians.com/

machine learningneural networksdeep learning

Post a Comment

0 Comments