Internship/ Thesis - Synthetic Data Generation for In-Cabin Sensing

This challenge awaits you:

IAV Fahrzeugsicherheit GmbH & Co. KG is a competent and reliable partner for the automotive industry in the field of vehicle safety. To protect occupants in future vehicles in the event of accidents, vehicle safety must already have answers to tomorrow's questions today. New vehicles are equipped with an interior camera for monitoring vehicle occupants. This also enables the integration of additional functions such as seat assignment or seat belt detection for vehicle occupants using image processing methods, etc. Synthetic data plays an important role in training and testing these camera functions.

The aim of this thesis is to create a realistic virtual twin of vehicle interiors, encompassing vehicle occupants in various body positions and objects like child seats and bags, using game engines. This virtual twin will incorporate ground truth values such as the 3D position of each pixel, segmentation masks for vehicle occupants, seat belts, seats, and more. The focus will be on the generation of synthetic data, which can be leveraged for training deep learning models or testing existing models.

The topic includes a three-month internship, followed by a six-month contract to complete the thesis.

Your Tasks:

• You are developing a concept for the virtual modelling of vehicle interiors and occupants using game engines (Unreal Engine 5).
• You create realistic scenarios of virtual occupants, such as a hand on the steering wheel, different seatbelt paths, a phone/object in hand, and feet on the dashboard.
• You generate ground truth values through the engine.
• You implement an API to automatically create synthetic images of in-cabin scenes with ground truth values for future automated testing of in-cabin functions or for training in-cabin deep learning models. The emphasis is up to you and will be defined during your internship.

Necessary Skills:

• Ongoing studies in the field of Computer Science, Technical Computer Science, Electrical Engineering, or comparable courses of study
• Experience with game engines such as Blender or Unreal is mandatory
• Programming skills
• Communication and teamwork abilities, as well as initiative and reliability
• Good German or English language skills (at least B2 level)

Desired Skills:

• Experience in Gitlab