Problem Statement

Let's learn how a self-driving car can "see" its surroundings using semantic image segmentation.

Introduction

The definition of a self-driving car is a vehicle that drives itself, with little or no human intervention. Its system uses several sensory receptors to perceive the environment. For instance, it identifies the drivable area, weather conditions, obstacles ahead and plans the next move for the vehicle accordingly.

There are different levels of autonomy in such vehicles. Tesla currently implements assisted driving, where the driving is autonomous, but someone is behind the wheel. Waymo (Google’s self-driving car), in contrast, is aiming for complete autonomy under all driving conditions (no driver required). Beyond human transportation, self-driving vehicles can also be utilized as a service for various purposes, e.g., Nuro is building self-driving vehicles for local goods transportation.

📝 Self-driving vehicles are perfect real-world systems for handling multi-sensory inputs that focus primarily on computer vision-based problems (e.g., object classification/ detection/ segmentation), using machine learning.

Now that you have some context, let’s look at the problem statement.

Problem statement

The interviewer has asked you to design a self-driving car system focusing on its perception component (semantic image segmentation in particular). This component will allow the vehicle to perceive its environment and make informed driving decisions. Don’t worry we will describe semantic image segmentation shortly.

Press + to interact
Perform semantic image segmentation on the driving scene
Perform semantic image segmentation on the driving scene

Interviewer’s questions

The interviewer might ask the following questions about this problem, narrowing the scope of the question each time.

...