Self driving cars are an exciting area of research for all data enthusiasts at this time. Getting a machine to process the richness of the real world and make ethical decisions. A major part of this is using camera images to extract information from the world. This talk is focused on allowing cars to perceive the world the way humans would. The aim here is to discuss the state of the art.