Thank you! End-to-end is a real challenge, but companies are working on it. You mentioned that the vehicle never knows where it is or where you want it to go. But both of those can be inputs to the neural network! Or at least GPS sensor data, lidar data, map data, and your destination address can all be inputs to the end-to-end network. Then the network has to figure out what to do next, based on that input!

I love self-driving cars and I work on them at Voyage! https://voyage.auto

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store