Andrej Karpathy (Tesla): CVPR 2021 (see description for better quality version)
Why Hacker News recommends it
HN cites it as the primary source for Tesla's vision-only reasoning, LIDAR arguments and sensor fusion challenges.
What it is
Andrej Karpathy's CVPR 2021 presentation on Tesla's Autopilot, covering its vision-based approach, sensor choices and the scale of Tesla's deep learning compute cluster. This upload is a lower-quality copy of the talk.
Recommended by 1 HN commenters across 1 different months, 2021 to 2022.
What Hacker News said
Recommends caf · 2022-02 · on “Tesla to recall vehicles that may disobey stop signs”
I would really like to hear Tesla to defend their decision to not use them. Andrej Karpathy talks some about it in this (it's quite long, but the whole thing is quite interesting): [this video]
Cites yellow_lead · 2021-06 · on “A from-scratch tour of Bitcoin in Python”
For others: Andrej Karpathy is the director of artificial intelligence and Autopilot Vision at Tesla. Was on front page yesterday for a presentation on Tesla's Autopilot / Autonomous features: [this video]
Cites brutus1213 · 2021-07 · on “OpenAI disbands its robotics research team”
First off, amazing farm-bot project! I am looking forward to reading the details on your site. Thx for the pointers on Tesla. Had not seen the Hydranet stuff. There was a Karpathy talk about 2 weeks back at a CVPR workshop .. he revealed the scale of Tesla's current generation deep learning cluster [1]. It is insane! Despite being in industrial research, I don't foresee ever being able to touch a cluster like that. A lot of our current research involves end-to-end training (some complex stuff with transformers and other networks stitched together). There was a CVPR tutorial on autonomous driving [2], where they pretty much said autonomy 2.0 is all about end-to-end. I've spoken to a few peopl
Cites adolph · 2021-07 · on “Tesla auto-pilot keeps confusing moon with traffic light then slowing down”
[this video] In the above video Andrej Karpathy claims that LIDAR required previously compiled maps, the creation of which is not scalable. Do you disagree with that point of view?
Cites TaylorAlexander · 2022-03 · on “A 2030 Self-Driving Car Bet”
Stereo vision is oversold in humans. You can easily drive with one eye. We use a lot of information to estimate depth including relative size of things, as well as “structure from motion” which is the relative movement of things over time. Tesla does estimate depth using structure from motion (and probably other cues). They call it virtual LIDAR in presentations. [this video]
Cites agoose77 · 2022-07 · on “Andrej Karpathy leaves Tesla”
IIRC there was a presentation from Karpathy talking about the challenges with sensor fusion, particular in resolving divergence between e.g. the vision and the radar stack: [this video] My background is in physics, but I find myself having a growing appreciate for the vision-only stack. It's really challenging building a formal understanding of the world that is robust to outliers that are so numerous as navigating in an urban environment. With vision, you have multiple kinds of information that are highly correlated (colour, spatial distribution, depth, etc) that are self-consistent. Whereas, fusing radar with vision, where object responses to radar are highly geometry & material dependent, is a