Abstract
Inspired by human vision, we propose a new periphery-fovea multi-resolution driving model that predicts vehicle speed from dash camera videos. The peripheral vision module of the model processes the full video frames in low resolution with large receptive fields. Its foveal vision module selects sub-regions and uses high-resolution input from those regions to improve its driving performance. We train the fovea selection module with supervision from driver gaze. We show that adding high-resolution input from predicted human driver gaze locations significantly improves the driving accuracy of the model. Our periphery-fovea multi-resolution model outperforms a uni-resolution periphery-only model that has the same amount of floating-point operations. More importantly, we demonstrate that our driving model achieves a significantly higher performance gain in pedestrian-involved critical situations than in other non-critical situations. Our code is publicly available at https://github.com/pascalxia/periphery-fovea-driving.
Original language | English |
---|---|
Title of host publication | Proceedings - 2020 IEEE Winter Conference on Applications of Computer Vision, WACV 2020 |
Publisher | Institute of Electrical and Electronics Engineers Inc. |
Pages | 1756-1764 |
Number of pages | 9 |
ISBN (Electronic) | 9781728165530 |
DOIs | |
Publication status | Published - 2020 Mar |
Externally published | Yes |
Event | 2020 IEEE/CVF Winter Conference on Applications of Computer Vision, WACV 2020 - Snowmass Village, United States Duration: 2020 Mar 1 → 2020 Mar 5 |
Publication series
Name | Proceedings - 2020 IEEE Winter Conference on Applications of Computer Vision, WACV 2020 |
---|
Conference
Conference | 2020 IEEE/CVF Winter Conference on Applications of Computer Vision, WACV 2020 |
---|---|
Country/Territory | United States |
City | Snowmass Village |
Period | 20/3/1 → 20/3/5 |
Bibliographical note
Publisher Copyright:© 2020 IEEE.
ASJC Scopus subject areas
- Computer Science Applications
- Computer Vision and Pattern Recognition