Intermediate
Technical
Specialization
Autonomous Vehicle Sensing Systems
This specialized 3-day course offers a deep dive into the sensing systems that form the eyes and ears of an autonomous vehicle. Participants will explore the physics, operation, and data processing techniques for key sensors like LiDAR, RADAR, and cameras. The course focuses on practical application, including sensor calibration, data synchronization, and the development of basic perception algorithms.
Course Curriculum
- Physics of Light and Radio Waves for Sensing
- Deep Dive: LiDAR Technology and Point Cloud Processing
- Deep Dive: RADAR Signal Processing and Object Detection
- Deep Dive: Camera Models, Calibration, and Computer Vision
- Sensor Fusion Architectures (Early vs. Late Fusion)
- Practical Lab: Sensor Calibration with ROS
- Project: Building a Multi-Sensor Object Detector
Course Information
Learning Outcomes
- Compare and contrast the strengths and weaknesses of different AV sensors.
- Perform intrinsic and extrinsic sensor calibration.
- Process and visualize data from LiDAR, RADAR, and camera sensors.
- Implement basic object detection and tracking algorithms.
- Understand the challenges of sensor fusion and how to overcome them.
Target Audience
Engineers and developers with some programming experience who wish to specialize in AV perception systems.
Prerequisites
Basic programming knowledge (Python or C++) and familiarity with linear algebra concepts are recommended. Completion of the 'AV Awareness Course' or equivalent knowledge is advised.