⬅️ Back
Interactive Mode

Driver Behavior Modeling and Use of Automation

Tags

Scope:

Behavior Modeling

Keywords:

Context-aware Modeling Explainable AI Lane Change Prediction Forward Collision Warning Multi-modal Fusion Attention Mechanisms Naturalistic Driving Study
📋

Project Overview

Comprehensive research program at MIT AgeLab developing context-aware driver behavior models using explainable AI methods. The core approach focuses on understanding triads of vehicle-driver-environment interactions in partial automation scenarios.

  • Context-aware modeling framework integrating vehicle dynamics, driver state, and environmental factors
  • Multi-modal naturalistic driving data analysis using cameras, CAN bus, GPS, and IMU sensors
  • Explainable AI methods for understanding human-automation interaction patterns
  • Multiple research directions covering lane changes, collision warnings, transfer of control, and pedestrian interactions
🔬

Methodology

Employs naturalistic driving data from MIT-AVT dataset combined with advanced machine learning methods to understand context-dependent driver behavior in automated driving scenarios.

  • Naturalistic driving data collection: multi-perspective cameras (in-cabin face/body, forward view), CAN bus, GPS, IMU
  • Context-aware modeling: triads of vehicle-driver-environment interactions with XAI explainability
  • Multiple AI approaches: CNN-RNN with attention mechanisms, Graph Neural Networks (GNN), Large Language Models (LLM)
  • Cross-scenario analysis: highway vs local roads, different automation levels, various traffic conditions
Flowchart for lane change prediction

Flowchart for lane change prediction

Results & Impact

Comprehensive insights into driver behavior patterns across multiple automation scenarios, with published and ongoing research demonstrating improved understanding of human-automation interaction.

  • Lane Change Prediction: 87% F1-score using multi-modal spatio-temporal attention networks
  • Forward Collision Warning Analysis: Context-dependent effectiveness across road types and traffic scenarios
  • Ongoing: GNN+XAI models for FCW effectiveness and Transfer of Control (TOC) modeling
  • Ongoing: LLM-based driver-pedestrian interaction modeling in automated driving scenarios
  • Ongoing: Electric vehicle usage patterns and large vehicle encounters during lateral assistance
🔗

Related Resources

External Links:

🔗 MIT Advanced Vehicle Technology Consortium

Publications:

End-to-End Spatio-Temporal Attention-Based Lane-Change Intention Prediction from Multi-Perspective Cameras

Driver Behavior in Response to Forward Collision Warnings Considering Driving Context