UPM Institutional Repository

Ear-CCPM-Net: a cross-modal collaborative perception network for early accident risk prediction


Citation

Sun, Wei and Abdullah, Lili Nurliyana and Khalid, Fatimah and Sulaiman, Puteri Suhaiza (2025) Ear-CCPM-Net: a cross-modal collaborative perception network for early accident risk prediction. Applied Sciences, 15 (17). art. no. 9299. pp. 1-26. ISSN 2076-3417

Abstract

Early traffic accident risk prediction in complex road environments poses significant challenges due to the heterogeneous nature and incomplete semantic alignment of multimodal data. To address this, we propose a novel Early Accident Risk Cross-modal Collaborative Perception Mechanism Network (EAR-CCPM-Net) that integrates hierarchical fusion modules and cross-modal attention mechanisms to enable semantic interaction between visual, motion, and textual modalities. The model is trained and evaluated on the newly constructed CAP-DATA dataset, incorporating advanced preprocessing techniques such as bilateral filtering and a rigorous MINI-Train-Test sampling protocol. Experimental results show that EAR-CCPM-Net achieves an AUC of 0.853, AP of 0.758, and improves the Time-to-Accident (TTA0.5) from 3.927 s to 4.225 s, significantly outperforming baseline methods. These findings demonstrate that EAR-CCPM-Net effectively enhances early-stage semantic perception and prediction accuracy, providing an interpretable solution for real-world traffic risk anticipation.


Download File

[img] Text
121780.pdf - Published Version
Available under License Creative Commons Attribution.

Download (3MB)
Official URL or Download Paper: https://www.mdpi.com/2076-3417/15/17/9299

Additional Metadata

Item Type: Article
Divisions: Faculty of Computer Science and Information Technology
DOI Number: https://doi.org/10.3390/app15179299
Publisher: Multidisciplinary Digital Publishing Institute
Keywords: Early risk perception; Multimodal fusion; Semantic interaction; Traffic accident prediction
Depositing User: Ms. Nur Faseha Mohd Kadim
Date Deposited: 18 Nov 2025 04:03
Last Modified: 18 Nov 2025 04:03
Altmetrics: http://www.altmetric.com/details.php?domain=psasir.upm.edu.my&doi=10.3390/app15179299
URI: http://psasir.upm.edu.my/id/eprint/121780
Statistic Details: View Download Statistic

Actions (login required)

View Item View Item