↓ Skip to main content
sis-arxiv-vad-papers

Jialong Zuo

2023

Holmes-VAU: Towards Long-term Video Anomaly Understanding at Any Granularity

·11025 words·52 mins
Huaxin Zhang ,  Xiaohao Xu ,  Xiang Wang ,  Jialong Zuo ,  Xiaonan Huang ,  Changxin Gao ,  Li Yu ,  Shanjun Zhang ,  Nong Sang
Ucf-Crime Other Hybrid Other
A semi-automated hierarchical video annotation framework combined with a novel Anomaly-focused Temporal Sampler and a multimodal large language model, aimed at comprehensive understanding of complex and long-term video anomalies across multiple temporal scales.

Holmes-VAD: Towards Unbiased and Explainable Video Anomaly Detection via Multi-modal LLM

·8242 words·39 mins
Huaxin Zhang ,  Xiaohao Xu ,  Xiang Wang ,  Jialong Zuo ,  Chuchu Han ,  Xiaonan Huang ,  Changxin Gao ,  Yuehuan Wang ,  Nong Sang
Shanghaitech Ucf-Crime Xd-Violence Hybrid Method
A novel framework leveraging multimodal instructions and large-scale datasets to enable unbiased, interpretable, and accurate video anomaly detection with large language models, including a new dataset VAD-Instruct50k with single-frame annotations and explanatory instruction data.