IndexError with specific videos in demo_face_rec_on_video.py

[Sushiman31]

Hi, thanks a lot for your work on this project!

I’ve been running the demo_face_rec_on_video.py script on several videos, and most of them work just fine. However, for some specific videos, I encounter the following error:

Traceback (most recent call last): File "demo_face_rec_on_video.py", line 179, in main() File "demo_face_rec_on_video.py", line 174, in main reconstruct_video(args) File "demo_face_rec_on_video.py", line 65, in reconstruct_video dm.prepare_data() File "/home/thomas/ENTER/envs/work38/lib/python3.8/site-packages/pytorch_lightning/core/datamodule.py", line 428, in wrapped_fn fn(*args, **kwargs) File "/mnt/c/Users/tbald/Documents/Doctorat/Projet/Learning2Listen/inferno/inferno/datasets/FaceVideoDataModule.py", line 3788, in prepare_data self._gather_data(exist_ok=True) File "/mnt/c/Users/tbald/Documents/Doctorat/Projet/Learning2Listen/inferno/inferno/datasets/FaceVideoDataModule.py", line 3811, in _gather_data self._gather_video_metadata() File "/mnt/c/Users/tbald/Documents/Doctorat/Projet/Learning2Listen/inferno/inferno/datasets/FaceVideoDataModule.py", line 2031, in _gather_video_metadata del self.annotation_list[vi] IndexError: list assignment index out of range

This error happens only with a few specific videos, while most others run without any issue.

I’m attaching one of the problematic videos here for reference, in case it helps you reproduce the bug or identify the root cause.

Do you have any idea what could be causing this issue?
Could it be that annotation_list isn't being populated correctly when certain types of videos are processed?

Thanks in advance for your

1.mp4

[guajiangjun]

I came across the same issue, and I modify here to be allow_later_audio_start=True will just work for me.