Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Question about the video emotion recognition #16

Open
jby1993 opened this issue Mar 29, 2024 · 1 comment
Open

Question about the video emotion recognition #16

jby1993 opened this issue Mar 29, 2024 · 1 comment

Comments

@jby1993
Copy link

jby1993 commented Mar 29, 2024

Hi, thanks for releasing the code! I want to use the video emotion recognition network, and I found a question in its used module TransformerEncoder. It seems that the newly computed encoded_feature have overwritten the encoded_feature previously calculated using the alibi mask. This does not correspond to the description in the paper.

I also wanted to ask, how long do you usually set the sequence length T when using it?

@radekd91
Copy link
Owner

Can you be a bit more specific with your question? What lines of code are you referring to?

Thanks to alibi, the transformer should be fairly robust to varying T. In training we set T=150 (i.e up to 6s). Most MEAD videos are shorter than that, though.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants