How to create kps.pkl and pose_shape.pkl

[sondv2]

How do you generate this file ?

Thanks

[darkAlert]

pose_shape.pkl is a SMPL-model
You can get it using HMR/VIBE

[AmberCheng]

pose_shape.pkl is a SMPL-model
You can get it using HMR/VIBE

hi, I wonder have you ever tried VIBE. I am confused when I use the VIBE result, then I generate images with the source person rotating up and down. I wonder do you have any idea about it.

[piaozhx]

@AmberCheng Hi, could you provide some examples about this problem (VIBE data or synthesis results)?

[AmberCheng]

@AmberCheng Hi, could you provide some examples about this problem (VIBE data or synthesis results)?

I just use the demo result of VIBE which I have attached. I just use the inference_from_smpl function. I am not sure is there any problem with my usage.
One more, I tried to replace one more parameter verts, the result is without spinning, but it is not good that some frames don't contain the whole body.

I find that the video I generated trembled, is there could be any improvement with the HMR network(maybe it doesn't detect the human mesh precisely enough)?

Looking for your reply~

vibe_output.pkl.zip

[piaozhx]

@AmberCheng Hi, I try to open this pkl file but it seems to be broken

ValueError: unregistered extension code 30855

and as your description, you have tried HMR and VIBE to extract SMPL parameters, and HMR results were not good but the synthesis result is "normal", but parameters from VIBE had wrong rotation(rotating up and down).

actually I have nerver used VIBE so I do not know whether the definition between HMR and VIBE are same or not, but I think they can transfer to each other

[AmberCheng]

@AmberCheng Hi, I try to open this pkl file but it seems to be broken

ValueError: unregistered extension code 30855

and as your description, you have tried HMR and VIBE to extract SMPL parameters, and HMR results were not good but the synthesis result is "normal", but parameters from VIBE had wrong rotation(rotating up and down).

actually I have never used VIBE so I do not know whether the definition between HMR and VIBE are same or not, but I think they can transfer to each other

@piaozhx Thanks for your replay. Actually, I have solved this problem recently. HMR and VIBE are using different render methods. VIBE uses 4 dimension params for the original camera params which different from the HMR. So when I only use the VIBE pose parameters, it works but as the difference between camera parameters, it seems like the person suddenly far suddenly near. I think there may be something that needs to do with the camera parameters.