Can anyone explain the data format in IC_Python_API:RLPy_RIHandDevice for motion capture?


https://forum.reallusion.com/Topic454121.aspx
Print Topic | Close Window

By delebash - 6 Years Ago
Looking at the example script https://wiki.reallusion.com/IC_Python_API:RLPy_RIHandDevice I am looking for an explanation of the t_pose_data and frame_data

1) What is the format of the frame_data?
frame_data = [-0.05, 106.89, -3.65, -6.91, 173.25, -1.78, -11.44, -1.88, -0.06, -6.14, 12.7, -9.17]   what do the coordinates mean?   xyz of bone? max min values?

2) What is the format of the t_pose_data?

Thanks
By AllenLee (RL) - 6 Years Ago
Hi delebash,

1) This means the position and rotation data of each bone, and whether the rotation data is a quaternion or Euler angle depends on the "RotationSetting" in RIHandDevice.

2) This format is the same as frame_data.

Allen Lee
By delebash - 6 Years Ago
Thank you.  In the data where does 1 bone begin and end?

Lets take just the righthandthumb1.

1) Where does the thumb data begin and end?

In below example data
2) Which numbers represent the position of each joint of on righthandthumb1

[-0.05, 106.89, -3.65, -6.91, 173.25, -1.78, -11.44, -1.88, -0.06, -6.14, 12.7, -9.17] 

Basically in the above data what does each number represent? The data I have coming in from my hand device is in the below format

{'bone': 'pinky', 'points': [[64.95238595569313, 171.718923274501, -0.0009579360485076904], [59.822598460498455, 151.65957994718073, -20.494264602661133], [63.88668846634125, 149.68754767955303, -32.010066986083984], [68.38916300083876, 154.26528484584694, -36.71549987792969], [70.63849201948001, 158.00665351094867, -36.614227294921875]]}

Each array represents the xyz position of the palm then the xyz position of each joint in a finger .

[64.95238595569313, 171.718923274501, -0.0009579360485076904] = xzy of palm point
t[59.822598460498455, 151.65957994718073, -20.494264602661133] = xyz of 1st joint in the pinky
[63.88668846634125, 149.68754767955303, -32.010066986083984] = xyz of 2nd joint in the pinky
[68.38916300083876, 154.26528484584694, -36.71549987792969] = xyz of 3rd joint in the pinky
[70.63849201948001, 158.00665351094867, -36.614227294921875] = xyz of tip of the pinky

I am trying to figure out how to map this format to your format. If you can look at https://github.com/tensorflow/tfjs-models/tree/master/handpose. The gif shows how the positions are represented on each finger.

Thank you very very much for your help.