Profile Picture

Can anyone explain the data format in IC_Python_API:RLPy_RIHandDevice for motion capture?

Posted By delebash 4 Years Ago
You don't have permission to rate!

Can anyone explain the data format in IC_Python_API:RLPy_RIHandDevice...

Author
Message
delebash
delebash
Posted 4 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (1.2K reputation)Distinguished Member (1.2K reputation)Distinguished Member (1.2K reputation)Distinguished Member (1.2K reputation)Distinguished Member (1.2K reputation)Distinguished Member (1.2K reputation)Distinguished Member (1.2K reputation)Distinguished Member (1.2K reputation)Distinguished Member (1.2K reputation)

Group: Forum Members
Last Active: Last Month
Posts: 41, Visits: 448
Looking at the example script https://wiki.reallusion.com/IC_Python_API:RLPy_RIHandDevice I am looking for an explanation of the t_pose_data and frame_data

1) What is the format of the frame_data?
frame_data = [-0.05, 106.89, -3.65, -6.91, 173.25, -1.78, -11.44, -1.88, -0.06, -6.14, 12.7, -9.17]   what do the coordinates mean?   xyz of bone? max min values?

2) What is the format of the t_pose_data?

Thanks
Edited
4 Years Ago by delebash
AllenLee (RL)
AllenLee (RL)
Posted 4 Years Ago
View Quick Profile
Senior Member

Senior Member (343 reputation)Senior Member (343 reputation)Senior Member (343 reputation)Senior Member (343 reputation)Senior Member (343 reputation)Senior Member (343 reputation)Senior Member (343 reputation)Senior Member (343 reputation)Senior Member (343 reputation)

Group: Forum Members
Last Active: Last Year
Posts: 54, Visits: 526
Hi delebash,

1) This means the position and rotation data of each bone, and whether the rotation data is a quaternion or Euler angle depends on the "RotationSetting" in RIHandDevice.

2) This format is the same as frame_data.

Allen Lee
delebash
delebash
Posted 4 Years Ago
View Quick Profile
Distinguished Member

Distinguished Member (1.2K reputation)Distinguished Member (1.2K reputation)Distinguished Member (1.2K reputation)Distinguished Member (1.2K reputation)Distinguished Member (1.2K reputation)Distinguished Member (1.2K reputation)Distinguished Member (1.2K reputation)Distinguished Member (1.2K reputation)Distinguished Member (1.2K reputation)

Group: Forum Members
Last Active: Last Month
Posts: 41, Visits: 448
Thank you.  In the data where does 1 bone begin and end?

Lets take just the righthandthumb1.

1) Where does the thumb data begin and end?

In below example data
2) Which numbers represent the position of each joint of on righthandthumb1

[-0.05, 106.89, -3.65, -6.91, 173.25, -1.78, -11.44, -1.88, -0.06, -6.14, 12.7, -9.17] 

Basically in the above data what does each number represent? The data I have coming in from my hand device is in the below format

{'bone': 'pinky', 'points': [[64.95238595569313, 171.718923274501, -0.0009579360485076904], [59.822598460498455, 151.65957994718073, -20.494264602661133], [63.88668846634125, 149.68754767955303, -32.010066986083984], [68.38916300083876, 154.26528484584694, -36.71549987792969], [70.63849201948001, 158.00665351094867, -36.614227294921875]]}

Each array represents the xyz position of the palm then the xyz position of each joint in a finger .

[64.95238595569313, 171.718923274501, -0.0009579360485076904] = xzy of palm point
t[59.822598460498455, 151.65957994718073, -20.494264602661133] = xyz of 1st joint in the pinky
[63.88668846634125, 149.68754767955303, -32.010066986083984] = xyz of 2nd joint in the pinky
[68.38916300083876, 154.26528484584694, -36.71549987792969] = xyz of 3rd joint in the pinky
[70.63849201948001, 158.00665351094867, -36.614227294921875] = xyz of tip of the pinky

I am trying to figure out how to map this format to your format. If you can look at https://github.com/tensorflow/tfjs-models/tree/master/handpose. The gif shows how the positions are represented on each finger.

Thank you very very much for your help.



Reading This Topic