Search the Community

Hello everyone!I plan to use the Kinect v2 (that for xboxOne) to move an avatar in my scene.My idea was to gain the quaternions of jointOrientations and then change the appropriate bone matrix. Nevertheless, the jointOrientations are expressed in global rotations (each jointOrientation indicates the direction of the joint in absolute coordinates) while, if I understand it, I can only modify the local matrix of skeleton bone. So I am trying to convert local jointOrientation in local rotation:var joint; //the joint of kinectvar parent = joint.Parent();var localOrientation = BABYLON.Quaternion.Inverse(parent.Orientation).Multiply(joint.Orientation);But I'm having trouble in the transformation of the reference coordinate between kinect joints and avatar bones int the babylon scene... I tried to change the axes by swapping values (x, y, z), but I'm probably wrong var kinectOrientation; //orientation of the joint expressed in quaternionreturn new BABYLON.Quaternion(kinectOrientation.y, kinectOrientation.x, kinectOrientation.z, kinectOrientation.w); //this is just one example, I have tried in different casesDo you have any advice? Thanks in advance

Hello everyone! I'm working on a BabylonJS project and having problems with the movement of the 3D-model. I have used tens of hours to find a solution with poor results. The projects goal is to get 3D-model/avatar move according to the movement data from Kinect-sensor. I'm using a C#-server to send Kinect data through WebSocket to JS and BabylonJS for visualization. The problem what I'm having is that I don't know how to correctly move the model. BJS documentation seems to focus only to ready-made animations and not to the manual deforming of meshes with skeletons. I've moved and deformed the skeleton in BJS, but cannot get the meshes to move with the skeleton. Everything works fine in Blender (moving the skeleton deforms the mesh), but not in BJS. I've also tried to make custom animations for the skeleton in BJS to animate the model frame by frame with the data, but it's so complex I'm having a hard time understanding it (with no proper tutorial). What is the correct way to manually deform models with skeletons in BabylonJS? If the right way is to make custom animations can you help me understand how to build an animation for a skeleton in BJS? (I'm familiar with the BJS tutorials and documentations for animating meshes with no skeletons). My previous post about the problem Here is a bit creepy custom animation I'm working on. (How to delete the ready-made animation?) Here is one debug-model I'm using. How to make skeleton animation from scratch if your model doesn't have one? Thank you for your help. Mazax