A good few years ago I started to experiment with body tracking and how it could be used to add another element to my martial art training in Choi Kwang Do. The aim being that if you capture 3D data points of a movement you can recreate that move digitally from any angle and at any speed. Video may be simpler and more immediate but you need multiple cameras, matrix bullet time style, to see moves from every angle. Using the old Microsoft Kinect controller then the newer version 2 (2012 and 2014 even longer ago than I thought 🙂 ). A digital capture with human biomechanical context applied to it could also be scaled up or down to compare different body types and sizes too. A digital mirror could help overlay the optimum moves over the live performed moves and so on. The possibilities are quite vast. What was not quite working though was dealing with the speed of movement using camera technology at the time. Also the kinect rig for people lacked some points such as shoulders, and could get confused by body rotation too. It was a good bit of kit but was more for front facing. Two kinexts would solve some of that but it started to get complex.
The interesting news that just appeared from another martial art is in this video from World Taekwando using body sensors attached to students to control virtual characters for distanced sparring.
Using sensors from startup Refract they federation has officially created this technology showing a great deal of technical know how. It looks as if the sensors are measuring the knee and elbow joints for position and relative position to power the avatar. I am not sure how precise it is as a teaching aid but I would love to try it out and see how it works with my martial art.
Enjoyed checking out this post and seeing how far along the experience has come with Refract. I could imagine the same kind of training/learning applications applied with wearable mocap points. The digital mirror could be a TV or a phone/tablet that allows you to match your body positioning to the remote instructor. Further, the remote instructor could get instant feedback on the students to see how many of them are matching within tolerance to the martial arts, yoga, golf or whatever moves are being taught. Very cool!!