|
|
| Line 1: |
Line 1: |
| − | == log ==
| + | source: https://www.youtube.com/watch?v=RhSbNNIMBLg |
| − | | + | |
| − | '''26/11/2017''' - calibration based on successive positions of skeleton >
| + | |
| − | | + | |
| − | * white points: reference, or ground truth
| + | |
| − | * yellow points: points to be calibrated
| + | |
| − | * cyan points not linked together: calibrated points rotated, before translation
| + | |
| − | * cyan points linked: calibrated points after full matrix correction
| + | |
| − | | + | |
| − | there is also a 2d projection of the trajectories on the ground, for better readability.
| + | |
| − | | + | |
| − | <script> {
| + | |
| − | global $wgGallerier;
| + | |
| − | $wgGallerier->addGallery( array( "path" => "20171126_kinect_calibration/", "width" => 200 ) );
| + | |
| − | }</script>
| + | |
| − | | + | |
| − | '''25/11/2017''' - Working on a visualing / calibrating software, called NetworkViewer in the repo. A first attempt of "auto calibration" is not giving too bad results. The orientation are not processed yet, I will work on this tomorrow.
| + | |
| − | | + | |
| − | <html>
| + | |
| − | <iframe src="https://player.vimeo.com/video/244466848?title=0&byline=0&portrait=0" width="640" height="360" frameborder="0" webkitallowfullscreen mozallowfullscreen allowfullscreen></iframe>
| + | |
| − | </html>
| + | |
| − | | + | |
| − | This software is a visualiser of streams. It displays messages processed by the "streamer", the software mapping kinect skeletons on an avatar (see http://vimeo.com/242486050).
| + | |
| − | In this example, 2 kinects are largely overlapping each other. A first attempt to calibrate them, based only on positions, is not giving too bad results.
| + | |
| − | | + | |
| − | | + | |
| − | '''24/11/2017''' - back to my desk! La connection de 2 kinects simultanément est concluant:
| + | |
| − | | + | |
| − | [[File:Kinectstreamer2kinect.png|400px]]
| + | |
| − | | + | |
| − | Le travail sur un soft de calibration des différents points de vue est commencé:
| + | |
| − | | + | |
| − | [[File:Kinectstreamer calibrator.png|400px]]
| + | |
| − | | + | |
| − | | + | |
| − | '''13/11/2017''' - premiers essais de mapping vers divers squelettes - les hanches et le "spine" posent problèmes dans la plupart des modèles...
| + | |
| − | | + | |
| − | <html>
| + | |
| − | <iframe src="https://player.vimeo.com/video/242638856?title=0&byline=0&portrait=0" width="400" height="225" frameborder="0" webkitallowfullscreen mozallowfullscreen allowfullscreen></iframe>
| + | |
| − | </html>
| + | |
| − | | + | |
| − | '''12/11/2017''' - le calcul des orientations relatives à envoyer à blender a été tout aussi fastidieux que le reste, mais moins long. Pour ceux qui aiment la magie noire, il a fallu environ 5 heures de prises de tête pour écrire ces 2 lignes de code.
| + | |
| − | | + | |
| − | if (parent != NUI_SKELETON_POSITION_COUNT) {
| + | |
| − | m = absolute_matrices[i] *
| + | |
| − | absolute_matricesi[parent] *
| + | |
| − | model.delta_matricesi[i];
| + | |
| − | }
| + | |
| − | else {
| + | |
| − | m = absolute_matrices[i] * model.absolute_matricesi[i];
| + | |
| − | }
| + | |
| − | | + | |
| − | Le reste des modifications est de l'ordre de l'optimisation et de la dataviz, comme la grille de 6 squelettes sous le modèle.
| + | |
| − | | + | |
| − | <html>
| + | |
| − | <iframe src="https://player.vimeo.com/video/242486050?title=0&byline=0&portrait=0" width="640" height="360" frameborder="0" webkitallowfullscreen mozallowfullscreen allowfullscreen></iframe>
| + | |
| − | </html>
| + | |
| − | | + | |
| − | '''10/11/2017''' - l'alignement du squelette kinect et de l'armature exportée depuis blender est maintenant automatique, plus besoin de tuner les matrices à la main
| + | |
| − | | + | |
| − | [[File:Kinectstreamer-automatic-skeleton-alignment-cropped.png|400px]]
| + | |
| − | | + | |
| − | '''08/11/2017''' - importation des matrices des os de l'armature blender dans l'application. Les orientations ne sont plus calculées par blender, ce qui posait de gros problèmespour le spin (rotations autour de l'axe alignés avec la direction de l'os).
| + | |
| − | | + | |
| − | [[File:Kinectstreamer-blender-matrices-import.png|400px]]
| + | |
| − | | + | |
| − | '''05/11/2017''' - première réussite: les orientations relatives sont calculées correctement et envoyées à blender via OSC<ref>Open Sound Control, [http://opensoundcontrol.org/ site officiel] et [[wikipedia:Open Sound Control|wikipedia]]</ref>
| + | |
| − | | + | |
| − | <html>
| + | |
| − | <iframe src="https://player.vimeo.com/video/241406587?title=0&byline=0&portrait=0" width="640" height="360" frameborder="0" webkitallowfullscreen mozallowfullscreen allowfullscreen></iframe>
| + | |
| − | </html>
| + | |
| − | | + | |
| − | '''23/10/2017''' - code archeology, re-enabling ofxKinectNui<ref>https://github.com/sadmb/ofxKinectNui</ref>
| + | |
| − | | + | |
| − | [[File:Technology-archeology-kinect.png|400px]]
| + | |
| − | | + | |
| − | == resources ==
| + | |
| − | | + | |
| − | * [https://bitbucket.org/frankiezafe/marionnettes dépôt marionnettes]
| + | |
| − | | + | |
| − | | + | |
| − | <references/>
| + | |
| − | | + | |
| − | [[category:avatar]]
| + | |
| − | [[category:kinect]]
| + | |
| − | [[category:openframeworks.cc]]
| + | |
| − | [[category:math]]
| + | |
| − | [[category:3D]]
| + | |
| − | [[category:tools]]
| + | |
| − | [[category:blender]]
| + | |
