Une pin-up pour vendre le tuto !

Ce sujet est très actuel, un concours a eu lieu en 2019. Nous allons essayer de trouver, construire un projet qui détecterait un squelette, envoie les datas en OSC, les visualisent dans Blender.

• List of datasets for machine-learning research @ wikipedia.org

• Common Object in Context. COCO is a large-scale object detection, segmentation, and captioning dataset.
• COCO 2019 Keypoint Detection Task Le concours de détection de squelette

• human-pose du Max Plant Institut

• MPII Human Pose dataset is a state of the art benchmark for evaluation of articulated human pose estimation

• Image_Pose.py @ github.com/kunjshah2511

Les points sont les articulations. Les os sont définis par des couples de points. Facile

if MODE is "COCO":
    nPoints = 18
    POSE_PAIRS = [[1, 0], [1, 2], [1, 5], [2, 3], [3, 4], [5, 6], [6, 7], [1, 8], [8, 9], [9, 10], [1, 11],
                  [11, 12], [12, 13], [0, 14], [0, 15], [14, 16], [15, 17]]
 
elif MODE is "MPI":
    nPoints = 15
    POSE_PAIRS = [[0, 1], [1, 2], [2, 3], [3, 4], [1, 5], [5, 6], [6, 7], [1, 14], [14, 8], [8, 9], [9, 10],
                  [14, 11], [11, 12], [12, 13]]

Cubemos utilise le MODE COCO.

• Human Pose Estimation using OpenCV in Deep Learning @ medium.com/analytics-vidhya
• https://learnopencv.com/deep-learning-based-human-pose-estimation-using-opencv-cpp-python/|]] @ learnopencv.com et le github.com/spmallick

• openpose de CMU Perceptual Computing Lab @GitHub: Real-time multi-person keypoint detection library for body, face, hands, and foot estimation with only one camera. Whole-body (Body, Foot, Face, and Hands) 2D Pose Estimation and Whole-body 3D Pose Reconstruction and Estimation. Projet complet, riche, bien documenté.

• http://openptrack.org/overview-3d-skeleton-tracking-pose-recognition-with-opt/ A voir pour Pose Recognition

• https://support.troikatronix.com/support/solutions/articles/13000069937-skeleton-tracking-in-isadora-3-with-openni-tracker
• https://www.intelrealsense.com/openni2-for-intel-realsense-sdk/
• https://www.intelrealsense.com/developers/

• What is ROS? The Robot Operating System (ROS) is a set of software libraries and tools that help you build robot applications. From drivers to state-of-the-art algorithms, and with powerful developer tools, ROS has what you need for your next robotics project. And it's all open source.
• A ROS Wrapper for the OpenNI2 and NiTE2 Skeleton Tracker
• wiki.ros.org/openni_tracker

• Installation du RealSense2 OpenNI2 driver. Télécharger OpenNI2 SDK, puis sudo ./intall.sh dans le dossier
• Installation des libs Intel Realsense
• API python de librealsense pour les capteurs Intel. Donne le code pour récupérer les images des capteurs RealSense, en python avec openCV.
• intelrealsense.com/openni2-for-intel-realsense-sdk
• OpenNI_Programmers_Guide.pdf

• Nuitrack™ is a 3D tracking middleware developed by 3DiVi Inc. This is a solution for skeleton tracking and gesture recognition that enables capabilities of Natural User Interface (NUI) on Android, Windows, and Linux.

• Skeleton Tracking de Cubemos Logiciel propriétaire