J.A.W. pose estimation and joint angle calculator

The API uses a computer vision model to estimate human pose and returns a list of 31 detected points, 3 projected points and 16 angles formed by different joints on the body.

Input

The API takes an URL or dataURI to an image, and optionally, the plane in with the person in the image appears.

Example:

{
    "url": "[url-to-image/dataURI from image]",
    "plane": "coronal"
}

The posible values of plane are as follows:

• coronal: For front or back analysis. Default value.
• right sagittal: Or right. For Right side analysis.
• left sagittal: Or left. For Left side analysis.

The response has the following structure:

{
    "success": true,
    "angles": [
        {
            "name": "Left Elbow-Shoulder-Hip",
            "angle": 30.2049,
        }
        ...
    ],
    "landmarks": [
        {
            "point": "nose",
            "type": "detected",
            "visibility": 0.9996007084846497,
            "x": 0.4148496687412262,
            "y": 0.0948917344212532,
            "z": -0.2626589834690094
        }
        ...
    ],
}

Response description

Angles:

• name: Name of the angle formed by three joints. The central one represents the vertex angle.
• angle: Value of the angle in degrees formed by the three joints.

Landmarks:

• point: Name of the point
• type: Indicates if the points is detected by the model or projected based on other points
• visibility: Visibility of the point in the image. Ranges from 0 to 1.
• x: X coordinate.
• y: Y coordinate.
• z: Estimation of the Z coordinate.

Points detected by the model

• Nose
• Eyes(inner, center and outer parts)
• Ears
• Mouth (left and right corners)
• Shoulders
• Elbows
• Wrists
• Pinkie fingers
• Index fingers
• Thumbs
• Hips
• Knees
• Ankles
• Heels
• Foot Index fingers

Points projected based on other points

• Center of head (Depends of plane)
• Center of shoulders
• Center of hips

Angles calculated by the API

• Elbow-Shoulder-Hip
• Wrist-Elbow-Shoulder
• Index-Wrist-Elbow
• Left Knee-Left Hip-Right Hip
• Right Knee-Right Hip-Left Hip
• Ankle-Knee-Hip
• Heel-Ankle-Knee
• Head (projected)-Shoulders center(projected)-Left Shoulder
• Head (projected)-Shoulders center(projected)-Right Shoulder
• Shoulders center(projected)-Hips center(projected)-Left Hip
• Shoulders center(projected)-Hips center(projected)-Right Hip

Drawing and image scale utilities

The API can be complemented by a JavaScript library that allows to draw the output over an HTML canvas.

Examples of how to consume the API from a web and how to use the utilities can be found here:

JAW-mk-utils