Face API

Detect human faces and compare similar ones
Organize images into groups based on similarity
Identify previously tagged people in images

Face verification

Check the likelihood that two faces belong to the same person. The API will return a confidence score about how likely it is that the two faces belong to one person.

See it in action

By uploading data for this demo, you agree that Microsoft may store it and use it to improve Microsoft services, including this API. To help protect your privacy, we take steps to de-identify your data and keep it secure. We won’t publish your data or let other people use it.

Want to build this?

Documentation

Face detection

Detect one or more human faces in an image and get back face rectangles for where in the image the faces are, along with face attributes which contain machine learning-based predictions of facial features. The face attribute features available are: Age, Emotion, Gender, Pose, Smile, and Facial Hair along with 27 landmarks for each face in the image.

See it in action

Gender	female
Age	23.8
Glasses	ReadingGlasses
Smile	0.826
Anger	0.103
Contempt	0.003
Disgust	0.038
Fear	0.003
Happiness	0.826
Neutral	0.006
Sadness	0.001
Surprise	0.02

Browse

Detection result:
JSON:
 [
  {
    "FaceId": "0f48f46c-43f3-47c4-a485-378facd0358a",
    "FaceRectangle": {
      "Top": 124,
      "Left": 459,
      "Width": 227,
      "Height": 227
    },
    "FaceAttributes": {
      "Hair": {
        "Bald": 0.01,
        "Invisible": false,
        "HairColor": [
          {
            "Color": "brown",
            "Confidence": 1.0
          },
          {
            "Color": "blond",
            "Confidence": 0.69
          },
          {
            "Color": "black",
            "Confidence": 0.45
          },
          {
            "Color": "other",
            "Confidence": 0.32
          },
          {
            "Color": "gray",
            "Confidence": 0.06
          },
          {
            "Color": "red",
            "Confidence": 0.04
          }
        ]
      },
      "Smile": 0.826,
      "HeadPose": {
        "Pitch": 0.0,
        "Roll": -16.9,
        "Yaw": 21.3
      },
      "Gender": "female",
      "Age": 23.8,
      "FacialHair": {
        "Moustache": 0.0,
        "Beard": 0.0,
        "Sideburns": 0.0
      },
      "Glasses": "ReadingGlasses",
      "Makeup": {
        "EyeMakeup": true,
        "LipMakeup": true
      },
      "Emotion": {
        "Anger": 0.103,
        "Contempt": 0.003,
        "Disgust": 0.038,
        "Fear": 0.003,
        "Happiness": 0.826,
        "Neutral": 0.006,
        "Sadness": 0.001,
        "Surprise": 0.02
      },
      "Occlusion": {
        "ForeheadOccluded": false,
        "EyeOccluded": false,
        "MouthOccluded": false
      },
      "Accessories": [
        {
          "Type": "glasses",
          "Confidence": 0.99
        }
      ],
      "Blur": {
        "BlurLevel": "low",
        "Value": 0.0
      },
      "Exposure": {
        "ExposureLevel": "goodExposure",
        "Value": 0.48
      },
      "Noise": {
        "NoiseLevel": "low",
        "Value": 0.11
      }
    },
    "FaceLandmarks": {
      "PupilLeft": {
        "X": 504.4,
        "Y": 202.8
      },
      "PupilRight": {
        "X": 607.7,
        "Y": 175.9
      },
      "NoseTip": {
        "X": 598.5,
        "Y": 250.9
      },
      "MouthLeft": {
        "X": 527.7,
        "Y": 298.9
      },
      "MouthRight": {
        "X": 626.4,
        "Y": 271.5
      },
      "EyebrowLeftOuter": {
        "X": 452.3,
        "Y": 191.0
      },
      "EyebrowLeftInner": {
        "X": 531.4,
        "Y": 180.2
      },
      "EyeLeftOuter": {
        "X": 487.6,
        "Y": 207.9
      },
      "EyeLeftTop": {
        "X": 506.7,
        "Y": 196.6
      },
      "EyeLeftBottom": {
        "X": 506.8,
        "Y": 212.9
      },
      "EyeLeftInner": {
        "X": 526.5,
        "Y": 204.3
      },
      "EyebrowRightInner": {
        "X": 583.7,
        "Y": 167.6
      },
      "EyebrowRightOuter": {
        "X": 635.8,
        "Y": 141.4
      },
      "EyeRightInner": {
        "X": 592.0,
        "Y": 185.0
      },
      "EyeRightTop": {
        "X": 607.3,
        "Y": 170.1
      },
      "EyeRightBottom": {
        "X": 612.2,
        "Y": 183.4
      },
      "EyeRightOuter": {
        "X": 626.6,
        "Y": 171.7
      },
      "NoseRootLeft": {
        "X": 549.7,
        "Y": 201.0
      },
      "NoseRootRight": {
        "X": 581.7,
        "Y": 192.9
      },
      "NoseLeftAlarTop": {
        "X": 557.5,
        "Y": 241.1
      },
      "NoseRightAlarTop": {
        "X": 603.7,
        "Y": 228.5
      },
      "NoseLeftAlarOutTip": {
        "X": 549.4,
        "Y": 261.8
      },
      "NoseRightAlarOutTip": {
        "X": 616.7,
        "Y": 241.7
      },
      "UpperLipTop": {
        "X": 593.2,
        "Y": 283.5
      },
      "UpperLipBottom": {
        "X": 594.1,
        "Y": 291.6
      },
      "UnderLipTop": {
        "X": 595.6,
        "Y": 307.0
      },
      "UnderLipBottom": {
        "X": 598.0,
        "Y": 320.7
      }
    }
  }
]

Want to build this?

Documentation

Face identification

Search and identify faces. Tag people and groups with user-provided data and then search those for a match with previously unseen faces.

Similar face search

Easily find similar-looking faces. Given a collection of faces and a new face as a query, this API will return a collection of similar faces.

Face grouping

Organize many unidentified faces together into groups, based on their visual similarity.

"By enhancing our service with the Face API, we have a competitive advantage in markets that demand a high degree of facial detection accuracy"

Daniel Amitai: Vice President of Business Development | Cloudinary

Learn more

"Because the Cognitive Services APIs harness the power of machine learning, we were able to bring advanced intelligence into our product without the need to have a team of data scientists on hand"

Aaron Edell: Chief Product Owner | GrayMeta

Learn more

"We found Cognitive Services to be the missing piece in the equation, the one that we needed to bring this solution to market and really revolutionize the way people look at video"

Katie McCann: Vice President of Product and Engineering | Prism Skylabs

Learn more

"Thousands of partners sign in to our platform every hour. The response time from the Face API is incredible, enabling us to verify our drivers without slowing them down"

Dima Kovalev: Product Manager | Uber

Learn more

"It didn’t take us long to realize Microsoft Cognitive Services had handed us a powerful set of computer-vision and artificial-intelligence tools that we could use to create great apps and new features for our customers in just a few hours"

John Fan: Cofounder and CEO | Cardinal Blue Software

Learn more

"Using the Cognitive Services APIs, it took us three months to develop a test pair of glasses that can translate text and images into speech, identify emotions, and describe scenery. If we had been working full time, we could have done it in two weeks"

Benoit Chirouter: R&D Director | Pivothead

Learn more