Skip to main content
U.S. flag

An official website of the United States government

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS
A lock ( ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

Taking Measure

Just a Standard Blog

Facial Recognition Experts Can Identify You by … Your Ears?

NIST researcher Carina Hahn, wearing a lime green sweater, sits at a white table and smiles at the camera.

NIST researcher Carina Hahn's research led to some surprising findings about facial recognition research. 

Credit: Megan King/NIST

When investigators are working to solve a criminal case, they sometimes rely on experts who identify faces.

A forensic facial examiner’s job is to look at images or video footage of people (such as surveillance footage from a crime scene) and decide how likely it is that two images are of the same person.

But the scientific community is still working to understand how these professionals make their judgments. My research is working to do just that — in hopes that our knowledge can help with examiners’ education and training.

Testing Forensic Facial Examiners

Until fairly recently, the justice system and law enforcement lacked ways to test how skilled an examiner was.

That changed after a 2009 National Academy of Sciences report found that many forensic science disciplines were not supported by evidence. Since then, NIST researchers have been part of an effort to bring more scientific rigor to the field.

One of our efforts in response was to research the accuracy of forensic facial examiners.

Our research subsequently found that there are two groups of facial experts — including some who are naturally gifted at identifying faces and often can’t even explain how they do it so well. We call them “super-recognizers.” A second group is the forensic facial examiners who do this professionally. We believe the second group of experts has honed its abilities through experience and training. This is the group that I focused on in my latest research.

I wanted to answer the question: How does a face examiner identify a face? What is their process?

The answer might surprise you.

The Ears Have It

Our study required examiners to reveal only one part of the face at a time and try to identify someone. We wanted to see which parts of the face they were drawn to, as well as how accurate their analyses were when they focused on only those parts.

While the eyes may be the window to the soul, it wasn’t the eyes (or the nose or the mouth) that experts focused on. It was the ears.

You may not even think of a person’s ears as part of their face. But our research showed that examiners were more likely to be accurate when they saw only the ears than when they saw almost any other part of the face. Foreheads were also really helpful!

So, could you recognize someone based on only their ears? Maybe with a little training, you could too.

YouTube | Can You Recognize Someone Just by Their Ears?
YouTube | Can You Recognize Someone Just by Their Ears?
The ears are crucial to identifying faces, NIST researcher Carina Hahn found in a recent study.

Why This Matters

I am passionate about researching facial recognition to promote both accuracy and transparency in the justice system.

In my research, I help facial examiners by providing evidence-based techniques for their work. If experts are using the same reliable and transparent methods, ideally, they should all reach very similar conclusions that are easily understood by judges and juries.

Becoming a Facial Recognition Researcher

As an undergraduate, I majored in psychology. I knew I was interested in people and their decision-making. One of my early research projects in school was to see how labeling someone as part of different groups changed how people saw that person’s face itself.

This intrigued me, and I wanted to learn more about how people perceive faces. I went to graduate school and studied how people learn and remember the faces of new people they meet. I studied their brain activity to see which parts of the brain are involved when we’re learning the face of someone new.

Faces fascinate me because our brains see and process faces differently from the way we perceive other objects. There are even regions in the brain for recognizing and viewing faces! And research shows that we make a lot of judgments about people, their personalities, and how trustworthy or even how competent they are based on their faces only. We rely on the face (often inaccurately) to make judgments about people so often.

You might be wondering if my research expertise means I am better at recognizing faces than anyone else. The answer is no — I actually forget faces pretty often. If you struggle with that as well, don’t worry; it happens to us researchers, too!

Facing the Future

I’m now working on future research projects to help us better understand different aspects of how forensic facial examiners work.

As a researcher, I am grateful to the examiners who voluntarily agree to participate in my research. I can imagine it’s nerve-wracking to have a researcher poke and prod into how you do your job, but the examiners we study are generous with their time and motivated to improve the field.

My goal is to continue to help these professionals do their jobs effectively — and make our justice system more transparent and accurate for all of us.

About the author

Carina Hahn

Carina Hahn is a social scientist in NIST's Information Technology Laboratory. With a Ph.D. in cognition and neuroscience from the University of Texas at Dallas, Carina's research is centered around facial forensic expertise, where she works to understand this specialized type of facial recognition ability. Carina was part of a team that won a gold medal from the U.S. Department of Commerce — the highest honor granted by the secretary. 

Comments

Add new comment

CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Please be respectful when posting comments. We will post all comments without editing as long as they are appropriate for a public, family friendly website, are on topic and do not contain profanity, personal attacks, misleading or false information/accusations or promote specific commercial products, services or organizations. Comments that violate our comment policy or include links to non-government organizations/web pages will not be posted.
Was this page helpful?