Face BenchmarkHow face recognition and deepfake detection are measured, from the papers.

Face recognition benchmarks and datasets, and what each one measures

The Face Benchmark editorsPublishedFigures checked

Face recognition is benchmarked by asking a system to compare faces and counting its mistakes. In one-to-one verification the question is whether two images show the same person, scored as the true accept rate at a fixed false accept rate. In one-to-many identification the question is who in a gallery a probe image matches, scored by rank. Every score holds for one test set, one protocol and one operating point, and large training sets changed the field by making those scores saturate.

F.1

How matching is scored

The metrics and the evaluations that report them.

  1. F.1.1

    Face verification metrics explains true accept rate at a fixed false accept rate, the difference between 1:1 verification and 1:N identification, and how to read a face recognition results table.

  2. F.1.2

    NIST's evaluations explains how the NIST FRTE series tests submitted algorithms on sequestered images, how 1:1 and 1:N accuracy is reported, and how to read a results page without over-claiming.

  3. F.1.3

    Demographic differentials sets out what the NIST demographic effects evaluation (NISTIR 8280) measured about false match and false non-match rates across groups, and what the numbers do not say.

F.2

The datasets and where they came from

How the large face sets were gathered, and what happened to several of them.

  1. F.2.1

    Datasets and consent describes how the large face sets were gathered from the web, what happened to MS-Celeb-1M and MegaFace, how WebFace260M was licensed, and what regulators decided about Clearview AI.

F.3

The WebFace260M history on this domain

Two pages kept for readers arriving from old papers and READMEs.

  1. H.2

    WebFace260M and WebFace42M explains what WebFace260M and WebFace42M are, how the cleaned set was made, what the research licence covered, and why nothing is downloadable here.

  2. H.1

    The ICCV 2021 challenge describes the ICCV 2021 masked face recognition challenge from its public report: test sets, time limit, scoring, and where the results live now.

F.4

Where face recognition meets deepfake detection

The same pipeline, asked a different question.

  1. D.4.3

    From face recognition to deepfake detection follows one pipeline from "who is this?" to "is this real?", and shows which benchmark habits carry across and which do not.

  2. D.3.5

    Liveness and injection attacks covers how identity checks are fooled at the camera or behind it, how presentation attack detection is tested under ISO/IEC 30107-3, and where a deepfake detector fits.

F.5

Further pages in this section

Every other page of the section, newest topics included, each with its sources.

  1. F.5.1

    Gender Shades sets out what Buolamwini and Gebru measured in 2018, on which faces, with which metric, and why it is a gender classification result rather than a face recognition one.

  2. F.5.2

    How face recognition works walks the four steps every modern system runs, detect, align, embed and compare, with the paper and the published number behind each one.

  3. F.5.51

    Face recognition technology explains the parts of a face recognition system, the web-scale training sets behind modern models and the evaluations that score them.

  4. F.5.52

    FMR, FNMR, FPIR, FNIR defines the false match rate, false non-match rate, false positive identification rate and false negative identification rate in NIST's own words, with the threshold that links them.

  5. F.5.54

    NISTIR 8280 explained walks through the NIST demographic effects report section by section: its datasets, its metrics, its four results chapters and the 17 annexes behind them.

  6. F.5.55

    AI face recognition traces how learned embeddings and web-scale training sets saturated LFW and moved evaluation to TAR at FAR on IJB-C and to NIST operational tests.

  7. F.5.56

    Face recognition bias separates the two studies most often cited for face recognition bias, says what each measured, what causes are supported, and what a bias claim must specify.

  8. F.5.57

    System components walks through the five components of a face recognition system in plain language, with the error each one can introduce and who measures it.

  9. F.5.58

    Face recognition accuracy explains why face recognition accuracy is quoted as an error rate at a fixed operating point on a named dataset, and what NIST found when it measured 189 algorithms that way.

  10. F.5.59

    LFW dataset gives the Labeled Faces in the Wild counts, the verification protocol they feed, the three published accuracies that took it to 99.83 percent, and what replaced it.

  11. F.5.60

    1:1 versus 1:N separates verification from identification, follows one face through each branch, and shows how NIST reports the two with different error rates and thresholds.

  12. F.5.61

    MegaFace records what the MegaFace benchmark measured with a million distractors, how far LFW-saturated algorithms fell, and the University of Washington notice that decommissioned it.

  13. F.5.62

    ArcFace explains the additive angular margin loss, what a results table means by an ArcFace backbone, and the verification figures the CVPR 2019 paper reported on each named set.

  14. F.5.63

    TSA face recognition describes the TSA checkpoint face comparison program as TSA and DHS documents state it: the 1:1 match, the optional photo, the deletion rules and the 1:n program for trusted travellers.

  15. F.5.64

    Face recognition at airports separates the two US airport face recognition programs, CBP biometric entry and exit and TSA identity verification, by what each compares a face against and which privacy assessment covers it.

  16. F.5.65

    InsightFace describes the open-source toolkit behind ArcFace and RetinaFace, its licence split between code and data, and the training and test sets its dataset README lists with their identity counts.

  17. F.5.66

    Clearview AI rulings sets out each regulator's Clearview AI decision with its date, amount and order, read from the decision pages, and follows the UK penalty through two tribunals.

  18. F.5.67

    Benchmarks list puts five face recognition benchmarks in one table, with each one's protocol, metric, size and distribution status, then explains what each measures.

  19. F.5.68

    What is face recognition defines face recognition, separates it from detection, attribute classification and deepfake detection, and names the two tasks and the error rates that score each.

  20. F.5.69

    Biometric face recognition explains face recognition as a biometric system, the ISO/IEC 19795-1 testing framework, the four error rates and how NIST applies them at fixed operating points.

  21. F.5.70

    Face recognition test sets out what a face recognition test fixes before any score is quoted, from the pair list and threshold policy to the metric and the report, with the NIST and ISO rules.

  22. F.5.71

    WebFace260M paper walks through the CVPR 2021 WebFace260M paper: how 260 million faces were collected, how CAST cleaned them to 42 million, what the FRUITS time budgets test and what the tables show.

  23. F.5.72

    Law enforcement use lists what official audits and court findings have recorded about police and federal use of face recognition, with dates, and what those documents did not measure.

  24. F.5.73

    Face recognition in China reads China's Personal Information Protection Law, the 2021 Supreme People's Court interpretation and the 2025 facial recognition measures as their official texts state them, with deployments only where a document records them.

  25. F.5.74

    TAR at FAR works through one published IJB-C verification row, 97.2 percent TAR at FAR 1e-4, in genuine and impostor pairs, and shows how the same model's TAR moves when the FAR moves.

  26. F.5.75

    Open-source face recognition compares the three open toolkits most papers and libraries build on, the licences that split code from models, and the published scores that change with the training set behind each model.

  27. F.5.76

    Facial recognition privacy puts the laws, regulator decisions and dataset withdrawals that shape facial recognition privacy on one dated timeline, each with its primary document.

  28. F.5.77

    Definition and terms defines face recognition and 25 working terms in one sentence each, from NIST FRTE pages, NISTIR 8280 and the ISO/IEC 19795 and 30107 standards.

  29. F.5.78

    Dataset withdrawals traces what happened after MS-Celeb-1M was taken down and MegaFace decommissioned, with the counts of copies, derivatives and models that stayed in use.

  30. F.5.79

    Face embeddings explains what a face embedding vector holds, how FaceNet and ArcFace train it, and how a distance or cosine threshold turns two vectors into a match decision.

  31. F.5.80

    NIST report cards walks through the header, the datasets, the operating points and the demographic panels of a NIST FRTE report card, and lists the reading mistakes that produce false rankings.

F.5

How face recognition is benchmarked

A face recognition benchmark has three parts: a set of face images with identity labels, a protocol that says which pairs or which probes and galleries are compared, and a metric. The protocol does most of the work. Labeled Faces in the Wild fixed 6,000 pairs and asked for accuracy on them, which is why its results saturated once deep networks arrived. IJB-C and the NIST evaluations instead report the true accept rate at a false accept rate the evaluator chooses, so a system is held to a strict limit on how often it matches two different people. The face verification metrics page explains that format and why a single accuracy percentage says less than it seems.

Two things make a face recognition number hard to compare. The first is the training set: a system trained on tens of millions of faces behaves differently from one trained on hundreds of thousands, and the timeline table below is as much a history of training data as of test sets. The second is the population tested, which is why NIST's evaluations and the question of demographic differentials have their own pages: the same algorithm can show false match rates that differ by large factors between groups, and the evaluation that found this processed more images than any academic test set holds.

F.6

Where the data came from

Most of the large training sets in the table were built by downloading photographs of named people from the web. Several were later withdrawn or stopped being distributed, and a database built the same way by a commercial company drew regulatory penalties in several countries. The datasets and consent page sets out what each dataset's documentation says about the people in it, what happened to the sets that were withdrawn, and what that history means for how a dataset should be described. This domain's own history is part of that story: it was the WebFace260M benchmark site from 2021 to 2025, and the pages on the WebFace260M dataset and the ICCV 2021 masked face recognition challenge are kept for readers who arrive from papers and READMEs that still cite them. This site is not the WebFace260M project and is not affiliated with its authors, Tsinghua University or XForwardAI.

TBL

The benchmark timeline

The datasets and test sets that have defined face recognition accuracy, in the order they appeared. Identity and image counts are as each dataset's paper or official page states them; several of these sets are no longer distributed, which the access column records.

Face recognition benchmarks and training sets by yearCounts as published by each dataset's authors or official page, read 8 Nov 2026. "Not stated" means the source we could reach does not give the figure.
DatasetYearIdentitiesImagesProtocol and metricAccess today
Labeled Faces in the Wild (LFW)20075,74913,2331:1 verification on 6,000 pairs, accuracyPublic download
Strip: Labeled Faces in the Wild (LFW), 2007, 5,749, 13,233, 1:1 verification on 6,000 pairs, accuracy, Public download, check digit 3.
MS-Celeb-1M20161 million (target)about 10 million (version 1)Training set; identificationWithdrawn 2019
Strip: MS-Celeb-1M, 2016, 1 million (target), about 10 million (version 1), Training set; identification, Withdrawn 2019, check digit 9.
MegaFace2016690,572 (distractor gallery)1 million distractorsIdentification against 1 million distractors, rank-1 accuracyDecommissioned
Strip: MegaFace, 2016, 690,572 (distractor gallery), 1 million distractors, Identification against 1 million distractors, rank-1 accuracy, Decommissioned, check digit 8.
IJB-C20173,53121,294 images plus 117,542 video frames1:1 verification, TAR at FAR; 1:N identificationNIST distribution ended March 2023
Strip: IJB-C, 2017, 3,531, 21,294 images plus 117,542 video frames, 1:1 verification, TAR at FAR; 1:N identification, NIST distribution ended March 2023, check digit 3.
Glint360K2020about 360,000about 17 millionTraining setGitHub links
Strip: Glint360K, 2020, about 360,000, about 17 million, Training set, GitHub links, check digit 1.
WebFace42M20212 million42 millionTraining set; FRUITS time-constrained testRequest to the authors
Strip: WebFace42M, 2021, 2 million, 42 million, Training set; FRUITS time-constrained test, Request to the authors, check digit 1.
WebFace260M20214 million260 million (noisy)Training set; FRUITS time-constrained testRequest to the authors
Strip: WebFace260M, 2021, 4 million, 260 million (noisy), Training set; FRUITS time-constrained test, Request to the authors, check digit 9.
  • FBFface set record
  • 1dataset
  • 2year
  • 3identities
  • 4images
  • 5protocol
  • 6access
  • #check digit over the line

A dataset's status changes; the access column records what its official page said on the date in the caption. This site hosts none of these sets.

Face images in the training sets of the timeline, LFW to WebFace260MHorizontal bars: LFW 13,233 images (2007); MS-Celeb-1M about 10,000,000 (2016); Glint360K about 17,000,000 (2020); WebFace42M 42,000,000 (2021); WebFace260M 260,000,000 noisy images (2021). Sources: each dataset's paper or official page, read 8 Nov 2026.065000000130000000195000000260000000LFW (2007)13,233MS-Celeb-1M (2016)10,000,000Glint360K (2020)17,000,000WebFace42M (2021)42,000,000WebFace260M (2021)260,000,000face images, as each dataset states them
Figure 1Image counts of the sets in the timeline, as their papers or official pages state them. The growth from thousands to hundreds of millions of web-collected faces is the story the consent page tells.

The pipeline that recognises a face is the same one that is asked whether a face is real: detect, align, embed, compare. The bridge page follows it across, and the deepfake detection section covers the datasets, metrics and published results on the other side.