Face detection and recognition models trained on datasets skewed toward lighter skin tones have a well-documented history of performing worse on darker skin tones. This isn't a hypothetical risk — it's a measurable, testable failure mode.
What to actually test
- Detection and matching accuracy broken out by skin tone group in your test set, not just an aggregate accuracy number.
- Performance under the lighting conditions where the gap tends to widen further — low light disproportionately affects darker skin tones in many models.
- Whether your enrolment/training data itself is balanced, since an unbalanced test set can hide a real gap.
If a gap is found
Document it honestly rather than shipping silently, and prefer a model or vendor with published fairness evaluations if the application is anything consequential — access control, identity verification — where a false accept or reject has real cost.
See evaluating a vision model beyond accuracy.
GenAI engineer and AI product builder with 2+ years shipping production-grade AI systems: RAG pipelines, fine-tuned LLMs, hybrid retrieval and multi-modal apps across vision, speech and OCR, architected end to end from ingestion to deployment. Leads engineering for SCULT INDIA's 14-member team, founded the 500+ member TechVerse Enclave community and has mentored 200+ students. Three hackathon first prizes: Changethon 2025 (IIT Roorkee), Product Genesis at Vividhotsava 2025 (CSJMU Kanpur) and BYTEBATTLE (MeetKats).
Open to GenAI roles, hackathon judging, mentorship sessions and guest talks at colleges. Email pranjulrathour41@gmail.com.
