Manara - Qatar Research Repository
10.1016_j.dim.2022.100020.pdf (1.32 MB)

The illusion of data validity: Why numbers about people are likely wrong

Download (1.32 MB)
journal contribution
submitted on 2024-04-21, 11:32 and posted on 2024-04-21, 11:33 authored by Bernard J. Jansen, Joni Salminen, Soon-gyo Jung, Hind Almerekhi

This reflection article addresses a difficulty faced by scholars and practitioners working with numbers about people, which is that those who study people want numerical data about these people. Unfortunately, time and time again, this numerical data about people is wrong. Addressing the potential causes of this wrongness, we present examples of analyzing people numbers, i.e., numbers derived from digital data by or about people, and discuss the comforting illusion of data validity. We first lay a foundation by highlighting potential inaccuracies in collecting people data, such as selection bias. Then, we discuss inaccuracies in analyzing people data, such as the flaw of averages, followed by a discussion of errors that are made when trying to make sense of people data through techniques such as posterior labeling. Finally, we discuss a root cause of people data often being wrong – the conceptual conundrum of thinking the numbers are counts when they are actually measures. Practical solutions to address this illusion of data validity are proposed. The implications for theories derived from people data are also highlighted, namely that these people theories are generally wrong as they are often derived from people numbers that are wrong.

Other Information

Published in: Data and Information Management
See article on publisher's website:



  • English



Publication Year

  • 2022

License statement

This Item is licensed under the Creative Commons Attribution 4.0 International License.

Institution affiliated with

  • Hamad Bin Khalifa University
  • Qatar Computing Research Institute - HBKU
  • College of Science and Engineering - HBKU

Usage metrics

    Qatar Computing Research Institute - HBKU



    Ref. manager