Seeing Through Colored Glasses: The Limits of Scientific Observation

1. The Elusive Ideal of Objectivity

Objectivity is often hailed as the cornerstone of scientific knowledge. It is the ideal that guides empirical research: through careful observation, rigorous methodology, and standardized procedures, we believe we can uncover truths that are independent of individual perspectives. Science, in this view, progresses cumulatively, and with enough careful work, objectivity seems within reach.

Empirical research assumes that by measuring, observing, and replicating, we can approach a neutral understanding of reality. Yet this assumption is more a promise than a fact. A radical question emerges: can empirical methods ever truly deliver objectivity?

To illustrate this, imagine each person wearing a subtly different pair of colored glasses. Each observer sees the world slightly differently. Now, suppose one among millions claims to have discovered something entirely new — a glimpse of reality as it “truly” is. Others, looking through their own glasses, do not see it, and therefore cannot recognize it as truth. Even if the discoverer shares the “correct” glasses, the truth remains inaccessible to others who continue to see the world through their individual lenses.

This simple metaphor reveals a profound epistemological insight: empirical methods, no matter how rigorous, cannot fully bridge the gap between subjective perspectives. Objectivity, in the sense of universally accessible truth, remains elusive. Empirical science, for all its precision and standardization, cannot escape the constraints of the individual observer.

---

2. Aligning Methods, Not Minds: Standardization and Formalization

If empirical methods alone cannot guarantee universal objectivity, how does science attempt to compensate? One key tool is standardization. By defining procedures, protocols, and measurement techniques, research aims to reduce the influence of individual perspectives. Formalization is science’s way of saying: “If we all follow the same rules, the results should converge, and truth will emerge.”

Yet standardization has its limits. It can align observations, reduce obvious errors, and make results reproducible, but it does not dissolve the underlying subjectivity embedded in every choice — from which questions are asked to which variables are measured, and how data are interpreted. The rigorous formalization of empirical methods attempts to construct objectivity, but it can only ever approximate it. The colored glasses of each observer remain, subtle but persistent, filtering what can be seen and understood.

---

3. Operational Choices and Persistent Subjectivity

Even when researchers meticulously follow protocols, empirical research is still filtered through human perspectives. The colored glasses remain.

1. Study Design and Operationalization
Every research project begins with choices: what questions to ask, which variables to measure, how to operationalize complex concepts. Each decision reflects the priorities, assumptions, and perspective of the designer. Standardized forms and checklists may align methods across researchers, but they cannot remove the influence of these initial choices.

2. Measurement and Data Collection
Once the study is underway, the observer’s perceptions and biases continue to shape what is recorded and how. Tools are imperfect, contexts vary, and even subtle cues from the experimenter can influence outcomes. Calibration or protocol adherence reduces some variation, but the lens of the individual researcher persists.

3. Data Analysis and Interpretation
After data collection, subjectivity multiplies. Statistical models are selected, data transformations applied, outliers considered or dismissed. Each analytic decision allows room for interpretation, judgment, and even intuition. The same dataset may yield different conclusions depending on the observer’s framework.

Picture: Say Pye Phyo on Unsplash

Radical Insight: At every stage — design, measurement, and analysis — empirical methods operate within constraints defined by human subjectivity. Standardization and formalization can create convergence, but they cannot erase the individual “colors” of each observer. Objectivity remains an ideal, not a fully attainable state.

4. Reproducibility and the Publish-or-Perish Dilemma

Even with meticulous design, careful measurement, and rigorous analysis, science faces another challenge: reproducibility.

Standardization promises that if a study is repeated under the same conditions, results will converge, giving the impression of objective truth. In practice, however, reproducibility often fails. Subtle differences in implementation, interpretation, or context mean that what seems established in one study may vanish in another. This is the essence of the reproducibility crisis: even when empirical methods are rigorously applied, the anticipated objectivity remains elusive.

The pressure to publish, summarized as Publish-or-Perish, compounds this problem. Researchers are incentivized to produce results that are clean, novel, and publishable rather than to explore nuanced questions or reflect deeply. This dynamic can exaggerate the perception that standardization and replication guarantee objectivity, when in reality they often prioritize visibility and productivity over epistemic depth.

Here, the colored glasses metaphor gains an additional dimension. Social dynamics — including group pressures, hierarchical influence, and conformity — can lead researchers to adjust their perspectives to align with dominant views. In effect, subjective lenses are “passed around,” and consensus becomes an illusion. In such contexts, opinion can dominate over epistemic reflection, and the pursuit of truth may be subordinated to social conformity.

Thus, empirical research, even at its most formally rigorous, can only approximate objectivity. It creates the appearance of convergence, but the underlying human perspectives, judgments, and biases remain. Reproducibility does not eliminate them; it merely constructs a framework in which partial agreement is possible, giving a simulated sense of certainty.

5. Objectivity and the Limitations of Empirical Research

Let's state a perfect design, standardization, and reproducibility are given. Then still, science faces fundamental limits in achieving true objectivity. The “simulated sense of certainty” created by methodological protocols and publication pressures often conceals rather than resolves these epistemic constraints.

Philosophers have long debated what objectivity means. One strand treats it as a truth existing independently of human observers, though epistemologically limited. Thinkers such as Immanuel Kant, Martin Heidegger, and Karl Popper exemplify this view. Kant emphasized that we cannot access the “things-in-themselves” directly; our knowledge is always filtered through human cognitive structures. Heidegger highlighted that truth is revealed through disclosure rather than as an absolute state. Popper argued that while we can never definitively prove a theory true, we can approach objectivity asymptotically through falsification. In this perspective, objectivity is an ideal, limited by the constraints of human understanding.

A second, contrasting approach conceives objectivity as socially constructed or intersubjective. Scholars like Helen Longino and Lorraine Daston argue that objectivity emerges from communal critique, pluralistic discourse, and shared norms within scientific communities. However, this approach carries a critical danger: by reducing objectivity to social agreement, it risks passing subjectivity off as truth.

The colored glasses metaphor can help illustrate these subtleties in two complementary ways:

1. Individual lenses: Each observer sees the world through their own unique lens. Subtle differences in perspective ensure that objectivity can never be fully attained—each view remains inherently subjective.

2. Lenses “passed around”: Social dynamics—such as group pressures, hierarchical influence, and conformity—can lead individuals to adjust their perspectives to align with dominant views. In this scenario, a single lens is circulated as if everyone shares it. The result is that subjective viewpoints are treated as objective, producing a consensus illusion. Here, opinion, rather than critical evaluation of evidence, dominates what is accepted as “truth.” This dynamic illustrates a profound problem: science can drift far from its epistemic ideals when social adaptation overrides genuine inquiry.

"Subjectivize" objectivity highlights a profound risk: When opinion dominates over critical inquiry, what counts as “objective” may drift far from scientific truth.

The limitations of empirical methods, standardization, and social construction together show that procedural rigor alone cannot secure objectivity. If empirical approaches fall short, and social consensus risks conflating agreement with truth, alternative conceptual frameworks become necessary.

6. Kuhn and Paradigms

One such framework is offered by Thomas Kuhn’s paradigm concept. Science is not simply a linear accumulation of facts but evolves through paradigms that define legitimate questions, methods, and explanations.

For example, in psychology, a paradigm that treats human behavior as a sum of discrete cognitive variables privileges lab-based, quantifiable methods. Such a framework can blind researchers to context, history, or embodied cognition—dimensions that resist simple measurement. Even open or flexible methods may yield limited insight if they operate under misaligned assumptions.

Kuhn distinguished between “normal science,” which operates within a dominant paradigm, and moments of crisis, when accumulating anomalies strain the paradigm’s credibility. While we may not yet witness a full paradigm shift, the persistence of crises—reproducibility, measurement, generalizability, and theory crises—suggests the scientific framework may be approaching a critical threshold. In such cases, methodological tweaks alone cannot resolve deep conceptual tensions.

Paradigms provide provisional order without presupposing absolute objectivity. They guide inquiry, frame interpretations, and shape the evolution of knowledge. But they also highlight the importance of reflecting on our questions, constructs, and methods: Are our inquiries meaningful? Do our constructs map onto real phenomena or convenient abstractions? Might some phenomena resist quantification entirely?

In the face of these challenges, the future of science may depend less on the illusory pursuit of pure objectivity and more on cultivating critical reflection, epistemic flexibility, and sensitivity to the frameworks through which we interpret the world. Inquiry, rather than rigid adherence to method, may become the truest compass for scientific understanding.

Key References 

Baker, M. (2016). 1,500 scientists lift the lid on reproducibility. Nature, 533, 452–454. https://doi.org/10.1038/533452a

Blanton, H., et al. (2017). Replication and reproducibility in social psychology. Annual Review of Psychology, 68, 87–109. https://doi.org/10.1146/annurev-psych-010416-044224

Brandt, R. (2026). Epistemic Conditions and Ontological Limits of Scientific Objectivity: A Systematic Analysis of Intersubjectivity, Consensus Formation, and Their Implications for the Philosophy of Science (1.0). Zenodo/Cern. https://doi.org/10.5281/zenodo.20234026

Daston, L., & Galison, P. (2007). Objectivity. New York: Zone Books.

Gelman, A., & Loken, E. (2014). The statistical crisis in science. American Scientist, 102(6), 460–465. https://doi.org/10.1511/2014.111.460

Ioannidis, J. P. A. (2005). Why most published research findings are false. PLoS Medicine, 2(8), e124. https://doi.org/10.1371/journal.pmed.0020124

Kant, I. (1998). Critique of pure reason (P. Guyer & A. W. Wood, Eds. & Trans.). Cambridge: Cambridge University Press. (Original work published 1781)

Nosek, B. A., et al. (2015). Promoting an open research culture. Science, 348(6242), 1422–1425. https://doi.org/10.1126/science.aab2374

Popper, K. (2002). The logic of scientific discovery (R. G. Chisholm, Trans.). London: Routledge. (Original work published 1934)

Yarkoni, T. (2020). The generalizability crisis. Behavioral and Brain Sciences, 43, e1. https://doi.org/10.1017/S0140525X20001685 

Picture by Ruslan Sikunov on Unsplash

Inspired by Kanwar Singh 

Authored by Rebekka Brandt 

LinkedIn