From Methodological Constraints to Ontological Boundaries: Why Traditional Limitations Sections Remain Incomplete
Introduction: The Limits of Scientific Self-Critique
Most scientific papers contain a section devoted to limitations. Researchers discuss sample size, measurement error, potential biases, model assumptions, and issues of generalizability. Such reflections are widely regarded as a hallmark of good scientific practice. They demonstrate transparency, encourage caution in interpretation, and help readers understand the conditions under which findings should be evaluated.
Over the past decades, this form of methodological self-critique has become deeply embedded in scientific culture. Research integrity, open science initiatives, and reproducibility standards all encourage scholars to be explicit about the weaknesses and uncertainties of their work. In many fields, a paper without a limitations section would be considered incomplete.
Yet there is a curious paradox at the heart of this practice.
While modern science has developed sophisticated ways of reflecting on methodological limitations, it rarely reflects on a different kind of limitation: the ontological boundaries imposed by the methods themselves. Researchers often discuss how accurately they measured something, but much less frequently ask what aspects of reality became invisible through the very act of measurement.
This article argues that the traditional concept of research limitations remains incomplete because it focuses primarily on methodological concerns while largely neglecting ontological ones. The question is therefore not whether scientific methods are reliable, but whether scientific practice adequately reflects on what those methods can and cannot make visible in the first place.
What Is Meant by “Ontology” Here?
The term ontology is often associated with abstract philosophical debates about the nature of reality. In the present context, however, the concept is used in a more practical sense.
Methodology asks how we investigate a phenomenon.
Epistemology asks what kind of knowledge we can obtain.
Ontology, in the sense used here, asks what aspects of reality become accessible through a given method and what aspects remain outside its scope.
This distinction is important because every scientific method necessarily operates through selection. A method does not simply reveal reality in its entirety. Rather, it establishes a particular way of accessing reality by defining what can be observed, measured, categorized, and analyzed.
Consequently, scientific knowledge is never produced from reality as such. It is produced from reality as filtered through specific methodological frameworks.
This observation does not undermine science. On the contrary, it helps clarify both its power and its limits.
The Traditional Limitations Section
The conventional limitations section performs an essential function in scientific research. It allows researchers to acknowledge uncertainties and constraints that may influence their findings.
Common examples include:
- limited sample sizes,
- measurement inaccuracies,
- selection bias,
- uncontrolled variables,
- assumptions embedded in statistical models.
These discussions are valuable because they improve the interpretation of results and help prevent overgeneralization. They encourage researchers to remain cautious about the strength and scope of their conclusions.
However, all of these limitations share a common feature: they operate within an already accepted methodological framework.
 |
| Picture: Adam Birkett on Unsplash |
The underlying assumption is that the phenomenon has already been appropriately defined and operationalized. Reflection begins only after the relevant variables, measurements, and analytical procedures have been selected.
As a result, the traditional limitations section mainly evaluates how well a study was conducted within a given framework. It rarely addresses the prior question of what that framework may have excluded from consideration altogether.
The Hidden Dimension: Ontological Selectivity
Every act of scientific measurement involves a process of selection.
Researchers decide which variables matter, which indicators will be used, and which aspects of a phenomenon are considered measurable. This process is unavoidable. Without it, systematic inquiry would be impossible.
Yet selection has consequences.
Consider a survey measuring life satisfaction. Respondents may rate their satisfaction on a numerical scale from one to ten. The resulting data can be analyzed, compared, and visualized. From a methodological perspective, the procedure may be entirely sound.
At the same time, the richness of lived experience is reduced to a numerical representation. Personal narratives, cultural meanings, emotional nuances, and situational contexts are transformed into a format suitable for statistical analysis.
The issue is not that the measurement is wrong.
The issue is that the measurement captures only certain dimensions of the phenomenon while leaving others outside the field of observation.
The same logic applies across disciplines. A brain scan may reveal neural activity without revealing subjective experience. Economic indicators may describe financial conditions without capturing the meaning individuals attach to those conditions. Social media data may reveal patterns of behavior without explaining motivations.
In each case, scientific methods illuminate part of reality while simultaneously obscuring other parts.
Why Methodological Reflection Is Not Enough
This observation leads to a distinction between two different forms of limitation.
The first consists of methodological limitations. These concern errors, uncertainties, and weaknesses within a research design.
The second consists of ontological limitations. These concern the boundaries of what the research design is capable of making visible.
Methodological limitations ask questions such as:
- How accurate was the measurement?
- Was the sample representative?
- Could bias have influenced the results?
Ontological limitations ask different questions:
- What dimensions of the phenomenon were not operationalized?
- Which aspects of reality remain outside the measurement framework?
- What forms of experience, meaning, or context were excluded by design?
Modern science is highly skilled at addressing the first set of questions. The second set receives far less systematic attention.
This imbalance creates a subtle but important problem. The more precise and sophisticated a method becomes, the easier it is to forget that precision does not necessarily imply completeness.
The Illusion of Completeness
Scientific precision possesses persuasive power.
A highly accurate measurement, a sophisticated statistical model, or an impressive visualization often conveys an impression of comprehensive understanding. The clarity of the result can create the impression that the phenomenon itself has been fully captured.
Yet this impression can be misleading.
Precision refers to the quality of measurement within a selected domain. It does not automatically expand the domain itself.
A spotlight provides a useful metaphor. A powerful spotlight may illuminate a small area with extraordinary clarity. Details become visible, structures become sharp, and observations become reliable.
 |
| Pic: Rebecca Orlov | Epic Playdate |
However, the brightness of the illuminated area does not reduce the darkness surrounding it.
Scientific methods often function in a similar manner. They generate remarkable clarity within specific observational boundaries while leaving the existence of those boundaries largely unexamined.
The danger emerges when methodological precision is unconsciously interpreted as ontological completeness.
At that point, confidence in the measurement begins to overshadow awareness of what remains outside the measurement.
Why This Blind Spot Persists
The relative absence of ontological reflection is not simply an oversight. It is partly a consequence of how science operates.
Scientific inquiry depends upon:
- standardization,
- operationalization,
- reproducibility,
- comparability.
These requirements encourage researchers to reduce complexity into manageable forms.
Ontological questions, however, often resist standardization. Asking what remains unobserved or excluded rarely produces a straightforward methodological correction. Instead, such questions point toward the broader limits of the investigative framework itself.
For this reason, ontological reflection often remains implicit rather than explicit. Researchers may be aware that their methods provide only partial access to reality, yet this awareness rarely becomes a formal component of scientific reporting.
As a consequence, scientific publications frequently discuss uncertainty within the model while remaining relatively silent about the boundaries of the model.
Toward the Concept of Ontological Limitations
One possible response is not to replace traditional limitations sections but to expand them.
Alongside methodological limitations, researchers could explicitly address ontological limitations.
Such a discussion might include questions like:
- Which dimensions of the phenomenon were not captured by the chosen method?
- Which assumptions about reality were embedded in the operationalization process?
- What aspects of the phenomenon remain inaccessible within the current research design?
The purpose would not be to weaken scientific claims.
Rather, it would be to situate those claims more accurately within their actual scope.
This approach would encourage a richer understanding of scientific knowledge as both powerful and selective.
Implications for Research, Education, and Public Communication
The idea of ontological limitations has implications beyond academic methodology.
In research, it could encourage more explicit reflection on the relationship between data and the phenomena they represent.
In education, it could help students understand that methods do not simply discover reality but actively structure how reality becomes knowable.
In public communication, it may be even more important. Visualizations, graphs, rankings, and statistical indicators often appear to present reality directly. The public rarely encounters the methodological and conceptual decisions that make such representations possible.
A stronger awareness of ontological limitations could therefore help reduce the tendency to equate data with reality itself.
Conclusion: Scientific Knowledge and the Boundaries of Visibility
Science achieves its greatest successes through disciplined selection, measurement, and analysis. These practices make complex phenomena understandable and allow knowledge to accumulate across generations.
Yet every act of measurement also establishes boundaries.
The traditional limitations section acknowledges uncertainties within a chosen framework. What it rarely acknowledges are the ontological limits of the framework itself.
Recognizing these limits does not diminish scientific knowledge. Instead, it provides a more accurate account of how that knowledge is produced.
Scientific inquiry does not offer a complete mirror of reality. It offers carefully constructed, methodologically stabilized perspectives on reality.
The challenge is therefore not merely to identify errors in our measurements, but also to remain aware of the realities that our measurements leave unseen.
Only then can scientific self-reflection become as comprehensive as the methods it seeks to evaluate.
References
Antoniou, A. (2021). What is a data model? An anatomy of data analysis in high energy physics. European Journal for Philosophy of Science, 11(101). https://doi.org/10.1007/s13194-021-00412-2
Bennett, M., & Miller, M. E. (2023). The conventionality of real-valued quantities. Philosophy of Science, 90(5), 1338–1350.
Bokulich, A., & Parker, W. S. (2021). Data models, representation and adequacy-for-purpose. European Journal for Philosophy of Science, 11(31). https://doi.org/10.1007/s13194-020-00345-2
Brandt
see my latest preprint
Bridgman, P. W. (1927). The logic of modern physics. Macmillan.
Cartwright, N. (1983). How the laws of physics lie. Oxford University Press.
Giere, R. N. (2006). Scientific perspectivism. University of Chicago Press.
Goertz, G., & Mahoney, J. (2012). Concepts and measurement: Ontology and epistemology. Social Science Information, 51(2), 205–216. https://doi.org/10.1177/0539018412437108
Hacking, I. (1983). Representing and intervening: Introductory topics in the philosophy of natural science. Cambridge University Press.
Kuhn, T. S. (1962/2012). The structure of scientific revolutions (4th ed.). University of Chicago Press.
Latour, B., & Woolgar, S. (1986). Laboratory life: The construction of scientific facts (2nd ed.). Princeton University Press.
Leonelli, S. (2019). What distinguishes data from models? European Journal for Philosophy of Science, 9(2), Article 22. https://doi.org/10.1007/s13194-018-0246-0
Michell, J. (1999). Measurement in psychology: A critical history of a methodological concept. Cambridge University Press.
Parker, W. S. (2020). Model evaluation: An adequacy-for-purpose view. Philosophy of Science, 87(3), 457–477.
Suppes, P. (2002). Representation and invariance of scientific structures. CSLI Publications.
van Fraassen, B. C. (2008). Scientific representation: Paradoxes of perspective. Oxford University Press.
van Fraassen, B. C. (2012). Modeling and measurement: The criterion of empirical grounding. Philosophy of Science, 79(5), 773–784.
Vessonen, E. (2021). Representation in measurement. European Journal for Philosophy of Science, 11(76). https://doi.org/10.1007/s13194-021-00365-6
Authored by Rebekka Brandt