From Big Data to Valued Data: A Dataset Value Taxonomy for AI-Native Empirical Research
Open Access
- 15 October 2025
- journal article
- Published by Association for the Advancement of Artificial Intelligence (AAAI) in Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society
- Vol. 8 (3) , 2294-2305
Abstract
Artificial intelligence is rapidly commoditizing many stages of empirical research, including code generation, statistical analysis, visualization, and manuscript drafting, yet its gains accrue unevenly across disciplines. As the marginal cost of these downstream tasks falls, the decisive bottleneck shifts to the data itself. The era of training and testing neural networks with ever-larger datasets is giving way to one in which the value of the data matters more than its volume. Building on but significantly revising earlier “Big Data” taxonomies, we introduce a Dataset Value Taxonomy (DVT) that reassesses the epistemic importance of datasets in an age where AI is commoditizing analytical labor. We argue that humans, as physically embodied agents, retain a comparative advantage in acquiring and curating observations from the world; partnered with AI, they can channel this advantage into higher-impact scholarship. To guide funders, evaluators, and researchers, we introduce a three-construct taxonomy: Temporal Investment, Scale, and Accessibility, each decomposed into measurable dimensions with ordinal class labels. We further operationalize these constructs through a calibrated scoring scheme that disciplines can adapt to field-specific conventions, enabling cross-field comparability while respecting contextual nuance. By quantifying how temporal investment, observational breadth, and access barriers jointly determine dataset salience, the framework helps allocate resources toward datasets that are most likely to advance knowledge. Ultimately, our taxonomy positions dataset creation as the new core site of human and AI cooperation and provides an actionable roadmap for recognizing, funding, and stewarding high-value data assets across the empirical sciences.Keywords
This publication has 25 references indexed in Scilit:
- Algorithmic fairness datasets: the story so farData Mining and Knowledge Discovery, 2022
- Ten years of dynamic consent in the CHRIS study: informed consent as a dynamic processEuropean Journal of Human Genetics, 2022
- Biodegradable sensors are ready to transform autonomous ecological monitoringNature Ecology & Evolution, 2022
- The ERA5 global reanalysisQuarterly Journal of the Royal Meteorological Society, 2020
- What we talk about when we talk about (big) dataThe Journal of Strategic Information Systems, 2019
- Benchmark dataset for mid‐price forecasting of limit order book data with machine learning methodsJournal of Forecasting, 2018
- The FAIR Guiding Principles for scientific data management and stewardshipScientific Data, 2016
- Snapshot Serengeti, high-frequency annotated camera trap images of 40 mammalian species in an African savannaScientific Data, 2015
- The WU-Minn Human Connectome Project: An overviewNeuroImage, 2013
- The NCBI dbGaP database of genotypes and phenotypesNature Genetics, 2007