Adaptations of data mining methodologies: a systematic literature review
Authors:
- Veronika PlotnikovaVPVeronika Plotnikova
- Marlon DumasMDMarlon Dumas
- Fredrik MilaniFMFredrik Milani
Open Access
- 25 May 2020
- journal article
- review article
- Published by PeerJ in PeerJ Computer Science
- Vol. 6, e267
Abstract
The use of end-to-end data mining methodologies such as CRISP-DM, KDD process, and SEMMA has grown substantially over the past decade. However, little is known as to how these methodologies are used in practice. In particular, the question of whether data mining methodologies are used ‘as-is’ or adapted for specific purposes, has not been thoroughly investigated. This article addresses this gap via a systematic literature review focused on the context in which data mining methodologies are used and the adaptations they undergo. The literature review covers 207 peer-reviewed and ‘grey’ publications. We find that data mining methodologies are primarily applied ‘as-is’. At the same time, we also identify various adaptations of data mining methodologies and we note that their number is growing rapidly. The dominant adaptations pattern is related to methodology adjustments at a granular level (modifications) followed by extensions of existing methodologies with additional elements. Further, we identify two recurrent purposes for adaptation: (1) adaptations to handle Big Data technologies, tools and environments (technological adaptations); and (2) adaptations for context-awareness and for integrating data mining solutions into business processes and IT systems (organizational adaptations). The study suggests that standard data mining methodologies do not pay sufficient attention to deployment issues, which play a prominent role when turning data mining models into software products that are integrated into the IT architectures and business processes of organizations. We conclude that refinements of existing methodologies aimed at combining data, technological, and organizational aspects, could help to mitigate these gaps.Keywords
This publication has 22 references indexed in Scilit:
- Data mining in educationWIREs Data Mining and Knowledge Discovery, 2012
- Data mining techniques and applications – A decade review from 2000 to 2011Expert Systems with Applications, 2012
- Methodological support for business process redesign in health care: a literature review protocolInternational Journal of Care Pathways, 2011
- A data mining framework for time series estimationJournal of Biomedical Informatics, 2010
- Lessons from applying the systematic literature review process within the software engineering domainJournal of Systems and Software, 2007
- Knowledge discovery from industrial databasesJournal of Intelligent Manufacturing, 2004
- Business data mining — a machine learning perspectiveInformation & Management, 2001
- Building the KDD Roadmap2001
- A Data Mining methodology for cross-salesKnowledge-Based Systems, 1998
- The KDD process for extracting useful knowledge from volumes of dataCommunications of the ACM, 1996