Roy Alan Ruddle
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Interests
Roy Alan Ruddle has a total of 151 co-authors. Here are the top co-authors by number of shared publications:
- Richard G. Feltbower
University of Leeds, Leeds, UK
5 shared publications - Chris P. Gale
Leeds Institute of Cardiovascular and Metabolic Medicine, University of Leeds , Leeds
4 shared publications - Dawn Dowding
School of Health Sciences, Division of Nursing, Midwifery and Social Work, University of Manchester , Manchester
4 shared publications - Joanne Greenhalgh
School of Sociology and Social Policy, University of Leeds, Leeds, UK
4 shared publications - Lynn McVey
Faculty of Health Studies, University of Bradford, Bradford, UK
4 shared publications - Mamas Andreas Mamas
Keele Cardiovascular Research Group, Centre for Prognosis Research, Institute for Primary Care and Health Sciences, Keele University, United Kingdom; National Institute for Health and Care Research (NIHR) Birmingham Biomedical Research Centre, Birmingham, United Kingdom
4 shared publications
Latest Publications
- Open Access
Using classification and regression trees (CART) to investigate unknown ethnicity records in NHS emergency care data
Objective: High-quality ethnicity data are necessary for tackling health inequalities. This study aims to support the improvement of ethnicity recording in emergency care data by (a) investigating variation in unknown ethnicity records, (b) exploring patterns of missingness between ethnicity and other variables and (c) identifying the variables most important in the recording of an unknown ethnicity. Design: Secondary analysis of the Emergency Care Data Set (ECDS). Setting and participants: National Health Service (NHS) and independent sector organisations who provide emergency care services in England. Includes all anonymised ECDS records from the financial year 2023/2024, excluding those with a ‘Null’ anonymised pseudo-NHS number or those patients announced as dead on arrival (24 167 154 records after exclusions). Results: Differences in the percentage of unknown ethnicity records were seen across ages, organisation types and attendance characteristics. An increase in the percentage of missing values was observed for 62 variables when ethnicity was unknown, with the largest increases shown by variables related to investigations and treatments received by the patient (15.31% and 14.74%). Provider site code was identified as the most important variable in recording ethnicity as unknown. Further analysis highlighted a subset of acute trusts and independent sector organisations that disproportionately contributed to unknown ethnicity records. Conclusions: This study has improved understanding of unknown ethnicity recording by exploring variation across demographics and organisation types and demonstrating an increase in missingness across other ECDS variables when ethnicity is unknown. Unknown ethnicity recording appears to be a site-specific problem, which should be addressed through improvements to the data collection processes of individual providers. These insights should be used to improve the quality of ethnicity coding within emergency care data, necessary for tackling health inequalities.
Open AccessUsing classification and regression trees (CART) to investigate unknown ethnicity records in NHS emergency care data
Objective: High-quality ethnicity data are necessary for tackling health inequalities. This study aims to support the improvement of ethnicity recording in emergency care data by (a) investigating variation in unknown ethnicity records, (b) exploring patterns of missingness between ethnicity and other variables and (c) identifying the variables most important in the recording of an unknown ethnicity. Design: Secondary analysis of the Emergency Care Data Set (ECDS). Setting and participants: National Health Service (NHS) and independent sector organisations who provide emergency care services in England. Includes all anonymised ECDS records from the financial year 2023/2024, excluding those with a ‘Null’ anonymised pseudo-NHS number or those patients announced as dead on arrival (24 167 154 records after exclusions). Results: Differences in the percentage of unknown ethnicity records were seen across ages, organisation types and attendance characteristics. An increase in the percentage of missing values was observed for 62 variables when ethnicity was unknown, with the largest increases shown by variables related to investigations and treatments received by the patient (15.31% and 14.74%). Provider site code was identified as the most important variable in recording ethnicity as unknown. Further analysis highlighted a subset of acute trusts and independent sector organisations that disproportionately contributed to unknown ethnicity records. Conclusions: This study has improved understanding of unknown ethnicity recording by exploring variation across demographics and organisation types and demonstrating an increase in missingness across other ECDS variables when ethnicity is unknown. Unknown ethnicity recording appears to be a site-specific problem, which should be addressed through improvements to the data collection processes of individual providers. These insights should be used to improve the quality of ethnicity coding within emergency care data, necessary for tackling health inequalities.
- Open Access
- 7 August 2026
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 21 (8) , e0355400
A visual analytic method to investigate patterns and structures of missing data
Datasets often have missing values. Understanding the locations and underlying reasons (missing data patterns and structures, respectively) is important to avoid analysis bias or building inappropriate models. However, investigating missing data patterns and structures presents significant challenges. To address them we developed a novel visual analytic method, which combines new purity metrics for three core types of pattern (block, monotone and disjoint) with seven different visualizations in an iterative workflow. We also conducted two case studies, one with a UCI Machine Learning Repository dataset and the other with a 21 million record/389 variable hospital dataset that had many interwoven missingness patterns. In the UCI case study, the method’s purity metrics and heatmaps revealed a rare data quality issue that affected 0.08% of records, but was not apparent when an existing correlation-based approach was used. Our method also implements perceptual discontinuity to ensure that small values are visible in bar charts, and that showed that two variables were missing values in 0.02% and 0.3% of records, respectively, rather than being complete as reported in the original UCI paper. The hospital dataset contained 595,171 unique combinations of missing values, but that overwhelming number was reduced to 57 comprehensible patterns by iteratively using purity metrics and heatmaps with the three core pattern types in our method. That revealed insights that ranged from uncovering rare and common data quality issues, to finding data dictionary errors, and making explicit relationships between groups of variables that may otherwise be hidden. The method also provides an explanation graph, which aids reproducibility by documenting the order in which patterns were found and acts as a tangible artifact that should help communicate the findings to stakeholders.
- 7 August 2026
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 21 (8) , e0355400
Open AccessA visual analytic method to investigate patterns and structures of missing data
Datasets often have missing values. Understanding the locations and underlying reasons (missing data patterns and structures, respectively) is important to avoid analysis bias or building inappropriate models. However, investigating missing data patterns and structures presents significant challenges. To address them we developed a novel visual analytic method, which combines new purity metrics for three core types of pattern (block, monotone and disjoint) with seven different visualizations in an iterative workflow. We also conducted two case studies, one with a UCI Machine Learning Repository dataset and the other with a 21 million record/389 variable hospital dataset that had many interwoven missingness patterns. In the UCI case study, the method’s purity metrics and heatmaps revealed a rare data quality issue that affected 0.08% of records, but was not apparent when an existing correlation-based approach was used. Our method also implements perceptual discontinuity to ensure that small values are visible in bar charts, and that showed that two variables were missing values in 0.02% and 0.3% of records, respectively, rather than being complete as reported in the original UCI paper. The hospital dataset contained 595,171 unique combinations of missing values, but that overwhelming number was reduced to 57 comprehensible patterns by iteratively using purity metrics and heatmaps with the three core pattern types in our method. That revealed insights that ranged from uncovering rare and common data quality issues, to finding data dictionary errors, and making explicit relationships between groups of variables that may otherwise be hidden. The method also provides an explanation graph, which aids reproducibility by documenting the order in which patterns were found and acts as a tangible artifact that should help communicate the findings to stakeholders.
- 1 April 2026
- Published by Springer Nature
- p. 291-307
An Evaluation of AI-Based Grading of Multiple Choice Assessments
- 1 April 2026
- Published by Springer Nature
- p. 291-307
An Evaluation of AI-Based Grading of Multiple Choice Assessments
- Top Cited PapersOpen Access
- 8 January 2026
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 28, e74304
Developing an AI-Assisted Tool That Identifies Patients With Multimorbidity and Complex Polypharmacy to Improve the Process of Medication Reviews: Qualitative Interview and Focus Group Study
Background: Structured medication reviews (SMRs) are an essential component of medication optimization, especially for patients with multimorbidity and polypharmacy. However, the process remains challenging due to the complexities of patient data, time constraints, and the need for coordination among health care professionals (HCPs). This study explores HCPs’ perspectives on the integration of artificial intelligence (AI)–assisted tools to enhance the SMR process, with a focus on the potential benefits of and barriers to adoption. Objective: This study aims to identify the key user requirements for AI-assisted tools to improve the efficiency and effectiveness of SMRs, specifically for patients with multimorbidity, complex polypharmacy, and frailty. Methods: A qualitative study was conducted involving focus groups and semistructured interviews with HCPs and patients in the United Kingdom. Participants included physicians, pharmacists, clinical pharmacologists, psychiatrists from primary and secondary care, a policy maker, and patients with multimorbidity. Data were analyzed using a hybrid inductive and deductive thematic analysis approach to identify themes related to AI-assisted tool functionality, workflow integration, user-interface visualization, and usability in the SMR process. Results: Four major themes emerged from the analysis: innovative AI potential, optimizing electronic patient record visualization, functionality of the AI tool for SMRs, and facilitators of and barriers to AI tool implementation. HCPs identified the potential of AI to support patient identification and prioritizing those at risk of medication-related harm. AI-assisted tools were viewed as essential in detecting prescribing gaps, drug interactions, and patient risk trajectories over time. Participants emphasized the importance of presenting patient data in an intuitive format, with a patient interface for shared decision-making. Suggestions included color-coding blood results, highlighting critical medication reviews, and providing timelines of patient medical histories. HCPs stressed the need for AI tools to integrate seamlessly with existing electronic patient record systems and provide actionable insights without overwhelming users with excessive notifications or “pop-up” alerts. Factors influencing the uptake of AI-assisted tools included the need for user-friendly design, evidence of tool effectiveness (though some were skeptical about the predictive accuracy of AI models), and addressing concerns around digital exclusion. Conclusions: The findings highlight the potential for AI-assisted tools to streamline and optimize the SMR process, particularly for patients with multimorbidity and complex polypharmacy. However, successful implementation depends on addressing concerns related to workflow integration, user acceptance, and evidence of effectiveness. User-centered design is crucial to ensure that AI-assisted tools support HCPs in delivering high-quality, patient-centered care while minimizing cognitive overload and alert fatigue.
- 8 January 2026
- Published by JMIR Publications Inc. in Journal of Medical Internet Research
- Vol. 28, e74304
Top Cited PapersOpen AccessDeveloping an AI-Assisted Tool That Identifies Patients With Multimorbidity and Complex Polypharmacy to Improve the Process of Medication Reviews: Qualitative Interview and Focus Group Study
Background: Structured medication reviews (SMRs) are an essential component of medication optimization, especially for patients with multimorbidity and polypharmacy. However, the process remains challenging due to the complexities of patient data, time constraints, and the need for coordination among health care professionals (HCPs). This study explores HCPs’ perspectives on the integration of artificial intelligence (AI)–assisted tools to enhance the SMR process, with a focus on the potential benefits of and barriers to adoption. Objective: This study aims to identify the key user requirements for AI-assisted tools to improve the efficiency and effectiveness of SMRs, specifically for patients with multimorbidity, complex polypharmacy, and frailty. Methods: A qualitative study was conducted involving focus groups and semistructured interviews with HCPs and patients in the United Kingdom. Participants included physicians, pharmacists, clinical pharmacologists, psychiatrists from primary and secondary care, a policy maker, and patients with multimorbidity. Data were analyzed using a hybrid inductive and deductive thematic analysis approach to identify themes related to AI-assisted tool functionality, workflow integration, user-interface visualization, and usability in the SMR process. Results: Four major themes emerged from the analysis: innovative AI potential, optimizing electronic patient record visualization, functionality of the AI tool for SMRs, and facilitators of and barriers to AI tool implementation. HCPs identified the potential of AI to support patient identification and prioritizing those at risk of medication-related harm. AI-assisted tools were viewed as essential in detecting prescribing gaps, drug interactions, and patient risk trajectories over time. Participants emphasized the importance of presenting patient data in an intuitive format, with a patient interface for shared decision-making. Suggestions included color-coding blood results, highlighting critical medication reviews, and providing timelines of patient medical histories. HCPs stressed the need for AI tools to integrate seamlessly with existing electronic patient record systems and provide actionable insights without overwhelming users with excessive notifications or “pop-up” alerts. Factors influencing the uptake of AI-assisted tools included the need for user-friendly design, evidence of tool effectiveness (though some were skeptical about the predictive accuracy of AI models), and addressing concerns around digital exclusion. Conclusions: The findings highlight the potential for AI-assisted tools to streamline and optimize the SMR process, particularly for patients with multimorbidity and complex polypharmacy. However, successful implementation depends on addressing concerns related to workflow integration, user acceptance, and evidence of effectiveness. User-centered design is crucial to ensure that AI-assisted tools support HCPs in delivering high-quality, patient-centered care while minimizing cognitive overload and alert fatigue.
- 10 December 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 32 (2) , 1850-1863
OM4AnI: A Novel Overlap Measure for Anomaly Identification in Multi-Class Scatterplots
Scatterplots are widely used across various domains to identify anomalies in datasets, particularly in multi-class settings, such as detecting misclassified or mislabeled data. However, scatterplot effectiveness often declines with large datasets due to limited display resolution. This paper introduces a novel Visual Quality Measure (VQM) – OM4AnI (Overlap Measure for Anomaly Identification) – which quantifies the degree of overlap for identifying anomalies, helping users estimate how effectively anomalies can be observed in multi-class scatterplots. OM4AnI begins by computing anomaly index based on each data point's position relative to its class cluster. The scatterplot is then discretized into a matrix representation by binning the display space into cell-level (pixel-level) grids and computing the coverage for each pixel. It takes into account the anomaly index of data points covering these pixels and visual features (marker shapes, marker sizes, and rendering orders). Building on this foundation, we sum all the coverage information in each cell (pixel) of matrix representation to obtain the final quality score with respect to anomaly identification. We conducted an evaluation to analyze the efficiency, effectiveness, sensitivity of OM4AnI in comparison with six representative baseline methods that are based on different computation granularity levels: data level, marker level, and pixel level. The results show that OM4AnI outperforms baseline methods by exhibiting more monotonic trends against the ground truth and greater sensitivity to rendering order, unlike the baseline methods. It confirms that OM4AnI can inform users about how effectively their scatterplots support anomaly identification. Overall, OM4AnI shows strong potential as an evaluation metric and for optimizing scatterplots through automatic adjustment of visual parameters.
- 10 December 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 32 (2) , 1850-1863
OM4AnI: A Novel Overlap Measure for Anomaly Identification in Multi-Class Scatterplots
Scatterplots are widely used across various domains to identify anomalies in datasets, particularly in multi-class settings, such as detecting misclassified or mislabeled data. However, scatterplot effectiveness often declines with large datasets due to limited display resolution. This paper introduces a novel Visual Quality Measure (VQM) – OM4AnI (Overlap Measure for Anomaly Identification) – which quantifies the degree of overlap for identifying anomalies, helping users estimate how effectively anomalies can be observed in multi-class scatterplots. OM4AnI begins by computing anomaly index based on each data point's position relative to its class cluster. The scatterplot is then discretized into a matrix representation by binning the display space into cell-level (pixel-level) grids and computing the coverage for each pixel. It takes into account the anomaly index of data points covering these pixels and visual features (marker shapes, marker sizes, and rendering orders). Building on this foundation, we sum all the coverage information in each cell (pixel) of matrix representation to obtain the final quality score with respect to anomaly identification. We conducted an evaluation to analyze the efficiency, effectiveness, sensitivity of OM4AnI in comparison with six representative baseline methods that are based on different computation granularity levels: data level, marker level, and pixel level. The results show that OM4AnI outperforms baseline methods by exhibiting more monotonic trends against the ground truth and greater sensitivity to rendering order, unlike the baseline methods. It confirms that OM4AnI can inform users about how effectively their scatterplots support anomaly identification. Overall, OM4AnI shows strong potential as an evaluation metric and for optimizing scatterplots through automatic adjustment of visual parameters.
- Open Access
DECOVID: A UK Two-Center Harmonized Database of Acute Care Electronic Health Records for COVID-19 Research
The DECOVID database contains harmonized pseudonymized electronic health record (EHR) data on all adult (≥18 years old) patients presenting to two large, digitally mature centers in the United Kingdom between 1 January 2020 and 28 February 2021, with follow-up until at least 28 March 2021. The database was originally developed to support the COVID-19 response but is now available via the PIONEER data hub for researchers to explore a wide range of research questions, including exploratory analyses, risk factor assessment, prediction modeling, and comparative effectiveness studies. Raw data were extracted from local EHRs and transformed into a standardized form (Observational Health Data Sciences and Informatics-Common Data Model version 5.3.1). The database includes 165,420 patients across 256,804 hospital presentations. For these patients, highly granular data are available, including patient demographics, longitudinal vital signs, physiology, treatments, laboratory findings, clinical diagnoses, and outcomes. There are 10,030 patients with COVID-19, of whom 1472 died in hospital.
Open AccessDECOVID: A UK Two-Center Harmonized Database of Acute Care Electronic Health Records for COVID-19 Research
The DECOVID database contains harmonized pseudonymized electronic health record (EHR) data on all adult (≥18 years old) patients presenting to two large, digitally mature centers in the United Kingdom between 1 January 2020 and 28 February 2021, with follow-up until at least 28 March 2021. The database was originally developed to support the COVID-19 response but is now available via the PIONEER data hub for researchers to explore a wide range of research questions, including exploratory analyses, risk factor assessment, prediction modeling, and comparative effectiveness studies. Raw data were extracted from local EHRs and transformed into a standardized form (Observational Health Data Sciences and Informatics-Common Data Model version 5.3.1). The database includes 165,420 patients across 256,804 hospital presentations. For these patients, highly granular data are available, including patient demographics, longitudinal vital signs, physiology, treatments, laboratory findings, clinical diagnoses, and outcomes. There are 10,030 patients with COVID-19, of whom 1472 died in hospital.
- 12 June 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Computer Graphics and Applications
- Vol. 45 (2) , 135-142
Reflections on the Use of Dashboards in the COVID-19 Pandemic
Dashboards have arguably been the most used visualizations during the COVID-19 pandemic. They were used to communicate its evolution to national governments for disaster mitigation, to the public domain to inform about its status, and to epidemiologists to comprehend and predict the evolution of the disease. Each design had to be tailored for different tasks and to varying audiences—in many cases set up in a very short time due to the urgent need. In this article, we collect notable examples of dashboards and reflect on their use and design during the pandemic from a user-oriented perspective. We interview a group of researchers with varying visualization expertise who actively used dashboards during the pandemic as part of their daily workflow. We discuss our findings and compile a list of lessons learned to support future visualization researchers and dashboard designers.
- 12 June 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Computer Graphics and Applications
- Vol. 45 (2) , 135-142
Reflections on the Use of Dashboards in the COVID-19 Pandemic
Dashboards have arguably been the most used visualizations during the COVID-19 pandemic. They were used to communicate its evolution to national governments for disaster mitigation, to the public domain to inform about its status, and to epidemiologists to comprehend and predict the evolution of the disease. Each design had to be tailored for different tasks and to varying audiences—in many cases set up in a very short time due to the urgent need. In this article, we collect notable examples of dashboards and reflect on their use and design during the pandemic from a user-oriented perspective. We interview a group of researchers with varying visualization expertise who actively used dashboards during the pandemic as part of their daily workflow. We discuss our findings and compile a list of lessons learned to support future visualization researchers and dashboard designers.
- Open Access
- 12 November 2024
- Published by The Open Journal in Journal of Open Source Software
- Vol. 9 (103) , 6925
SetVis: Visualizing Large Numbers of Sets and Intersections
Set-type data occurs in many domains such as life sciences (Lamy & Tsopra, 2019), health (Landolfi et al., 2022) and the retail industry (Adnan & Ruddle, 2018), as well as in generic applications such as analysing structures of missing data (Ruddle, Adnan, & Hall, 2022) and association rule mining (Wang et al., 2020). SetVis is new matrix-based set visualization software, implemented as a Python package which is available from PyPi. The documentation is available from setvis.readthedocs.io which contains various hands-on Jupyter notebooks guiding users to use the package. SetVis uses a memory-efficient design, operates with datasets held in RAM or a database such as PostgreSQL, and allows user interaction graphically or programmatically. A technical evaluation shows that SetVis uses orders of magnitude less memory than the UpSet (Lex et al., 2014) Python package (Nothman, 2022).
- 12 November 2024
- Published by The Open Journal in Journal of Open Source Software
- Vol. 9 (103) , 6925
Open AccessSetVis: Visualizing Large Numbers of Sets and Intersections
Set-type data occurs in many domains such as life sciences (Lamy & Tsopra, 2019), health (Landolfi et al., 2022) and the retail industry (Adnan & Ruddle, 2018), as well as in generic applications such as analysing structures of missing data (Ruddle, Adnan, & Hall, 2022) and association rule mining (Wang et al., 2020). SetVis is new matrix-based set visualization software, implemented as a Python package which is available from PyPi. The documentation is available from setvis.readthedocs.io which contains various hands-on Jupyter notebooks guiding users to use the package. SetVis uses a memory-efficient design, operates with datasets held in RAM or a database such as PostgreSQL, and allows user interaction graphically or programmatically. A technical evaluation shows that SetVis uses orders of magnitude less memory than the UpSet (Lex et al., 2014) Python package (Nothman, 2022).
- 25 July 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 109-118
Using Visualization Methods for Improving Web Navigation
Using either a search engine or website navigation can pose difficulties for web users in certain situations. Therefore, creating a useful visualization of the website structure can aid web users in navigating through a website. By employing visualization techniques, the website structure can be presented as regions that provide clarity on all pages, links, and labels. To address these challenges, our goal is to identify the top three existing visualization layouts that improve website navigation. To achieve this, we aim to evaluate different types of existing visualization layouts by applying the region mechanism to visualize website structures. Initially, we designed a region mechanism that ensures scalability and ease of navigation and understanding for website structures. Subsequently, we conducted a technical evaluation to assess the performance of 12 existing visualization layouts on a website structure. During the evaluation, we generated 12 layouts for each webpage in the University of London (UoL) website. We then calculated three metrics for each layout: average aspect ratio, visualization area, and label overlapping. Finally, based on the results obtained, we identified the three most suitable visualization layouts for visualizing a website structure. These selections were made based on low aspect ratio and stability, effective control of the visualization area, and support for readability. Overall, this research focuses on improving website navigation by evaluating existing visualization layouts and selecting the most suitable ones. The chosen layouts are determined based on their ability to maintain low aspect ratio, ensure stability, control visualization area, and support readability.
- 25 July 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 109-118
Using Visualization Methods for Improving Web Navigation
Using either a search engine or website navigation can pose difficulties for web users in certain situations. Therefore, creating a useful visualization of the website structure can aid web users in navigating through a website. By employing visualization techniques, the website structure can be presented as regions that provide clarity on all pages, links, and labels. To address these challenges, our goal is to identify the top three existing visualization layouts that improve website navigation. To achieve this, we aim to evaluate different types of existing visualization layouts by applying the region mechanism to visualize website structures. Initially, we designed a region mechanism that ensures scalability and ease of navigation and understanding for website structures. Subsequently, we conducted a technical evaluation to assess the performance of 12 existing visualization layouts on a website structure. During the evaluation, we generated 12 layouts for each webpage in the University of London (UoL) website. We then calculated three metrics for each layout: average aspect ratio, visualization area, and label overlapping. Finally, based on the results obtained, we identified the three most suitable visualization layouts for visualizing a website structure. These selections were made based on low aspect ratio and stability, effective control of the visualization area, and support for readability. Overall, this research focuses on improving website navigation by evaluating existing visualization layouts and selecting the most suitable ones. The chosen layouts are determined based on their ability to maintain low aspect ratio, ensure stability, control visualization area, and support readability.
- 6 January 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 30 (7) , 3400-3412
Tasks and Visualizations Used for Data Profiling: A Survey and Interview Study
The use of good-quality data to inform decision making is entirely dependent on robust processes to ensure it is fit for purpose. Such processes vary between organisations, and between those tasked with designing and following them. In this paper we report on a survey of 53 data analysts from many industry sectors, 24 of whom also participated in in-depth interviews, about computational and visual methods for characterizing data and investigating data quality. The paper makes contributions in two key areas. The first is to data science fundamentals, because our lists of data profiling tasks and visualization techniques are more comprehensive than those published elsewhere. The second concerns the application question “what does good profiling look like to those who routinely perform it?,” which we answer by highlighting the diversity of profiling tasks, unusual practice and exemplars of visualization, and recommendations about formalizing processes and creating rulebooks.
- 6 January 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Visualization and Computer Graphics
- Vol. 30 (7) , 3400-3412
Tasks and Visualizations Used for Data Profiling: A Survey and Interview Study
The use of good-quality data to inform decision making is entirely dependent on robust processes to ensure it is fit for purpose. Such processes vary between organisations, and between those tasked with designing and following them. In this paper we report on a survey of 53 data analysts from many industry sectors, 24 of whom also participated in in-depth interviews, about computational and visual methods for characterizing data and investigating data quality. The paper makes contributions in two key areas. The first is to data science fundamentals, because our lists of data profiling tasks and visualization techniques are more comprehensive than those published elsewhere. The second concerns the application question “what does good profiling look like to those who routinely perform it?,” which we answer by highlighting the diversity of profiling tasks, unusual practice and exemplars of visualization, and recommendations about formalizing processes and creating rulebooks.