UserFlow: A Tool for Visualizing Fine-grained Contextual Analytics in Teaching Documents
Authors:
Open Access
- 15 June 2020
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 384-390
Abstract
The adoption of innovative online teaching tools in Computer Science (CS) courses provides opportunities for data-informed instruction as a regular teaching practice in CS classrooms. In this paper, we present a design study for an interactive visual analytics dashboard, called UserFlow, that supports feedback collection from teaching documents and assists instructors in interpreting feedback and acting on it in a timely manner. The design study is conducted with eight domain experts comprising of four teaching instructors, two learning analytics (LA) experts and two instructional designers. UserFlow offers a set of novel visualization designs for presenting the four interleaving aspects of document engagement (i.e., annotations, document traversal path, reading/focus time and student information). We evaluated UserFlow in an undergraduate computer science course with over 700 students. Our results demonstrate the usefulness and need for such a tool for CS educators to inform teaching approaches and courseware improvement.Keywords
This publication has 18 references indexed in Scilit:
- Let’s not forget: Learning analytics are about learningTechTrends, 2014
- The student prompt: Student feedback and change in teaching practices in postsecondary computer science2014
- Using feature selection and association rule mining to evaluate digital courseware2013
- Tensions in human-centred designCoDesign, 2011
- Collecting student feedback: a comparison of questionnaire and other methodsAssessment & Evaluation in Higher Education, 2008
- Nasa-Task Load Index (NASA-TLX); 20 Years LaterProceedings of the Human Factors and Ergonomics Society Annual Meeting, 2006
- Interactive Sankey diagrams2005
- Visualising student tracking data to support instructors in web-based distance education2004
- Changing the Agenda for Research into Students' Views about University Teaching: Four shortcomings of SRT researchTeaching in Higher Education, 2003
- Deep and surface learning: a simple or simplistic dichotomy?Accounting Education, 1997