Lei Liu
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Lei Liu has a total of 31 co-authors. Here are the top co-authors by number of shared publications:
- Teresa M. Ober
Transcend Education
4 shared publications - Field M. Watts
ETS Research Institute, ETS, Princeton, NJ, USA
3 shared publications - Ou Lydia Liu
Educational Testing Service
3 shared publications - Xiaoming Zhai
University of Georgia
3 shared publications - David Nitkin
Transcend Education
2 shared publications - Ninghao Liu
The Hong Kong Polytechnic University, Hong Kong, Hong Kong
2 shared publications
Latest Publications
- Open Access
- 9 July 2026
- Published by Association for Computing Machinery (ACM)
- p. 876
Connecting Calculus to Computing Education A Conceptual Mapping Tool to Support Disciplinary Applications
- 9 July 2026
- Published by Association for Computing Machinery (ACM)
- p. 876
Open AccessConnecting Calculus to Computing Education A Conceptual Mapping Tool to Support Disciplinary Applications
- 27 June 2026
- Published by Springer Nature
- p. 507-515
AI Evaluation and Feedback to Support Middle-School Students’ Scientific Argumentation and Reasoning
- 27 June 2026
- Published by Springer Nature
- p. 507-515
AI Evaluation and Feedback to Support Middle-School Students’ Scientific Argumentation and Reasoning
- 1 May 2026
- Published by Springer Nature
- p. 219-246
Addressing Challenges of Science Assessment with Artificial Intelligence
- 1 May 2026
- Published by Springer Nature
- p. 219-246
Addressing Challenges of Science Assessment with Artificial Intelligence
- Open Access
- 8 November 2025
- Published by MDPI AG in Education Sciences
- Vol. 15 (11) , 1507
A Framework for Designing an AI Chatbot to Support Scientific Argumentation
As large language models (LLMs) are increasingly used to support learning, there is a growing need for a principled framework to guide the design of LLM-based tools and resources that are pedagogically effective and contextually responsive. This study proposes a framework by examining how prompt engineering can enhance the quality of chatbot responses to support middle school students’ scientific reasoning and argumentation. Drawing on learning theories and established frameworks for scientific argumentation, we employed a design-based research approach to iteratively refine system prompts and evaluate LLM-generated responses across diverse student input scenarios. Our analysis highlights how different prompt configurations affect the relevance and explanatory depth of chatbot feedback. We report findings from the iterative refinement process, along with an analysis of the quality of responses generated by each version of the chatbot. The outcomes indicate how different prompt configurations influence the coherence, relevance, and explanatory processes of LLM responses. The study contributes a set of critical design principles for developing theory-aligned prompts that enable LLM-based chatbots to meaningfully support students in constructing and revising scientific arguments. These principles offer broader implications for designing LLM applications across varied educational domains.
- 8 November 2025
- Published by MDPI AG in Education Sciences
- Vol. 15 (11) , 1507
Open AccessA Framework for Designing an AI Chatbot to Support Scientific Argumentation
As large language models (LLMs) are increasingly used to support learning, there is a growing need for a principled framework to guide the design of LLM-based tools and resources that are pedagogically effective and contextually responsive. This study proposes a framework by examining how prompt engineering can enhance the quality of chatbot responses to support middle school students’ scientific reasoning and argumentation. Drawing on learning theories and established frameworks for scientific argumentation, we employed a design-based research approach to iteratively refine system prompts and evaluate LLM-generated responses across diverse student input scenarios. Our analysis highlights how different prompt configurations affect the relevance and explanatory depth of chatbot feedback. We report findings from the iterative refinement process, along with an analysis of the quality of responses generated by each version of the chatbot. The outcomes indicate how different prompt configurations influence the coherence, relevance, and explanatory processes of LLM responses. The study contributes a set of critical design principles for developing theory-aligned prompts that enable LLM-based chatbots to meaningfully support students in constructing and revising scientific arguments. These principles offer broader implications for designing LLM applications across varied educational domains.
- Open Access
- 1 September 2025
- Published by National Council on Measurement in Education (NCME) in Chinese/english Journal of Educational Measurement and Evaluation
- Vol. 6 (3) , 1
Aligning Models of Competency-based Education with Skills for the Future
Essential competencies such as collaboration and critical thinking, integral to long-term success, have been notably absent from traditional curricula, as the current instructional materials largely focus on disciplinary domains. Previous research, as highlighted by Liu, Kell, Ling et al. (2023), established a compelling link between these competencies and success across educational, occupational, civic, and health and wellbeing outcomes. The Skills for the Future, a joint initiative by ETS and Carnegie Foundation, presents a comprehensive approach to transform skills identification, demonstration, and verification. The initiative aims to create an ecosystem for skills consisting of a skills framework, assessment, extraction, and insight, skill-based credentialing, an integrated data warehouse, professional learning communities, and a supportive network of partnerships within a community of practice. To illustrate the practical implementation of the skills ecosystem's features, this paper presents five unique school and program models that have organically leveraged components of the proposed skills ecosystem in delivering competency-based education to support students and educators while fostering meaningful connections more optimally within the school community.
- 1 September 2025
- Published by National Council on Measurement in Education (NCME) in Chinese/english Journal of Educational Measurement and Evaluation
- Vol. 6 (3) , 1
Open AccessAligning Models of Competency-based Education with Skills for the Future
Essential competencies such as collaboration and critical thinking, integral to long-term success, have been notably absent from traditional curricula, as the current instructional materials largely focus on disciplinary domains. Previous research, as highlighted by Liu, Kell, Ling et al. (2023), established a compelling link between these competencies and success across educational, occupational, civic, and health and wellbeing outcomes. The Skills for the Future, a joint initiative by ETS and Carnegie Foundation, presents a comprehensive approach to transform skills identification, demonstration, and verification. The initiative aims to create an ecosystem for skills consisting of a skills framework, assessment, extraction, and insight, skill-based credentialing, an integrated data warehouse, professional learning communities, and a supportive network of partnerships within a community of practice. To illustrate the practical implementation of the skills ecosystem's features, this paper presents five unique school and program models that have organically leveraged components of the proposed skills ecosystem in delivering competency-based education to support students and educators while fostering meaningful connections more optimally within the school community.
- Open Access
- 1 September 2025
- Published by National Council on Measurement in Education (NCME) in Chinese/english Journal of Educational Measurement and Evaluation
- Vol. 6 (3) , 2
能力导向教育模式与未来技能的对接研究
由于目前的教学材料主要侧重于学科领域,因此传统的教学课程明显缺乏对协同合作和批判性思维等长期成功所必需的基本能力的培养。而正如 Liu、Kell、Ling 等人 (2023) 所强调,之前的研究成果发现了这些能力与教育、职业、公共事务、健康和福祉等方面成果之间的紧密联系。美国教育考试服务中心 (ETS) 和卡内基基金会联合发起的“未来技能 (Skills for the Future, SFF)”计划提出了一种综合方法,以改变技能的识别、展示和验证过程。该计划旨在创建一个技能生态系统,包括技能框架、评估、提取和洞察、基于技能的认证、集成数据仓库、教师专业学习社区以及实践社区内的支持性合作伙伴关系网络。为了说明该技能生态系统功能的实际实施,本文介绍了五种独特的学校和项目模式,这些模式有机地利用了该技能生态系统的组件来实施能力本位教育,以支持学生和教育工作者,同时在学校社区内建立有意义的联系。
- 1 September 2025
- Published by National Council on Measurement in Education (NCME) in Chinese/english Journal of Educational Measurement and Evaluation
- Vol. 6 (3) , 2
Open Access能力导向教育模式与未来技能的对接研究
由于目前的教学材料主要侧重于学科领域,因此传统的教学课程明显缺乏对协同合作和批判性思维等长期成功所必需的基本能力的培养。而正如 Liu、Kell、Ling 等人 (2023) 所强调,之前的研究成果发现了这些能力与教育、职业、公共事务、健康和福祉等方面成果之间的紧密联系。美国教育考试服务中心 (ETS) 和卡内基基金会联合发起的“未来技能 (Skills for the Future, SFF)”计划提出了一种综合方法,以改变技能的识别、展示和验证过程。该计划旨在创建一个技能生态系统,包括技能框架、评估、提取和洞察、基于技能的认证、集成数据仓库、教师专业学习社区以及实践社区内的支持性合作伙伴关系网络。为了说明该技能生态系统功能的实际实施,本文介绍了五种独特的学校和项目模式,这些模式有机地利用了该技能生态系统的组件来实施能力本位教育,以支持学生和教育工作者,同时在学校社区内建立有意义的联系。
- 1 February 2017
- Published by Wiley in Journal of Educational Measurement
- Vol. 54 (1) , 70-84
Measuring Student Engagement During Collaboration
- 1 February 2017
- Published by Wiley in Journal of Educational Measurement
- Vol. 54 (1) , 70-84
Measuring Student Engagement During Collaboration
- Open Access
- 31 December 2012
- Published by Asian Pacific Organization for Cancer Prevention in Asian Pacific Journal of Cancer Prevention
- Vol. 13 (12) , 6077-6081
Pretreatment Thrombocytosis as a Prognostic Factor in Women with Gynecologic Malignancies: a Meta-analysis
Pretreatment Thrombocytosis as a Prognostic Factor in Women with Gynecologic Malignancies: a Meta-analysis Thrombocytosis;gynecologic malignancies;meta;analysis;prognosis; Background: This study was performed to analyze the prognostic implications of pretreatment or preoperative thrombocytosis in women with gynecologic malignancies. Material and Methods: We surveyed 2 medical databases, PubMed and EMBASE, to identified all relevant studies. A total of 14 (n=3,490) that evaluated the link between thrombocytosis and 5-year survival were included. REVMAN version 5.1 was used for our analysis and publication bias was evaluated using the Begg's funnel plot and tested by STATA 11.0. Risk ratios (RRs) with 95% confidence intervals (CIs) generated by the random effect model were used to assess the strength of any association. Results: 709(20.3%) of the 3,490 patients exhibited thrombocytosis (platelet counts > $400{\times}10^9/L$) at primary diagnosis, and their mortality was 1.62-fold higher compared with the others (RR=1.62, 95%CI=[1.28-2.05], p<0.0001). Thrombocytosis failed to have a stronger effect on the survival of advanced patients of stages III to IV in our study (n=478, RR=1.29, 95% CI=[1.13-1.48], p=0.0003), nor in women with cervical cancer in stage IB (n=1371, RR=1.73, 95% CI=[1.71-2.58], p=0.007). In addition, when adjusted for different carcinoma, it was associated with worse prognosis for all except the ones with vulvar cancer (n=201, RR=0.43, 95% CI=[0.14-1.29], p=0.13). Conclusions: This meta-analysis indicated that thrombocytosis might be associated with a worse prognosis for patients with gynecologic malignancies but without specificity or sensitivity for the ones in advanced stage. When adjusted for different gynecologic malignancies, it showed a significant effect on survival of all except vulvar cancers.
- 31 December 2012
- Published by Asian Pacific Organization for Cancer Prevention in Asian Pacific Journal of Cancer Prevention
- Vol. 13 (12) , 6077-6081
Open AccessPretreatment Thrombocytosis as a Prognostic Factor in Women with Gynecologic Malignancies: a Meta-analysis
Pretreatment Thrombocytosis as a Prognostic Factor in Women with Gynecologic Malignancies: a Meta-analysis Thrombocytosis;gynecologic malignancies;meta;analysis;prognosis; Background: This study was performed to analyze the prognostic implications of pretreatment or preoperative thrombocytosis in women with gynecologic malignancies. Material and Methods: We surveyed 2 medical databases, PubMed and EMBASE, to identified all relevant studies. A total of 14 (n=3,490) that evaluated the link between thrombocytosis and 5-year survival were included. REVMAN version 5.1 was used for our analysis and publication bias was evaluated using the Begg's funnel plot and tested by STATA 11.0. Risk ratios (RRs) with 95% confidence intervals (CIs) generated by the random effect model were used to assess the strength of any association. Results: 709(20.3%) of the 3,490 patients exhibited thrombocytosis (platelet counts > $400{\times}10^9/L$) at primary diagnosis, and their mortality was 1.62-fold higher compared with the others (RR=1.62, 95%CI=[1.28-2.05], p<0.0001). Thrombocytosis failed to have a stronger effect on the survival of advanced patients of stages III to IV in our study (n=478, RR=1.29, 95% CI=[1.13-1.48], p=0.0003), nor in women with cervical cancer in stage IB (n=1371, RR=1.73, 95% CI=[1.71-2.58], p=0.007). In addition, when adjusted for different carcinoma, it was associated with worse prognosis for all except the ones with vulvar cancer (n=201, RR=0.43, 95% CI=[0.14-1.29], p=0.13). Conclusions: This meta-analysis indicated that thrombocytosis might be associated with a worse prognosis for patients with gynecologic malignancies but without specificity or sensitivity for the ones in advanced stage. When adjusted for different gynecologic malignancies, it showed a significant effect on survival of all except vulvar cancers.
- 21 December 2012
- Published by Springer Nature
- p. 75-92
Promoting the Collaborative Use of Cognitive and Metacognitive Skills Through Conceptual Representations in Hypermedia
- 21 December 2012
- Published by Springer Nature
- p. 75-92
Promoting the Collaborative Use of Cognitive and Metacognitive Skills Through Conceptual Representations in Hypermedia