A Documentary Evaluation of Offline AI Integration in Teacher-in-a-Box OER Programmes for Low-Connectivity Schools
Open Access
- 26 August 2026
- journal article
- Published by Cahaya Ilmu Cendekia in Indonesian Journal of Education Research (IJoER)
- Vol. 7 (4) , 463-479
Abstract
Purpose of the study: To conduct a documentary, ex ante programme evaluation of how a bounded offline AI augmentation could be specified, governed and later tested within an offline OER teacher development programme delivered through Teacher in a Box. Methodology: Documentary programme evaluation using a thesis corpus. Methods: Theory of Change reconstruction, CIPP evaluation framework, directed qualitative content analysis with a scope-aligned codebook, and construct-to-instrument mapping for assessment tools. Offline AI specification is GPT4All class local LLMs plus retrieval-augmented generation (RAG) over the local Teacher in a Box OER and training repository, with governance wrappers. Main Findings: Offline OER effectiveness depends on integrated, in-situ teacher support rather than access alone. Offline AI is most defensible as a governed, retrieval-grounded, teacher-facing layer that improves resource discovery, supports formative assessment routines, and scaffolds assessment literacy. The study outputs measurable CIPP indicators, an evidence-to-implication warrant structure, a baseline-versus-augmentation risk and safeguard matrix, and offline-feasible instruments for formative assessment, summative task quality, character education evidence, and deeper learning portfolios. Novelty/Originality of this study: This study provides an audit-ready, evaluation methodology linking offline OER programmes to offline AI. It advances knowledge by separating evidence, implication, and design claims; specifying a minimum viable governance package; and producing offline-feasible assessment instruments and indicators for formative, summative, character, and deeper learning assessment under low-connectivity conditions, supporting policy and implementation decisions before field trials.Keywords
This publication has 25 references indexed in Scilit:
- The EAP‐AIAS: Adapting the AI Assessment Scale for English for Academic PurposesTESOL Journal, 2026
- Schools’ support in the implementation of the Emancipated Curriculum in secondary schools in IndonesiaCogent Education, 2024
- Chatting and cheating: Ensuring academic integrity in the era of ChatGPTInnovations in Education and Teaching International, 2023
- Ethics of AI in Education: Towards a Community-Wide FrameworkInternational Journal of Artificial Intelligence in Education, 2022
- Conceptualizing AI literacy: An exploratory reviewComputers and Education: Artificial Intelligence, 2021
- Teacher assessment literacy: A three-dimensional modelTeaching and Teacher Education, 2019
- Open educational resources and college textbook choices: a review of research on efficacy and perceptionsEducational Technology Research and Development, 2016
- Rethinking models of feedback for learning: the challenge of designAssessment & Evaluation in Higher Education, 2012
- Assessment Literacy for Teachers: Faddish or Fundamental?Theory Into Practice, 2009
- Assessment and Classroom LearningAssessment in Education: Principles, Policy & Practice, 1998