John C. Hogenbirk

This paper reports the findings of a Canada based multi-institutional study designed to investigate the relationships between admissions criteria, in-program assessments, and performance on licensing exams. The study’s objective is to provide valuable insights for improving educational practices across different institutions. Data were gathered from six medical schools: McMaster University, the Northern Ontario School of Medicine University, Queen’s University, University of Ottawa, University of Toronto, and Western University. The dataset includes graduates who undertook the Medical Council of Canada Qualifying Examination Part 1 (MCCQE1) between 2015 and 2017. The data were categorized into five distinct sections: demographic information as well as four matrices: admissions, course performance, objective structured clinical examination (OSCE), and clerkship performance. Common and unique variables were identified through an extensive consensus-building process. Hierarchical linear regression and a manual stepwise variable selection approach were used for analysis. Analyses were performed on data set encompassing graduates of all six medical schools as well as on individual data sets from each school. For the combined data set the final model estimated 32% of the variance in performance on licensing exams, highlighting variables such as Age at Admission, Sex, Biomedical Knowledge, the first post-clerkship OSCE, and a clerkship theta score. Individual school analysis explained 41–60% of the variance in MCCQE1 outcomes, with comparable variables to the analysis from of the combined data set identified as significant independent variables. Therefore, strongly emphasising the need for variety of high-quality assessment on the educational continuum. This study underscores the importance of sharing data to enable educational insights. This study also had its challenges when it came to the access and aggregation of data. As such we advocate for the establishment of a common framework for multi-institutional educational research, facilitating studies and evaluations across diverse institutions. This study demonstrates the scientific potential of collaborative data analysis in enhancing educational outcomes. It offers a deeper understanding of the factors influencing performance on licensure exams and emphasizes the need for addressing data gaps to advance multi-institutional research for educational improvements.

Introduction: The study predicted practice location of doctors trained at a socially accountable medical school with education programs in over 90 communities. Methods: A cross-sectional study examined practice location 10 years after the first class graduated from the Northern Ontario School of Medicine (NOSM), Canada. Exact tests and logistic regression models were used to assess practice location in northern Ontario; northern Canada; or other region; and rural (population <10,000) or urban community. Results: There were 435 doctors with 334 (77%) practising as family doctors (FPs), 62 (14%) as generalist specialists and 39 (9%) as other medical or surgical specialists. Approximately 92% (128/139) of FPs who completed both UG and PG at NOSM practised in northern Ontario in 2019, compared with 63% (43/68) who completed only their PG at NOSM, and 24% (30/127) who completed only their UG at NOSM. Overall, 37% (23/62) of generalist specialists and 23% (9/39) of other specialists practised in northern Ontario. Approximately 28% (93/334) of FPs practised in rural Canada compared with 4% (4/101) of all other specialists. FP northern Ontario practice was predicted by completing UG and PG at NOSM (adjusted odds ratio = 46, 95% confidence interval = 20–103) or completing only PG at NOSM (15, 6.0–38) relative to completing only UG at NOSM, and having a northern Ontario hometown (5.3, 2.3–12). Rural Canada practice was predicted by rural hometown (2.3, 1.3–3.8), completing only a NOSM PG (2.0, 1.0–3.9), and age (1.4, 1.1–1.8). Conclusion: This study uniquely demonstrated the interaction of two mechanisms by which medical schools can increase the proportion of doctors’ practices located in economically deprived regions: first, admit medical students who grow up in the region; and second, provide immersive UG and PG medical education in the region. Both mechanisms have enabled the majority of NOSM-trained doctors to practise in the underserved region of northern Ontario.

Background Enhanced Recovery After Surgery (ERAS) programs include preoperative, intraoperative and postoperative clinical pathways to improve quality of patient care while reducing length of stay and readmission. This study assessed the feasibility and outcomes of an ERAS protocol for colorectal surgery implemented over two-years in a small, resource-challenged rural hospital. Study design A prospective cohort study used retrospectively matched controls to assess the effect of ERAS on LOS in patients undergoing colorectal surgery in a small rural hospital in northern Ontario, Canada. ERAS patients were matched to two patients in the control group based on diagnosis, age and gender. Patients had open or laparoscopic colorectal surgeries, with those in the intervention group treated per ERAS protocol and given instructions on pre- and post-operative self-care. Results Most ERAS patients reported adherence to ERAS protocols prior to surgery. Approximately one quarter of patients chose not to complete the postoperative survey. Of those who completed the survey, adherence to protocol was strongest for chewing gum in the days after surgery. Most patients were sitting in a chair for their afternoon meal by the first day and most were walking down the hallway by the second day. The control and ERAS patient groups did not differ significantly (p≥0.07) in age ( years, sd=13.1), gender (52% male), nor in the Canadian Classification of Health Interventions 5-character code. The control group significantly higher (pConclusion This study found that ERAS could be implemented in a small rural hospital and provided evidence for a reduced LOS of approximately two days.

Background: Medical schools with distributed or regional programs encourage people to live, work, and learn in communities that may be economically challenged. Local spending by the program, staff, teachers, and students has a local economic impact. Although the economic impact of DME has been estimated for nations and sub-national regions, the community-specific impact is often unknown. Communities that contribute to the success of DME have an interest in knowing the local economic impact of this participation. To provide this information, we estimated the economic impact of the Northern Ontario School of Medicine (NOSM) on selected communities in the historically medically underserviced and economically disadvantaged Northern Ontario region. Methods: Economic impact was estimated by a cash-flow local economic model. Detailed data on program and learner spending were obtained for Northern Ontario communities. We included spending on NOSM’s distributed education and research programs, medical residents’ salary program, the clinical teachers’ reimbursement program, and spending by learners. Economic impact was estimated from total spending in the community adjusted by an economic multiplier based on community population size, industry diversity, and propensity to spend locally. Community employment impact was also estimated. Results: In 2019, direct program and learner spending in Northern Ontario totalled $64.6 M (million) Canadian Dollars. Approximately 76% ($49.1 M) was spent in the two largest population centres of 122,000 and 165,000 people, with 1–5% ($0.7 M – $3.1 M) spent in communities of 5000–78,000 people. In 2019, total economic impact in Northern Ontario was estimated to be $107 M, with an impact of $38 M and $36 M in the two largest population centres. The remaining $34 M (32%) of the economic impact occurred in smaller communities or within the region. Expressed alternatively as employment impact, the 404 full time equivalent (FTE) positions supported an additional 298 FTE positions in Northern Ontario. NOSM-trained physicians practising in the region added an economic impact of $88 M. Conclusions: By establishing programs and bringing people to Northern Ontario communities, NOSM added local spending and knowledge-based economic activity to a predominantly resource-based economy. In an economically deprived region, distributed medical education enabled distributed economic impact.

RRH: Rural and Remote Health. Published article number: 5835 - Retaining graduates of non-metropolitan medical schools for practice in the local area: the importance of locally based postgraduate training pathways in Australia and Canada

Purpose: To describe the admissions process and outcomes for Indigenous applicants to the Northern Ontario School of Medicine (NOSM), a Canadian medical school with the mandate to recruit students whose demographics reflect the service region’s population. Method: The authors examined 10-year trends (2006–2015) for self-identified Indigenous applicants through major admission stages. Demographics (age, sex, northern and rural backgrounds) and admission scores (grade point average [GPA], preinterview, multiple mini-interview [MMI], final), along with score-based ranks, of Indigenous and non-Indigenous applicants were compared using Pearson chi-square and Mann–Whitney tests. Binary logistic regression was used to assess the relationship between Indigenous status and likelihood of admission outcomes (interviewed, received offer, admitted). Results: Indigenous qualified applicants (338/17,060; 2.0%) were more likely to be female, mature (25 or older), or of northern or rural background than non-Indigenous applicants. They had lower GPA-based ranks than non-Indigenous applicants ( P < .001) but had comparable preinterview-, MMI-, and final-score-based ranks across all admission stages. Indigenous applicants were 2.4 times more likely to be interviewed and 2.5 times more likely to receive an admission offer, but 3 times less likely to accept an offer than non-Indigenous applicants. Overall, 41/338 (12.1%) Indigenous qualified applicants were admitted compared with 569/16,722 (3.4%) non-Indigenous qualified applicants. Conclusions: Increased representation of Indigenous peoples among applicants admitted to medical school can be achieved through the use of socially accountable admissions. Further tracking of Indigenous students through medical education and practice may help assess the effectiveness of NOSM’s social accountability admissions process.

Understanding the impact of selection and medical education on practice intentions and eventual practice is an essential component of training a fit-for-purpose health workforce distributed according to population need. Existing evidence comes largely from high-income settings and neglects contextual factors. This paper describes the practice intentions of entry and exit cohorts of medical students across low and high income settings and the correlation of student characteristics with these intentions. The Training for Health Equity Network (THEnet) Graduate Outcome Study (GOS) is an international prospective cohort study tracking learners throughout training and ten years into practice as part of the longitudinal impact assessment described in THEnet’s Evaluation Framework. THEnet is an international community of practice of twelve medical schools with a social accountability mandate. Data presented here include cross-sectional entry and exit data obtained from different cohorts of medical students involving eight medical schools in six countries and five continents. Binary logistic regression was used to create adjusted odds ratios for associations with practice intent. Findings from 3346 learners from eight THEnet medical schools in 6 countries collected between 2012 and 2016 are presented. A high proportion of study respondents at these schools come from rural and disadvantaged backgrounds and these respondents are more likely than others to express an intention to work in underserved locations after graduation at both entry and exit from medical school. After adjusting for confounding factors, rural and low income background and regional location of medical school were the most important predictors of intent to practice in a rural location. For schools in the Philippines and Africa, intention to emigrate was more likely for respondents from high income and urban backgrounds. These findings, from a diverse range of schools with social accountability mandates in different settings, provide preliminary evidence for the selection and training of a medical workforce motivated to meet the needs of underserved populations. These respondents are being followed longitudinally to determine the degree to which these intentions translate into actual practice.

The “rural pipeline” suggests that students educated in rural, or other underserviced areas, are more likely to establish practices in such locations. It is upon this concept that the Northern Ontario School of Medicine (NOSM) was founded. Our analysis answers the following question: Are physicians who were educated at NOSM more likely to practice in rural and northern Ontario compared with physicians who were educated at other Canadian medical schools? We used data from the College of Physicians and Surgeons of Ontario. We compared practice locations of certified Ontario family physicians who had graduated from NOSM vs. other Canadian medical schools in 2009 or later. We categorized the physicians according to where they completed their undergraduate (UG) and postgraduate (PG) training, either at NOSM or elsewhere. We used logistic regression models to determine if the location of UG and PG training was associated with rural or northern Ontario practice location. Of the 535 physicians examined, 67 had completed UG and/or PG medical education at NOSM. Over two thirds of physicians with any NOSM education were practicing in northern areas and 25.4% were practicing in rural areas of Ontario compared with those having no NOSM education, with 4.3 and 10.3% in northern and rural areas, respectively. Physicians who graduated from NOSM-UG were more likely to have practices located in rural Ontario (OR = 2.57; p = 0.014) whereas NOSM-PG physicians were more likely to have practices in northern Ontario (OR = 57.88; p < 0.001). NOSM education was associated with an increased likelihood of practicing in rural (NOSM-UG) and northern (NOSM-PG) Ontario.

The Northern Ontario School of Medicine (NOSM) opened in 2005 with a social accountability mandate to address a long history of physician shortages in northern Ontario. The objective of this qualitative study was to understand the school's effect on recruitment of family physicians into medically underserviced rural communities of northern Ontario. We conducted a multiple case study of 8 small rural communities in northern Ontario that were considered medically underserviced by the provincial ministry of health and had successfully recruited NOSM-trained physicians. We interviewed 10 people responsible for physician recruitment in these communities. Interview transcripts were analyzed by means of an inductive and iterative thematic method. All 8 communities were NOSM medical education sites with populations of 1600-16 000. Positive changes, linked to collaboration with NOSM, included achieving a full complement of physicians in 5 communities with previous chronic shortages of 30%-50% of the physician supply, substantial reduction in recruitment expenditures, decreased reliance on locums and a shift from crisis management to long-term planning in recruitment activities. The magnitude of positive changes varied across communities, with individual leadership and communities' active engagement being key factors in successful physician recruitment. Locating medical education sites in underserviced rural communities in northern Ontario and engaging these communities in training rural physicians showed great potential to improve the ability of small rural communities to recruit family physicians and alleviate physician shortages in the region.

Introduction: Northern Ontario is a region in Canada with approximately 775,000 people in communities scattered across 803,000 km ² . The Ontario Telemedicine Network (OTN) facilitates access to medical care in areas that are often underserved. We assessed how OTN utilization differed throughout the province. Materials and Methods: We used OTN medical service utilization data collected through the Ontario Health Insurance Plan and provided by the Ministry of Health and Long Term Care. Using census subdivisions grouped by Northern and Southern Ontario as well as urban and rural areas, we calculated utilization rates per fiscal year and total from 2008/2009 to 2013/2014. We also used billing codes to calculate utilization by therapeutic area of care. Results: There were 652,337 OTN patient visits in Ontario from 2008/2009 to 2013/2014. Median annual utilization rates per 1,000 people were higher in northern areas (rural, 52.0; urban, 32.1) than in southern areas (rural, 6.1; urban, 3.1). The majority of usage in Ontario was in mental health and addictions (61.8%). Utilization in other areas of care such as surgery, oncology, and internal medicine was highest in the rural north, whereas primary care use was highest in the urban south. Conclusions: Utilization was higher and therapeutic areas of care were more diverse in rural Northern Ontario than in other parts of the province. Utilization was also higher in urban Northern Ontario than in Southern Ontario. This suggests that telemedicine is being used to improve access to medical care services, especially in sparsely populated regions of the province.