Edward Y. Zamrini

Transformer is the latest deep neural network (DNN) architecture for sequence data learning, which has revolutionized the field of natural language processing. This success has motivated researchers to explore its application in the healthcare domain. Despite the similarities between longitudinal clinical data and natural language data, clinical data presents unique complexities that make adapting Transformer to this domain challenging. To address this issue, we have designed a new Transformer-based DNN architecture, referred to as Hybrid Value-Aware Transformer (HVAT), which can jointly learn from longitudinal and non-longitudinal clinical data. HVAT is unique in the ability to learn from the numerical values associated with clinical codes/concepts such as labs, and in the use of a flexible longitudinal data representation called clinical tokens. We have also trained a prototype HVAT model on a case-control dataset, achieving high performance in predicting Alzheimer’s disease and related dementias as the patient outcome. The results demonstrate the potential of HVAT for broader clinical data-learning tasks.

The high cost and time for developing a new drug or repositioning a partially-developed drug has fueled interest in “repurposing” drugs. Drug repurposing is particularly of interest for Alzheimer’s disease (AD) or AD-related dementias (ADRD) because there are no unrestricted disease-modifying treatments for ADRD. We have designed and pilot tested a 3-Step Medication-Wide Association Study Plus (MWAS+) approach to rigorously accelerate the identification of drugs with a high potential to be repurposed for delaying and preventing AD/ADRD: Step 1 is a hypothesis-free exploration; Step 2 is mechanistic filtering; And Step 3 is hypothesis testing using observational data and prospective cohort design. Our results demonstrated the feasibility of the MWAS+ approach. The Step 1 analysis identified potential candidate drugs including atorvastatin and GLP1. The literature search in Step 2 found evidence supporting the mechanistic plausibility of the statin-ADRD association. Finally, Step 3 confirmed our hypothesis that statin may lower the risk of incident ADRD, which was statistically significant using a target trial design that emulated randomized controlled trials.