Using motion capture technology and AI to monitor the progression of movement disorders

Reviewed by Emily Henderson, B.Sc.Jan 23 2023

A multi-disciplinary team of researchers has developed a way to monitor the progression of movement disorders using motion capture technology and AI.

In two ground-breaking studies, published in Nature Medicine, a cross-disciplinary team of AI and clinical researchers have shown that by combining human movement data gathered from wearable tech with a powerful new medical AI technology they are able to identify clear movement patterns, predict future disease progression and significantly increase the efficiency of clinical trials in two very different rare disorders, Duchenne muscular dystrophy (DMD) and Friedreich's ataxia (FA).

DMD and FA are rare, degenerative, genetic diseases that affect movement and eventually lead to paralysis. There are currently no cures for either disease, but researchers hope that these results will significantly speed up the search for new treatments.

Tracking the progression of FA and DMD is normally done through intensive testing in a clinical setting. These papers offer a significantly more precise assessment that also increases the accuracy and objectivity of the data collected.

The researchers estimate that using these disease markers mean that significantly fewer patients are required to develop a new drug when compared to current methods. This is particularly important for rare diseases where it can be hard to identify suitable patients.

Scientists hope that as well as using the technology to monitor patients in clinical trials, it could also one day be used to monitor or diagnose a range of common diseases that affect movement behaviour such as dementia, stroke and orthopaedic conditions.

Senior and corresponding author of both papers, Professor Aldo Faisal, from Imperial College London's Departments of Bioengineering and Computing, who is also Director of the UKRI Centre for Doctoral Training in AI for Healthcare, and the Chair for Digital Health at the University of Bayreuth (Germany), and a UKRI Turing AI Fellowship holder, said: "Our approach gathers huge amounts of data from a person's full-body movement - more than any neurologist will have the precision or time to observe in a patient. Our AI technology builds a digital twin of the patient and allows us to make unprecedented, precise predictions of how an individual patient's disease will progress. We believe that the same AI technology working in two very different diseases, shows how promising it is to be applied to many diseases and help us to develop treatments for many more diseases even faster, cheaper and more precisely."

The two papers highlight the work of a large collaboration of researchers and expertise, across AI technology, engineering, genetics and clinical specialties. These include researchers at Imperial's Department of Bioengineering and Department of Computing, the MRC London Institute of Medical Sciences (MRC LMS), the UKRI Centre in AI for Healthcare, UCL Great Ormond Street Institute for Child Health (UCL GOS ICH), the NIHR Great Ormond Street Hospital Biomedical Research Centre (NIHR GOSH BRC), Imperial College London, Ataxia Centre at UCL Queen Square Institute of Neurology, Great Ormond Street Hospital the National Hospital for Neurology and Neurosurgery, the National Hospital for Neurology and Neurosurgery (UCLH and UCL/UCL BRC), the University of Bayreuth in Germany and the Gemelli Hospital in Rome, Italy.

Movement fingerprints - the trials in detail

In the DMD-focused study, researchers and clinicians at Imperial College London, Great Ormond Street Hospital and University College London trialled the body worn sensor suit in 21 children with DMD and 17 healthy age-matched controls. The children wore the sensors while carrying out standard clinical assessments (like the 6-minute walk test) as well as going about their everyday activities like having lunch or playing.

In the FA study, teams at Imperial College London and the Ataxia Centre, UCL Queen Square Institute of Neurology worked with patients to identify key movement patterns and predict genetic markers of disease. FA is the most common inherited ataxia and is caused by an unusually large triplet repeat of DNA, which switches off the FA gene. Using this new AI technology, the team were able to use movement data to accurately predict the 'switching off' of the FA gene, measuring how active it was without the need to take any biological samples from patients.

The team were able to administer a rating scale to determine level of disability of ataxia SARA and functional assessments like walking, hand/arms movements (SCAFI) in 9 FA patients and matching controls. The results of these validated clinical assessments were then compared with the one obtained from using the novel technology on the same patients and controls. The latter showing more sensitivity in predicting disease progression.

In both studies, all the data from the sensors was collected and fed into the AI technology to create individual avatars and analyse movements. This vast data set and powerful computing tool allowed researchers to define key movement fingerprints seen in children with DMD as well as adults with FA, that were different in the control group. Many of these AI-based movement patterns had not been described clinically before in either DMD or FA.

Scientists also discovered that the new AI technique could also significantly improve predictions of how individual patients' disease would progress over six months compared to current gold-standard assessments. Such a precise prediction allows to run clinical trials more efficiently so that patients can access novel therapies quicker, and also help dose drugs more precisely.

Smaller numbers for future clinical trials

This new way of analysing full-body movement measurements provide clinical teams with clear disease markers and progression predictions. These are invaluable tools during clinical trials to measure the benefits of new treatments.

The new technology could help researchers carry out clinical trials of conditions that affect movement more quickly and accurately. In the DMD study, researchers showed that this new technology could reduce the numbers of children required to detect if a novel treatment would be working to a quarter of those required with current methods.

Similarly, in the FA study, the researchers showed that they could achieve the same precision with 10 of patients instead of over 160. This AI technology is especially powerful when studying rare diseases, when patient populations are smaller. In addition, the technology allows to study patients across life-changing disease events such as loss of ambulation whereas current clinical trials target either ambulant or non-ambulant patient cohorts.

Author quotes

Co-author on both studies Professor Thomas Voit, Director of the NIHR Great Ormond Street Biomedical Research Centre (NIHR GOSH BRC) and Professor of Developmental Neurosciences at UCL GOS ICH, said:"These studies show how innovative technology can significantly improve the way we study diseases day-to-day. The impact of this, alongside specialised clinical knowledge, will not only improve the efficiency of clinical trials but has the potential to translate across a huge variety of conditions that impact movement. It is thanks to collaborations across research institutes, hospitals, clinical specialities and with dedicated patients and families that we can start solving the challenging problems facing rare disease research."

Joint first author on both studies, Dr Balasundaram Kadirvelu, post-doctoral researcher at Imperial College London's Departments of Computing and Bioengineering, said "We were surprised to see how our AI algorithm was able to spot some novel ways of analysing human movements. We call them 'behaviour fingerprints' because just like your hand's fingerprints allow us to identify a person, these digital fingerprints characterise the disease precisely, no matter whether the patient is in a wheelchair or walking, in the clinic doing an assessment or having lunch in a café."

Joint first author on the DMD study and co-author on the FA study, Dr Valeria Ricotti, honorary clinical lecturer at the UCL GOS ICH said: "Researching rare conditions can be substantially more costly and logistically challenging, which means that patients are missing out on potential new treatments. Increasing the efficiency of clinical trials gives us hope that we can test many more treatments successfully."

Co-author Professor Paola Giunti, Head of UCL Ataxia Centre, Queen Square Institute of Neurology, and Honorary Consultant at the National Hospital for Neurology and Neurosurgery, UCLH, said: "We are thrilled with the results of this project that showed how AI approaches are certainly superior in capturing progression of the disease in a rare disease like Friedreich's ataxia. With this novel approach we can revolutionise clinical trial design for new drugs and monitor the effects of already existing drugs with an accuracy that was unknown with previous methods."

"The large number of FA patients who were very well characterised both clinically and genetically at the Ataxia Centre UCL Queen Square Institute of Neurology in addition to our crucial input on the clinical protocol has made the project possible. We are also grateful to all our patients who participated in this project."

Co-author of both studies Professor Richard Festenstein, from the MRC London Institute of Medical Sciences and Department of Brain Sciences at Imperial College London said: "Patients and families often want to know how their disease is progressing, and motion capture technology combined with AI could help to provide this information. We're hoping that this research has the potential to transform clinical trials in rare movement disorders, as well as improve diagnosis and monitoring for patients above human performance levels."

The research was funded by a UKRI Turing AI Fellowship to Professor Faisal, NIHR Imperial College Biomedical Research Centre (BRC), the MRC London Institute of Medical Sciences, the Duchenne Research Fund, the NIHR Great Ormond Street Hospital (GOSH) BRC, the UCL/UCLH BRC, and the UK Medical Research Council.