Revolutionizing Movement Tracking with AI: Introducing GlowTrack


Unlocking New Frontiers in Behavioral Research
Movement is a window into the intricate workings of the brain and its control over the body. Over the years, the methods for tracking both human and animal movement have evolved significantly, from manual observations with clipboards and pens to cutting-edge artificial intelligence (AI) techniques. In this transformative era, AI has taken center stage in movement tracking, offering precision and efficiency. Yet, the process of training AI models remains laborious, constrained by the necessity for researchers to manually mark body parts repeatedly, sometimes hundreds or thousands of times.

Now, Associate Professor Eiman Azim and his team introduce GlowTrack, a groundbreaking non-invasive movement tracking method. GlowTrack harnesses the power of fluorescent dye markers to train AI systems, offering robustness, time-efficiency, and high-definition tracking capabilities. This revolutionary technique holds promise across diverse fields, from biology to robotics and medicine.

A Leap Forward in Behavioral Research
Published in Nature Communications on September 26, 2023, GlowTrack represents a monumental leap forward in the realm of movement tracking. As Professor Azim notes, the incorporation of potent AI tools into laboratories has triggered a revolution in behavior tracking. GlowTrack enhances the versatility of these tools, facilitating the capture of a wide range of movements in laboratory settings. This advancement holds the potential to deepen our understanding of how the brain governs behavior and could prove invaluable in studying movement disorders such as amyotrophic lateral sclerosis (ALS) and Parkinson's disease.

Overcoming Manual Limitations
Traditional methods for tracking animal and human movement heavily rely on manual processes that involve marking body parts on a computer screen repeatedly. Unfortunately, this approach is time-consuming, susceptible to human errors, and restricted in its application due to the specialized nature of AI models. These models are limited to the training data they receive, making them ill-suited for adapting to changes in lighting conditions, body orientation, camera angles, and other environmental factors.

To tackle these constraints head-on, the researchers turned to fluorescent dye markers. These "invisible" markers offer the advantage of creating a vast and visually diverse dataset rapidly, without the need for human annotation. With this robust dataset, AI models can track movements across a broad spectrum of environments and achieve a level of resolution that manual human labeling struggles to match.

Promoting Cross-Study Comparisons
GlowTrack introduces a game-changing element to the scientific community—easy comparability of movement data across studies. Different laboratories can employ the same AI models to track body movements in various scenarios. This fosters greater consistency and reproducibility in experiments, both crucial aspects of the scientific discovery process.

A Glowing Future for Behavioral Research
Daniel Butler, the first author of the study, aptly likens fluorescent dye markers to invisible ink that can be activated at will, generating a wealth of training data effortlessly. The potential applications of GlowTrack are vast and extend to fields that demand sensitive, reliable, and comprehensive movement tracking tools.

As Professor Azim enthuses, "Our approach can benefit a host of fields that need more sensitive, reliable, and comprehensive tools to capture and quantify movement." The scientific community eagerly anticipates the adoption of these methods and eagerly awaits the unforeseen applications that this transformative technology may unveil.

The GlowTrack project received support from the UC San Diego CMG Training Program, the Jesse and Caryl Philips Foundation Award, the National Institutes of Health (R00NS088193, DP2NS105555, R01NS111479, RF1NS128898, and U19NS112959), the Searle Scholars Program, the Pew Charitable Trusts, and the McKnight Foundation. Collaborators on this groundbreaking research include Alexander Keim and Shantanu Ray of Salk.