2023 | Vivek Nair · Louis Rosenberg · James F. O’Brien · Dawn Song | doi.org/10.48550/arXiv.2306.06459
Motion tracking "telemetry" data lies at the core of nearly all modern extended reality and metaverse experiences. While generally presumed innocuous, recent studies have demonstrated that motion data actually has the potential to profile and deanonymize XR users, posing a significant threat to security and privacy in the metaverse.
To date, the most comprehensive analysis of biometric identification is a 2003 study from the National Institutes of Standards and Technology (NIST), which analyzed dozens of commercially-available biometric sensors using real data from over 100,000 users. The results indicate that high-end fingerprint sensors could, at the time, identify users within a population of 10,000 with 90% accuracy. By contrast, our research shows that XR motion data can be used to identify at least 55,000 users, and likely more, with over 90% accuracy.
Learn MoreIn a second study, we surveyed 1,006 Beat Saber players to ask them a variety of questions about their background, biometrics, demographics, health information, behavioral patterns, and technical device specifications. Later, we trained a series of machine learning models to see which, if any, of these responses could be accurately inferred just by examining the motion patterns of these users. We found that everything from the country that a user is from to the clothes that they are wearing can be determined using features derived from their motions alone.
Learn MoreWe developed "MetaGuard," an open-source plugin for the Unity game engine that we think of as a proof of concept for how to protect motion data in future XR experiences. Using MetaGuard, developers can select from three different "levels" of motion data protection, each of which applies a slightly more aggressive, yet reversible, transformation to the motion signals being sent over the internet. With MetaGuard Level 1, for example, 50,000 users can still be uniquely identified in our BOXRR dataset. At Level 3, this number drops to just 500.
Learn MoreOur extended reality motion research, tools, and datasets are constantly evolving based on feedback from XR researchers, developers, and enthusiasts. We would love to hear about your thoughts and experiences with motion data in XR, and are happy to answer any questions that you have about our research. If you would like to learn more, please get in touch!