MetaGuard thumbnail
MetaGuard small logo

“Going Incognito in the Metaverse”

2022  |  Vivek Nair · Gonzalo Munilla Garrido · Dawn Song  |  https://doi.org/10.1145/3586183.3606754

  UIST '23 Best Paper Award

Virtual reality (VR) telepresence applications and the so-called "metaverse" promise to be the next major medium of interaction with the internet. However, with numerous recent studies showing the ease at which VR users can be profiled, deanonymized, and data harvested, metaverse platforms carry all the privacy risks of the current internet and more while at present having none of the defensive privacy tools we are accustomed to using on the web. To remedy this, we present the first known method of implementing an "incognito mode" for VR. Our technique leverages local ε-differential privacy to quantifiably obscure sensitive user data attributes, with a focus on intelligently adding noise when and where it is needed most to maximize privacy while minimizing usability impact. Moreover, our system is capable of flexibly adapting to the unique needs of each metaverse application to further optimize this trade-off. We implement our solution as a universal Unity (C#) plugin that we then evaluate using several popular VR applications. Upon faithfully replicating the most well known VR privacy attack studies, we show a significant degradation of attacker capabilities when using our proposed solution.

  Read Paper     View Repo

Vivek C Nair*, Gonzalo Munilla-Garrido*, and James F. O'Brien. Going Incognito in the Metaverse: Achieving Theoretically Optimal Privacy-Usability Tradeoffs in VR. In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology (UIST '23), 2023. https://doi.org/10.1145/3586183.3606754

MetaGuard at XRSI

MetaData and MetaGuard are already helping to shape metaverse safety and privacy standards. Watch an excerpt from an invited presentation about MetaGuard at the eXtended Reality Safety Initiative (XRSI) Privacy & Safety Working Group.


We appreciate the support of:

Berkeley RDI Logo NSF Logo NPSC Logo Hertz Foundation Logo

How it works:

MetaGuard is an open-source Unity (C#) plugin that can easily be patched into virtually any VR application using MelonLoader. With MetaGuard installed, "going incognito" in the metaverse is as easy as flipping a switch!

MetaGuard UI

1. Intuitive VR UI

Once installed, MetaGuard inserts its intuitive into your VR application of choice.

(A) Master Toggle: Allows users to "go incognito" at the press of a button.

(B) Feature Toggles: Allows users to toggle individual defenses according to their needs.

(C) Privacy Slider: Adjusts the privacy parameter (ε) for each defense, allowing users to dynamically adjust the inherent trade-off between privacy and accuracy when using MetaGuard.

MetaGuard Calibration

2. Instantaneous Calibration

When a defense is first enabled, the MetaGuard system uses the OpenVR API to estimate the ground truth attribute values of the user using a one-time snapshot of their telemetry. These ground truth values are then used in combination with pre-defined ε-values and bounds to calculate noisy offsets corresponding to each privacy level.

MetaGuard Coordinate Transformations

3. Coordinate Transformations

By default, the Unity game engine uses telemetry data from OpenVR to position game objects within a virtual environment, which are then manipulated by a VR application. The MetaGuard system modifies the game object hierarchy by inserting intermediate "offset" objects. For each enabled defense, the system fetches the noisy attribute value for the currently-selected privacy level and enables the relevant coordinate transformation on one or more of the inserted offset objects such that the observable attribute value matches the differentially private attribute value.

Authors:
Vivek Nair

Vivek Nair

  Website
Gonzalo Munilla Garrido

Gonzalo Munilla Garrido

  Website
Dawn Song

Dawn Song

  Website

Copyright ©2022–2023 UC Regents  |  Email us at rdi@berkeley.edu.