Microsoft Research Details Room2Room Project Which Enables Life-Size Telepresence

Reading time icon 2 min. read


Readers help support MSpoweruser. We may get a commission if you buy through our links. Tooltip Icon

Read our disclosure page to find out how can you help MSPoweruser sustain the editorial team Read more

Microsoft Research recently published the paper related to Room2Room project which is a life-size telepresence system that leverages projected augmented reality to enable co-present interaction between two remote participants. Room2Room recreates the experience of a face-to-face conversation by performing 3D capture of the local user with Kinect and projecting their virtual copy into the remote space at life-size scale createing an illusion of the remote person’s physical presence in the local space.

Room2Room is a telepresence system that leverages projected augmented reality to enable life-size, co-present interaction between two remote participants. Our solution recreates the experience of a face-to-face conversation by performing 3D capture of the local user with color + depth cameras and projecting their life-size virtual copy into the remote space. This creates an illusion of the remote person’s physical presence in the local space, as well as a shared understanding of verbal and non-verbal cues (e.g., gaze, pointing.) In addition to the technical details of two prototype implementations, we contribute strategies for projecting remote participants onto physically plausible locations, such that they form a natural and consistent conversational formation with the local participant. We also present observations and feedback from an evaluation with 7 pairs of participants on the usability of our solution for solving a collaborative, physical task.

Read about this project in detail from the source link below.

User forum

2 messages