Augmented Reality Communication
Remote visual and audio communication system using augmented reality with animated avatars on HoloLens 2.
Project
Remote visual and audio communication system using augmented reality with animated avatars on HoloLens 2.
01
Project brief
This prototype connects a browser user with a remote participant wearing a HoloLens 2. The headset user sees an animated 3D representation of the remote person and can communicate through text and audio.
02
Avatar pipeline
Head orientation, facial expressions, mouth movement, pupils, shoulders, arms, hands and fingers are estimated from the browser camera. Kalidokit converts the MediaPipe landmarks into animation parameters for a VRM avatar.
03
Communication system
Both participants join the same web session. The experience can run as an augmented-reality view on HoloLens or as a conventional web view, with synchronized avatar animation, messaging and audio controls.
04
Applications
The system investigates remote communication without transmitting a conventional camera image. Possible extensions include remote assistance, object visualization and maintenance guidance in spatial computing.
