AR Mural

  WINLAB Summer Internship 2025

  Advisors: Ivan Seskar, Jennifer Shane, Wade Trappe

  Group Members: Maelle Mevel, Amithi Pathak, Hans Wassermann

Project Description

This project aims to create a collaborative augmented reality application that will allow remote users to create a virtual mural collaboratively. This project will be made using the Unity game engine and deployed to AR platforms such as Microsoft Hololens.

We are continuing development from last years' AR Mural project by refining tools they created as well as improving the structure of the server to make multiplayer more accessible. Students should get started with this project by familiarizing themselves with the Unity game engine and Hololens development tools.

Weekly Progress

Week 1: Presentation Link: ​https://docs.google.com/presentation/d/1aQ2NxaRPrsO5ZBgjDjDU8Piezr5A8DLDx2pvLjs2Cro/edit?usp=sharing

1. Got acquainted with Unity and HoloLens, and linked the two
2. Using the Mixed Reality tool (MRTK) in Unity
3. Viewed last year's codebase on ​GitLab

Week 2: Presentation Link: ​https://docs.google.com/presentation/d/13HVsFsC7pe0QbLtg0b1EIvlA28w-17QMqlFcIJYjwCw/edit?usp=sharing

1. Created document with file breakdowns
   1. Core functionality
   2. Key functions
   3. Attributes
   4. Plan to organize
2. Created documentation to make setup and configuration of Unity and HoloLens easier
3. QR Code Initialization
   1. Multiple users in the same room can see objects in the same position
4. Undo Functionality
   1. Base code implemented using stacks

Week 3: Presentation Link: ​https://docs.google.com/presentation/d/1MmFYcW0hngEcrWNa6y64QlfmTCxdba_8g1MGcYq5wCU/edit?usp=sharing

1. Analyzed server side codebase on ​GitLab
2. Added function to import 3D models to the scene with a scroll down menu
   1. Trying to fix some issues related to the assets being stored incorrectly in the server
3. Undo/Redo
   1. Testing and debugging; only for brushstrokes and erasures
   2. Need to integrate with MQTT, current model is primarily local