A Personalized Future Shopping Experience with Mixed Reality Interaction

Project On Going

Duration: 3 days, originally Hackathon Project from MIT Reality Hack 2022 Team Member: Eddie Chan, Jiayue Gou, Bowen Li, Zane Zhang Role: Team Leader Contribution: Research, UX Design, Digital Assets, Crafting


Overview

HEELAND is a holistic immersive XR shopping experience. Users could get a smooth, safe, engaged, and gamified shopping experience across the whole process of buying Garage Kits (GKs): exploring in the virtual store park, playing with GKs, interacting through games to conduct shopping activities, collecting virtual GKs, etc.

fe6a60950b7ffc80bcbb900278e0583.jpg


Background

Inspiration

Pop Mart, Pokemon Go, Disneyland

popmart.png

Developing Tools

Unity is our main platform to build this experience. STYLY VR is the platform to run the experience, and Oculus Quest 2 is our device to experience. We remade some toys to build our own physical controller and use Arduino as our signal transformer to build connections between the interactions in Unity and the controllers.

Uploading digital scene with Interaction into STYLY

Uploading digital scene with Interaction into STYLY

Open the scene from STYLY app and play

Open the scene from STYLY app and play


Concept & Design Principle