AR Accident Simulation
The Accident Simulator is designed to prevent traffic accidents by simulating frequently occurring accidents as AR and 360 video experiences.
I designed an XR app that allows users to easily navigate different scenarios and also created an interaction flow for the XR experience.
2019 – 2021
2019 – 2021
3D Character Design
About the project
- Phoenix On the Ground(POG) is a startup aimed at creating safer cities through XR solutions.
- The team consists of engineers developing apps and utilizing deep learning, PMs, and a CEO.
- We launched our service, XR book, in 2023 and installed QR code devices in a few locations to attract users and conduct further user testing.
- As the only designer on the team, I was responsible for app, web, 3D assets, and marketing material design.
- I also developed 30 different AR and 360 video simulations using Unity ARfoundation and collaborated with PMs and engineers to conduct user research using methods such as eye-tracking and EEG.
I joined the team during the design and prototyping phase, after the team leader had developed the business concepts and plans. I contributed to refining the value propositions and creating the designs and interactions to bring the idea to the viable product.
The process I have not participated in is marked in grey.
The project successfully got funded by multiple public and private corporations and we are aiming to launch the app to the public.
A user scanning the QR code at the POG station to start the experience
Our team conducted field research to explore the current status and mitigation strategies for traffic accidents. We also performed a competitive analysis to determine how user-based insurance (UBI) can contribute to minimizing traffic accidents.
Planting memories of near-miss traffic accidents
Based on preliminary research, we found that helping users improve their ability to prepare for similar accidents by instilling memories of accidents is the most effective solution for preventing traffic accidents.
I began by designing an interaction scenario for the entire experience, from the first encounter with the service to turning an immersive experience into educational moments. With the established scenario, I developed content that includes 3D characters and AR and 360 scenarios in the Unity game engine. Additionally, I designed a mobile app to store our AR experience and other features to create profit model for the product.
We used our 360 video solution to conduct user tests and evaluate the effectiveness of an immersive accident simulation. Participants wore eye-tracking devices and Bluetooth Low Energy, and went through four different phases of testing to compare and contrast the impact of the experience. I contributed to planning the user testing.
A participant going through user testing
The survey and interview sought out to answer the following:
User test process
DEVELOP PHASE 1
DEEP LEARNING INTEGRATION
The service aims to provide a seamless user experience where the AR simulations are augmented at the right position, especially in vehicles.
I worked with a deep learning engineer who trained a deep learning model to differentiate between lanes and not-lanes and converted the data into coordination usable at Unity. I was responsible for using those data and augmenting the simulation at the right location on the screen.
Scene to train
Trained result showing lane in white and non-lane in black
After demonstrating the effectiveness of immersive simulation in traffic accident education, we expanded the scope of traffic accident simulations to include three different perspectives.