Into to Phy Comp 10

Project2 Final

Project 2

How can we improve the zoom experience?

Experimental studies on improving virtual two-person communication.

Video

pain points: What did we lose from virtual communication?

Touch

We lost tactile feedback, such as a touch on the shoulder as a sign of support or friendship.

Presence and 3D space

When meeting people in-person we feel the three dimensions as we look around people sitting/ standing in different directions/positions. However, virtual and on-screen communication has made everything flat – every conversation happens only in front of you.

How can we improve it?

1. Touch

Virtual clap allows two users to feel the co-presence through augmented tactile feedback. On clapping, the ring on the users gives haptic feedback, simulating clap feeling.

Process

Using ML5 – PoseNet, and WebRTC, the computer reads the position of the right wrist of both users A and B. When the distance between the two gets closer, it reads it as “clap action”.

On clap detection, the vibration feedback is sent to the users through a ring and it simulates “clap tactile feedback”.

Fabriaction

3D printed ring

Haptic driver and motor is used

2. Presence in 3D Space

In in-person experience, people can look at different aspects of the partner one is talking to. Virtual turntable simulates this 3D feeling by allowing a partner to turn your PC/ phone/ tablet, enabling the partner to see multiple aspect of you and your enviornment.

Process

Using ML5 PoseNet, the computer reads out whether the partner is looking front/ right/ or left. The direction of the face was calculated by checking the distance between nose-eyeR and nose-eyeL. When looking right, the distance between the nose and right eye gets closer.