Tobii Eye Tracker Test
Eye tracking is fascinating not only because of the fact that human experiences have 80% of dependency on vision, but because there are underlying meanings and functions which eye movement indicates. According to the paper I looked at(Link), in human interactions, people gaze at points around the area around a target, shifting points about every one-third second. This is one of the reason why most people have difficulty detecting actual eye contact, whereas they’re fairly accurate at detecting face-directed gaze. In this sense, I was wondering how accurate/how long an advanced eye tracker could detect the actual point and direction that I gaze at.
I worked with Devin and Yu to test out the Tobii Eye Tracker to get data of gaze awareness and position. Tobii measured both the direction of gaze as well as the position of the eyes in space pretty accurately, once I went through the calibration process.
We made a simple test piece in Unity3D using gaze awareness function in Tobii. I rotated a flower on the screen just by staring at it. Since it enabled high-resolution clock synchronization, I was able to get the visual response without any time lag, even a second. It stopped reacting not only whenI I moved my eyes up, down, left and right, but also when I turned my head and moved back and forth, which was enabled by the calculation of head movements and eye movements within the orbit of the eye.
As a next step, we tried to measure pupil dilation which is one of the function that Tobii Analytics SDK provided. With this toolkit, we expected to see how pupil size responds to specific stimuli including emotional changes. It was fascinating in a sense that twitching and pupil dilation are non-verbal cues and an indicator of our unconsciousness. Even though we couldn’t reach to test and get data because of technical difficulty, it was valuable to research what meaningful interpretation of data we can get from tracking our different eye behaviors in multiple layers.
Reference
http://www.tobii.com/eye-tracking-research/global/research/ophthalmology/
http://www.dizziness-and-balance.com/disorders/symptoms/visual.htm
Kinect 3D Motion Capture Test
The openFrameworks application got 3d coordinate values of real-time motion from Kinect IR sensor and created mesh cloud in virtual space using the recorded data. The goal of this first trial was: 1. to measure appropriate dimensions of the area and subjects's orientation in physical space. 2. to figure out which movements/choreography works best with the implementation of the 3d motion tracking technology. 3. to explore different ways of overlapping multiple human figures implying the elements of the digital game Pong.
@Tisch dance department | Oct 14, 2014
Maya Physics & Python Script Test
Open Source Animation Class, 2014
Mood Orb Prototype
Physical computing, responsive installation prototype | Mixed media - LED, drop sheets, bio sensor, wire, etc
@ ITP floor, Dec 2013
Mood Orb is a biofeedback orb and an external bio-sensing art piece that reacts to changes of your feeling. The effect is of a heart and LED lights change with the body temperature of a user wearing a heat and humidity sensor bracelet.
Process
1. Initial ideation - Biofeedback Suit
As a project of Physical Computing class, my partner Claire and I have an idea of making ‘Mood Suit(Mood Shield)’ that shows a wearer’s mood in different colors. An example of color chart of the suit is below.
Basically,looked through how mood rings are made. A mood ring is a ring which contains a thermochromic element, such as liquid crystal. The ring changes color in response to the body temperature of its wearer. The color is said, by some proponents, to indicate the emotional state of the wearer.
There’s an another example product called ‘Heat Sensitive iPhone 4/4S Backing’ made by Rf LaserWorks. This self-adhesive laser cut backing changes colors in the range 90 to 95 degrees F – or just below body temperature, according to changing heat from your hands, pocket, or while playing music, surfing, or on a phone call.
2. Coding & wiring
3. Testing