Creative Technology Projects
I’m interested in developing technology prototypes, mixing art and programming to build novel HCI patterns and provocations.
2022
Intelligent spaces, interaction design, physical computing, hardware, programming
Brain-Computer Interface
What if the manipulation of screen-based interfaces could be controlled by our brain?
This project onboards people to brain computer interfaces (BCI). Through a guided audio tour, people can experience the phenomenon of directly controlling the pixelation of a video projection based on changes in their brain activity.
My Role
Concept development, industrial design, exhibit design, voice AI scripts, computation design
Details
Team: Elaine Lu, Gabriel Alvarez, Rohan Sonecha
Time: 4 weeks
Video Demo
This project was prepared for “Responsive Mobile Environments,” a CMU Computation Design Exhibition. Participants’ brain waves were recorded with the Muse headset. The data was then computed into an abstraction value corresponding to greater pixelation during highly focused states, and less pixelation during unfocused states.
System and Materials
Software: Processing, Node.js
Materials: mesh fabric, projector, PVC pipes, speakers, Muse2 headset
Muse headband
Brain wave monitor (Muse monitor app)
Software Demo
Changes in brain activity recorded from the Muse headset, controlling the video pixelation values in Processing.js
Project Cloud, Alexa’s Multiple Personalities
What if Alexa could express emotion and embody different personalities? This project presents an alternative interaction with voice assistants, inviting people to critique the boundaries between the desirability and spookiness of voice AI.
It takes inspiration from precedent work like Ghosts in the Smart Home, Superflux’s Our Friends Electric, and Bjorn Karmann’s Project Alias, which all share the theme of telling stories from the perspective of the device, and giving the device capability to express emotions.
My Role
Concept development, industrial design, voice AI script writing, Alexa skill development, laser cutting
Details
Team: Elaine Lu, Gabriel Alvarez
Time: 4 weeks
Tools
Alexa Skills, Particle IDE, Rhinoceros 3D V7, Grasshopper 3D
Hardware: Electret Microphone Amplifier, Power Relay FeatherWing, NeoPixel Ring - 24 x 5050 RGB LED, Particle Argon WiFi development board, Half-size breadboard, SXD-205A Mini 8 Multi Voice Changer Microphone Megaphone Loudspeaker, Echo Dot
Materials: plywood, white spray paint, laser cutter
Materials
Video Demo
Once connected to “the cloud,” Alexa’s voice will change randomly, responding in voices ranging from high pitched and child-like, to undecipherable robotic noises. The voice change occurs after a randomized delay. Many visitors found the interaction surprising, and it led many interesting discussions about what people view as desirable from voice interactions.
VR Environments
Prototyping in unity
I’ve also done some exploratory prototyping in Unity. This project explores the idea of browsing event venues in virtual reality. We prototyped key interactions for switching between a curated list of venues, swapping out decor and customizations, and inviting collaborators to visit venues together.
My Role
Interaction design, prototyping
Details
Team: Elaine Lu, Matt Muenzer
Course: Design Studio II
Time: 3 weeks
Tools
Unity3D, After Effects, C#
1. Launch Environment
2. Invite Collaborators
3. Explore Other Venues
4. Swap Decor and Look Around