Design Proposal

ENGR 103 - Spring 2016

Freshman Engineering Design Lab

“Synesthetic Light”

Project Design Proposal

Date Submitted: April 08, 2016

Group Members          {Albert Hanan, akh67@drexel.edu }

                                     {Cassandra Lees, cml398@drexel.edu }

                                     {Jeremy Isaacs, jhi23@drexel.edu}

                                     

Technical Advisor       {Dr. Eugenia Ellis}

Abstract:

The design module will take a sound input and display a certain color light based on the sound. The goal of this project is to use light as a means of enhancing one’s sensory experience when listening to sound. The design itself will take sound, convert it into useable data, and run that data through an algorithm that will instruct a microcontroller to display certain LEDs based on the sound. Some challenges that may arise are that the group must familiarize themselves with both the theory behind synesthetic sensory enhancement as well as the technical process with which to complete the actual module (i.e. arduino, MATLAB, Spectrum Shield, etc.). The main tasks that must be accomplished are connecting the Spectrum Shield with MATLAB and properly programming the microcontroller to deliver certain colors based on certain sounds. The final product will be a module that will display certain colors based on certain notes and/or chords played in real time to enhance the overall sensory experience.

1        Introduction

The goal of this project is using bioengineering to alter a person’s mood and cognitive functioning. The group will research the photobiological effects of different light wavelengths and relate them to similar psychological effects of sound on humans according to music theory. People are exposed to different kinds of light all day long, and studies have been conducted on the effects of natural versus artificial light. The hypothesis for this project is that if artificial light can affect a person’s mood, then light can be manipulated to affect that person’s mood by selectively exposing them to certain wavelengths. Specifically, we will be focusing on displaying light that is matched with sound and using that as a means to further enhance and influence the emotional state of the subject.

The team is going to design a module that demonstrates the biological and psychological connections between sound/light and people’s emotional states. LED lights will be utilized in an array as a display for the subject. The general idea for the module is that a MIDI keyboard will play notes into a microphone input, and each note frequency will correspond to a light wavelength in an LED. The LEDs will respond to the sound stimulus, and the subject should hypothetically respond to both the sound and the light stimuli. Ideally, combinations of sounds (i.e. chords) should output combinations of light colors that are similarly psychologically stimulating.

Anticipated difficulties for this project are mainly centered around understanding the materials and software necessary to build this module. The team will need to become familiar with the functions of a Spectrum Shield and Arduino device, as they will be utilized in analyzing the audio input and coding the LED output display. The team is not yet familiar with the processing power of the Arduino, so the delay between the MIDI device and the LEDs is a potential issue that will need to be addressed.

2        Deliverables

By week ten, the module will be completed and able to display the synesthetic connection between light and sound in psychology. The module will consist of a MIDI keyboard, a Spectrum Shield, an Arduino, and a set of LEDs. The MIDI keyboard will relay audio into the Spectrum Shield which will process the frequencies into the Arduino. The Arduino will use a MATLAB code that will take the data and convert sound frequencies into light wavelengths, which correspond to different colors in the LEDs. As the sound inputs change, the lights will change.

3        Technical Activities

To successfully create the synesthetic module, the first thing that must be done is research. None of the group members are particularly experienced with the science of waves, programming, or music theory which simply means that extra time and effort must be put into learning the necessary software and theories. Because of the team’s lack of erudition in the relevant topics, the group will also utilize the resources available to them including the group’s technical advisor, Dr. Eugenia Ellis as well as Drexel’s DLux Light Lab. Once the relevant knowledge has been learned, the group will acquire all necessary materials to make the module possible. After said materials have been acquired the group will begin programming the device to perform our designed tasks.

3.1      Research

Much research must be done in a variety of subjects to complete this project. The team must have a broad understanding of how light works as well as how it relates to sound psychologically. Similarly, the team must develop a level of expertise in certain areas of computer programming as it relates to arduino, MATLAB, and circuitry.

3.1.1      Light, Color, and Synesthesia

Perhaps the most fundamental knowledge that must be ascertained is that regarding light and sound as the basis of the project assumes that there is an inherent connection between the two. The team must learn the science behind light and color and how they are connected. A number of issues must be researched in depth to make this project possible. Why do humans relate to a sound or a color in an emotional way? What causes an emotional response in certain colors? How do certain colors match up with certain notes to produce similar emotions? These are all questions that are crucial to creating a module that produces light based on certain sounds. Similarly, a potentially useful area of research to look into will be Synesthesia, the neurological disorder that connects normally unrelated senses. People with the condition have an enhanced level of senses and are able to hear colors, smell sounds, etc. This disorder may be relevant in deciding which colors to display for certain sounds.

3.2      Programming

The device that will be created will be coded using MATLAB software. The program will take information from the Spectrum Shield and turn it into inputs that for the LEDs. Because the group members lack all of the required knowledge regarding how the Spectrum Shield works, the exact scope of what the code will do beyond what was previously stated is still not completely known, but that will be quickly determined after meetings with Dr. Ellis as well as upperclassmen who have completed similar projects. The intention that the group has at this moment, however, is that there will be an input of sound, which will go into the Spectrum Shield. This will transform the sound to useable data that our code will make use of and tell the arduino what color(s) to display.

3.3 Testing

Considering the group's lack of experience, it is anticipated that extensive testing will be required to make the module successful. After acquiring the necessary theoretical knowledge it will be up to the group to thoroughly troubleshoot the module to ensure its success. This stage of the project will involve substantial trial and error to determine what parts of our code, circuitry, and/or theory is incorrect or faulty. Again, the team will make sure to use all resources available to them including experts in the field as mentors and guides to creating the synesthetic module.

4       Project Timeline

	Week
Task	1	2	3	4	5	6	7	8	9	10
Research/Learning from experts	x	x	x	x
Acquisition of materials			x	x
Electrical design				x	x
Code Development					x	x	x
Testing/Troubleshooting						x	x	x	x
Final report preparation								x	x	x

Table 1: Timeline for design project

5        Facilities and Resources

For the synesthetic light project, a few resources will be needed. As a lack of knowledge in MATLAB programming exists in the group, friends and professor will be used as a resource to help move the project forward. In addition, the Drexel lighting lab will be utilized for materials for the project.

5.1 MatLab

As coding will be a large part of this project, some advanced knowledge of the MATLAB language will be required. The code developed will help the different components of the project interact and work smoothly together. Friends of the group who have more experience coding in MATLAB may be called upon to help the group tackle problems in a timely manner.

5.2 DLux

The Drexel Lighting Lab will provide the group with the necessary tools to understand and develop the synesthetic light project. By providing materials and guidance the DLux lab will help the group develop an efficient lighting system.

5.3 Miscellaneous

There will be a few miscellaneous resources required. A soldering kit may be required to solder together components. Knowledge of soldering is provided by the group. Another resource required is knowledge of music theory. Friends and professors can be utilized as a resource to thoroughly understand the theories behind music and how it will correlate to lighting.

6        Expertise

The group has a few areas of expertise that will be utilized for the project. A fairly comprehensive understanding of MATLAB, a solid base of music, and some basic circuitry understanding is brought in by the group. However, an increased knowledge of programming languages for the arduino must be developed throughout the project. Creating a program that will take musical notes and translate them into light frequencies demands a higher understanding of programming. Understanding how the MIDI controller, spectrum shield, arduino, and LED array will require some hands-on learning. With little expertise in fully constructing systems that translate data the group will need to learn a lot about microcontrollers, processors, and circuit theory.

7        Budget

       Table 2: Budget

Category	Projected Cost
MIDI Controller	$110.00
Sound Processor	$30.00
Microcontroller	$24.95
LED Lights	$15.00
TOTAL	169.95

7.1      MIDI Controller

The MIDI Controller will be used to create sounds and musical notes that will be outputted to the Spectrum Shield. The MIDI controller will be played by the group, or can be set to record tracks. By being able to select notes individually the group will show how light and music can interact in a synesthetic program. A mobile MIDI controller can be used to reduce costs and to increase flexibility. In addition cables to connect the MIDI controller will be required.

7.2      Spectrum Shield/Processors

The Spectrum Shield will be used as a sound processor. Notes will be outputted from the MIDI controller to the sound processor. Input to the sound processor will be through a 3.5mm auxiliary cable. The sound processor will take in the notes, and will send corresponding data to the arduino microcontroller.

7.3      Arduino Microcontroller

The arduino microcontroller will take in the data from the spectrum shield and will control which LED lights light up.

7.4      LED Lights

An array of LED lights will be configured to form a synesthetic experience. These LED’s will be secured on a structure and will light up with different colors when a corresponding note is played.