Vocal Isolating and Amplifying Headphones

From Mindworks
Jump to: navigation, search

The goal of this project is to create headphones that isolate the vocals in a media stream and amplify them

SoundAssist
Sponsor James Frenzel
Mentor Feng Li
Team Name Sound Assist
Duration Spring 2017 - Fall 2017



Problem Definition[edit]

Background[edit]

The goal of this project is to create a device that assists the hard of hearing in picking out and distinguishing human vocals, in media like television and film, from background noise and other sounds that can distract from overall speech intelligibility. This is being explored from several different approaches, first is a simple filter that lowers the perceived volume of non-human speech frequencies while leaving the spectrum that the human voice commonly falls in (1-4kHz) untouched. This method has the drawback of not attenuating noises that are non-human in origin but occupy the same frequency range. The second approach is to utilize a blind source separation algorithm (BSS) to analyse and separate the individual components that make up the mixed audio signal. This will allow us to extract the human speech from the signal and amplify it separately from the source signal before remixing at the output of the device. The drawback to this method is the processing time required to perform the BSS, which could delay the audio signal by enough for the offset from the video signal to be noticeable.

Specifications[edit]

Required:

Client Request: Client would like a vocal audio to become clearer to listen to
Specification: Vocal audio range to be variably increased from +0db to +10db

Client Request: Client would like a reduction in background noise and nonspeech
Specification: An reduction in nonspeech noise by variable -0db to -10db

Optional:

Client Request: Client would like the device to be wireless from the audio source
Specification: Design must only have wires at the device for headphones and power.

Client Request: Client would like the device to support multiple users
Specification: Allow for full range of options to multiple hearing outputs

Client Request: Client would like the device to have learning capabilities
Specification: Create a learning system to tune user specific Equalization values.

Project Learning[edit]

Equalizer chip: LMC835[edit]

The LMC835 is a 12 band, digitally controlled equalizer. It is capable of boosting or cutting by 6 or 12 decibels and can be reprogrammed on the fly. This chip or something similar, coupled with a micro controller will help in giving the vocal speech range the required boosting.

Amplifier: Objective 2[edit]

The Objective 2 is an open source HiFi headphone amplifier with dual gain stage and plenty of room for growth and modifications. With schematics readily available, iterating off of this design can help our project move forward and maintain reasonable package size.

Microcontroller: Digilent WiFire[edit]

The WiFire micro controller is a smaller microcontroller that has a DSP enhanced core contained inside of it. This will give us the proper processing hardware in order to create voice separation without introducing latency.

Blind Source Separation[edit]

This is an unsolved problem in signal processing, but there are various algorithms that give good approximations for separating various types of mixed signals. Several notable algorithms include: Independent Component Analysis (ICA), Non-negative Matrix Factorization (NMF), and Principal Component Analysis (PCA).

Voice Recognition[edit]

Voice recognition algorithms are another avenue for determining what is (and isn’t) speech in a signal and include using Hidden Markov Models (HMM) and neural networks for unsupervised learning.

Team Information[edit]

2017 soundassist alex.jpg
Alex Inskeep Interests: 'Cars, computers, guns'
Computer Engineering
Hometown: Boise, Idaho
Email: insk8626@vandals.uidaho.edu
2017 SoundAssist pic2.jpg
Adam Seubert Interests: 'Hiking, playing drums, and guitar'
Electrical Engineering
Hometown: Lewsiton ID
Email: seub3049@vandals.uidaho.edu

Document Archive[edit]

File:Aound Assist Preliminary design review slides.pdf
File:Sound Assist team contract.pdf
File:Sound Assist Signed client contract.pdf
File:Sound Assist meeting minutes 2-9-17.pdf
File:Sound Assist meeting minutes 2-16-17.pdf
File:Sound Assist meeting minutes 3-1-17.pdf
File:Sound Assist meeting agenda 3-22-17.pdf
File:Sound Assist meeting minutes 3-22-17.pdf