Speech Pathology Application

From Mindworks
Jump to: navigation, search
Sponsors Micron Foundation
Team Name Horsemen of the Epiglottis
Duration 2018 - 2019
Faculty Adviser
  • Feng Li
Client
  • Eric Booth
  • Ujjwal Roy
Team Members
  • Hailey Johnson
  • Wei Zhao
  • Jordan Cates

The goal of this project is to build off of last year's Speech Therapy App, adding additional features such as a Database and GUI. This setup should allow for much easier access to child speech data. The database should allow the program to be easily expanded upon.


Problem Definition[edit]

This project is a continuation of a project from the 2017-2018 school year. In their project, they created the majority of the speech recognition processes with a basic GUI. The existing program provides prompts for users, and informs them of the phones that were not pronounced correctly. It also provides waveform and frequency visualizations of their speech patterns,which is less for the child and more for a therapist who would understand the diagrams. The program recognizes all English phones, and is based on a speech recognition library called Sphinx. The team’s duty for this year is to build off the last team’s work. Faced with a number of possible courses of action, they chose to build a better GUI and implement a database. As it is, the GUI is not exceptionally visually appealing, nor is it very child friendly. The intention is to retain the features of the program, but present them in different ways depending on who is using the program, the child or the therapist. The database on the other hand, is a portion of the original project that just wasn’t obtainable within the timeframe given. With it, the team intends to provide an efficient way to store the children’s speech data, so that it is easy to find and sort. The team would also like to provide a way of creating sort of “profiles” for the various children, making it easier for the therapist to switch between multiple patients.

Background[edit]

Around 1 in 12 children require speech therapy in the US. Our sponsor’s daughter began speech therapy, and soon after, he recognized the need for readily available speech therapy tools. This led Eric Booth and Ujjwal Roy to begin a project to do just that. Research has shown that the effectiveness of speech therapy directly correlates to the number of quality repetitions the participant does. They also found that, although many speech analysis tools exist, they are all lacking in the same way. They are not nearly as effective on children as they are on adults. In part, this is due to the unpredictable changes in children’s speech, but the main problem is the lack of data. Child speech is covered by numerous laws such as COPPA and HIPAA that make the collection and use of data difficult. This program can help people better understand what children with impediments are struggling with. The fact it is planned to be open source leads to even more possibilities. It provides the chance for communities of developers to alter it for use in other regions. On top of that, its convenience allows more time for children to work on their speech.

Deliverables[edit]

  • Secure database that stores account information and vocal recordings
  • Different User Accounts
    • Therapist
    • Care Giver
    • Researcher
    • Developer
  • Ability to sort and display specific data sets
  • Ability for researchers to submit speech data to the database
  • Ability to port database to different services

Specifications[edit]

  • Cloud based system
    • Has set up the environment for our application
    • Must have a 12 month free period
    • Must scale easily
    • Must be able to use and port to other services

Database Diagram[edit]

Database-Diagram.png


Team Members[edit]

Hailey.jpg
Hailey Johnson

Major: CE
Hometown: Stanwood, WA
Responsibility: Team leader, Meeting planning
Email: john3817@vandals.uidaho.edu

Wei.jpg
Wei Zhao

Major: CS
Hometown: Taixing, Jiangsu, China
Responsibility: Budget, assisting with Documentation
Email: zhao3940@vandals.uidaho.edu


JordanC.jpg
Jordan Cates

Major: CS
Hometown: Coeur d'Alene, ID
Responsibility: Meeting minutes, Portfolio, Wikimaster
Email: cate9783@vandals.uidaho.edu


Additional Documentation[edit]

Project Schedule

Schedule: Updated 12-4-18

Meeting Minutes

9-14-18
9-26-18
9-28-18
10-1-18
10-2-18
10-3-18
10-12-18
10-15-18
10-19-18
10-24-18
10-26-18
11-2-18
11-7-18
11-9-18
11-26-18
11-30-18

Presentations

CDR #1 Powerpoint Slides