Speech Therapy Application 2019-2020

The goal of the project has been to continue the work of two previous teams for a speech therapy application intended for children. Specifically, this project has implemented a front-end user interface to interact with the last team's database system, a back-end server that controls data flow, and an expansion upon security to ensure compliance with medical data laws.

=Background= About 8% of children need speech therapy globally and while there are many speech therapy apps intended to help these children, most only supplement typical sessions, require a therapist to use, or are of little use for research. This project’s aim has been to create an all-in-one computer application for speech therapy utilizing last year’s database system by implementing: a dynamic user-interface, an overhauled security system, and features useful to children, therapists, and researchers, alike.

=Problem Definition= This project is a continuation of two previous capstone teams’ work on a speech therapy application intended for children. The first team developed a proof-of-concept speech analyzer using an open-source library called Sphinx. The second team developed a java wrapper and database structure for the back-end of the application. This year, we have developed a front-end for the application, connected the last team's database program, and successfully integrated a robust security layer. Overall, this project is eventually intended to assist children undergoing speech therapy with an application that provides speech lessons. These lessons can either prompt words or phrases with a text-to-speech generator or by the patient’s therapist and the patient’s response will be scored by comparing it to a matching phrase. All of the patient data and their recordings will then be stored and can be downloaded within the application for research use.

=Deliverables=
 * A complete user interface for the application including but not limited to: a login screen, menu screen, help menu, lessons screen, and data viewing screen.


 * Expansion upon security and authentication to keep the project on track for COPPA and HIPAA compliance


 * A system to give therapists, caregivers, and researchers a view of patient records


 * A system allowing for the upload of patient audio files


 * A back-end server to handle data transfer and to control the security layer


 * Meaningful integration of the previous database system

=Design= This project utilizes Angular as the framework for the user interface. The back-end runs on Java and accesses databases hosted on Google Cloud through MySQL queries.

Specifications
 The user ID and password data must be encrypted The user interface should be able to check if credentials input are valid User Interface must be intuitive enough that children can use it User interface must be able to call database wrapper functions Certain parts of the user interface should only be accessible by specific user types User interface should be able to separate voices using Google Speech-To-Text API User interface should load the correct records accessible to that user The user interface should ensure data can only be changed by valid users</li> Patient data must be encrypted</li> </ul>

Alternative Designs
<ul> Use React instead of Angular</li> <ul> Not as expansive and hinders expandability</li> </ul> Use Javascript as the frontend</li> <ul> More lightweight than React or Angular but loses many features including mobile porting</li> </ul> Use another server service other than Google Cloud</li> <ul> Less complex but lose access to features such as the Speech-to-Text API</li> </ul> </ul>

=Manufacturing=

=Project Learning= <ul> Authentication</li> Frontend and Backend Communication</li> Google Cloud</li> Angular</li> Typescript</li> Maven</li> Google Speech-to-Text API</li> MySQL</li> Encryption</li> <li>GitHub</li> </ul>

=Team Members=

=Additional Documentation=

Project Schedule

Schedule v1.0

Meeting Minutes

Minutes: 9/11/19 Minutes: 9/20/19 Minutes: 9/27/19 Minutes: 10/4/19 Minutes: 10/11/19 Minutes: 10/25/19

Presentations

Concept Design Review