As I approached this project I had 2 things in mind , one being how can I improve my health VA and 2nd being figuring out emotions in voice.
Like the project name suggests , I wanted to create a voice assistant which can be of help when someone is not feeling well. By asking ” how am I doing ” the VA gets triggered and senses the emotion in the voice of the user and replies in a way which is calming , uplifting or helpful . Depending on the instance , it responds to the user on checking the vitals by accessing the basic health report covering heart rate , sleep cycle and calorie burn.
We learnt intent making on dialogflow , I created an intent called how_am_idoing with entities resolving to a response related to health.
I have some test results :
I am yet to find a plausible way to detect emotions as detecting emotion such as happy, sad , angry and frustrated are very important for the project.