Real-time facial emotion recognition and mood correction with Spotify integration / Adam Zikri Zailani

Zailani, Adam Zikri (2023) Real-time facial emotion recognition and mood correction with Spotify integration / Adam Zikri Zailani. Degree thesis, Universiti Teknologi MARA, Melaka.

Abstract

This project presents the development of a mobile application aimed at enhancing driver well-being through real-time facial emotion recognition and mood correction. The application utilizes deep learning-based emotion recognition, employing the MobileNetV2 convolutional neural network, to identify four primary emotions - sad, happy, angry, and neutral - in drivers. Upon recognizing negative emotional states, such as anger and sadness, the app responds by playing music from Spotify to uplift the driver's mood. The successful implementation of the mobile app showcases its potential to mitigate negative emotions in drivers, providing a novel approach to promote emotional well-being during driving experiences. Accuracy obtained from controlled environment testing using python coding snippets proved promising with over 90% accuracy across all four emotions. However, the paper also acknowledges certain limitations, including the app's limited emotional spectrum, individual variability in emotional expression, and the challenge of distinguishing genuine anger from naturally angry resting faces. Additionally, technical constraints related to CNN architecture and hardware requirements are discussed.

Metadata

Item Type: Thesis (Degree)
Creators:
Creators
Email / ID Num.
Zailani, Adam Zikri
2020853616
Contributors:
Contribution
Name
Email / ID Num.
Advisor
Ahmad Fadzil, Ahmad Firdaus
UNSPECIFIED
Subjects: T Technology > T Technology (General) > Information technology. Information systems
Divisions: Universiti Teknologi MARA, Melaka > Jasin Campus > Faculty of Computer and Mathematical Sciences
Programme: Bachelor of Computer Science (Hons.) (CS230)
Keywords: Mobile application; Facial emotion recognition; Spotify integration
Date: 2023
URI: https://ir.uitm.edu.my/id/eprint/88974
Edit Item
Edit Item

Download

[thumbnail of 88974.pdf] Text
88974.pdf

Download (110kB)

Digital Copy

Digital (fulltext) is available at:

Physical Copy

Physical status and holdings:
Item Status:

ID Number

88974

Indexing

Statistic

Statistic details