Sign In to Follow Application
View All Documents & Correspondence

Real Time Music Recommendation System

Abstract: An intelligent, real-time, Music Recommendation System (S) Moodify, based on real-time facial emotion recognition and EEG validation. The language-specific System (S) uses facial emotions to detect the emotion of the user and EEG signal to validate the change in emotion enabling music recommendation based on the preference of the user. Real-time expression of the user is captured through a built-in camera and the captured expression is processed using a custom-built CNN model which is trained on the CMU Multi-PIE Face Database. Thereafter, music is played from a music streaming platform based on the recognized emotion, the songs chosen from user preference of songs in the desired language. The system projects a customized user experience through language settings chosen from six regional and foreign languages. The system (S) recommends emotion-based songs to the user in the preferred language with high accuracy within 2-3 seconds to relieve the stress of a person instantly.

Get Free WhatsApp Updates!
Notices, Deadlines & Correspondence

Patent Information

Application #
Filing Date
07 November 2024
Publication Number
46/2024
Publication Type
INA
Invention Field
COMPUTER SCIENCE
Status
Email
Parent Application

Applicants

AMRITA VISHWA VIDYAPEETHAM
Bengaluru Campus Kasavanahalli, Carmelaram P.O. Bangalore – 560035, India

Inventors

1. DUVVURI, Kavya
Flat No. 303, Ramaiah Residency, 3rd Cross, SR Layout, Murgeshpalya Bengaluru 560017 Karnataka
2. SIDDHARTHA, Sai Sri Mutyala
HIG-460, APHB, Bhavanipuram Vijayawada, Andhra Pradesh 520012
3. PALANISWAMY, Suja
#102, MIG B4 Suryanagara Phase 1, Chandapura, Anekal Road, Bengaluru 560099 Karnataka
4. KANISETTYPALLI, Harshitha
1/50/5, Rajendra Prasad Street, Kadiri, Sri Satya Sai (D), Kadiri 515591 Andhra Pradesh
5. KANISETTYPALLI, Karthik
1/50/6, Rajendra Prasad Street, Kadiri, Sri Satya Sai (D), Kadiri 515591 Andhra Pradesh

Specification

Description:This application is an improvement of the invention claimed in the specification of the main patent application no. 202341007344 titled “Music Recommendation System and Method Thereof” filed on 6th February 2023.

STATEMENT OF INVENTION AS DISCLOSED IN THE PARENT APPLICATION NO. 202341007344:
The invention as disclosed in the application titled “Music Recommendation System and Method Thereof” (parent application) relates to a music recommendation system which is based on speech and body gesture emotions. More particularly, the invention discloses a music recommendation system that recognizes emotions of a user from both body gestures such as facial expressions and speech and recommends appropriate songs based on the recognized emotion of the user by using few-shot meta-learning based Siamese Neural Network. Emotions of the user are derived by combining both speech and body gestures by using element-wise multiplication to counter the issue of dimensionality. The derived emotions are recognized through an inpu , Claims:1. A Music Recommendation System (S), Moodify based on real-time facial emotion recognition, the system (S) comprising:
- a Facial Emotion Recognition (FER) Module for capturing and processing real-time facial expressions of the user (U),
- a song extraction (SE) module for extracting songs from music API,
- a Music Recommendation (MR) module for recommending music based on the recognized emotion of the user (U),
- a Language Selection Module (LSM) with customized language selection option,
- an EEG signal validation (ESV) module for recording the EEG signals of the user (U),
wherein, music in the user preferred language is recommended based on real-time facial expressions of the user (U), instantly and the change in emotions validated through the EEG signals of the said user (U).

2. The Music Recommendation System (S), as claimed in claim 1, wherein facial expressions captured by the Facial Emotion Recognition (FER) module are used as input by the system (S) to recommend songs for enhancing the mood of the

Documents

Application Documents

# Name Date
1 202443085367-STATEMENT OF UNDERTAKING (FORM 3) [07-11-2024(online)].pdf 2024-11-07
2 202443085367-FORM FOR SMALL ENTITY(FORM-28) [07-11-2024(online)].pdf 2024-11-07
3 202443085367-FORM 1 [07-11-2024(online)].pdf 2024-11-07
4 202443085367-FIGURE OF ABSTRACT [07-11-2024(online)].pdf 2024-11-07
5 202443085367-EVIDENCE FOR REGISTRATION UNDER SSI(FORM-28) [07-11-2024(online)].pdf 2024-11-07
6 202443085367-EVIDENCE FOR REGISTRATION UNDER SSI [07-11-2024(online)].pdf 2024-11-07
7 202443085367-EDUCATIONAL INSTITUTION(S) [07-11-2024(online)].pdf 2024-11-07
8 202443085367-DRAWINGS [07-11-2024(online)].pdf 2024-11-07
9 202443085367-DECLARATION OF INVENTORSHIP (FORM 5) [07-11-2024(online)].pdf 2024-11-07
10 202443085367-COMPLETE SPECIFICATION [07-11-2024(online)].pdf 2024-11-07
11 202443085367-FORM-9 [11-11-2024(online)].pdf 2024-11-11
12 202443085367-FORM 18 [11-11-2024(online)].pdf 2024-11-11
13 202443085367-Proof of Right [09-12-2024(online)].pdf 2024-12-09
14 202443085367-FORM-5 [09-12-2024(online)].pdf 2024-12-09
15 202443085367-FORM-26 [30-01-2025(online)].pdf 2025-01-30