Sign In to Follow Application
View All Documents & Correspondence

Deep Learning Algorithm Based Multilingual Opinion Mining

Abstract: The hype of sharing thoughts, plans, opinions, sentiments, reviews, and whatsoever comes to our mind on Social networking sites is increasing day by day and is at an all-time high. The data collected and made from this is enormous, and using them for analyzing, reviewing and as a guiding light by the calculative minds shows the advent of this era and the tremendous growth of technology. It also helps industries and organizations in various forms. One of them is to gather the thoughts of the people globally, which is termed opinion mining or sentimental analysis. This helps them to understand the market demand and help make the things consumers want and to separate the goods that are undesired or fix a specific issue. It enables growth at a much higher pace. This study focuses on the literature done in the years 2015-2019 and will help the researchers and scholars to analyze the recent works in the field of Opinion mining.

Get Free WhatsApp Updates!
Notices, Deadlines & Correspondence

Patent Information

Application #
Filing Date
17 October 2022
Publication Number
42/2022
Publication Type
INA
Invention Field
COMPUTER SCIENCE
Status
Email
registrar@geu.ac.in
Parent Application

Applicants

Registrar
Graphic Era Deemed to be University, Dehradun, Uttarakhand 248002, India.

Inventors

1. Dr. Kamlesh Singh
Professor, Department of Computer Science & Engineering, Graphic Era Hill University, Dehradun, Uttarakhand India, 248002
2. Dr. Bhasker Pant
Professor, Department of Computer Science & Engineering, Graphic Era Deemed to be University, Dehradun, Uttarakhand India, 248002.
3. Mr. Prabhdeep Singh
Assistant Proferssor, Department of Computer Science & Engineering, Graphic Era Deemed to be University, Dehradun, Uttarakhand India, 248002
4. Dr. Mahesh Manchanda
Professor, Department of Computer Science & Engineering, Graphic Era Hill University, Dehradun, Uttarakhand India, 248002
5. Dr. Devesh Pratap SIngh
Professor, Department of Computer Science & Engineering, Graphic Era Deemed to be University, Dehradun, Uttarakhand India, 248002

Specification

FIELD OF THE INVENTION
This invention relates to the Machine learning deals with the systems study that learns from
data, instead of following explicitly programmed instructions.
BACKGROUND OF THE INVENTION
Machine learning framework is an integrated system ofprograms. These programs learn from
existing data and capable of predicting new observations. Machine learning deals with the
systems study that learns from data, instead offollowing explicitly programmed instructions.
This technique is used in a wide range of computing tasks. Opinion originates from state of
mind, when we experience something in our day to day life. The expression may be an
appraisal or a negative comment. Some of the typical techniques to identify and predict the
sentiments from the text are Lexicon, Natural Language Processing, Machine Learning based
techniques. In this study, we have used Machine learning based technique to extract opinions
of customers and use it for business. The approach is quite straightforward; recordcustomer‟s
opinion, train and classify on selected key words. Similarly, opinion can be predicted by
using a pre-populated list of positive and negative words. For example,in the sentence
“performance of XYZ Laptop is not good”, the word „good‟ is a positive word but
presence of word „not‟ contradicts polar nature of the word. Simple negative andpositive
word combination creates a negative expression.
SUMMARY OF THE INVENTION
Opinion mining transforms the industry. In this research, we evaluated and updated social
networking sentiment analysis. In the past, we've seen a lot of literature and study in this
field, and as I've worked on them, it's become clearer to me that sentiment analysis is a
profound issue that benefits market growth. We've discussed methods that yield accurate
results. Hashtags, emojis, text, etc. are evaluated. There are several obstacles in this subject,
such as how a customer's emotions effect a product, and building a system that can
understand multiple languages instead of just one, since customers from around the world
utilise a single platform to offer their opinions or ideas. All these challenges can require
identifying fundamental or important emotions, however multiple emotions can be utilised to
train a model to recognise many additional emotion classes. It can identify abrupt client
emotional shifts.

BRIEF DESCRIPTION OF THE INVENTION
The role of social networking has slowly but steadily made a base in our lives. In one way or another we are slowly drawn towards it no matter how much we keep ourselves at bay but at the end of the day we always find our way back to it whether we want to check the reviews or are bored and want to look at other people plans or want to buy a particular thing. It’s a new trend to post everything you feel or does to share with others, and opportunists use this habit of people for their profits. The textual content, emoticons, photos and videos all help in coming up at a better conclusion of the opinions regarding a specific subject. Sentiment analysis or opinion mining classifies the data into three categories: positive, negative and neutral. Since it is not physically possible for anyone to read all the reviews and posts posted on a site thus, researchers and scholars are adamant on finding a way that does it with lesser computational power and time frame and therefore the vast area of machine learning and text mining is Sentimental analysis.
The three basic approaches of Opinion mining are: Lexicon drove in which we use word dictionary of textual guide or corpus- based method, Machine Learning approach and Hybrid, i.e. integration of both Lexicon and Machine Learning approach. In recent years, various powerful techniques are implemented in machine learning for a higher possibility of correct prediction such as SVM (“Support Vector Machines”), DT (“Decision Tree”), NB (“Naive Bayes”), and its ensemble approaches such as GBT (“Gradient Boosted Trees”). Other than this Deep Neural Networks (DNN) is also in use for text classifications. In this survey, The concept of fuzzy networks is introduced in as in a simple sentence there may be positive and negative or both words and thus discriminative algorithms such as SVM, DT, NB and GBT do not provide a correct representation. This paper focuses on a “fuzzy method that involves combining or the fusion of relationship degrees for each class of multiple fuzzy classifiers produced with discrete arguments setting”. It focuses on the detection of cyberhate, i.e. hate speeches that are posted on online platforms that can result in antisocial activities. It deals with race, sexual orientation, religion and disability by developing the fuzzy approach to deal with the text ambiguity that can arise in other methods. Secondly, it deals with the semi-fixed rule of defuzzification.
This proposed fuzzy method with both qualities can achieve effective recapitulate of text. A Knowledge-based recommendation system which helps in monitoring human emotions and detecting psychological disturbances such as stress and depression is addressed in. Based on this monitoring, messages will be sent to the users according to their state like motivational, happy and calming posts and the intensity of them can also be monitored by it as well as warnings can also be sent to higher and designated authorities. Character level representation is done using Convolutional Neural Network and disorder entity recognition by BiLSTM-RNN (“Bi- directional Long Short term memory-Recurrent Neural Network”). It provides an enhanced recommendation system that provides a personalized and improved sentiment metric and a mobile application that requires low computational power, memory and energy. “The projected model gives the precision of 0.90 and 0.89 to identify stressed and depressed users, respectively”. A deep learning-based model is introduced in to categorize reviews expressed by different users called RNSA. In this, a “consolidated feature set which is representative of sentiment knowledge, word embedding, sentiment shifter rules, statistical and linguistic knowledge is thoroughly studied for sentiment analysis”. This model differentiates between the senses of the word and applies a strategy to create a single demonstration per word procedure. Contextual polarity is also taken into account as it changes concerning contexts. Therefore, yielding advanced performance enhancements in contrast with other existing renowned methods. The issues in that in micro- blog sentimental analytics, emoticons also help to get precise emotional meanings.
According to previous studies, they considered emoticons as noisy sentiment labels and overlooked their potential for emotional feelings. In this paper, a new “Emoticon Semantic Enhanced Convolutional Neural Network, i.e. ECNN model” is proposed. Thus, we can identify subjectivity, emotion and polarity in micro-blog environments. In this, “an emotional space is constructed using many common emoticons based on the principle of semantic composition calculation of vector representation, the emotional vectors and the word vectors is more explicit.” People commonly use these emoticons to express their emotions since they are easy to understand and correlate, which can play an essential role in opinion mining. A novel approach to distinguish and extracting the opinion terms and aspect terms from the data is proposed in as they are profoundly misguided by each other. Firstly, we articulate the chore of “two sequence labelling problems and then followed by a multi-task learning framework via joint” optimization. Next, the ILP (Integer Linear Programming) framework is applied to “perform global inference over the results of the neural network and designing several intra-task and inter-task constraints for global consistency.” Therefore, automatically extracting opinion terms and aspect terms from online reviews. Detection of irony in texts as sometimes while posting some issues or comments is listed in as we seldom use ironical lines that combines a positive polarity term and a negative term in the same sentence and the meaning of the sentence is opposite of the sentiments are behind it. A model is proposed for “attention-based models” for integrating “sentiment features as an alternative of feature vector concatenation”. In this, we learn in-depth features on sentiments and transferring them into “the attention-based model” of neural networks to detect both implicit and explicit context incompatibility.
It is also discovered that hash-tag labelled dataset is more comfortable to identify than human labelled dataset for irony detection. The scope of sentimental analytics in new product development in as it relates the sentiments of users afore and after the introduction of goods in the market. It gives a real-time opinion about the expectations of the users about the product and what can be done to accomplish it. It also helps in the advertising as we have a view of the emotions possessed by the customers regarding the particular product. Total three products experimented, and 302,632 tweets were collected in which before and after reviews of the products were listed. Thus, if any changes have to be done in the product in its next version according to the public reviews, it could be done. It can also tell the market value, the future growth rate of the particular product. “Weakly supervised multimodal deep learning system” is developed to predict a microblog sentiment that composes of images, texts and emoticons in. The main challenge that we encounter, i.e. difficulty in collecting training labels for a better modal prediction is overruled. This scheme learns from the "weak" emoticon labels that are iteratively and selectively learnt by Convolutional Neural Network, which often contain noise but are otherwise cheaply available. Also, a feasible graphical model is instigated to capture the modality dependency and to filter out label noise and therefore, the modal “infer the confidence of label noise as well as learn discriminative label noise”. The techniques of analyzing movie reviews with deep learning is discussed in and. The movies before and after their release have an excellent level of excitement. This analysis will help in learning constructive criticism or help.
The texts represented by researchers were commonly traditional texts. They could be a single word opinion, a line or a blog which expresses a person's sentiments about a particular thing. These texts require various algorithms to extract the right emotion from them. We can get the essential information, knowledge of recent trends, summarize the long blogs, characterize emotions or classify them etc. Often human sentiments are difficult to understand because they seldom use ironical or sarcastic comments to tell their views. Thus, we have to classify them thoroughly. The primary concern of opinion mining is to distinguish between the negative and the positive polarity. We first distinguish the sentiments via their domain since it highly depends on it. Then, we either break it to sentence-level or we apply various algorithms that are concerned with document level to extract opinions from documents. In words are clustered in different groups so that it can be easy to determine the context of the word once used as well as in we determines the words which change their meaning with context and can seldom be confused. A hybrid approach is then proposed in for a model to obtain “opinionated content”. Now, below is the architecture of Sentimental Analysis: Many times researchers and scholars use Twitter datasets or its API to collect information and reviews but there are various other platforms that are widely used for this.
In a novel approach is proposed to collect data from other social networking sites such as Instagram, Facebook etc. and algorithms are proposed to gain the best conclusive review. Earlier, supervised algorithms were used to identify the sentiments, but since everyone has their opinion and things change with time, we cannot prepare a supervised algorithm to give us the desired result. “Support Vector Machines, Naïve Bayes, maximum entropy” algorithms can give the result only till a particular level. Thus, we started using unsupervised or reinforcement learning to train our models, and deep learning and neural networks come into the picture. Let's discuss below how Deep Learning and neural network algorithms work in opinion mining as they help in word embedding’s that are used in the skip-gram model, solve “sentiment classification tasks” and other tasks that can help in progressing the research of developing and understanding natural language processing.
DEEP LEARNING:
In Deep learning, we use algorithms to transform the data; each level learns to convert its input data into a composite representation. Deep learning architectures are used in sentiment analysis, computer vision, voice recognition, natural language processing, drug design etc. Deep learning defines how deeply data should transform to get the information. In this data is modified in the layer- wise process. By layers, we can get the information about any figure if we take the example of an image, the input image is reconstructed in different layers to get the constituents of an image. Firstly the pixels of input are extracted to get the edges of the figure. Secondly, these edges will be composed or encoded, the third layer encodes the features of the image like if there is an image of a human, then it will recognize the nose, eye etc. in the fourth layer, it will finally recognize the image. Similarly, it happens with the textual content. It is first retrieved and then passed on to different layers which check the sentiment, information etc. out of that data. To manipulate the input into output is done by the deep neural network, DNN found the correct mathematical way to transform the input into the output. These networks are trained to found the right sentiments in a way that has a high probability of an accurate outcome since they have various different approaches. As in the effectiveness of Deep Learning is checked by “Mining of Sustainable aspects of the hotel client opinions”, shows an approach to mine opinions in the field of Agriculture and a hybrid semantic knowledge-base approach is shown in.
NEURAL NETWORKS:
Neural Networks is also known as “Artificial Neural Networks”. It is an information processing pattern which is developed by getting idea from an animal brain or especially the human brain. It's been thousands of years we are studying the human brain. In 1943, the first stride was taken towards Artificial Neural Network when “Warren McCulloch and Walter Pitts”, a neurophysiologist and a young mathematician respectively, wrote a paper about how neural network works. They modelled neural network uses electronic circuits. It modifies itself with the changing relationships of inputs and develops a framework that helps process different algorithms of ML. The neural network can be further divided into two, i.e. “Convolutional Neural Network (CNN) and Recurrent Neural Network (RNN).” In CNN, the input generated is considered, but in RNN, the previous inputs generated as well as the current one all are considered. Usually, we use RNN’s much more than CNN’s for natural language processing since the results are much more accurate with RNN’s. Sentimental analysis can be considered as an example of neural networks implementation. For example, in sentimental analysis or opinion mining, the machine might learn to identify basic emotions by observing and analyzing the sample set of reviews on which it is already manually labelled as the type of emotion and device will use the result of these set of texts for identifying sentiments in other real- world applications such as identifying the abusive or the hate speeches. Even the machine does not have any prior knowledge about the feelings that they have different polarities, they have information, they have aspect and opinion terms, but gradually it will generate the results based on the learning.
DATASETS:
There were different datasets used scholars and researchers in their work. [33] Reviews different datasets and techniques that are used in recent years. These datasets can be collected from various sources such as Blog Writing Pages, Review sites, micro-blogging websites or social media etc. in the papers discussed the datasets collected were of different types explicitly collected for their task. Some of the datasets are explicitly designed for these experimentations.

We Claims:

1. It focuses on the detection of cyberhate, i.e. hate speeches that are posted on online platforms that can result in antisocial activities.
2. It deals with race, sexual orientation, religion and disability by developing the fuzzy approach to deal with the text ambiguity that can arise in other methods. Secondly, it deals with the semi-fixed rule of defuzzification.
3. It is first retrieved and then passed on to different layers which check the sentiment, information etc. out of that data.
4. To manipulate the input into output is done by the deep neural network, DNN found the correct mathematical way to transform the input into the output.
5. These networks are trained to found the right sentiments in a way that has a high probability of an accurate outcome since they have various different approaches.
6. A hybrid approach is then proposed in for a model to obtain “opinionated content”. Now, below is the architecture of Sentimental Analysis: Many times researchers and scholars use Twitter datasets or its API to collect information and reviews but there are various other platforms that are widely used for this.
7. In this, we learn in-depth features on sentiments and transferring them into “the attention-based model” of neural networks to detect both implicit and explicit context incompatibility.

Documents