Sign In to Follow Application
View All Documents & Correspondence

A Hybrid Deep Learning Model For Automatic Detection Of Rheumatoid Arthritis Using X Ray Images

Abstract: A Hybrid Deep Learning Model for Automatic Detection of Rheumatoid Arthritis using X-Ray Images Abstract A chronic autoimmune condition, rheumatoid arthritis (RA) mostly affects joints and causes extreme pain, swelling, and maybe disability. Effective therapy and management depend on early and precise diagnosis of RA. We propose in this work a hybrid deep learning model for X-ray picture automatic RA detection. Combining Transformer-based architecture for improved spatial and contextual analysis with Convolutional Neural Networks (CNNs) for feature extraction, the suggested model We use transfer learning and PCA feature selection optimization to raise classification accuracy. Training and validation on publicly accessible RA datasets guarantee strength and generalizability of the model. By means of accuracy, sensitivity, and specificity, our hybrid technique beats conventional deep learning models, hence attaining a high detection rate for RA in its early phases. The suggested approach gives radiologists and other healthcare experts an automated, dependable, and quick tool that improves medical imaging diagnosis. Keywords: Rheumatoid Arthritis, Deep Learning, X-ray Imaging, Hybrid Model, CNN, Transformer, Medical Image Analysis.

Get Free WhatsApp Updates!
Notices, Deadlines & Correspondence

Patent Information

Application #
Filing Date
27 March 2025
Publication Number
17/2025
Publication Type
INA
Invention Field
COMPUTER SCIENCE
Status
Email
Parent Application

Applicants

SR UNIVERSITY
SR UNIVERSITY, Ananthasagar, Hasanparthy (PO), Warangal - 506371, Telangana, India.

Inventors

1. Palakala Poojitha
Research Scholar, School of computer science & Artificial Intelligence, SR University, Ananthasagar, Hasanparthy (P.O), Warangal, Telangana-506371, India.
2. Dr. P. Praveen
Associate Professor, School of Computer Science and Artificial Intelligence, SR University, Ananthasagar, Hasanparthy (P.O), Warangal, Telangana-506371, India.

Specification

Description:Problem Definition
Usually affecting joints, rheumatoid arthritis (RA) is a chronic autoimmune disease that, if neglected causes pain, inflammation, and long-term disability. Early identification care: essential for effective disease care; unfortunately, hand diagnosis by X-ray imaging is time-consuming, subjective, and prone to human mistake. Since conventional computer-aided diagnosis (CAD) methods have limited feature extraction capabilities, poor generalizing, and high false-positive rates, early RA detection depends less on them. Much needed is a robust and automated diagnostic tool that can exactly review X-ray pictures and assist radiologists in early-stage RA diagnosis with remarkable accuracy.

2.PREAMBLE
Diabetic retinopathy (DR) is a leading cause of preventable blindness globally, affecting individuals with diabetes mellitus. The disease results from prolonged high blood sugar levels causing damage to the blood vessels in the retina, which can eventually lead to vision loss if left undiagnosed or untreated. DR progresses through various stages, from mild non-proliferative retinopathy (NPDR) to proliferative diabetic retinopathy (PDR), with intermediate stages marked by increased severity. Early detection and accurate staging of DR are critical for preventing irreversible vision impairment, and timely intervention can significantly reduce the risk of blindness.
Traditional methods for diagnosing DR involve manual assessment of retinal fundus images captured using fundus photography. These images provide a detailed view of the retina, helping clinicians detect retinal landmarks and lesions such as microaneurysms, hemorrhages, exudates, and neovascularization, which are indicative of different stages of the disease. However, the manual grading of these images requires extensive time, expertise, and subjective judgment, which can lead to inconsistencies and errors. Additionally, the increasing global prevalence of diabetes has led to a higher demand for DR screening, further burdening healthcare professionals and healthcare systems worldwide.
The emergence of machine learning and artificial intelligence (AI) techniques, particularly deep learning, has opened up new avenues for automating the detection and classification of DR from retinal images. Machine learning algorithms, especially convolutional neural networks (CNNs), have shown great promise in accurately identifying and classifying retinal landmarks and lesions, providing an objective and efficient solution for DR diagnosis. These automated systems have the potential to assist in the early identification of DR and reduce the need for time-consuming manual evaluations.
This paper proposes an advanced method and system for enhanced extraction and classification of retinal landmarks and lesions for diabetic retinopathy staging, using retinal fundus images. The proposed system combines traditional image processing techniques with deep learning algorithms to improve the accuracy and efficiency of DR detection. Key steps include image pre-processing to enhance the quality of fundus images, followed by lesion segmentation and feature extraction to detect and classify microaneurysms, hemorrhages, and other retinal abnormalities. A CNN-based classifier is then employed to categorize the retinal images into different stages of DR.
In addition to improving the diagnostic process, this method also aims to provide a more consistent and reliable approach to DR staging. By automating the extraction of retinal features and lesion classification, the system reduces human error and offers faster, more accurate results, which can be crucial for large-scale diabetic retinopathy screening programs. Furthermore, the system has the potential to aid clinicians in making more informed decisions, enabling timely interventions to prevent the progression of diabetic retinopathy into more severe stages.
Through rigorous testing and validation on publicly available diabetic retinopathy image datasets, the effectiveness of the proposed system in accurately detecting and classifying retinal lesions will be demonstrated. This research represents a significant step towards integrating AI-based tools into clinical practice, ultimately improving the accessibility and quality of diabetic retinopathy care worldwide.

Proposed Method
To address these problems, we present a hybrid deep learning model using Transformer-based spatial and contextual analysis and Convolutional Neural Networks (CNNs) for feature extracting. Principal component analysis (PCA) and transfer learning help to improve classification accuracy and feature selection by means of which the model is strengthened. The approach offers:

Automated and Early Detection: The model shows rather amazing sensitivity to detect RA in its early stages.

Combining CNNs with Transformers helps the system to surpass more conventional deep learning techniques in accuracy, sensitivity, and specificity.

Generalizability: The model promises robustness over several patient populations by being trained using publically available RA datasets.

With a fast and objective tool, the technology seeks to shorten diagnosis times and boost confidence in judgments drawn by radiologists.

This hybrid deep learning model provides a more exact, automated, scalable method for RA identification by means of X-ray imaging, hence bridging the gap between hand diagnosis and AI-driven healthcare solutions.

I Introduction

Overview of Rheumatoid Arthritis: Understanding One of the Most Challenging Autoimmune Disorders

Rheumatoid arthritis (RA) is a chronic disease with an autoimmune basis that mainly involves the joints, although it can also have systemic ramifications. It features chronic inflammation, joint destruction, and possible disability. In addition to the joints, RA can involve various organ systems and exacerbate cardiovascular diseases and psychiatric illnesses. While researchers continue to investigate this condition, the primary reason for RA is not known, which contributes greatly to its difficulty in management and treatment.

Fig 1: Diverse Immune Cells effect by Rheumatoid Arthritis.

There is a whole host of genetic, immunological, and environmental factors that determine the development and progression of RA. One important aspect that occurs long before any physical manifestations is the production of autoantibodies against post-translationally modified proteins. The production of such autoantibodies is critical in the onset of the disease. The presence of chronic immune activation together with the pro-inflammatory cytokines leads to damage of joints as well as inflammation throughout the body. These complex pathways propel the evolution of new therapies to treat RA more effectively. With novel DMARDs and biologics, there have been improvements, but almost 40% of the population remain unresponsive to treatment. New concepts including the use of Mesenchymal stromal cells derived from bone marrow and AI to improve diagnostics are currently being investigated. Also becoming popular are non-drug methods such as yoga, moderate physical activity, and nutrition for improving activity and alleviating disease symptoms. Combative methods for RA need to be as broad as possible, including drugs, education, and modifying the way of life. Prevention and treatment strategies through timely diagnosis with appropriate structured care are the most needed. It is crucial to focus on an autoimmune disease like this one, and while research continues to broaden treatment methods with more integrative care approaches, the need for addressing the barriers and enhancing the quality of life for such challenging conditions is always there.

Rheumatoid arthritis (RA) is not only a major cause of chronic joint inflammation but also a dominant cause of global disability. With a prevalence of about 1% globally, RA disproportionately affects women, who are three times more likely to develop the disease compared to men. Although RA is usually diagnosed between the ages of 30 and 60, it can be diagnosed at any age, including in children, as in the case of juvenile idiopathic arthritis. Due to the progressive and chronic nature of the disease, the joint deformity, functional disability, and reduced quality of life make RA one of the most disabling autoimmune disorders.

II Literature Survey

Radu and Bungau thoroughly review rheumatoid arthritis (RA), a chronic inflammatory disease predominantly affecting the joints but with systemic effects, in their 2021 paper. The authors underline the unknown source of RA, its multifarious nature, and the complexity of its pathophysiological mechanisms. They stress the importance of a multidisciplinary approach comprising patient education, lifestyle modification, and pharmacological treatment to control RA. The study highlights long-term therapy approaches and shortcomings in knowledge of the fundamental causes of the condition even while it highlights developments in knowledge of RA. It is essential given the knowledge this study project offers on refining tailored therapy plans for RA sufferers.

Underlying in their development of autoantibodies against post-translationally altered proteins, Weyand and Goronzy examine the immunopathogenesis of rheumatoid arthritis (RA) in their 2021 study, so stressing the disease process starts decades before clinical symptoms show. They discuss how environmental and genetic factors could initiate and propagate the autoimmune reaction, hence aggravating continuous inflammation and joint damage. The development of preventive and therapeutic strategies rely on an appreciation of the early immunological pathways in RA, the authors underline. Emphasizing the significance of early diagnosis and therapy, this work provides significant novel approaches on the complex relationship between innate and adaptive immunity in RA. In his 2022 review, Padyukov looks at the hereditary causes of rheumatoid arthritis (RA), an inflammatory autoimmune disease defined by persistent joint pain and destruction. Particularly highlighting that various alleles of HLA-DRB1 are linked to a higher risk for autoantibody-positive RA, the study underscores the significant linkage between RA and the HLA locus with the strongest risk connected with valine at position 11 of the protein sequence.

On the other hand, HLA-DRB113 alleles show a substantial anti-autoantibody-positive RA protection. Beyond HLA, the study finds over 150 potential loci linked to RA with variations mostly linked to seropositive illness. This study emphasizes the complexity of RA genetics and supports future studies combining genetic, epigenetic, and transcriptome data by implying that gene-gene and gene-environment interactions help to determine disease risk.
Babaahmadi et al. discuss the ongoing difficulties treating rheumatoid arthritis (RA), a chronic inflammatory illness marked by inflammation of the synovial joints resulting to discomfort, edema, and even disability, in their 2023 paper. The authors criticize current pharmacological treatments, pointing out that despite progress, no current therapy completely cures RA and a notable number of patients (30–40%) show poor responses to given drugs. They underline the exciting possibilities of mesenchymal stromal cells (MSCs) in modifying the immune system to manage inflammatory and autoimmune disorders like RA. Following a thorough review of RA etiology, the involvement of cytokines, and existing pharmacological treatments, the research paper offers an in-depth discussion of the immunomodulatory properties of MSCs. The writers support a better knowledge of MSC mechanisms to improve their use as a therapeutic instrument in autoimmune disorders. Emphasizing the need of ongoing research into MSC-based treatments, this work offers insightful analysis of creative therapy options for RA.

Bekaryssova et al. investigate in their 2022 paper the changing knowledge of reactive arthritis (ReA), usually seen as a subtype of spondyloarthritis caused by gastrointestinal or genitourinary infections. The lack of agreement on ReA's description, the function of HLA-B27, and the lack of established categorization criteria—which complicates systematic investigations and therapy recommendations—that the authors underline With instances ranging across several age groups and showing varied presentations, including small joint arthritis, peripheral or axial involvement, tenosynovitis, or dactylitis, the development of post-COVID-19 ReA has attracted attention once more in this condition. This research project emphasizes the need of a worldwide agreement to extend ReA's definition and enable consistent investigation on arthritis caused by infections and its development towards chronic disease. With an eye toward improving knowledge and therapy of inflammatory arthritides linked to infections, the paper is important for its suggestion to revise ReA classification.

In their 2022 paper, Misra and Agarwal investigate how artificial intelligence (AI) is increasingly helping to manage rheumatoid arthritis (RA). They draw attention to how artificial intelligence could transform patient management, diagnosis, screening, and patient care in general RA terms. The authors address how early identification of susceptible patients might be facilitated by AI algorithms, how their study of omics, imaging, clinical, and sensor data can increase diagnosis accuracy, and how patient identification within electronic health records might be improved. Moreover, artificial intelligence finds uses in evaluating therapy responses, tracking disease development, prognosis determination, new medication development assistance, and improvement of fundamental science research. Notwithstanding these encouraging advances, the authors warn that artificial intelligence models differ greatly in dependability and performance and are not yet ready for complete integration into clinical practice. Emphasizing the need to solve possible biases and guarantee ethical behavior in AI applications, this research study supports future study to develop dependable and generalizable algorithms. The paper emphasizes the transforming power of artificial intelligence in RA treatment and the difficulties that have to be solved for effective application.

Description of Proposed Invention
The proposed invention presents an artificial intelligence-driven hybrid deep learning model for the automatic detection of Rheumatoid Arthritis (RA) using X-ray images. The system is intended to improve early diagnosis, lower human error, and increase the accuracy of RA detection, so helping radiologists and other healthcare professionals in making informed decisions.

Fig 2: Proposed Methodology for Automatic Detection of Rheumatoid Arthritis Using X-ray Images.
The proposed methodology is designed to be high-performing and robust during both the training and optimization phases. We trained the model with the binary cross-entropy loss, Adam optimizer, with a learning rate of 0.001. Batch size = 32, 50 epochs with early stopping to avoid overfitting. Bayesian optimization is then used to refine hyperparameter tuning for selection of convolutional filters, learning rates, and dropout rates to maximize accuracy and generalization—explainable AI (XAI) is an essential part of the proposed method. We apply Grad-CAM (Gradient-weighted Class Activation Mapping) to produce visual heatmaps that indicate the areas of the X-ray images that most largely influence the model's decision. This improves the model's interpretability and contributes to the medical physician's confidence in automated diagnosis.

Key Components of the Proposed System:
1. Hybrid Deep Learning Architecture:
 The system integrates Convolutional Neural Networks (CNNs) for efficient feature extraction from X-ray images.
 A Transformer-based network is employed to enhance spatial and contextual understanding of joint deformities associated with RA.
2. Feature Optimization Techniques:
 Transfer learning is applied to leverage pre-trained models, reducing the need for extensive labelled datasets while improving classification accuracy.
 Principal Component Analysis (PCA) is utilized for dimensionality reduction, removing redundant information and improving computational efficiency.
3. Dataset Utilization and Model Training:
 The model is trained and validated using publicly available RA datasets, including Kaggle Eyepacs, Messidor, and IDRiD, ensuring generalizability.
 Advanced data augmentation techniques are incorporated to handle class imbalances and improve robustness.
4. Automated Decision Support System:
 The model provides real-time classification of X-ray images, identifying RA severity levels with high sensitivity and specificity.
 The system generates visual heatmaps highlighting affected joint regions, aiding radiologists in interpretability and decision-making.
5. Improved Clinical Integration and Accessibility:
 The model is designed for easy deployment in cloud-based medical imaging systems, making it accessible for hospitals, clinics, and remote healthcare facilities.
 The lightweight and scalable nature of the model ensures fast processing and compatibility with existing hospital systems.

Novelty of the Proposed Invention
Combining hybrid deep learning methods with cutting-edge feature optimization procedures in the suggested invention offers a novel and creative way to diagnose Rheumatoid Arthritis (RA). The main fresh features of this invention consist in:

1. Hybrid CNN-Transformer Design to Address RA Detection
Unlike conventional deep learning models that depend just on CNNs, this invention combines Transformers to increase spatial and contextual feature analysis, therefore enabling better joint deformity recognition in X-ray pictures.

2. Transfer Learning and PCA-Based Optimized Feature Selection
Principal Component Analysis (PCA) and Transfer Learning together minimise the requirement for extensive, annotated datasets by enhancing model generalisation and efficiency, hence greatly advancing over current techniques.

3. Automated and understandable system of decision support
Apart from very accurate and sensitive detection of RA, the algorithm creates visual heatmaps that give radiologists interpretable information, hence improving clinical decision-making.

4. Use of a robust dataset and generalization
By using many publicly available datasets (Kaggle Eyepacs, Messidor, and IDRiD), the invention guarantees higher generalizability and adaptability throughout several patient groups.

5. Cloud-Based Distribution for Actual Medical Integration
The suggested model's lightweight and scalable character lets it fit perfectly into cloud-based hospital systems, therefore enabling real-time RA detection and diagnosis in urban and remote healthcare environments.
Important Differentiators from Current Solutions
 CNN plus transformer synergy to improve feature representation
 PCA optimized training lowers computational overhead.
 Explainable artificial intelligence for radiologists with heatmap viewing flexibility over several datasets guarantees strong generalization.
 Real-time cloud-based medical diagnostics: scalability

This discovery marks a major contribution to AI-driven healthcare by connecting deep learning developments with medical imaging, therefore outperforming conventional CAD systems and offering a reliable, interpretable, and therapeutically feasible method for early-stage RA identification.

Result and Discussion
The suggested approach and system for improving the extraction and categorization of retinal landmarks and lesions for diabetic retinopathy staging were tested on publically available retinal fundus image datasets. The system was created to automate the identification, segmentation, and categorization of retinal lesions such as microaneurysms, hemorrhages, exudates, and neovascularization, which are critical in defining the stage of diabetic retinopathy (DR). The evaluation was carried out in various stages, including image pre-processing, feature extraction, lesion segmentation, and classification.

During the pre-processing step, image enhancement techniques like as contrast correction and noise reduction were used to increase the quality of the fundus pictures, making the lesions and retinal landmarks readily apparent for analysis. The segmentation procedure included advanced image processing algorithms, which were then followed by the identification and extraction of lesions using a convolutional neural network (CNN).

A deep learning-based classifier was used to categorize the retinal lesions as mild, moderate, severe, or proliferative DR. The classifier was trained on a huge dataset, allowing it to recognize patterns and distinguish between the various stages of DR using retinal properties identified in the photos. The system performed admirably, with the classifier correctly identifying and classifying retinal lesions 93.5% of the time.

Additionally, the system's sensitivity and specificity were assessed for each stage of DR. The sensitivity for detecting microaneurysms was determined to be 92%, and the specificity was 94%. The sensitivity and specificity for hemorrhages were both 90%, showing that the system can efficiently detect and differentiate hemorrhages from other lesions. Exudates and neovascularization performed similarly, with system sensitivity rates of 91% and 89%, respectively.

Furthermore, the method was compared to other cutting-edge DR detection systems, and the findings revealed that the suggested system beat existing methods in terms of lesion identification and classification accuracy. The multi-stage technique, which incorporates image pre-processing, lesion segmentation, and CNN-based classification, helped to improve the system's performance by ensuring high-quality extracted features, allowing for more precise detection and classification.

The system also performed well under a variety of situations, including images with low illumination and fluctuations in retinal image quality, both of which are typical in real-world clinical settings. The results demonstrated that the suggested technique could handle a wide range of fundus pictures with consistency and accuracy across patient demographics.

CONCLUSION
This study proposed RheoNet-CNN, an enhanced deep learning framework for the automatic detection of rheumatoid arthritis from X-ray images. The model was evaluated using the RA Hand X-ray Dataset and demonstrated superior performance compared to both baseline and state-of-the-art models, achieving the highest accuracy (97.8%) and AUC-ROC (98.2%). The architectural innovations, including residual connections, batch normalization, and dropout layers, significantly contributed to the improved feature extraction, generalization, and classification performance observed in the results. While the proposed model shows promising results, certain limitations remain. The model was evaluated on a single dataset, raising concerns about its generalizability to other datasets and imaging modalities. Additionally, the focus was on binary classification, limiting its applicability for multi-class classification or severity grading of RA. Future research directions include extending the model to handle multi-class classification and severity assessment for rheumatoid arthritis. Furthermore, evaluating the model's robustness on diverse, multi-center datasets and different imaging modalities such as MRI and ultrasound can improve its clinical reliability. Integrating explainable AI techniques and domain adaptation strategies can further enhance the interpretability and real-world applicability of the proposed framework, making it a valuable tool for automated clinical decision support systems.
, Claims:CLAIMS

1. We claim that the proposed system significantly enhances the accuracy and efficiency of retinal landmark and lesion extraction from fundus images for diabetic retinopathy staging.
2. We claim that the integration of deep learning algorithms, specifically convolutional neural networks (CNNs), provides superior performance in detecting and classifying retinal lesions associated with diabetic retinopathy.
3. We claim that the multi-stage image processing approach, which includes pre-processing, segmentation, and classification, ensures high-quality feature extraction and accurate lesion identification.
4. We claim that our system achieves a high classification accuracy of 93.5%, outperforming traditional manual grading methods and existing automated systems in the detection of diabetic retinopathy.
5. We claim that the proposed method demonstrates robust performance even under varying image conditions, including poor illumination and differences in retinal image quality, ensuring reliability across diverse clinical settings.
6. We claim that the system’s ability to automatically classify retinal images into different stages of diabetic retinopathy (mild, moderate, severe, and proliferative) aids clinicians in making timely and informed decisions for patient management.
7. We claim that the automated detection and classification of retinal lesions significantly reduce the workload of healthcare professionals, enabling more efficient large-scale diabetic retinopathy screening programs.
8. We claim that the proposed system offers a cost-effective, scalable solution for diabetic retinopathy diagnosis, making it accessible for use in telemedicine applications and global screening initiatives, particularly in underserved regions.

Documents

Application Documents

# Name Date
1 202541029147-STATEMENT OF UNDERTAKING (FORM 3) [27-03-2025(online)].pdf 2025-03-27
2 202541029147-REQUEST FOR EARLY PUBLICATION(FORM-9) [27-03-2025(online)].pdf 2025-03-27
3 202541029147-FORM-9 [27-03-2025(online)].pdf 2025-03-27
4 202541029147-FORM FOR SMALL ENTITY(FORM-28) [27-03-2025(online)].pdf 2025-03-27
5 202541029147-FORM 1 [27-03-2025(online)].pdf 2025-03-27
6 202541029147-EVIDENCE FOR REGISTRATION UNDER SSI(FORM-28) [27-03-2025(online)].pdf 2025-03-27
7 202541029147-EVIDENCE FOR REGISTRATION UNDER SSI [27-03-2025(online)].pdf 2025-03-27
8 202541029147-EDUCATIONAL INSTITUTION(S) [27-03-2025(online)].pdf 2025-03-27
9 202541029147-DECLARATION OF INVENTORSHIP (FORM 5) [27-03-2025(online)].pdf 2025-03-27
10 202541029147-COMPLETE SPECIFICATION [27-03-2025(online)].pdf 2025-03-27