Sign In to Follow Application
View All Documents & Correspondence

“Method And System For Generating Synchronized Labelled Training Dataset For Building A Learning Model

Abstract: Disclosed subject matter relates to supervised machine learning including a method and system for generating synchronized labelled training dataset for building a learning model. The training data generation system determines a timing advance factor to achieve time synchronization between User Equipment (UE) and network nodes, by signalling the UE to initiate playback of the multimedia content based on the timing advance factor. The training data generation system receives network Key Performance Indicator [KPI] data from the network nodes and a user experience data from the UE, concurrently, for the streamed multimedia content, and performs timestamp based correlation to generate a synchronized labelled training dataset for building a learning model. The learning model is further deployed in external analytics system to act as a non-intrusive passive probe to predict real-time user experience, without intruding into the UE, thereby sustaining privacy of the user and eliminating additional computing load on the UE. FIG.2A

Get Free WhatsApp Updates!
Notices, Deadlines & Correspondence

Patent Information

Application #
Filing Date
17 March 2018
Publication Number
38/2019
Publication Type
INA
Invention Field
COMPUTER SCIENCE
Status
Email
bangalore@knspartners.com
Parent Application
Patent Number
Legal Status
Grant Date
2023-07-26
Renewal Date

Applicants

WIPRO LIMITED
Doddakannelli, Sarjapur Road, Bangalore 560035, Karnataka, India.

Inventors

1. SUBHAS CHANDRA MONDAL
Flat No, 303, Kristal Sapphire Apts, 29th Main, 4th Cross, BTM Layout, 2nd Stage, Bangalore 560076, Karnataka, India.
2. ARAVIND RAVI
A-201, Oak Yard Apartments, 38th Cross, Jayanagar 9th Block, Bangalore 560069, Karnataka, India.
3. PALLAVI SURESH MASTIHOLIMATH
No 65-B, 21st Cross, 2nd Block, Rajajinagar, Bangalore 560010, Karnataka, India.

Specification

Claims:We claim:
1. A method of generating synchronized labelled training dataset (213) for building a learning model, the method comprising:
determining, by a training data generation system (107), timing parameters related to a User Equipment (UE) (101) capable of receiving a multimedia content and timing parameters related to one or more network nodes (103) used to facilitate streaming of the multimedia content to the UE (101);
determining, by the training data generation system (107), a timing advance factor based on the timing parameters related to the UE (101) and the timing parameters related to the one or more network nodes (103) to achieve time synchronization between the UE (101) and the one or more network nodes (103);
signalling, by the training data generation system (107), the UE (101) to initiate playback of the multimedia content based on the timing advance factor;
receiving, by the training data generation system (107), network Key Performance Indicator [KPI] data (209) from the one or more network nodes (103) and a user experience data (211) from the UE (101), concurrently, for the streamed multimedia content; and
correlating, by the training data generation system (107), the user experience data (211) with the corresponding network KPI data (209), based on timestamp corresponding to the user experience data (211) and the network KPI data (209), to generate a synchronized labelled training dataset (213) for building a learning model.
2. The method as claimed in claim 1, wherein the user experience data (211) comprises at least one of UE (101) Identifier (ID), multimedia content type, predefined sample intervals, Mean Opinion Score (MOS), timestamp of the MOS and a label type.

3. The method as claimed in claim 1, wherein the network KPI data (209) comprises at least one of type of network KPIs and corresponding data types, network node layer Identifier (ID), network KPI record count per sample, network KPI values, predefined sample intervals and timestamp of network KPI records.

4. The method as claimed in claim 1, wherein the timing parameters related to the UE (101) comprises of Round Trip Time (RTT) for receiving the user experience data (211).

5. The method as claimed in claim 1, wherein the timing parameters related to the one or more nodes, comprises at least one of, RTT for receiving the network KPI data (209), predefined sample intervals, and timestamp of network KPI records per sample.

6. The method as claimed in claim 1, wherein the user experience data (211) and the network KPI data (209) are received by the training data generation system (107) at predefined sample intervals.

7. The method as claimed in claim 1, wherein the learning model is built using one or more predefined model building techniques.

8. The method as claimed in claim 1 further comprises deploying, by the training data generation system (107), the learning model in an external analytics system (115) for enabling the external analytics system (115) to perform real-time predictions of user experience when the multimedia content is streamed.

9. The method as claimed in claim 8 further comprises validating, by the training data generation system (107), accuracy of the real-time predictions of the user experience by comparing the user experience data (211) received from the UE (101) with the real-time predictions of the user experience.

10. The method as claimed in claim 9 further comprises rebuilding, by the training data generation system (107), the learning model, at regular intervals, based on current user experience data (211) and current network KPI data (209), when result of the validation is negative.

11. The method as claimed in claim 1, wherein the user experience data (211) is determined by at least one of predefined deep learning techniques configured in the UE (101), or by a Subject Matter Expert (SME) associated with the UE (101).

12. The method as claimed in claim 1, wherein the UE (101) and the one or more network nodes (103) are preconfigured with parameters related to the network KPI data (209), the time synchronization and a rebuilding criteria for the learning model, by a Central Configuration Manager (CCM) (105) associated with the training data generation system (107).

13. The method as claimed in claim 1 further comprises:

determining, by the training data generation system (107), a transmission rating factor based on one or more network parameters related to streaming of the multimedia content to the UE (101); and

evaluating, by the training data generation system (107), quality of the user experience data (211) received from the UE (101), based on the transmission rating factor, to determine usability of the user experience data (211) for building the learning model, prior to correlating the user experience data (211) with the network KPI data (209).

14. A training data generation system (107) for generating synchronized labelled training dataset (213) for building a learning model, the training data generation system (107) comprising:
a processor (109); and
a memory (113) communicatively coupled to the processor (109), wherein the memory (113) stores the processor (109)-executable instructions, which, on execution, causes the processor (109) to:
determine timing parameters related to a User Equipment (UE) (101) capable of receiving a multimedia content and timing parameters related to one or more network nodes (103) used to facilitate streaming of the multimedia content to the UE (101);
determine a timing advance factor based on the timing parameters related to the UE (101) and the timing parameters related to the one or more network nodes (103) to achieve time synchronization between the UE (101) and the one or more network nodes (103);
signal the UE (101) to initiate playback of the multimedia content based on the timing advance factor;
receive network Key Performance Indicator [KPI] data (209) from the one or more network nodes (103) and a user experience data (211) from the UE (101), concurrently, for the streamed multimedia content; and
correlate the user experience data (211) with the corresponding network KPI data (209), based on timestamp corresponding to the user experience data (211) and the network KPI data (209), to generate a synchronized labelled training dataset (213) for building a learning model.
15. The training data generation system (107) as claimed in claim 14, wherein the user experience data (211) comprises at least one of UE (101) Identifier (ID), multimedia content type, predefined sample intervals, Mean Opinion Score (MOS), timestamp of the MOS and a label type.

16. The training data generation system (107) as claimed in claim 14, wherein the network KPI data (209) comprises at least one of type of network KPIs and corresponding data types, network node layer Identifier (ID), network KPI record count per sample, network KPI values, predefined sample intervals and timestamp of network KPI records.

17. The training data generation system (107) as claimed in claim 14, wherein the timing parameters related to the UE (101) comprises of Round Trip Time (RTT) for receiving the user experience data (211).

18. The training data generation system (107) as claimed in claim 14, wherein the timing parameters related to the one or more nodes, comprises at least one of, RTT for receiving the network KPI data (209), predefined sample intervals, and timestamp of network KPI records per sample.

19. The training data generation system (107) as claimed in claim 14, wherein the processor (109) receives the user experience data (211) and the network KPI data (209) at predefined sample intervals.

20. The training data generation system (107) as claimed in claim 14, wherein the learning model is built using one or more predefined model building techniques.

21. The training data generation system (107) as claimed in claim 14, wherein the processor (109) is further configured to deploy the learning model in an external analytics system (115), for enabling the external analytics system (115) to perform real-time predictions of user experience when the multimedia content is streamed.

22. The training data generation system (107) as claimed in claim 21, wherein the processor (109) is further configured to validate accuracy of the real-time predictions of the user experience by comparing the user experience data (211) received from the UE (101) with the real-time predictions of the user experience.

23. The training data generation system (107) as claimed in claim 22, wherein the processor (109) is further configured to rebuild the learning model, at regular intervals, based on current user experience data (211) and current network KPI data (209), when result of the validation is negative.

24. The training data generation system (107) as claimed in claim 14, wherein the user experience data (211) is determined by at least one of predefined deep learning techniques configured in the UE (101), or by a Subject Matter Expert (SME) associated with the UE (101).

25. The training data generation system (107) as claimed in claim 14, wherein the UE (101) and the one or more network nodes (103) are preconfigured with parameters related to the network KPI data (209), the time synchronization and a rebuilding criteria for the learning model, by a Central Configuration Manager (CCM) (105) associated with the training data generation system (107).

26. The training data generation system (107) as claimed in claim 14, wherein the processor (109) is further configured to:

determine a transmission rating factor based on one or more network parameters related to the streaming of the multimedia content to the UE (101); and

evaluate quality of the user experience data (211) received from the UE (101), based on the transmission rating factor, to determine usability of the user experience data (211) for building the learning model, prior to correlating the user experience data (211) with the network KPI data (209).
Dated this 17th day of March, 2018

SWETHA S N
IN/PA-2123
OF K & S PARTNERS
AGENT FOR THE APPLICANT
, Description:TECHNICAL FIELD
The present subject matter relates generally to machine learning model, and more particularly, but not exclusively to a method and a system for generating synchronized labelled training dataset for building a learning model.

Documents

Application Documents

# Name Date
1 201841009850-STATEMENT OF UNDERTAKING (FORM 3) [17-03-2018(online)].pdf 2018-03-17
2 201841009850-REQUEST FOR EXAMINATION (FORM-18) [17-03-2018(online)].pdf 2018-03-17
3 201841009850-POWER OF AUTHORITY [17-03-2018(online)].pdf 2018-03-17
4 201841009850-FORM 18 [17-03-2018(online)].pdf 2018-03-17
5 201841009850-FORM 1 [17-03-2018(online)].pdf 2018-03-17
6 201841009850-DRAWINGS [17-03-2018(online)].pdf 2018-03-17
7 201841009850-DECLARATION OF INVENTORSHIP (FORM 5) [17-03-2018(online)].pdf 2018-03-17
8 201841009850-COMPLETE SPECIFICATION [17-03-2018(online)].pdf 2018-03-17
9 abstract 201841009850.jpg 2018-03-20
10 201841009850-REQUEST FOR CERTIFIED COPY [04-05-2018(online)].pdf 2018-05-04
11 201841009850-Proof of Right (MANDATORY) [30-07-2018(online)].pdf 2018-07-30
12 Correspondence by Agent_Form1_01-08-2018.pdf 2018-08-01
13 201841009850-Information under section 8(2) [10-03-2021(online)].pdf 2021-03-10
14 201841009850-FORM 3 [10-03-2021(online)].pdf 2021-03-10
15 201841009850-PETITION UNDER RULE 137 [12-03-2021(online)].pdf 2021-03-12
16 201841009850-FER_SER_REPLY [12-03-2021(online)].pdf 2021-03-12
17 201841009850-FER.pdf 2021-10-17
18 201841009850-US(14)-HearingNotice-(HearingDate-02-06-2023).pdf 2023-05-08
19 201841009850-POA [17-05-2023(online)].pdf 2023-05-17
20 201841009850-FORM 13 [17-05-2023(online)].pdf 2023-05-17
21 201841009850-Correspondence to notify the Controller [17-05-2023(online)].pdf 2023-05-17
22 201841009850-AMENDED DOCUMENTS [17-05-2023(online)].pdf 2023-05-17
23 201841009850-US(14)-ExtendedHearingNotice-(HearingDate-08-06-2023).pdf 2023-06-01
24 201841009850-Correspondence to notify the Controller [05-06-2023(online)].pdf 2023-06-05
25 201841009850-Written submissions and relevant documents [23-06-2023(online)].pdf 2023-06-23
26 201841009850-FORM-26 [23-06-2023(online)].pdf 2023-06-23
27 201841009850-FORM 3 [23-06-2023(online)].pdf 2023-06-23
28 201841009850-PatentCertificate26-07-2023.pdf 2023-07-26
29 201841009850-IntimationOfGrant26-07-2023.pdf 2023-07-26

Search Strategy

1 2020-09-2116-18-51E_21-09-2020.pdf

ERegister / Renewals

3rd: 16 Oct 2023

From 17/03/2020 - To 17/03/2021

4th: 16 Oct 2023

From 17/03/2021 - To 17/03/2022

5th: 16 Oct 2023

From 17/03/2022 - To 17/03/2023

6th: 16 Oct 2023

From 17/03/2023 - To 17/03/2024

7th: 15 Mar 2024

From 17/03/2024 - To 17/03/2025

8th: 17 Mar 2025

From 17/03/2025 - To 17/03/2026