Abstract: The present invention relates to contextual recommendation system and method based on various parameters and using probabilistic framework. Significantly, the recommendation system is a function of user or learner’s profile, job context and learning object attributes and utilizes Bayesian reasoning model for otherwise inaccurately specified parameters to impart robustness and flexibility to the system.
CLIAMS:WE CLAIM:
1. A computer implemented method for enabling contextual recommendation of relevant learning content from multitude of learning contents, comprising:
maintaining in at least one repository plurality of learning contents sourced from a corpora of structured or unstructured sources;
generating a data model defining a learner associated contextual information;
computing one or more utility values of the learning content using probabilistic reasoning being conditioned by the data model so generated;
combining the utility values associated with each of the learner associated contextual information to obtain an aggregated utility value for each of the learning content; and
recommending the most relevant learning content to the learner by comparing aggregated utility values obtained for the learning contents.
2. The computer implemented method of claim 1, wherein the learner associated contextual information comprises learner profile, learner job context, learner role or a combination thereof.
3. The computer implemented method of claim 2, wherein the learner profile is modeled based at least on learner proficiency levels.
4. The computer implemented method of claim 2, wherein the learner job context is modeled based at least on task assigned to the learner, learner’s defined level of proficiency to complete the task in a given amount of time, time frame allocated to obtain desired proficiency level in assigned task, time allocated to complete the assigned task or a combination thereof.
5. The computer implemented method of claim 2, wherein the learner role is modeled based at least on current proficiency level of the learner, expected proficiency level of the learner, learner’s learning goals and aspirations, resource type, content coverage and depth or a combination thereof.
6. The computer implemented method of claim 1, wherein the structured and unstructured sources comprise technical blogs, tutorials, e-books, digital libraries, video lectures, web-based and so on, corporate intranet or have subscription based access.
7. The computer implemented method of claim 1, wherein the probabilistic reasoning is a Bayesian network computing utility values in steps of:
initializing learner job context input node based on a causal relationship with at least a task assigned and time allocated and computing the utility value therefor;
initializing learner role node based on causal relationship with at least similarity between learning contents and the task assigned, learner current and expected proficiency levels, learner’s learning goals and aspirations, resource type, complexity level, and computing the utility value therefor;
initializing learner profile input node based on causal relationship with at least similarity between learner proficiency levels, and computing the utility value therefor;
said causal relationship being derived using conditional probability tables; and
combining the job context input node associated utility value, learner role node utility value and learner profile input node associated utility value for each of the learning content using a sigmoid conditional probability distribution function.
8. The computer implemented method of claim 7, wherein the utility values for learner job context input node, learner role input node and learner profile input node are combined using sigmoid conditional probability distribution function such that precedence is assigned to any of the job context input node, learner role input node and the learner profile input node so as to rank the learning contents in order of their relevance as and when needed.
9. The computer implemented method of claim 8, wherein the learning contents are ranked in order of their relevance by re-computing and re-combining the utility values to accord lower utility values to the learning contents exhibiting close similarity there between by applying greedy algorithm.
10. A system for enabling contextual recommendation of relevant content from multitude of learning contents, comprising:
a processor;
input means and output means, each in electronic communication with the processor;
at least one repository accessible by the processor having resident thereon a database comprising the learning content sourced from a corpora of structured or unstructured sources via the input means;
said processor operable to perform steps of:
generating a data model defining learner associated contextual information;
computing one or more utility values of the learning content using probabilistic reasoning being conditioned by the data model so generated; and
combining the utility values associated with each of learner associated contextual information to obtain an aggregated utility value for each of the learning content; and
recommending the most relevant learning content to the learner by comparing aggregated utility values obtained for the learning contents.
11. The system of claim 10, wherein the learner associated contextual information comprises learner profile, learner job context, learner role or a combination thereof.
12. The system of claim 10, wherein the probabilistic reasoning is a Bayesian network computing utility values in steps of:
initializing learner job context input node based on causal relationship with at least the task assigned and time allocated and computing the utility value therefor;
initializing learner role node based on causal relationship with at least similarity between learning contents and the task assigned, learner current and expected proficiency levels, learner’s learning goals and aspirations, resource type, complexity level, and computing the utility value therefor;
initializing learner profile input node based on causal relationship with at least similarity between learner proficiency levels, and computing the utility value therefor;
said causal relationship being derived using conditional probability tables; and
combining the job context input node associated utility value, learner role node utility value and learner profile input node associated utility value for each of the learning content using a sigmoid conditional probability distribution function.
13. The system of claim 12, wherein the utility values for learner job context input node, learner role input node and learner profile input node are combined using sigmoid conditional probability distribution function such that precedence is assigned to any of the job context input node, learner role input node and the learner profile input node so as to rank the learning contents in order of their relevance as and when needed.
14. The system of claim 13, wherein the learning contents are ranked in order of their relevance by re-computing and re-combining the utility values to accord lower utility values to the learning contents exhibiting close similarity there between by applying greedy algorithm. ,TagSPECI:FORM 2
THE PATENTS ACT, 1970
(39 of 1970)
&
THE PATENT RULES, 2003
COMPLETE SPECIFICATION
(See Section 10 and Rule 13)
Title of invention:
SYSTEM AND METHOD FOR CONTEXTUAL RECOMMENDATION OF LEARNING CONTENT
Applicant:
Tata Consultancy Services Limited
A company Incorporated in India under the Companies Act, 1956
Having address:
Nirmal Building, 9th floor,
Nariman point, Mumbai 400021,
Maharashtra, India
The following specification particularly describes the invention and the manner in which it is to be performed.
FIELD OF THE INVENTION
[001] The present invention relates to content recommendation, and more particularly, the invention relates to contextual recommendation of relevant content to users as they interact with copious volume of learning content available.
BACKGROUND OF THE INVENTION
[002] With the introduction of new technologies with changing job profile, a professional may have to be retrained to hone him with desired skill set. Ample online contents exists on the corporate network and the Internet to facilitate such retraining.
[003] There has been significant contemporary research interest in recommendation engines in recent past. A large proportion of publications on recommendation engines deals with movies (25%) and re- tail shopping (20%). With the growth of educational contents on the Internet, there has been significant research interest in creating recommendation engines for educational contents also. Broadly, the recommendation technologies can be categorized into below three categories:
Collaborative filtering techniques: The approach here is to analyze the pur chase or usage behavior of different users and to cluster them in some groups. A user in a group is recommended the product purchased or used by other users in the group. This technique is commonly used in many retail portals and in movie or music recommendation.
Content based filtering techniques: This approach is based on the similarity of products. A user is recommended a product that is similar to the products that he has already purchased or used. The similarity of the products is often established with a product ontology.
Rule based techniques: This technique attempts to match a product profile with user profile based on a set of rules. The rules are often derived from some expert knowledge. Static nature and possible dispute over the rules is a major hindrance in deployment of this technique. It is generally used only when the other two methods do not work.
[004] In the domain of e-learning, educational contents can be viewed as products and the learners can be viewed as the buyers or users. The objective of a personalized recommendation engine in e-learning context is to recommend the learning contents that are likely to be appreciated by the learner. This demands that the recommendations are tuned to the user needs. There are instances of all three approaches to construct recommendation engines in the e-learning domain, with the content based filtering approach dominating. This represents a rule-based engine where recommendation rules bridge the current state of user knowledge and learning objects from multiple repositories.
[005] However, finding a suitable content in the specific retraining context from a large volume of contents has remained a formidable task. While there is a significant corpus of work in educational content recommendation, none of them accounts for the requirements of users in context of his job profile and work-in-hand.
[006] The recommendation systems reviewed so far are primarily designed for academic environment, where the user model is based on his academic goals, preferences and past learning history. None of the recommendation systems account for the contextual need of the learner, i.e. his immediate needs for the knowledge depending on his job-profile or his task-in-hand. Further, most of the recommendation engines use content based filtering approach, which essentially means that the contents similar to those already experienced by the learner is recommended. This may result in feeding the learner with redundant recommendations, since progressive enrichment in learner’s knowledge-state and the depth of contents of the learning contents are not accounted for.
[007] There has been an architectural framework for context-aware e-learning system proposed in one of the prior works. While the necessity of `context-awareness' has been highlighted, no details of context model is available. On the other hand, there has been some efforts in contextual information retrieval in business process-oriented knowledge portals. However, there has been no attempt to recommend learning contents in context of a user current knowledge needs.
OBJECTIVES OF THE INVENTION
[008] In accordance with the present invention, the primary objective is to provide a system and method for contextual recommendation of content to the learner.
[009] Another objective of the invention is to provide a method and system for provisioning of most relevant learning content to the learner based on learner profile, learner job context and attributes of learning content.
[0010] Another objective of the invention is to provide a method and system for providing most pertinent learning content to the learner that is capable of significantly contributing to continuous learning and skill development programs of the learner in a corporate environment.
[0011] Yet another objective of the invention is to provide a method and system for feeding the learner with learning contents quiet diverse, also assuring relevancy of learning contents at all times.
SUMMARY OF THE INVENTION
[0012] Before the present methods, systems, and hardware enablement are described, it is to be understood that this invention in not limited to the particular systems, and methodologies described, as there can be multiple possible embodiments of the present invention which are not expressly illustrated in the present disclosure. It is also to be understood that the terminology used in the description is for the purpose of describing the particular versions or embodiments only, and is not intended to limit the scope of the present invention which will be limited only by the appended claims.
[0013] Accordingly, in a preferred embodiment the disclosure provides a method for enabling contextual recommendation of relevant learning content from multitude of learning contents. According to the embodiment, a large volume of learning content sourced from a corpora of structured or unstructured sources is maintained in at least one repository. Next, a data model defining learner associated contextual information in relation to learner profile, learner job context and learner role is generated, followed by computing of one or more utility values of the learning contents using probabilistic reasoning being conditioned by the data model so generated; the utility values obtained with respect to each of learner profile, learner job context and learner role is combined for each of the learning content; and finally the utility value computed for respective learning content is compared against another to enable the system recommend the most relevant learning content to the learner.
[0014] According to another embodiment of the disclosure, a system for enabling contextual recommendation of relevant content from multitude of learning contents is proposed. Broadly, the system comprises a processor; one or more input means and an output means, each being in electronic communication with the processor; at least one repository that is accessible by the processor and has resident thereon a database that comprises the learning contents sourced from a corpora of structured or unstructured sources via the input means. The processor herein is operable to perform steps of:
generating a data model defining learner associated contextual information;
computing utility values of the learning contents using probabilistic reasoning being conditioned by the data models so generated;
combining the utility values associated with each of learner associated contextual information to obtain an aggregated utility value for each of the learning contents ; and
recommending the most relevant learning content to the learner by comparing aggregated utility values obtained for the learning contents
[0015] In one significant embodiment of the present disclosure, probabilistic reasoning is done with Bayesian networks that computes utility values associated with learning contents for each of learner profile, learner role and learner job context for a given learner.
[0016] In another significant embodiment of the present disclosure, the plurality of utility values computed for each of the learning content are combined using Sigmoid Probability Density Function to compute an overall utility value associated with a learning content.
BRIEF DESCRIPTION OF THE DRAWINGS
[0017] The foregoing summary, as well as the following detailed description of preferred embodiments, are better understood when read in conjunction with the appended drawings. For the purpose of illustrating the invention, there is shown in the drawings exemplary constructions of the invention; however, the invention is not limited to the specific methods and system disclosed. In the drawings:
[0018] Figure 1 is a schematic diagram of an exemplary architecture for the system of the present disclosure;
[0019] Figure 2 illustrates a conceptual architecture of an embodiment of the present disclosure;
[0020] Figure 3 is an example data model for recommendation in accordance with one exemplary embodiment of present disclosure; and
[0021] Figure 4 along with Figure 4(a), 4(b), 4(c) and 4(d) depict the reasoning model used in recommendation system in accordance with one preferred embodiment of present disclosure.
DETAILED DESCRIPTION OF THE INVENTION
[0022] Some embodiments of this invention, illustrating all its features, will now be discussed in detail.
[0023] The words "comprising," "having," "containing," and "including," and other forms thereof, are intended to be equivalent in meaning and be open ended in that an item or items following any one of these words is not meant to be an exhaustive listing of such item or items, or meant to be limited to only the listed item or items.
[0024] It must also be noted that as used herein and in the appended claims, the singular forms "a," "an," and "the" include plural references unless the context clearly dictates otherwise. Although any systems and methods similar or equivalent to those described herein can be used in the practice or testing of embodiments of the present invention, the preferred, systems and methods are now described.
[0025] The disclosed embodiments are merely exemplary of the invention, which may be embodied in various forms.
[0026] The present invention enables a method and system for recommending reasoning model for a contextual recommendation for learning contents available. The proposed system is capable of integrating learning content from multiple structured repositories as well as unstructured sources or informal knowledge resources on the Internet. The presently proposed recommendation method involves a rule-based recommendation system, where the recommendations are functions of learner’s job profile, task-in-hand, learner role, learner’s background and the learning object attributes. It should be noted that following terms “learning object(s) [LO(s)]” and “learning content(s)” are being used interchangeably and referring to same meaning throughout the specification pertaining to present invention.
[0027] In the background of inflexible and restrictive nature of rule based recommendation systems, the present system deploy a Bayesian reasoning scheme to bring much needed flexibility and agility to the system.
[0028] As discussed above, the system or alternatively referred to as recommendation system considers three major inputs or entities: (1) Learner Profile, (2) Job Context and (3) Learner Role, all together commonly referred to as learner associated contextual information. Referring now to Figure 1, and generally speaking, the system 100 disclosed herein incorporates a plurality of components, including a processor 10 operable to communicate with repository 20 via a bus structure 18. The repository 20 being configured to includes storage such as random access memory, static memory, a hard drive, an optical drive, or the like to permanently or temporarily store constants, programs being executed, or related data.
[0029] Further coupled to bus 18 may be input means 30, for example, a keyboard; it could alternately or in addition comprise a pointing device, such as a mouse, or touch screen that is used by the user to interact with the recommendation system, log in to the system and authenticate the system, and to physically engage with display. The user is also enabled to select a recommended content for on-screen reading or downloading the content or even rating thereof. A local area network (LAN) interface 40 enables the system 100 to communicate with the local network (e.g., intranet). Further, a remote network interface 50 provides bidirectional communication with the World Wide Web or other remote networks (e.g., Internet), either through telecommunications or through other forms of data transmission without limitation. The system 100 uses the network interface 40, 50 to source data from both structured and unstructured sources and store in the repository 20. During normal operation of the system 100, recommended information can be displayed on the output means 60 like a display unit, under control of the processor 10.
[0030] The method for contextual recommendation of relevant content from multitude of learning contents to the learner utilizing probabilistic reasoning framework may be implemented on hardware (processor 10) or a combination of software and hardware. For example, they may be implemented in an operating system kernel, on a specially constructed machine, or on a network interface card. In a specific embodiment, it may be implemented in software such as an operating system or in an application running on an operating system.
[0031] Software/hardware hybrid implementation(s) of at least some of the embodiment(s) disclosed herein may be implemented on a programmable machine selectively activated or reconfigured by a computer program stored in memory of repository 20 as indicated above. Such network devices may have multiple network interfaces that may be configured or designed to utilize different types of network communication protocols. According to specific embodiments, at least some of the features and/or functionalities of the various embodiments disclosed herein may be implemented on one or more general-purpose network host machines such as an end-user computer system, computer, network server or server system, or any other suitable electronic device, router, switch, or the like, or any combination thereof.
[0032] Broadly, the conceptual architecture of the system involving involves learner profile, learner job context and learning content attributes as three major inputs is presented in Figure 2. The learner profile comprises learner’s background or his current knowledge state and role that defines his long-term aspirations towards acquiring knowledge. The job context relates to the tasks at hand characterized by required proficiency level in different knowledge domains and the time available to accomplish the task. The contents are characterized by several attributes, like the topics covered, the depth of contents and the estimated learning time.
[0033] For example, a learner, new to a corporate set up, who has been allocated the task to explore a suitable model for a recommendation system based on probabilistic reasoning principles. Say, he needs to report his progress to a research council on a weekly basis. This job-definition requires that the researcher acquires in-depth knowledge of probabilistic reasoning systems over a few weeks’ time. He also needs to acquire basic familiarity with an editing tool, such as `Latex', that might have been standardized for preparing reports in the research lab. If the user has some familiarity with Bayesian reasoning systems, but is altogether naive with the word processing tool, it is desirable that the recommendation system provide him with some short tutorial on `Latex' and some in-depth learning material on probabilistic reasoning methods, for example an e-book or a web-course pertaining to the subject. Considering the 'Researcher' role of the learner in some specific domain, the system may also recommend some other learning contents in that domain befitting his background knowledge. As the learner acquire proficiency in the various topics, more in-depth material should be recommended. With a change in the learner’s job context, the learner needs to acquire proficiency in new subjects and the recommendations to be appropriately modified.
[0034] The system proposed in present disclosure with a Bayesian network, where the different attributes of learner profile and job context causes different attributes, e.g. topic, difficulty level, etc. of learning objects to be suitable. The overall utility of the available learning contents is determined by feeding the Bayesian network that has been conditioned by the learner profile, learner role and job context. This method of ranking the recommendation objects runs the risk of many similar items on the top of the ranked list. This is especially true when the repository of contents is large and contain multiple and redundant learning objects for every topic. The current system 100 further envisages diversity in the recommendation set, so that learning contents on different relevant topics are recommended, discussed here in later sections.
[0035] According to one embodiment, the method for enabling contextual content recommendation implemented by processor includes creating of data model for three entities- Learner Profile, Job Context and Learner Role used in the recommendation system. A tabular depiction of data model comprising the above three entities, in accordance with one exemplary embodiment of the present disclosure, is given in Figure 3 wherein a topic proficiency tuple is considered as a building block in some of the data models. A tuple indicates a proficiency in a certain topic. As can be seen in Table 1, the proficiency for various topics has been modeled on a six point scale.
User Profile Model:
User profile in e-learning context generally comprises user competencies and his learning goals. Obtaining reliable information in either of the two aspects is a difficult job. There are two sources of such information that are considered for exemplary purposes. They shall not be construed limiting the scope of present disclosure:
a) Self-declared: As declared in a bio-data created by the learner, his personal web-site, etc.
b) Assessed: As obtained from a formal evaluation and recorded in some Learning Management System (LMS), well known in available literature.
While results of formal assessment may be more reliable, they are generally less granular.
Context Model:
[0036] Context is one of the most difficult aspect to understand and model in a system. In general, `context' can include many facets including the learner persona, the environment where it is situated and many such factors, however for the purposes of present invention, the context is restricted to two aspects based on the organizational needs: (a) the role assigned to an employee/learner and (b) tasks assigned to learner. It shall however be noted that the present assumption is only for the purposes of explanation and shall not be construed limiting in its spirit and scope.
Role context
[0037] At any given point of time, an employee (learner in given scenario) is assigned a role that broadly defines the activities he is expected to perform. Each role requires certain competencies or skill-sets that an employee needs to acquire to perform his duties and for his career growth. Thus, the role of an employee sets a long-term context for his learning.
[0038] Generally, there are a number of predefined roles in an organization. In context of learning, a role can be characterized with a set of topics and a proficiency level required for each, expressed as an array of . The data model for role is shown in part C of Table 1. Role allocation to an employee is shown in part F of the Table 1.
Task context:
[0039] An employee is generally assigned one or more tasks at any given point of time. Each task requires some skill-set and needs to be completed within a definite deadline. In general, the learning needs for each task can be characterized by an array of tuples and a time limit to acquire the required knowledge. The time available to acquire the knowledge depends on the scheduled completion time of the task. For exemplary purposes, the time-frame can be categorized in three categories as:
a) Immediate: Requirements that need to be fulfilled within 24 to 48 hours. They generally pertain to `how to', e.g. how to implement a particular logic, how to use a particular tool, and so on. They empower an employee to attend to his immediate job function. They are generally answered from informal resources on the intranet and the Internet, such as technical blogs and short tutorials.
b) Short-term: This type of knowledge requirement involves deep knowledge about some specific topic and need to be acquired within a time-frame of 2 to 6 weeks. Examples include algorithms that can achieve some specific results, e.g. machine learning algorithms for `clustering'. The sources of such knowledge can be tutorials, short courses, and survey papers available on the formal internal knowledge repository and web-sites hosted by reputed institutes.
c) Long-term: These requirements need to be fulfilled, typically within 3 months or beyond, though flexibility exists. They involve acquiring domain expertise in specific domains, e.g. `big data', `computer vision' or `mobility'. The sources of such knowledge are generally web based courses, e-books and such other resources available in the organizational resource pool or in public domain.
[0040] The general assumption is that the set of tasks are repetitive and a task database exists in the organization. However, this is not a restrictive assumption because new task definitions can always be added to the database. The Task data model is shown in part D of Table 1. Part E of the table associates a task with a time-frame for allocation. The task allocation to an employee is shown in part F of the Table 1.
Content Model:
[0041] The employees may use learning contents from many different sources, such as technical blogs, tutorials, e-books, digital libraries, video lectures, web-based and so on. Some of the resources are in public domain and can be freely accessed from the Internet. Some other resources are either hosted on the corporate intranet or have subscription based access. In order to integrate the variety of resources, the recommendation system 100 needs to use some common metadata. The virtual library of contents can be built through a collaborative effort of subject experts and reference librarians and the metadata for the learning contents can be created either manually or in an automated way.
[0042] There exists a comprehensive set of metadata fields for describing educational contents. Several application profiles are available for use of this standard in specific application scenario. From the context of learning content, the complexity of learning content has been identified as an important aspect in assessing if the given learning content is suitable to the learner in given scenario-referring to learner task and role. Thus, for understanding purposes, the learning content has been classified as below.
[0043] Difficulty Level (DL) of a learning object or learning content determines the utility of a content for an associate with a certain proficiency level. For example, it is not prudent to provide an advanced level material to a naive user. Similarly, it may not make sense to provide a beginner level material to an expert user. DL can have one of the following values:
a) Very Easy: Content with basics of the topic, examples and illustrations.
b) Easy: Content with basics of the topic with a few examples and not a very detailed explanation.
c) Medium: Content with basics and advanced areas of the topic, examples and illustrations.
d) Difficult: Content with basics and advanced areas of the topic with a few examples and not a very detailed explanation.
e) Very Difficult: Content that gives a deep insight or knowledge of a topic with minute details and concepts as well.
[0044] Typical Learning Time (TLT) of a learning object helps in determining the utility of a content with respect to the time-frame of an assigned task. For example, it is not prudent to recommend a long web-course in context of a task that needs to be completed in a short time-frame. The possible values of typical learning time are shown in Part G of Table 1.
[0045] Learning Resource Type refers to the nature of the learning resource, e.g. a video-lecture or a tutorial, etc. Different types of resource serve different purposes in an e-learning environment. Each of may be suitable for users with different proficiencies and may lead to different degrees of enrichment in the proficiency levels. For example, a `reference manual' is meant for a quick reference in a short task context by an experienced user, without enriching his proficiency level. In contrast, a `web course' may be suitable for a naive user and is likely to significantly enhance his skill-level. Based on the applicability, the Learning Resources are classified into three categories for purposes of present invention, though only for illustration and not limiting purposes:
a) Category 1: E-book, Web Course, Advanced Lectures, Advanced Tutorials.
b) Category 2: Primer, Tutorial, Slides, Short Lecture, Problem-Solving Exercise, On-line labs.
c) Category 3: Reference doc
Part G in Table 1 depicts the content model used in present recommendation system 100.
[0046] The recommendation system 100 is based on the generic and conceptual framework for contextual intelligence that proposes the use of a Bayesian reasoning model for contextual recommendation. The justification for using uncertain reasoning for contextual recommendation arises from the fact that the different content and context attributes in a social setting cannot be strictly quantified. Moreover, the different requirements in contextual learning, e.g. utility of the contents for a user/learner with given competency level, the requirements of the allocated role and tasks and the time-frame for consumption, are inexactly known and may pose conflicting requirements on an learning object (LO).
[0047] A probabilistic reasoning model is necessary for combining these conflicting requirements with inaccurately specified parameters for achieving robustness. Further, a probabilistic reasoning model can produce flexible results that account for variations in user or learner preferences. The problem is thus modeled as a causal reasoning model, where the attributes of the context causes some learning object attributes to be more suitable than the others. A mixed mode of reasoning is proposed, where the utility of a learning content from different perspectives is determined independently using causal reasoning mode of Bayesian network and combine the results with sigmoid functions.
[0048] Now referring to Figure 4, the reasoning model used in the proposed recommendation system 100 is presented. Figures 4 (a), 4(b), 4(c) show the Bayesian networks used to determine the utility of a learning object for a user from three different perspectives, namely
a) Utility of the learning object with respect to the knowledge of topics required in the allocated task set
b) Utility of the learning object with respect to user's current role, and,
c) Utility of a learning object with respect to user's current competencies.
[0049] Some of the nodes in the Bayesian networks are treated as the input nodes (shown towards the left), which are initialized to a certain state based on the observed values of some user and task attributes and the attributes of a learning object. This leads to a belief propagation in the network. The posterior probability of the target variable (shown towards the right) represents the belief in the utility value of the learning object from the respective perspective. As seen in Figure 4(d), the reasoning model is used to integrate the contextual utility values is depicted. The reasoning model is exercised for each of the learning object’s independently to determine its contextual utility, which is subsequently used for ranking the learning objects.
[0050] Following are the conventions used in the diagrams:
a) Clear bubbles in the figures represent nodes of the Bayesian networks. Inputs from the shaded nodes are analyzed to instantiate some of the nodes of the Bayesian network. The diamonds depict such processing nodes.
b) The input nodes are prefixed with the entity for which the property holds, e.g. the node learning object “LO: TLT" indicates Typical Learning Time for a learning object and “U: Topic, Prof" represents the array of topic-proficiency tuples signifying user competency. Some of the intermediate nodes have two prefixes signifying the entity and the context, e.g, “LO-T: Utility" represents the utility of a learning object in context of Tasks allocated to a user.
c) The numbers in curly braces in the Bayesian nodes represents its possible states. The numeric values for multi-state variables refer to symbolic labels as described in Table 1. Even if they may connote some ordering, such connotation is not used in the reasoning model.
Next, the utility values for each of the input node so initialized are computed, discussed herein below:
(i) Utility with respect to task or job context
Figure 4(a) depicts the part of Bayesian network that is used to compute the utility of a learning object with respect to an allocated task. This is done in two stages:
a) Content utility: Each task requires the knowledge of some topics at a desired proficiency level. This module evaluates if a learning object is expected to impart knowledge at least at desired level of proficiency for one or more of such topics.
b) Time utility: Each task needs to be completed within a finite time. This module evaluates if the learning object can be consumed in the desired time-frame.
Content Utility
[0051] The node “LO-T: Similarity" in the Bayesian network 1 (Figure 4(a)) is a binary node representing the similarity between the topics in a learning object and that in the requirements of a task. A learning object with sufficient similarity with a task is contextually more relevant than others. The similarity between the set of topics required in a task (T: Topic, Prof) and the topics available in an LO (LO: Topics) is computed using Jaccard Coefficient in one embodiment. Other methods may also be employed like natural language processing or speech processing of the contents, etc. A threshold is applied to instantiate the node to 1 if there is adequate compatibility and to 0 otherwise.
[0052] The utility of a learning content or learning object in a task context depends two other parameters (a) the topic proficiencies required by a task and (b) the expected user proficiency on using a learning object. The former is modeled with the node “T-LO: Max Prof". This node is instantiated to the state (one of {1…..5}) corresponding to the maximum of the required proficiency values required for a task with respect to the topics covered in the learning object. The expected user proficiency in any of the covered topics on using a learning object is modeled with the node “U-T: Exp User Prof". A learning object that can raise the user proficiency level to that desired in a task is more contextually relevant than the others. The possible states of this node are the {0……5}. The expected proficiency level achieved by the user depends on the learner’s current proficiency level and the learning resource type. For example, a web-course may take a learner from a low proficiency level to a higher one, while a reference manual will have little impact on raising the proficiency level. These two causal nodes are represented as “LO: Category" and “U-T: Min Prof" respectively in the diagram. The node “LO: Category" can take three possible values {1; 2; 3}. The node “U-T:Min Prof" represents minimum proficiency level of the user on any of the topics that are required in the task context and covered in the learning object. It is instantiated to one of the six possible states {0……5} that represent the proficiency levels. The node “LO: Category" represents the category of the learning object, which is indicative of learning resource type and can assume one of the three possible values {1; 2; 3}.
[0053] The node “LO-T: Content Utility" represents the utility of a learning object with respect to its contents, with parents as “T-LO: Max Prof", “U-T: Exp User Prof", and “LO-T: Similarity". It is a binary node with state 1 representing the utility of the content. Causal relations exist in this network. A child node in this network has multiple parents. The configuration of the states of parent nodes cause some state of the child node to be more probable than others. These causal associations are represented by appropriate Conditional probability Tables (CPT's).
Time Utility:
[0054] The time utility of a content depends on its consumption time vis-a-vis the time available for learning in context of the task and is represented by the node “LO-T: Time Utility" in Figure 4(a). This is a binary node where the state 1 represents that the content is suitable. The states of the node has causal relations with (a) typical learning time for a content and (b) the time available for the task. The former is represented by the node “LO: TLT" and is instantiated to one of the three possible values {0….4}. The latter is represented by the node “T: Time" and is instantiated to one of the three possible values {0; 1; 2}. A learning object is considered more suitable if it can be consumed well within the task time. A CPT represents the causal association between the nodes.
[0055] Finally, the overall utility of a learning object in context of a task (represented by the node “LO-T: Utility" in Figure reffig:bnet1) depends on its content utility (“LO-T: Content Utility") and its time utility “LO-T: Time Utility"). The conditional dependencies between these nodes are reflected in a CPT. Note that, in general, a learner is allocated with more than one task. The utility of a learning object with respect to each task is independently determined using the Bayesian network discussed above.
(ii) Role Utility:
[0056] Like a task, a role is characterized by an array of tuples. However, there is no time-frame associated with it. We interpret it as that the proficiencies relating to a role can be acquired in a longer term. Thus, the computation for utility of a learning object with respect to the role assigned to a user is similar to estimating content utility as described in the previous section. Figure 4(b) depicts the Bayesian network used for computing role utility.
(iii) User Profile Utility:
[0057] Figure 4(c) depicts the Bayesian network used to compute utility of a learning content with respect to user background. The idea is to recommend neither too difficult nor too elementary content to a user at a certain proficiency level. The utility with respect to a user is represented by the node “LO-U: Utility", which is a binary node with state 1 representing that the learning object is suitable in the given context. The state of this variable is influenced by two variables “LO: Difficulty" that represents the difficulty level of a learning object and “U-LO: Min Prof" that represents users minimum proficiency level in the topics covered by the learning object. The two variables can assume the values {0…….4} and {0 ……5}. A CPT provides the conditional dependencies between the variables.
[0058] Once the utility values related to each of role, task and user profile are obtained, they are combined for recommendation. The inputs to this stage are:
a) A set of probability values for task utilities obtained from multiple instances of the Bayesian network as depicted in Figure 4(a), one for each of the tasks assigned to a user;
b) A probability value for role utility obtained from the Bayesian network depicted in Figure 4(b);
c) A probability value for user utility obtained from the Bayesian network depicted in Figure 4(c).
[0059] The network used for the integration is shown in Figure 4(d). The integration is done in two stages. In the first stage, the utility values for the different tasks are combined to find an overall task utility (“LO-T: Utility"). A sigmoid Conditional Probability Distribution (CPD) function is used for this purpose. At the second stage, the utility values of the learning object from the three perspectives, namely task, role and learner/user are combined, again using a sigmoid CPD function. The guiding policy for assignment of weights has been to prioritize the task and role contexts over the user context. The combined probability value at the node “LO: Utility" represents the overall utility of learning object and can be used for contextual ranking.
[0060] The ranking algorithm mentioned above runs the risk of producing too many similar contents on the top of the list, thereby over-recommending for certain proficiencies required in the context while depriving the others. This is particularly true, if the learning object collection is quite large and contains many similar and competing contents, which can be quite common, e.g. a number of textbooks by different authors to learn a programming language. The learning object need to be re-ranked to bring in some diversity in the recommendations. Increasing diversity implies redefining the utility value of the items in such a way that the utility value of an item decreases if there are similar items in the recommendation list. In one embodiment, a way to model the problem is to combine utility and diversity scores and rank the items based on the combined score. The diversity of an item is not its innate property, but depends on other selected items, making the re-ranking problem an optimization problem with permutations and with complexity n!.
[0061] In an alternate embodiment, a greedy algorithm that essentially recomputes the utility of an item based on similarity with other items ahead in the list has a complexity O(n2) can produce satisfactory result. The similarity measure between two learning objects can be based on a subset of the LOM metadata. The complement of Jaccard coefficient of the topics is chosen to achieve diversity in terms of topic coverage.
[0062] The present system 100 enhances the performance of recommendation, significantly reduces the execution time, reduces the performance overhead and is also helpful in ignoring the irrelevant results for a given use case. The conditional set of probabilities define the degree of dependence of final output on several factors important in recommendation. Few of such important factors are: User's proficiencies in various topics, time given for a task, expected level of proficiency required by the user on the topics given, etc. The final list of recommendations will have learning objects based on the topics from Task based requirements and Role based Skill requirements. So the proposed system 100 aims at recommending a list of learning objects to a user relevant to his task/tasks at hand and role based skills required.
[0063] The preceding description has been presented with reference to various embodiments of the invention. Persons skilled in the art and technology to which this invention pertains will appreciate that alterations and changes in the described structures and methods of operation can be practiced without meaningfully departing from the principle, spirit and scope of this invention.
| # | Name | Date |
|---|---|---|
| 1 | REQUEST FOR CERTIFIED COPY [04-12-2015(online)].pdf | 2015-12-04 |
| 2 | Request For Certified Copy-Online.pdf | 2018-08-11 |
| 3 | Form 3.pdf | 2018-08-11 |
| 4 | Form 2.pdf | 2018-08-11 |
| 5 | Figure of Abstract.jpg | 2018-08-11 |
| 6 | Drawings.pdf | 2018-08-11 |
| 7 | ABSTRACT1.jpg | 2018-08-11 |
| 8 | 1741-MUM-2015-Power of Attorney-050615.pdf | 2018-08-11 |
| 9 | 1741-MUM-2015-OTHERS-270715.pdf | 2018-08-11 |
| 10 | 1741-MUM-2015-Form 5-270715.pdf | 2018-08-11 |
| 11 | 1741-MUM-2015-Form 13-270715.pdf | 2018-08-11 |
| 12 | 1741-MUM-2015-Form 1-270715.pdf | 2018-08-11 |
| 13 | 1741-MUM-2015-Form 1-050615.pdf | 2018-08-11 |
| 14 | 1741-MUM-2015-Correspondence-270715.pdf | 2018-08-11 |
| 15 | 1741-MUM-2015-Correspondence-050615.pdf | 2018-08-11 |
| 16 | 1741-MUM-2015-FER.pdf | 2019-11-28 |
| 17 | 1741-MUM-2015-OTHERS [28-05-2020(online)].pdf | 2020-05-28 |
| 18 | 1741-MUM-2015-FER_SER_REPLY [28-05-2020(online)].pdf | 2020-05-28 |
| 19 | 1741-MUM-2015-COMPLETE SPECIFICATION [28-05-2020(online)].pdf | 2020-05-28 |
| 20 | 1741-MUM-2015-CLAIMS [28-05-2020(online)].pdf | 2020-05-28 |
| 21 | 1741-MUM-2015-PatentCertificate23-01-2024.pdf | 2024-01-23 |
| 22 | 1741-MUM-2015-IntimationOfGrant23-01-2024.pdf | 2024-01-23 |
| 1 | SEARCH_22-11-2019.pdf |