F0RM2
THE PATENTS ACT, 1970
(39 of 1970)
&
THE PATENTS RULES, 2003
COMPLETE SPECIFICATION
(See section 10, rule 13)
"COMPUTER-BASED DATA PROCESSING SYSTEM AND
METHOD FOR ASSESSING THE EFECTIVENESS OF
KNOWLEDGE TRANSFER"
SWISS REINSURANCE CORPORATION, Mythenquai 50/60, 8022 Zurich, Switzerland.
The following specification particularly describes the invention and the manner in which it is to be performed.

WO 2005/124607 PCT/CH2005/000260
2
Computer-based Data Processing System and Method for Assessing the Effectiveness of Knowledge Transfer
Field of the invention
The present invention relates to a computer-based data processing
5 system and a computer-based method for determining the level of effectiveness of knowledge transfer. Specifically, the present invention relates to a computer-based data processing system and a computer implemented method for assessing the level of effectiveness of knowledge transfer directed to more than one defined area of expertise.
10 Background of the Invention
For any organization education and re-education of its employees is absolutely necessary for improving and maintaining internal know-how, skills, and work efficiency. Typically, knowledge related to specific areas of expertise, for example handling of electronic information, is transferred from an expert to
15 one or more students. The expert may be a teacher, transferring knowledge in a classical course setting according to a teaching program, or a consultant or coach, transferring knowledge to a client according to a consulting program. Knowledge may also be transferred as part of a knowledge transfer initiative including teaching and/or consulting programs. In order to evaluate the quality
20 of a teacher, a consultant, or a teaching or consulting program, the quality of the knowledge transfer is determined based on feedback from the students or clients. Conventionally, quantified feedback from the students or clients is entered in a spreadsheet program or a statistical software package configured specifically for the particular consulting program, teaching program, or course.
25 In the spreadsheet program or statistical software package the quality of the knowledge transfer is determined by computing averages of the quantified feedback recorded from the students or clients. Consulting programs, teaching

WO 2005/124607 3 PCT/CH20O5/000260

programs, or courses often relate to more than one area of expertise and include multiple consulting or training modules, each addressing a different area of expertise. For example, a consulting program related to general management may include consulting modules addressing budget control,
5 leadership skills, and project management; a course about project management may include training modules addressing project planning and scheduling, project monitoring and controlling, and project reporting. Depending on the learning goal, the client, and/or the group of students, different modules addressing different areas of expertise are combined to form the basis of a
10 course, teaching program, or consulting program. The areas of expertise included and covered in a course, teaching program, or consulting program may also vary over time. Furthermore, depending on the areas of expertise included in a course, teaching program, or consulting program, different aspects and criteria are used to determine the effectiveness of the knowledge
15 transfer. Consequently, depending on the areas of expertise included in a course, teaching program, or consulting program, different configurations of spreadsheet programs or statistical software packages are required for determining the quality of the knowledge transfer. Particularly in organizations with a great variety and number of teaching programs and/or consulting
20 programs, the constant changes and adaptations of configurations of spreadsheets and software packages are considered inefficient and prone to errors.
Summary of the Invention
It is an object of this invention to provide a computer-based data
25 processing system and a computer implemented method for assessing the level of effectiveness of knowledge transfer directed to more than one defined area of expertise, which system and method do not have the disadvantages of the prior art. In particular, it is an object of the present invention to provide a computer-based data processing system and a computer-based method for

WO 2005/124607

PCT7CH2005/000260

4
assessing the level of effectiveness of knowledge transfer directed to a varying set of defined areas of expertise. It is a further object of the present invention to provide a computer-based data processing system and a computer-based method for assessing the level of effectiveness of knowledge transfer directed
5 to defined areas of expertise requiring different types of quality indicators.
According to the present invention, the above-mentioned objects are particularly achieved in that, for assessing the level of effectiveness of knowledge transfer directed to more than one defined area of expertise, different sets of quality indicators are stored in the data processing system,
10 wherein each set of quality indicators is assigned to one of the defined areas of expertise. Moreover, the data processing system is provided with a configuration module for specifying for an instance of knowledge transfer selected areas of expertise from the defined areas of expertise. For example, for defining an instance of knowledge transfer related to information
15 management, "management of electronic information", "management of physical information", and "planning and coordinating based on electronic and physical information" are specified as selected areas of expertise. Furthermore, the data processing system is provided with a rating module for receiving and storing rating values. Each of the rating values is assigned to one of the quality
20 indicators of a set assigned to one of the selected areas of expertise. In addition, the data processing system is provided with a scoring module for computing the level of effectiveness of the knowledge transfer directed to the selected areas of expertise. The level of effectiveness is computed from the rating values assigned to the quality indicators of the sets assigned to the
25 selected areas of expertise. For measuring the effectiveness of knowledge transfer, the proposed system and method make it possible to specify flexibly selected areas of expertise to be included and to determine automatically the corresponding quality indicators to be used. Furthermore, the proposed system and method make it possible to control a user interface such that a user is
30 prompted to enter exactly and exclusively the rating values for those quality

WO 2005/124607 5 PCT/CH2005/000260

indicators used for measuring the effectiveness of knowledge transfer for the selected areas of expertise. Thus, the proposed system and method provide a flexible framework for measuring the effectiveness of knowledge transfer in environments where teaching or consulting programs are directed to varying
5 areas of expertise requiring different types of quality indicators. The computed level of effectiveness of knowledge transfer can be used effectively to identify efficient and inefficient courses, training or consulting modules, consultants and/or teachers.
In a preferred embodiment, the data processing system comprises means
10 for receiving and storing amounts of estimated maximum time savings, wherein each amount of estimated maximum time savings is assigned to one of the defined areas of expertise. Moreover, the scoring module is designed to compute from the level of effectiveness and from the amounts of estimated maximum time savings an amount of expected time savings for the selected
15 areas of expertise. The computed amount of expected time savings can be used effectively to forecast time savings expected from a course, teaching program, consulting program, consulting module, or training module based on qualitative feedback from students and clients (rating values) and estimated maximum time savings provided by experts.
20 It must be emphasized that, in the context of this document, the term
"student" relates not only to students or trainees participating in knowledge transfer in a classical student-teacher course setting, but also to clients participating in knowledge transfer provided by one or more consultants as part of a consultant program or knowledge transfer initiative, particularly, a program
25 or an initiative related to knowledge and information management. Correspondingly, the term "knowledge transfer" not only relates to the transfer of knowledge in a classical course or class setting but also to the transfer of knowledge through consulting, consulting programs, or general initiatives for

WO 2005/124607 6 PCT/CH2005/000260
improvement of know-how and skills. Consequently, the term "teacher" also includes consultants, trainers, coaches, and defined teams thereof.

In a preferred embodiment, the rating module is designed to receive and store student specific rating values and the scoring module is designed to
5 compute student specific amounts of expected time savings. In a further embodiment, the data processing system is provided with means for receiving and storing amounts of student specific, subjective time savings, and the scoring module is designed to compute student specific amounts of time savings from the student specific amounts of expected time savings and from
10 the student specific amounts of subjective time savings. Including in the computation subjective time savings indicating the students' time savings experienced after the knowledge transfer makes it possible to consider not only an experts opinion of estimated maximum time savings but also quantitative feedback from the students.
15 In an embodiment the scoring module is designed to compute the level of
effectiveness of the knowledge transfer from student specific rating values of a plurality of students and the scoring: module is designed to exclude student specific rating values from students having a student specific amount of expected time savings deviating by more than a defined value from the student
20 specific amount of subjective time savings. Excluding a student specific rating value based on a significant deviation of the student specific amount of expected time savings from the student specific amount of subjective time savings makes it possible to exclude automatically statistical outliers from the assessment of effectiveness.
25 In a preferred embodiment, the data processing system further includes
means for receiving and storing student specific competence levels indicating a student's level of competence prior to the knowledge transfer. Furthermore, the scoring module is designed to compute student specific amounts of expected

WO 2005/124607

PeT/CH2005/000260

time savings, the student specific amounts of expected time savings being weighted depending on a students specific competence level. Weighting student specific amounts of expected time savings depending on a student's competence level prior to the knowledge transfer makes it possible to consider
5 automatically the relative impact of a student's prior knowledge onto the amount of expected time savings. Typically, a student with great prior knowledge has smaller potential time savings than a student with only basic or no prior knowledge in the respective areas of expertise.
In a preferred embodiment, the data processing system further includes
10 means for receiving and storing student specific consulting quality levels
indicating a student's assessment of the quality of the knowledge transfer.
Furthermore, the scoring module is designed to compute student specific
amounts of expected time savings, the student specific amounts of expected
time savings being weighted depending on a student's specific consulting
15 quality level. Weighting student specific amounts of expected time savings
depending on a student's assessment of the quality of the knowledge transfer
makes it possible to consider automatically the relative impact of a student's
subjective experience of the knowledge transfer onto the amount of expected
time savings. Typically, a student giving a very positive assessment of the
20 quality of the knowledge transfer has greater potential time savings than a
student giving an average assessment, whereas a student giving a very
negative assessment of the quality of the knowledge transfer has smaller
potential time savings than the student giving the average assessment.
In a preferred embodiment, the data processing system further includes
25 means for receiving and storing amounts of estimated maximum time savings, wherein each amount of estimated maximum time savings is assigned to one of the defined areas of expertise, means for receiving and storing amounts of student specific, subjective time savings, means for receiving and storing student specific competence levels indicating a student's level of competence

WO 2005/124607 PCT/CH2005/000260
8
prior to the knowledge transfer, and means for receiving and storing student specific consulting quality levels indicating a student's assessment of quality of the knowledge transfer The rating module is designed to receive and store student specific rating values and the scoring module is designed to compute
5 an amount of expected time savings for the selected areas of expertise, wherein the amount of expected time savings is computed from student specific amounts of expected time savings, wherein the student specific amounts of expected time savings are computed from the amounts of estimated maximum time savings, from the student specific rating values, and from the amounts of
10 student specific, subjective time savings, and wherein the student specific amounts of expected time savings are weighted dependent on a student's specific competence level and on a student's specific consulting quality level.
Preferably, the data processing system further includes means for
assigning weighting factors to the quality indicators and the scoring module is
15 designed to compute the level of effectiveness according to the weighting
factors. In this way, different significance of quality indicators can be reflected in
the assessment of effectiveness.
Preferably, the data processing system further includes means for
Assigning weighting factors to the selected areas of expertise and the scoring
20 module is designed to compute the level of effectiveness according to the
weighting factors. In this way, different significance of areas of expertise can be
reflected in the assessment of effectiveness.
In addition to a computer-based method for assessing the level of effectiveness of knowledge transfer directed to defined areas of expertise, the
25 present invention also relates to a computer program product including computer program code means for controlling one or more processors of a computer, particularly, a computer program product including a computer readable medium containing therein the computer program code means.

WO 2005/124607 9 PCT/CH2005/000260
Brief Description of the Drawings
The present invention will be explained in more detail, by way of example, with reference to the drawings in which:
Figure 1 shows a block diagram illustrating schematically an exemplary
5 configuration of a computer-based data processing system for practicing
embodiments of the present invention, said configuration comprising a
computer with a processor and memory, and said configuration being
connected to peripheral data entry terminals.
Figure 2 shows a flow diagram illustrating an example of a sequence of 10 preparatory steps executed according to the present invention.
Figure 3 shows a flow diagram illustrating an example of a sequence of configuration steps executed according to the present invention.
Figure 4 shows a flow diagram illustrating an example of a sequence of steps executed according to the present invention for assessing a level of
15 effectiveness of knowledge transfer directed to defined areas of expertise.
Detailed Description of the Preferred Embodiments
In Figure 1, reference numeral 'l refers to a computer-based data processing system. The data processing system 1 includes one or more computers, for example personal computers, comprising one or more
20 processors. As is illustrated schematically, the data processing system 1 is connected to different peripheral data entry terminals. The reference numeral 3 refers to a local data entry terminal connected directly to the data processing system 1 via communication link 33. The reference numerals 4, 4', 4" refer to remote data entry terminals in the form of a personal computer, a laptop
25 computer, and a mobile radio telephone or personal digital assistant,

WO 2005/124607 PCT/CH2005/000260
respectively. The remote data entry terminals 4, 4', 4" are connected to the data processing system 1 via telecommunication network 2. The reference numeral 15 refers to a communication module. The communication module 15 is designed for data communication with the remote data entry terminals 4, 4',
5 and 4" via the telecommunication network 2 and with the local data entry terminal 3 via the communication link 33.
The telecommunication network 2 includes fixed networks and wireless networks. For example, the telecommunication network 2 includes a local area network (LAN), an integrated services digital network (ISDN), the Internet, a
10 global system for mobile communication (GSM), a universal mobile telephone system (UMTS) or another mobile radio telephone system, and/or a wireless local area network (WLAN).
As is illustrated schematically in Figure 1, the data processing system 1 further includes a database 10 and various functional modules namely a rating
15 module 11, a configuration module 12, a scoring module 13, and a control module 14. Preferably, the functional modules and the database 10 are implemented as programmed software modules. The computer program code of the software modules is stored in a computer program product, i.e. in a computer readable medium, either in memory integrated in a computer of the
20 data processing system 1 or on a data carrier that can be inserted into a computer of the data processing system 1. The communication module 15 and the software modules can be installed on one common or on separate computers of the data processing system 1. The computer program code of the software modules controls the computers) of the data processing system 1 so
25 that the data processing system executes various functions described later in more detail with reference to Figures 2, 3, and 4.
The control module 14 is designed to control the user interfaces of the local data entry terminal 3 and the remote data entry terminals 4, 4', 4". The

WO 2005/124607 PCT/CH2005/000260
11
user interfaces of the local data entry terminal 3 and the remote data entry terminals 4, 4', 4" are visualized on the displays 31, 41, 41', 41" and include graphical user interfaces, forms, and/or web pages in the form of HTML (Hypertext Markup Language) or XHTML (Extended Hypertext Markup
5 Language), for example. As is illustrated in Figure 1, the configuration module 12 and the rating module 11, explained later in more detail, are included in the control module 14. The configuration module 12 is concerned with the definition, setup, and configuration of instances of knowledge transfer (i.e. course, teaching program, or consulting program), including areas of expertise
10 (i.e. training or consulting modules) and associated quality indicators. The rating module 11 is concerned with the recording of rating values for the quality indicators associated with the areas of expertise of an instance of knowledge transfer.
Figure 2 shows a flow diagram illustrating preparatory steps for entering
15 and storing different areas of expertise and associated quality indicators in the database 10. The preparatory steps P1 to P4 can be executed by a user of a data entry terminal 3,4, 4', 4" at any time when new areas of expertise and/or quality indicators need to be added to the data processing system 1. Preferably, the user can request execution of the preparatory steps P1 to P4 through a
20 menu of the user interface provided by control module 14.
In step P1, the configuration module 12 prompts a user of a data entry terminal 3, 4, 4', 4" to define and enter areas of expertise. For example, the areas of expertise are defined by one or more key words, for example "electronic information handling", "management and consulting general",
25 "knowledge landscape screening", "workshop (topic)", "information audit", "process support (communication/documentation)", "communication consulting", "virtual collaboration consulting", "information process design", "knowledge workplace consulting", "customized information competence", "content integration", "project management', or "risk management". The areas of

WO 2005/124607

PCT/CH2005/000260

expertise defined and entered by the user are received by the configuration module 12 and stored in database 10.
In step P2, the configuration module 12 prompts the user to define and enter sets of quality indicators. For example, the set is defined by an
5 alphanumeric code or a keyword such as "A". The quality indicators are defined, for example, by an alphanumeric code or a keyword such as "A1", "A2", "A3", and a worded question such as "how has the efficiency of using electronic mail improved?". Once the user has indicated that the set of quality indicators is complete, the set of quality indicators defined and entered by the
10 user is stored by the configuration module 12 in database 10.
In step P3, the configuration module 12 prompts the user to enter and assign weighting factors to the quality indicators of the set defined in step P2. For example, in a set of three quality indicators, weighting factors of 50%, 20%, and 30% are assigned to the first, second, or third quality indicator,
15 respectively. The weighting factors entered and assigned to the quality indicators are received by the configuration module 12 and stored in database 10.
In step P4, the configuration module 12 prompts the user to assign the sets of quality indicators defined In step P2 and weighted in step P3 to one of
20 the areas of expertise defined and entered in step P1. For example, the user can perform the assignment by selecting one area of expertise from a drop down list containing the areas of expertise defined in step P1 and by selecting one set of quality indicators from a drop down list containing the sets of quality indicators defined in step P2. Data related to the assignment specified by the
25 user is received by the configuration module 12 and reflected in database 10 by linking the set of quality indicators and the area of expertise previously selected.

WO 2005/124607 13 PCT/CH2005/000260
The expert will understand, that it is also possible to arrange the preparatory steps P1 to P4 in a different sequence, for example, P4 could be executed before step P3, or the area of expertise to which a set of quality indicators is to be assigned could be specified before execution of P2.

Area of expertise (training or consulting module) Set ofqualityindicators Quality indicator Weighting factor
Management of electronic information "A" “A1” 50%
Management of electronic information "A" "A2" 20%
Management of electronic information "A" "A3" 30%
Management of physical information "B" "B1" 60%
Management of physical information "B" "B2” 40%
Planning and coordinating using electronic and physical information "C" “C1” 50%
Planning and coordinating using electronic and physical information "C" "C2" 50%
5 Table 1
As is illustrated in Table 1, the defined areas of expertise are linked to sets of quality indicators. The expert: will understand that the sets of quality indicators can be stored in the same table as the areas of expertise or in another table.
10 Figure 3 shows a flow diagram illustrating configuration steps for defining
and storing an instance of knowledge transfer (i.e. a particular course, teaching program, or consultant program) in database 10. The configuration steps C1 to C3 can be executed by a user of a data entry terminal 3, 4, 4', 4" at any time when a new instance of knowledge transfer needs to be defined in the data
15 processing system 1. Preferably, the user can request execution of the

WO 2005/124607 PCT/GH2005/000260
configuration steps CI to C3 through a menu of the user interface provided by the control module 14.
In step G1, the configuration module 12 prompts the user of the data entry terminal 3, 4, 4', 4" to define and enter an identifier for an instance of
5 knowledge transfer. For example, an identifier for an instance of knowledge transfer is defined by one or more key words, for example "knowledge and information management". The identifier for an instance of knowledge transfer defined and entered by the user is received by the configuration module 12 and stored in database 10.
10 In step C2, the configuration module 12 prompts the user to select areas
of expertise to be included in the instance of knowledge transfer defined in step C1. For example, the user can select the areas of expertise from a drop down list or through checks in a list containing the areas of expertise defined in step P1. Data related to the linking of the selected areas of expertise to the instance
15 of knowledge transfer defined in C1 is received by the configuration module 12 and reflected in the database 10 by linking the selected areas of expertise to the instance of knowledge transfer defined previously.
In step C3, the configuration module 12 prompts the user to enter and assign weighting factors to the areas of expertise selected in step C2. For
20 example, in an instance of knowledge transfer with three areas of expertise, weighting factors of 50%, 25%, and 25% are assigned to the first, second, or third area of expertise, respectively. The weighting factors entered and assigned to the areas of expertise are received by the configuration module 12 and stored in the database 10.
25 As is illustrated in Table 2, the selected areas of expertise and their
weighting factors are linked to an instance of knowledge transfer. The expert

WO 2005/124607

15

PCT/CH2005/000260

will understand that the sets of quality indicators can be stored in the same table as the areas of expertise or in another table.

Instance of knowledge transfer Estimated maximum time savings

Selected areas of expertise Weightingfactor(area ofexpertise) Set ofquality indicators Quality indicator Weighting factor (qualityindicator)
Management of electronic information 50% "A" "A1" 50%
Management of electronic information 50% "A° °A2" 20%
Management of electronic information 50% "A" "A3" 30%
Management of physical information 25% "B" "B1” 60%
Management of physical information 25% °B" "B2" 40%
Planning and coordinating using electronic and physical information 25% "C °C1" 50%
Planning and coordinating using electronic and physical information 25% “C” "C2" 50%
Table 2
As is also illustrated in Table 2, an amount of estimated maximum time
5 savings is assigned to the instance of knowledge transfer. The amount of estimated maximum time savings represents an expert opinion of the maximum time savings that can be expected in the selected areas of expertise after "delivery" of the instance of knowledge transfer. The amount of estimated maximum time savings can be entered as part of step C1 or at a later time. In
10 the present context, any amount of time savings can be entered or computed as daily, weekly, monthly, and/or yearly time savings.

WO 2005/124607 16 PCT/CH2005/000260
Figure 4 shows a flow diagram illustrating an example of a sequence of steps executed for assessing the level of effectiveness of an instance of knowledge transfer directed to selected areas of expertise.
In step S1, the control module 14 prompts the user of the data entry
5 terminal 3, 4, 4', 4" to enter an identification of a student (or client) participating in the instance of knowledge transfer defined in steps C1 to C3. Alternatively, before prompting the user to enter student (or client) identifications, the control module 14 may prompt the user to select another defined instance of knowledge transfer for which the level of effectiveness should be assessed
10 instead. An identification of a student is defined, for example, by a code, a number or a name. The identification of the student can be selected from a list of students, for example. The identification of the student entered by the user is received by the control module 14 and stored in database 10, The identification of the student is assigned to the instance of knowledge transfer specified
15 previously, i.e. the instance of knowledge transfer defined in steps C1 to C3 or selected in step S1.
In step S2, the control module 14 prompts the user to enter further student specific data such as a competence level indicating the students level of competence prior to the knowledge transfer, a consulting quality level indicating
20 the students assessment of the quality of the instance of knowledge transfer, and an amount of subjective time savings indicating an amount of time savings experienced subjectively by the student after a significant period of time, e.g. three months after the course. The student specific data entered by the user is received by the control module 14 and stored in database 10. The student
25 specific data is assigned to the student identification stored in step S1 and to the instance of knowledge transfer specified previously.
In step S3, the rating module 11 prompts the user to enter rating values for each of the quality indicators included in the sets of quality indicators

WO 2005/124607 PCT/CH2005/000260
17
assigned to the areas of expertise associated with the instance of knowledge transfer. Preferably, the rating values are selected from a drop down list or checked in a list containing the available range of rating values. For example, a range of four different rating values includes the values [0%, 33%, 66%, 100%],
5 each rating value corresponding to a verbal description such as [no improvement, hardly any improvement, some improvement, great improvement]. The student specific rating values entered by the user are received by the rating module 11 and stored in database 10. The student specific rating values are assigned to the student identification stored in step S1
10 and to the instance of knowledge transfer specified previously.
In step S4, the scoring module 13 computes a student specific level of effectiveness for the instance of knowledge transfer specified previously. As is indicated in formula (1), the level of effectiveness Eff is computed from the rating values Rfj entered and stored in step S3, from the weighting factors wff
15 assigned to the respective quality indicators In, and from the weighting factors Wi assigned to the areas of expertise A| included in the instance of knowledge transfer specified previously.

The student specific level of effectiveness of the instance of knowledge
20 transfer computed by the scoring module is stored in database 10. The student specific level of effectiveness is assigned to the student identification stored in step SI and to the instance of knowledge transfer specified previously.
In step S5, the scoring module 13 computes a student specific amount of
expected time savings. As is indicated in formula (2), the student specific
25 amount of expected time savings T exp is computed from the level of effectiveness Eff computed in step S4 and the amount of estimated maximum

WO 2005/124607 PCT/CH2005/000260
time savings Tmax assigned to the instance of knowledge transfer specified previously.
T exp-Eff*Tmax (2)
In the optional step S6, the scoring module 13 checks whether there is a
5 significant deviation of the student specific amount of expected time savings
Texp computed in step S5 from the student specific amount of subjective time
savings Tsub stored in step S2. A significant deviation is preferably defined
based on the difference between the expected time savings Texp and the
subjective time savings T^. For example, the deviation is defined as the
10 percentage of the difference from the expected time savings Texp, from the subjective time savings Tsub, or from an average of the expected time savings Texp and the subjective time savings Tsub- If there is a significant deviation, in step S7, the student is marked as a statistical outlier, otherwise, processing continues in step S8.
15 In step S8, the amount of expected time savings Texp computed in step S5
is stored by the scoring module 13 in database 10. The amount of expected time savings Texp is assigned to the student identification stored in step S1 and to the instance of knowledge transfer specified previously.
In step S9, the scoring module 13 computes a student specific weighted
20 amount of time savings Tw1 from the student specific amount of expected time savings Texp computed in step S5, from the student specific amount of subjective time savings Tsub stored in step S2, and from the student's competence level C stored in step S21 The student specific weighted amount of time savings Tw1 is computed as \ indicated in formula (3), wherein the
25 competence level C is in the range C=[0 (no experience) .. 20 (very experienced)]. Consequently, if the student is very experienced, the weight of the computed amount of expected time savings T6Xp is reduced to 80% in

WO 2005/124607 PCT/CH2005/000260
19
formula (3). However, if the student has no experience and therefore a great potential for improvement, the weight of the computed amount of expected time savings Texp is not reduced in formula (3). The weighted amount of time savings Tw1 is stored by the scoring module 13 in database 10. The weighted amount of
5 time savings Tw1 is assigned to the student identification stored in step S1 and to the instance of knowledge transfer specified previously.
100- C
Tw1=- 102° (3)
In step S10, the scoring module 13 computes a student specific weighted amount of time savings Tw2 from the student specific weighted amount of time
10 savings Tw1 computed in step S9 and from the student specific consulting quality level Q stored in step S2. The student specific weighted amount of time savings Tw2 is computed as indicated in formula (4), wherein the quality level Q is in the range Q=[0 (very low quality).. 100 (maximum quality)]. For example, if a student rates the quality of the knowledge transfer as medium (e.g. 50%), the
15 expected time savings are reduced (e.g. to 65%); if a student rates the quality of the knowledge transfer as very good (e.g. 95%), the expected time savings are increased (e.g. to 110%). The weighted amount of time savings Tw2 is stored by the scoring module 13 in database 10. The weighted amount of time savings Tw2 is assigned to the student identification stored in step S1 and to the
20 instance of knowledge transfer specified previously.
Tw2=Q+15 *Tw1 (4)
100
In step S11, the control module 14 determines whether data of further students is to be recorded or whether the overall level of effectiveness and the total time savings of the instance of knowledge transfer specified previously is
25 to be computed.

WO 2005/124607

20

PCT/CH2005/000260

In step S12, the scoring module 13 computes the overall level of effectiveness and the total amount of time savings of the instance of knowledge transfer specified previously. Based on formula (1), the overall level of effectiveness is computed from all the student specific rating values recorded in
5 step S3 for the instance of knowledge transfer. For example, the overall level of effectiveness is computed as an average from all the student specific levels of effectiveness stored in step S4 for the instance of knowledge transfer. In an embodiment, student specific data is excluded from computation of the overall level of effectiveness, if the data is associated with students who were marked
10 as statistical outliers in optional step S7.
Based on formulas (1), (2), (3), and (4), the total amount of time savings is computed based on all the student specific rating values recorded in step S3 for the instance of knowledge transfer, the amount of estimated maximum time savings assigned to the instance of knowledge transfer, all the students'
15 competence levels stored in step S2, and all the student specific consulting quality levels stored in step S2. For example, the total amount of time savings is computed as a total value from all the student specific weighted amount of time savings Tw2 computed and stored in step S10.
For statistical purposes, the scoring module 13 also computes total values
20 of the student specific amounts of expected time savings Texp computed in step S5 and of the student specific weighted amounts of time savings Tw1 computed in step S9. Moreover, the scoring module 13 computes average values of the rating values entered in step S3 for each of the quality indicators associated with the instance of knowledge transfer.
25 Furthermore, from student specific cost data stored in the database 10,
the scoring module 13 also computes student specific cost savings and total cost savings expected from the instance of knowledge transfer. For example, the student specific cost data is recorded as hourly rate. The student specific

WO 2005/124607 PCT/CH2005/000260
21

cost savings are computed based on the student specific weighted amount of time savings Tw2 computed and stored in step S10. The total cost savings are computed based on the total amount of time savings. The cost savings can be computed as daily, weekly, monthly, or yearly savings.
5 It must be pointed out that different sequences of steps S1 to S12 are
possible without deviating from the scope of the invention. For example, one skilled in the art will understand, that steps S4 to S10 can be executed after step S11, i.e. after student specific data and rating values have been entered in steps S1 to S3 for all students to be considered in the evaluation of the
10 instance of knowledge transfer. If there is no interest in student specific results, steps S4 to S10 can be omitted. One skilled in the art will also understand that step S12 can be executed before step $11, i.e. the overall level of effectiveness and the total time savings of the instance of knowledge transfer is computed in step S12 whenever the data and rating values of another student have been
15 entered in steps S1 to S3.

WO 2005/124607

22

PCT/CH2005/000260

We Claim :
What is claimed is:
1. A computer-based data processing system for assessing a level of
effectiveness of knowledge transfer, the knowledge transfer being directed
to more than one defined area of expertise, the system comprising
5 means for storing sets of quality indicators, each set of quality indicators
being assigned to one of the defined areas of expertise,
a configuration module for specifying for an instance of knowledge transfer selected areas of expertise from the defined areas of expertise,
a rating module for receiving and storing rating values, each of the rating
10 values being assigned to one of the quality indicators of a set assigned to
one of the selected areas of expertise, and
a scoring module for computing from the rating values assigned to the
quality indicators of the sets assigned to the selected areas of expertise
the level of effectiveness of the instance of knowledge transfer directed to

15 the selected areas of expertise.
2. The data processing system according to claim 1, further comprising
means for receiving and storing amounts of estimated maximum time
savings, each amount of estimated maximum time savings being assigned
to one of the defined areas of expertise, and wherein the scoring module
20 is designed to compute from the level of effectiveness and from the
amounts of estimated maximum time savings an amount of expected time savings for the selected areas of expertise.
3. The data processing system according to claim 2, further comprising
means for receiving and storing amounts of student specific, subjective
25 time savings, wherein the rating module is designed to receive and store

WO 2005/124607 PCT/CH2005/000260
23
student specific rating values, wherein the scoring module is designed to
compute student specific amounts of expected time savings, and wherein
the scoring module is designed to compute student specific amounts of
time savings from the student specific amounts of expected time savings
5 and from the student specific amounts of subjective time savings.
4. The data processing system according to claim 3, wherein the scoring
module is designed to compute the level of effectiveness of the knowledge
transfer from student specific rating values of a plurality of students, and
wherein the scoring module is designed to exclude student specific rating
10 values from students with a student specific amount of expected time
savings deviating by more than a defined value from the student specific amount of subjective time savings;
5. The data processing system according to claim 2, wherein the system
further includes means for receiving and storing student specific
15 competence levels indicating a students level of competence prior to the
knowledge transfer,, and wherein the scoring module is designed to compute student specific amounts of expected time savings, the student specific amounts of expected time savings being weighted dependent on a student's specific competence level.
20 6. The data processing system according to claim 2, wherein the system further includes means for receiving and storing student specific consulting quality levels indicating a student's assessment of quality of the knowledge transfer, and wherein the scoring module is designed to compute student specific amounts of expected time savings, the student
25 specific amounts of expected time savings being weighted dependent on
a student's specific consulting quality level.

WO 2005/124607 PCT/CH2005/000260
7. The data processing system according to claim 1, further comprising
means for receiving and storing amounts of estimated maximum time
savings, each amount of estimated maximum time savings being assigned
to one of the defined areas of expertise, means for receiving and storing
5 amounts of student specific, subjective time savings, means for receiving
and storing student specific competence levels indicating a student's level of competence prior to the knowledge transfer, means for receiving and storing student specific consulting quality levels indicating a student's assessment of quality of the knowledge transfer, wherein the rating
10 module is designed to receive and store student specific rating values,
and wherein the scoring module is designed to compute an amount of expected time savings for the selected areas of expertise, the amount of expected time savings being computed from student specific amounts of expected time savings, the student specific amounts of expected time
15 savings being computed from the amounts of estimated maximum time
savings, from the student specific rating values, and from the amounts of student specific, subjective time savings, and the student specific amounts of expected time savings being weighted dependent on a students specific competence level and on a students specific consulting quality
20 level.
8. The data processing system according to claim 1, wherein the system
further includes means for assigning weighting factors to the quality
indicators, and wherein the scoring module is designed to compute the
level of effectiveness according to the weighting factors.
25 9. The data processing system according to claim 1, wherein the system further includes means for assigning weighting factors to the selected areas of expertise, and wherein the scoring module is designed to compute tiie level of effectiveness according to the weighting factors.

WO 2005/124607 PCT/CH2005/000260
10. The data processing system according to claim 1, wherein the selected
areas of expertise include management of electronic information,
management of physical information, and planning and coordinating
based on electronic and physical information, and wherein the instance of
5 knowledge transfer relates information management.
11. The data processing system according to claim 1, further comprising a control module for controlling a user interface such that a user is prompted to enter rating values for all the quality indicators included in the sets of quality indicators assigned to the selected areas of expertise.
10 12. A computer implemented method for assessing a level of effectiveness of knowledge transfer, the knowledge transfer being directed to more than one defined area of expertise, the method comprising
storing sets of quality indicators in a database of a computer-based data
processing system, each set of quality indicators being assigned to one of
15 the defined areas of expertise,
specifying for an instance of knowledge transfer selected areas of expertise from the defined areas of expertise,
assigning in the database the selected areas of expertise to the instance of knowledge transfer,
20 receiving in the data processing system rating values for the quality
indicators of the sets assigned to the selected areas of expertise,
storing the rating values in the database, each of the rating values being assigned to one of the quality indicators of the sets assigned to the selected areas of expertise, and

WO 2005/124607 PCT/CH2005/000260
26
computing from the rating values assigned to the quality indicators of the sets assigned to the selected areas of expertise the level of effectiveness of the instance of knowledge transfer directed to the selected areas of expertise.
5 13. Computer program product comprising computer program code means for controlling one or more processors of a computer in a data processing system, such
that the computer stores sets of Quality indicators in a database of the
data processing system, each set of quality indicators being assigned to
10 one of a plurality of defined areas of expertise,
that the computer receives specifications for selecting for an instance of knowledge transfer selected areas of expertise from the defined areas of expertise,
that the computer assigns the selected areas of expertise to the instance
15 of knowledge transfer,
that the computer receives rating values for the quality indicators of the sets assigned to tine selected areas of expertise,
that the computer stores the rating values in the database, each of the
rating values being assigned to one of the quality indicators of the sets
20 assigned to the selected areas of expertise, and
that the computer computes from the rating values assigned to the quality indicators of the sets assigned to the selected areas of expertise a level of effectiveness of the instance of knowledge transfer directed to the selected areas of expertise.
25

27
14. A Computer based data processing system and computer implemented method for assessing a level of effectiveness of knowledge substantially as herein described with reference to the accompanying drawings.

Dated this 5th day of June, 2006

OMANA RAMAKRISHNAN
OF K & S PARTNERS
AGENT FOR THE APPLICANT(S)

28

ABSTRACT
A computer-based data processing system for assessing a level of effectiveness of knowledge transfer , the knowledge transfer being directed to more than one defined area of expertise, the system comprising means for storing sets of quality indicators, each set of quality indicators being assigned tone of the defined areas of expertise, a configuration module for specifying for an instance of knowledge transfer selected areas of expertise form the area of expertise , a rating module for receiving and storing rating values assigned to one of the quality indicators of a set assigned to one of the quality indicators of a set assigned to one of the selected areas of expertise, and a scoring module for computing from the rating values assigned o the quality indicators of the sets assigned to the selected areas of expertise the level of effectiveness of the instance of knowledge transfer directed to the selected areas of expertise.