Description:FORM 2
THE PATENTS ACT, 1970
(39 OF 1970)
&
THE PATENTS RULES, 2003

COMPLETE SPECIFICATION
[SEE SECTION 10, RULE 13]

HUMAN-MACHINE INTERFACE SYSTEM AND METHOD OF GENERATING DISPLAY OBJECTS THEREOF

MITSUBISHI ELECTRIC INDIA PRIVATE LIMITED
HAVING ADDRESS AT:
ICC-DEVI GAURAV TECHNOLOGY PARK, UNIT NO. 402, 4TH FLOOR, SR. NO.191-192(P), PIMPRI, PUNE – 411018, MAHARASHTRA, INDIA.

THE FOLLOWING SPECIFICATION PARTICULARLY DESCRIBES THE INVENTION AND THE MANNER IN WHICH IT IS TO BE PERFORMED. 

FIELD OF INVENTION
[0001] The present invention relates generally to electronic devices and specifically to Human-Machine Interface (HMI) systems.

BACKGROUND
[0002] Human-Machine Interface (HMI) Device is an industrial device which typically consists of display, touch panel, keyboard, communication interfaces to communicate with computers and other devices like Programmable Logic Controller (PLC) or Network devices. Human Machine Interface (HMI) devices are widely used in industrial automation domain to facilitate interaction of humans with machines. HMI screens are designed by a user as per application requirements using a set of display objects. HMI application program consists of user configured screens with HMI objects. These screens can be designed using computer-based programming software. HMI application program created and compiled by computer-based software is downloaded in the external ROM of the HMI device.
[0003] Conventional HMI display objects are shown in Figure 1. Examples of the conventional HMI display objects (100) include, a scroll bar, a slider, a progress bar, a bar display, a meter, a rocker switch, a DIP switch etc.
[0004] Each type of display object (100) has a set of attributes to customize its appearance on the screen. These attributes are maintained in a data structure which is managed by the system software of the HMI device.
[0005] Referring now to Figure 2, a configured HMI display (200) is shown.
[0006] The HMI display (200) shows different types of display objects, such as, a multi-text display object, a graphical symbol, a numeric symbol, and a date.
[0007] Referring now to Figure 3, a plurality of HMI display objects (300) are shown.
[0008] Examples of the display objects include, but are not limited to, a multi-text display object, a bit, a numeric symbol, a time, a time of a day, a date, a graphical symbol, a bit symbol, a multi-symbol, and an image.
[0009] Referring now to Figure 4, a table depicting common attributes of display objects is shown.
[0010] All types of display objects possess the common attributes, such as, Position X, Position Y, Height, and Width. In an example, Position X is Position on X axis from top left corner of screen, Position Y is Position on Y axis from top left corner of screen, Height is Height of the object, and Width is Width of the object.
[0011] Referring now to Figure 5, a table depicting specific attributes of display objects is shown.
[0012] The specific attributes are different for different types of display objects. For instance, a graphical symbol includes color and resolution as specific attributes, a numeric symbol includes decimal point and digits as specific attribute, a date includes date format and font type as specific attribute, and a multi-text includes font color and size as specific attribute.
[0013] Referring now to Figure 6, a schematic block diagram of a data structure for a graphical symbol (602) and a data structure for a numeric symbol (604) is shown.
[0014] The data structure for graphical symbol (602) includes common attributes (602a), specific attributes (602b), and a next reference (602c). The common attributes (602a) for data structure for graphical symbol (602) include Position X and Position Y. The specific attributes (602b) for data structure for graphical symbol (602) include color and resolution.
[0015] The data structure for numeric symbol (604) includes common attributes (604a), specific attributes (604b), and a next reference (604c). The common attributes (604a) for data structure for numeric symbol (604) include Position X and Position Y. The specific attributes (604b) for data structure for numeric symbol (604) include position of decimal point and total number of digits.
[0016] Referring now to Figure 7A, a linked list (700a) of data structures for graphical symbols (602) is shown.
[0017] The linked list (700a) includes a first data structure for graphical symbol (602-1) and a second data structure for graphical symbol (602-2). The first data structure for graphical symbol (602-1) includes common attributes (602-1a), specific attributes (602-1b), and a next reference (602-1c). The second data structure for graphical symbol (602-2) includes common attributes (602-2a), specific attributes (602-2b), and a next reference (602-2c).
[0018] The next reference (602-1c) of the first data structure for graphical symbol (602-1) points to the second data structure for graphical symbol (602-2), thereby linking the first data structure for graphical symbol (602-1) with the second data structure for graphical symbol (602-2).
[0019] Referring now to Figure 7B, a linked list (700b) of data structures for numeric symbols (604) is shown.
[0020] The linked list (700b) includes a first data structure for numeric symbol (604-1) and a second data structure for numeric symbol (604-2). The first data structure for numeric symbol (604-1) includes common attributes (604-1a), specific attributes (604-1b), and a next reference (604-1c). The second data structure for numeric symbol (604-2) includes common attributes (604-2a), specific attributes (604-2b), and a next reference (604-2c).
[0021] The next reference (604-1c) of the first data structure for numeric symbol (604-1) points to the second data structure for numeric symbol (604-2), thereby linking the first data structure for numeric symbol (604-1) with the second data structure for numeric symbol (604-2).
[0022] Referring now to Figure 8A, addition of a data structure (806) in a linked list (800A) is shown.
[0023] The linked list (800A) includes first through third data structures (802,804,806). The first data structure (802) includes common attributes (802a), specific attributes (802b), and a next reference (802c). The second data structure (804) includes common attributes (804a), specific attributes (804b), and a next reference (804c). The third data structure (806) includes common attributes (806a), specific attributes (806b), and a next reference (806c).
[0024] The third data structure (806) is added by adding a pointer to the third data structure (806). The pointer is stored in the next reference (804c) of the second data structure (804).
[0025] The next reference (802c) of the first data structure (802) points to the second data structure (804) and after addition, the next reference (804c) of the second data structure (804) points to the third data structure (806), thereby linking the first through third data structures (802,804,806).
[0026] Referring now to Figure 8B, deletion of a data structure (804) from a linked list (800B) is shown.
[0027] The linked list (800A) includes first through third data structures (802,804,806). The first data structure (802) includes common attributes (802a), specific attributes (802b), and a next reference (802c). The second data structure (804) includes common attributes (804a), specific attributes (804b), and a next reference (804c). The third data structure (806) includes common attributes (806a), specific attributes (806b), and a next reference (806c).
[0028] Initially, the next reference (802c) of the first data structure (802) points to the second data structure (804) and the next reference (804c) of the second data structure (804) points to the third data structure (806), thereby linking the first through third data structures (802,804,806).
[0029] During deletion, a pointer to the second data structure (804) stored in the next reference (802c) of the first data structure (802) is replaced by a pointer to the third data structure (806).
[0030] After deletion, the next reference (802c) of the first data structure (802) points to the third data structure (806), thereby delinking the second data structure (804).
[0031] Referring now to Figure 9, procedures for different types of data structures are shown.
[0032] As there are several types of display objects, it is necessary to manage several types of data structures using their corresponding lists. It is not possible to maintain data structures of different types of display object in a single list. Additionally, every type of list has its own procedures to handle the data structures, hence there are several procedures to be maintained. This approach increases the overhead on the system software.
[0033] Therefore, there is a need to manage these data structures effectively for every configured display object.

SUMMARY
[0034] This summary is provided to introduce concepts of the present invention. This summary is neither intended to identify essential features of the present invention nor is it intended for use in determining or limiting the scope of the present invention.
[0035] In an embodiment of the present invention, a method of generating different types of display objects in a human-machine interface system is provided. The method includes generating a plurality of reference structures. Each reference structure includes a generic reference structure. The generic reference structure includes a self generic reference and a next generic reference. Each reference structure corresponds to a type of display object. The method includes creating a linked list of the plurality of reference structures such that a next generic reference of a reference structure points to a generic reference structure of another reference structure. The method further includes generating display objects of one or more types based on the created linked list. The method further includes displaying the objects on a display.
[0036] In another embodiment of the present invention, a human-machine interface system is provided. The human-machine interface system includes a display and a microcontroller. The display is configured to display different types of display objects. The microcontroller is configured to generate a plurality of reference structures. Each reference structure includes a generic reference structure. The generic reference structure includes a self generic reference and a next generic reference. Each reference structure corresponds to a type of display object. The microcontroller is further configured to create a linked list of the plurality of reference structures such that a next generic reference of a reference structure points to a generic reference structure of another reference structure. The microcontroller is further configured to generate display objects of one or more types based on the created linked list. The display displays the objects.
[0037] In an embodiment, each reference structure includes a plurality of common attributes associated with every type of display objects. Each reference structure also includes a plurality of specific attributes associated with a corresponding type of display object.
[0038] In an embodiment, the self generic reference of each generic reference structure within corresponding reference structure points to the same reference structure.
[0039] In an embodiment, the plurality of reference structures have same data structures.

BRIEF DESCRIPTION OF ACCOMPANYING DRAWINGS
[0040] The detailed description is described with reference to the accompanying figures. The same numbers are used throughout the drawings to refer to features and modules.
[0041] Figure 1 illustrates a plurality of Human-Machine Interface (HMI) display objects.
[0042] Figure 2 illustrates a configured HMI display.
[0043] Figure 3 illustrates a plurality of HMI display objects.
[0044] Figure 4 is a table depicting common attributes of display objects.
[0045] Figure 5 is a table depicting specific attributes of display objects.
[0046] Figure 6 illustrates a schematic block diagram of a data structure for a graphical symbol and a data structure for a numeric symbol.
[0047] Figure 7A illustrates a linked list of data structures for graphical symbols.
[0048] Figure 7B illustrates a linked list of data structures for numeric symbols.
[0049] Figure 8A illustrates addition of a data structure in a linked list.
[0050] Figure 8B illustrates deletion of a data structure from a linked list.
[0051] Figure 9 illustrates procedures (for example addition, deletion) for different types of data structures.
[0052] Figure 10 illustrates a schematic block diagram of a generic framework for creating a plurality of HMI display objects in accordance with an embodiment of the present invention.
[0053] Figure 11A illustrates a generic reference structure in accordance with an embodiment of the present invention.
[0054] Figure 11B illustrates a linked list of generic reference structures in accordance with an embodiment of the present invention.
[0055] Figure 11C illustrates insertion and deletion procedures for generic reference structures in accordance with an embodiment of the present invention.
[0056] Figure 12A illustrates a linked list of two reference structures for numeric symbols in accordance with an embodiment of the present invention.
[0057] Figure 12B illustrates a linked list of two reference structures for graphical symbols in accordance with an embodiment of the present invention.
[0058] Figure 12C illustrates a linked list of a reference structure for numeric symbol and a reference structure for graphical symbol in accordance with an embodiment of the present invention.
[0059] Figure 12D illustrates multiple linked lists derived using the generic framework in accordance with an embodiment of the present invention.
[0060] Figure 13 illustrates a layer-wise list of display objects in accordance with an embodiment of the present invention.
[0061] Figure 14 illustrates a schematic block diagram of an HMI programming setup in accordance with an embodiment of the present invention.
[0062] Figure 15 illustrates a schematic block diagram of hardware components of an HMI system in accordance with an embodiment of the present invention.
[0063] Figure 16 illustrates a user program in accordance with an embodiment of the present invention.
[0064] It should be appreciated by those skilled in the art that any block diagrams herein represent conceptual views of illustrative systems embodying the principles of the present disclosure.
[0065] Similarly, it will be appreciated that any flow charts, flow diagrams, and the like represent various processes which may be substantially represented in computer readable medium and so executed by a computer or processor, whether or not such computer or processor is explicitly shown.

DETAILED DESCRIPTION
[0066] The various embodiments of the present invention provide a method of generating different types of display objects in a Human-Machine Interface (HMI) system and an HMI system thereof.
[0067] In the following description, for purpose of explanation, specific details are set forth in order to provide an understanding of the present disclosure. It will be apparent, however, to one skilled in the art that the present disclosure may be practiced without these details.
[0068] One skilled in the art will recognize that various implementations of the present disclosure, some of which are described below, may be incorporated into a number of systems.
[0069] However, the systems and methods are not limited to the specific implementations described herein. Further, structures and devices shown in the figures are illustrative of exemplary implementations of the present disclosure and are meant to avoid obscuring the present disclosure.
[0070] Furthermore, connections between components and/or modules within the figures are not intended to be limited to direct connections. Rather, these components and modules may be modified, re-formatted or otherwise changed by intermediary components and modules.
[0071] References in the present disclosure to “one embodiment” or “an embodiment” mean that a particular feature, structure, characteristic, or function described in connection with the embodiment is included in at least one embodiment of the invention. The appearances of the phrase “in an embodiment” or “in an implementation” in various places in the specification are not necessarily all referring to the same embodiment or implementation.
[0072] In an embodiment, the present invention provides a generic framework through which data structures of different Human-Machine Interface (HMI) display objects can be derived, maintained in a single list, and handled using a single set of procedures.
[0073] Referring now to Figure 10, a schematic block diagram of a generic framework (1000) for HMI display objects is shown.
[0074] The generic framework (1000) includes a plurality of first data structures (N through N+2) (1002a-1002c) (also collectively referred to as “first data structure (1002)”), a plurality of second data structures (N through N+2) (1004a-1004c) (also collectively referred to as “second data structure (1004)”), a plurality of third data structures (N through N+2) (1006a-1006c) (also collectively referred to as “third data structure (1006)”). The generic framework (1000) includes a plurality of generic data structures (N through N+2) (1008a-1008c) (also collectively referred to as “generic data structure (1008)”).
[0075] The generic framework (1000) provides generic data structure and procedures related to generic data structure. The generic framework (1000) handles linked lists for different types of display objects using the same generic method.
[0076] Using generic framework (1000), data structures for any type of display objects can be derived. Advantageously, the data structures of different types of display objects can be maintained in a single linked list. Additionally, the same generic methods are used to handle the generic data structures in corresponding lists. This reduces the overhead on the system software.
[0077] In an example, the generic reference structure (1008) may represent the first data structure (1002), the second data structure (1004), or the third data structure (1006).
[0078] Referring now to Figure 11A, a generic reference structure (1102) is shown in accordance with an embodiment of the present invention.
[0079] The generic reference structure (1102) includes a self generic reference (1102a) and a next generic reference (1102b).
[0080] Referring now to Figure 11B, a linked list (1100B) of generic reference structures is shown in accordance with an embodiment of the present invention.
[0081] The linked list includes a first generic reference structure (1102-1) and a second generic reference structure (1102-2).
[0082] The first generic reference structure (1102-1) includes a self generic reference (1102-1a) and a next generic reference (1102-1b). The second generic reference structure (1102-2) includes a self generic reference (1102-2a) and a next generic reference (1102-2b).
[0083] The next generic reference structure (1102-1b) of the first generic reference structure (1102-1) points to the second generic reference structure (1102-2), thereby linking the first generic reference structure (1102-1) with the second generic reference structure (1102-2).
[0084] Referring now to Figure 11C, insertion and deletion procedures for generic reference structures are shown in accordance with an embodiment of the present invention.
[0085] Referring now to Figure 12A, a linked list (1200A) of two reference structures for numeric symbols is shown in accordance with an embodiment of the present invention.
[0086] The linked list (1200A) includes a first reference structure (1202A) and second reference structure (1202B).
[0087] The first reference structure (1202A) includes a generic reference structure (1202-1). The generic reference structure (1202-1) includes a self generic reference (1202-1a) and a next generic reference (1202-1b). The first reference structure (1202A) further includes common attributes (1202-1c) and specific attributes (1202-1d).
[0088] The second reference structure (1202B) includes a generic reference structure (1202-2). The generic reference structure (1202-2) includes a self generic reference (1202-2a) and a next generic reference (1202-2b). The second reference structure (1202B) further includes common attributes (1202-2c) and specific attributes (1202-2d).
[0089] The next generic reference (1202-1b) of the generic reference structure (1202-1) of the first reference structure (1202A) for numeric symbol points to the generic reference structure (1202-2) of the second reference structure (1202B) for numeric symbol, thereby linking the first reference structure (1202A) for numeric symbol with the second reference structure (1202B) for numeric symbol.
[0090] The self generic reference (1202-1a, 1202-2a) of each generic reference structure (1202-1, 1202-2) within corresponding reference structure (1202A, 1202B) points to the same reference structure (1202A, 1202B).
[0091] Referring now to Figure 12B, a linked list (1200B) of two reference structures for graphical symbols is shown in accordance with an embodiment of the present invention.
[0092] The linked list (1200B) includes a first reference structure (1204A) and second reference structure (1204B).
[0093] The first reference structure (1204A) includes a generic reference structure (1204-1). The generic reference structure (1204-1) includes a self generic reference (1204-1a) and a next generic reference (1204-1b). The first reference structure (1204A) further includes common attributes (1204-1c) and specific attributes (1204-1d).
[0094] The second reference structure (1204B) includes a generic reference structure (1204-2). The generic reference structure (1204-2) includes a self generic reference (1204-2a) and a next generic reference (1204-2b). The second reference structure (1204B) further includes common attributes (1204-2c) and specific attributes (1204-2d).
[0095] The next generic reference (1204-1b) of the generic reference structure (1204-1) of the first reference structure (1204A) for graphical symbol points to the generic reference structure (1204-2) of the second reference structure (1204B) for graphical symbol, thereby linking the first reference structure (1204A) for graphical symbol with the second reference structure (1204B) for graphical symbol.
[0096] The self generic reference (1204-1a, 1204-2a) of each generic reference structure (1204-1, 1204-2) within corresponding reference structure (1204A, 1204B) points to the same reference structure (1204A, 1204B).
[0097] Referring now to Figure 12C, a linked list of a reference structure for a first type of display object and a reference structure for another second type of display object is shown in accordance with an embodiment of the present invention. In an exemplary embodiment, the first type of display object is a numeric symbol, and another second type of display object is a graphical symbol.
[0098] The linked list (1200C) includes the first reference structure (1202A) for the first type i.e., the numeric symbol and another second reference structure (1204A) for the second type i.e., the graphical symbol. The first reference structure (1202A) for the first type and the second reference structure (1204A) for the second type have same structural arrangement for their respective data structure.
[0099] The next generic reference (1202-1b) of the generic reference structure (1202-1) of the first reference structure (1202A) for the first type i.e., the numeric symbol points to the generic reference structure (1204-1) of another second reference structure (1204A) for the second type i.e., the graphical symbol, thereby linking the first reference structure (1204A) for numeric symbol with another second reference structure (1204A) for graphical symbol.
[0100] The self generic reference (1202-1a, 1204-1a) of each generic reference structure (1202-1, 1204-1) within corresponding reference structure (1202A, 1204A) points to the same reference structure (1202A, 1204A).
[0101] Referring now to Figure 12D, multiple linked lists derived using the generic framework are shown in accordance with an embodiment of the present invention. As can be seen, all types of data structures and their linked lists are derived using the generic framework, while the procedures to handle the data structures remain the same. A technical advantage offered by the generic framework is that different types of data structures are combined in a single list using the generic framework. Another technical advantage is that any new display object and its data structure can be derived very easily without doing any modification in the generic framework or in the system software. Similarly new attributes can be added to any existing display object and its data structure.
[0102] Referring now to Figure 13, a layer-wise list of display objects is shown in accordance with an embodiment of the present invention.
[0103] The display objects displayed in a first layer of a display (1300) are multitext and graphical symbol. The display objects displayed in a second layer of the display (1300) are date and numeric symbol. As can be seen, different display objects appearing in a same layer on the HMI screen can be maintained in the same list. This is beneficial during the handling of screen rendering of HMI device.
[0104] Referring now to Figure 14, a schematic block diagram of an HMI programming setup (1400) is shown in accordance with an embodiment of the present invention.
[0105] The setup (1400) includes a personal computer (1404) and an HMI system (1402).
[0106] The personal computer (1404) is used to configure the HMI system (1402).
[0107] Referring now to Figure 15, a schematic block diagram of hardware components of an HMI system (1500) is shown in accordance with an embodiment of the present invention.
[0108] The HMI system (1500) includes a microcontroller (1502), a RAM (1504), a ROM (1506) storing a system program (1508), an external RAM (1510), an external ROM (1512) storing a user program (1514), digital inputs (1516), digital outputs (1518), COM PORT (1520), and TFT LCD (1528).
[0109] The TFT LCD (1528) displays the different types of display objects.
[0110] Referring now to Figure 16, a user program (1600) is shown in accordance with an embodiment of the present invention.
[0111] The user program (1600) is executed by the HMI system (1500) to display the different types of display objects on the TFT LCD (1528).
[0112] The foregoing description of the invention has been set merely to illustrate the invention and is not intended to be limiting. Since modifications of the disclosed embodiments incorporating the spirit and substance of the invention may occur to person skilled in the art, the invention should be construed to include everything within the scope of the invention.
, Claims:

1. A method of generating different types of display objects in a human-machine interface system (1500), said method comprising:
generating a plurality of reference structures (1202A, 1204A),
wherein each reference structure (1202A, 1204A) comprises a generic reference structure (1202-1, 1204-1) including a self generic reference (1202-1a,1204-1a) and a next generic reference (1202-1b,1204-1b), and
wherein each reference structure (1202A,1204A) corresponds to a type of display object;
creating a linked list (1200C) of the plurality of reference structures (1202A,1204A) such that a next generic reference (1202-1b) of a reference structure (1202A) points to a generic reference structure (1204-1) of another reference structure (1204A);
generating display objects of one or more types based on the created linked list; and
displaying the display objects on a display (1528).

2. The method as claimed in claim 1, wherein each reference structure (1202A,1204A) includes:
a plurality of common attributes (1202-1c,1204-1c) associated with every type of display object; and
a plurality of specific attributes (1202-1d,1204-1d) associated with a corresponding type of display object.

3. The method as claimed in claim 2, wherein the self generic reference (1202-1a,1204-1a) of each generic reference structure (1202-1,1204-1) within corresponding reference structure (1202A,1204A) points to the same reference structure (1202A,1204A).

4. The method as claimed in claim 1, wherein the plurality of reference structures (1202A,1204A) have same structural arrangement for their respective data structures.

5. A human-machine interface system (1500) comprising:
a display (1528) configured to display different types of display objects; and
a microcontroller (1502) configured to:
generate a plurality of reference structures (1202A, 1204A),
wherein each reference structure (1202A,1204A) comprises a generic reference structure (1202-1, 1204-1) including a self generic reference (1202-1a,1204-1a) and a next generic reference (1202-1b,1204-1b), and
wherein each reference structure (1202A,1204A) corresponds to a type of display object, and
create a linked list (1200C) of the plurality of reference structures (1202A,1204A) such that a next generic reference (1202-1b) of a reference structure (1202A) points to a generic reference structure (1204-1) of another reference structure (1204A),
generate display objects of one or more types based on the created linked list (1200C), and
wherein the display (1528) displays the display objects.

6. The human-machine interface system (1500) as claimed in claim 5, each reference structure (1202A,1204A) includes:
a plurality of common attributes (1202-1c,1204-1c) associated with every type of display objects; and
a plurality of specific attributes (1202-1d,1204-1d) associated with a corresponding type of display object.

7. The human-machine interface system (1500) as claimed in claim 6, wherein the self generic reference (1202-1a,1204-1a) of each generic reference structure (1202-1,1204-1) within corresponding reference structure (1202A,1204A) points to the same reference structure (1202A,1204A).

8. The human-machine interface system (1500) as claimed in claim 5, wherein the plurality of reference structures (1202A,1204A) have same structural arrangement for their respective data structures.