Abstract: The present invention is provided with: a storage unit which stores first screen data for displaying a screen for a programmable display device; a calling unit (123) which disposes a called image which is at least a part of a first screen on a second screen to be displayed on a terminal by using the first screen data stored in the storage unit; and an adjustment unit (124) which adjusts the size of the called image.
FORM 2
THE PATENTS ACT, 1970 (39 of 1970)
&
THE PATENTS RULES, 2003
COMPLETE SPECIFICATION [See section 10, Rule 13]
IMAGE CREATION SUPPORTING DEVICE, DISPLAY SYSTEM, AND IMAGE CREATION SUPPORTING METHOD;
MITSUBISHI ELECTRIC CORPORATION, A CORPORATION ORGANISED AND EXISTING UNDER THE LAWS OF JAPAN, WHOSE ADDRESS IS 7-3, MARUNOUCHI 2-CHOME, CHIYODA-KU, TOKYO 100-8310, JAPAN
THE FOLLOWING SPECIFICATION PARTICULARLY DESCRIBES THE INVENTION AND THE MANNER IN WHICH IT IS TO BE PERFORMED. 1
DESCRIPTION
Field
[0001] The present invention relates to an image creation supporting device, a display system, and an image creation supporting method for supporting image creation using existing screen data.
Background
[0002] A programmable display device is typically connected with a device such as a programmable logic controller (hereinafter referred to as PLC), a sensor, a driving device, and an input/output device, and used for display of a state of the device and operation of the device.
[0003] In recent years, there have been increasing demands for displaying a state of a device not only on a programmable display device but also on display devices including an Andon, a large monitor, and a portable terminal. Andon is a display device used for notification of states of production in production sites.
[0004] To address these demands, it can be expected that display of screens on display devices such as Andons, large monitors, and portable terminals is realized by using screen data created for a programmable display device. These display devices and the programmable display device are, however, typically have their screens of different sizes, and for this reason, some change would be made on the screen data created for a programmable display device. [0005] On the other hand, if screen data sets for
various screen sizes are prepared, a greater memory capacity has to be reserved for storage of these screen data sets. Patent Literature 1 discloses an image creation supporting system capable of generating screen data sets for various screen sizes while minimizing a memory capacity. The image creation supporting system described in Patent Literature 1 minimizes the memory capacity by converting screen data into relative information screen data consisting of information on relative arrangement for any given screen.
Citation List
Patent Literature
[0006] Patent Literature 1: Japanese Patent Application
Laid-open No. 2012-8893
Summary
Technical Problem
[0007] In the technique described in Patent Literature 1, conversion into a screen data set for each of various screen sizes is performed such that one and the same screen information can be displayed on display devices having various screen sizes properly depending on the respective screen sizes. In the technique described in Patent Literature 1, the expected display devices are different in screen size but are of a single type, that is, all of the expected display devices are programmable display devices, and so there is no problem because the same screen information is displayed in this manner. On the other hand, in a case where display is subjected to display devices other than programmable display device, such as Andons, large monitors, and portable terminals, it is seemingly desirable to perform displaying of screens that are not
completely the same as that of a programmable display device. For example, there may be such demands as displaying a screen displayed on a programmable display device onto a display device with additional information included in the screen, or displaying a screen displayed on a programmable display device with some part being deleted from the screen. In such a case, it is desirable that existing screen data can be screen-displayed with a size different from the size of a screen determined by the screen size. With the technique described in Patent Literature 1, however, existing screen data is converted without any change into screen data according to each screen size, and screen data needs to be rearranged when information is added or deleted in the converted screen data. Such need has been problematic.
[0008] The present invention has been made in view of the above circumstances, and an object thereof is to provide an image creation supporting device capable of easily changing the size of screen data used when the screen data is existing screen data and is used to create a display screen.
Solution to Problem
[0009] In order to solve the aforementioned problems and achieve the object, an image creation supporting device according to the present invention includes a storage unit that stores first screen data which is screen data of a first screen. The image creation supporting device includes a calling unit that places a called image which is at least part of the first screen, in a second screen, using the first screen data stored in the storage unit, and an adjustment unit that adjusts the size of the called image.
Advantageous Effects of Invention
[0010] An image creation supporting device according to the present invention produces an advantageous effect of enabling the size of screen data to be easily changed when the screen data is existing screen data and is used to create a display screen.
Brief Description of Drawings [0011]
FIG. 1 is a diagram illustrating an example configuration of a display system according to an embodiment of the present invention.
FIG. 2 is a diagram illustrating an example configuration of a computation unit of an image creation supporting device.
FIG. 3 is a diagram illustrating an example configuration of a computation unit of a terminal.
FIG. 4 is a diagram illustrating an example configuration of a control circuit.
FIG. 5 is a diagram illustrating an example of screen information including screen data created by the image creation supporting device.
FIG. 6 is a flowchart illustrating an example of a processing procedure for creation of a screen to be displayed on a terminal.
FIG. 7 is a diagram illustrating a displayed state of a creation screen for creating a new screen.
FIG. 8 is a diagram illustrating an example of a screen containing a list of screen images and a creation screen in which and a called screen is placed.
FIG. 9 is a diagram for explaining a method for calculating ratios.
FIG. 10 is a diagram illustrating an example structure of screen information in a case where a screen using a screen call is created.
FIG. 11 is a diagram illustrating an example of a screen containing a list of screen images and a screen for selecting a subject to be called.
FIG. 12 is a diagram illustrating an example of object information in a case where a subject to be called is selected in units of areas.
FIG. 13 is a flowchart illustrating an example of a processing procedure of screen display in a terminal.
FIG. 14 is a flowchart illustrating an example of a processing procedure for an automatic size adjustment in a case where two or more screens are placed based on a screen call.
FIG. 15 is a diagram illustrating an example of a screen displayed in step S42.
FIG. 16 is a diagram illustrating an example of a setting screen for whether or not to edit.
FIG. 17 is a diagram illustrating an example of screen data in a case where setting is performed for whether or not to edit.
FIG. 18 is a diagram illustrating an example of a creation screen in a case where a screen whose size is not permitted to change in its setting is called as a called screen.
Description of Embodiments
[0012] An image creation supporting device, a display system, and an image creation supporting method according to an embodiment of the present invention will now be described in detail with reference to the drawings. Note that the present invention is not necessarily limited by
the embodiment.
[0013] Embodiment.
FIG. 1 is a diagram illustrating an example configuration of a display system according to an embodiment of the present invention. A display system 5 according to the embodiment includes an image creation supporting device 1, a display device 2, and a terminal 3. The display device 2 can be connected to an external device 4. FIG. 1 illustrates an example in which the display device 2 is connected to the external device 4.
[0014] The external device 4 is such a device as a PLC, a sensor, a driving device, or an input/output device. The display device 2 is a programmable display device, which displays the state of the external device 4. The display device 2 also receives an operation on the external device 4 from a user. The image creation supporting device 1 is a device capable of supporting creation of a screen to be displayed on the display device 2 and storing screen data that are data presenting the created screen. In addition, the image creation supporting device 1 of the present embodiment is capable of generating screen data that can be displayed on the terminal 3 using the screen data that are data of a screen created for the display device 2. Hereinafter, data of a first screen created for the display device 2 will be referred to as existing screen data or first screen data. While an example in which the display device 2 of the present embodiment is a programmable display device will be described, the display device 2 may be any display device compatible with existing screen data and is not limited to a programmable display device.
[0015] The terminal 3 is a terminal having a function of communicating with a display unit such as a display or a monitor. The terminal 3 is an Andon, a large monitor, or a
smartphone, a tablet, for example. While one terminal 3 is illustrated in FIG. 1, the number of terminals 3 may be more than one. In the case where the display system 5 includes a plurality of terminals 3, the terminals 3 may be different types of devices from one another. For example, the terminals 3 may include a mix of a smartphone, an Andon, and a large monitor. In the present embodiment, the terminal 3 is capable of displaying a screen which uses at least part of existing screen data created for the display device 2.
[0016] The image creation supporting device 1 of the present embodiment is capable of placing at least part of the existing screen data in a new screen currently being created when creating screen data of the new screen. Placement of the existing screen data into a new screen in this manner is referred to as a screen call. A user can use the image creation supporting device 1 to place the existing screen data in a new screen by using a screen call and further place another drawing object in the new screen, for example.
[0017] Note that image data called by the screen call described above is typically placed with a fixed size in a new screen. Since a screen call is typically used in creation of a new screen for the display device 2, the size is suitable for the display device 2. The terminal 3, however, typically has a screen size different from the screen size of the display device 2. In addition, the purpose of displaying on the terminal 3 may be different from the purpose of displaying on the display device 2, and the size of the screen that the user wants to display on the terminal 3 is not necessarily the same as size of the screen to be displayed on the display device 2. The image creation supporting device 1 of the present embodiment
receives a change in the size of screen data called by a screen call. In this way, the image creation supporting device 1 can easily change the size of the existing screen data to be displayed when using the existing screen data to create a new screen to be displayed on the terminal 3. [0018] In addition, when using part of the existing screen data to create screen data for the terminal 3, a common image creation supporting device generates screen data obtained by extracting necessary part from the existing screen data, and places the generated screen data by a screen call. In contrast, the image creation supporting device 1 of the present embodiment enables placement in a newly-created screen in units of objects placed in called screen data. This allows a user to easily create a screen for which part of the existing screen data is used. Hereinafter, detailed description is given for configurations and operations of components constituting the display system 5 of the present embodiment. [0019] As illustrated in FIG. 1, the image creation supporting device 1 includes a communication unit 11, a computation unit 12, a storage unit 13, a display unit 14, and an input unit 15. The communication unit 11 communicates with a communication unit 21 of the display device 2, described later. The communication between the communication unit 11 and the communication unit 21 may be cable communication or radio communication. The computation unit 12 performs computation in the image creation supporting device 1. More specifically, the computation unit 12 performs processing including an image creation supporting processing of the present embodiment. Details of the computation unit 12 will be described later. The storage unit 13 stores image information that is a set of screen data generated by the computation unit 12. In
other words, the storage unit 13 stores screen information including first screen data that is screen data for the display device 2. The display unit 14 displays image data including screen data in accordance with an instruction from the computation unit 12. Examples of the display unit 14 include a display and a monitor. The input unit 15 receives an input from a user, and outputs the received information to the computation unit 12. Examples of the input unit 15 include a keyboard and a mouse. The display unit 14 and the input unit 15 may be integrated with each other such that a touch panel or the like may implement the display unit 14 and the input unit 15. [0020] FIG. 2 is a diagram illustrating an example configuration of the computation unit 12 of the image creation supporting device 1. The computation unit 12 includes an image creation support processing unit 121 that performs the image creation support processing. The image creation support processing unit 121 includes a creation unit 122, a calling unit 123, an adjustment unit 124, and a data generation unit 125. The creation unit 122 creates screen data to be displayed on a device equipped with a display part, such as the display unit 2 or the terminal 3. The calling unit 123 controls screen calls. Specifically, the calling unit 123 places a called image that is at least part of a first screen, in a second screen that is a new screen being created, using first screen data stored in the storage unit 13. The called image is an image to be placed in the screen being created, which is the entire or part of the first screen data that is the existing screen data. The adjustment unit 124 carries out adjustment of the size of a called image that is at least part of a screen called by a screen call. The data generation unit 125 adds call information that is information relating to a called screen,
to the screen data.
[0021] The description refers back to FIG. 1. As illustrated in FIG. 1, the display device 2 includes the communication unit 21, a computation unit 22, a storage unit 23, a display unit 24, and an input unit 25. The communication unit 21 communicates with the communication unit 11 of the image creation supporting device 1, and with a communication unit 31 of the terminal 3 described later. The communication between the communication unit 21 and the communication unit 31 may be cable communication or radio communication. The communication between the communication unit 21 and the communication unit 11 and the communication between the communication unit 21 and the communication unit 31 may use the same communication system or different communication systems.
[0022] The computation unit 22 performs computation for the display device 2. More specifically, the computation unit 22 performs such processes as displaying screen data received from the image creation supporting device 1 via the communication unit 21 on the display unit 24 and executing computation based on information inputted by a user and received by the input unit 25. In addition, upon receiving a request for acquisition of screen information from the terminal 3 via the communication unit 21, the computation unit 22 reads the screen information from the storage unit 23 and transmits the screen information to the terminal 3 via the communication unit 21. For example, the computation unit 22 has a web server function, and causes the terminal 3 to download the screen information using the web server function. The computation unit 22 also acquires information indicating the state of the external device 4 from the external device 4, and reflects the acquired information in screen data to be displayed on the display
unit 24. The storage unit 23 stores screen information received from the image creation supporting device 1 via the communication unit 21. The display unit 24 displays screen data in accordance with an instruction from the computation unit 22. Examples of the display unit 24 include a display and a monitor. The input unit 25 receives an input from a user, and outputs the received information to the computation unit 22. Examples of the input unit 25 include a keyboard and a mouse. The display unit 24 and the input unit 25 may be integrated with each other using a touch panel or the like to implement the display unit 24 and the input unit 25. [0023] In addition, as illustrated in FIG. 1, the terminal 3 includes the communication unit 31, a computation unit 32, a storage unit 33, a display unit 34, and an input unit 35. The communication unit 31 communicates with the communication unit 21 of the display device 2. The computation unit 32 performs computation for the terminal 3. Details of the computation unit 32 will be described later. More specifically, the computation unit 32 displays screen data received from the display device 2 via the communication unit 31 on the display unit 34, for example. The display unit 34 displays screen data in accordance with an instruction from the computation unit 32. Examples of the display unit 34 include a display and a monitor. The input unit 35 receives an input from a user, and outputs the received information to the computation unit 32. Examples of the input unit 35 include a keyboard and a mouse. The display unit 34 and the input unit 35 may be integrated with each other using a touch panel or the like to implement the display unit 34 and the input unit 35. [0024] FIG. 3 is a diagram illustrating an example configuration of the computation unit 32 of the terminal 3.
The computation unit 32 includes a display processing unit 321 that performs a display process of the present embodiment. The display processing unit 321 includes an acquisition unit 322 and a display control unit 323. The acquisition unit 322 acquires screen information stored in the storage unit 23 of the display device 2 via the communication unit 31, and stores the screen information in the storage unit 33. In the case where the display device 2 has the web server function, the acquisition unit 322 is implemented by some functions of a browser. A user downloads the screen information from the display device 2 by operating the input unit 35 of the terminal 3. The display control unit 323 reads screen data to be displayed from the screen information stored in the storage unit 33, adjusts a called screen using called screen information added to the screen data, and then displays the screen data. [0025] Next, a hardware configuration of the computation unit 12, the computation unit 22, and the computation unit 32 described above will be described. The computation unit 12, the computation unit 22, and the computation unit 32 are processing circuits. The processing circuit may be a control circuit equipped with a processor or a dedicated hardware set. FIG. 4 is a diagram illustrating an example configuration of a control circuit. In a case where the above-described processing circuit is a control circuit, the control circuit is a control circuit 900 having a configuration illustrated in FIG. 4, for example. [0026] The control circuit 900 includes a processor 901 and a memory 902. The processor 901 is a CPU (also referred to as central processing unit, a central processing device, a processing device, a computing device, a microprocessor, a microcomputer, a processor, or a DSP (digital signal processor), or the like. The memory 902 is
nonvolatile or volatile semiconductor memory such as a random access memory (RAM), a read only memory (ROM), or a flash memory, or a magnetic disk or the like, for example.
[0027] In a case where a processing circuit is the control circuit 900 including the processor, the processing circuit is implemented by the processor 901 reading and executing programs describing processes of the components, stored in the memory 902. The memory 902 is also used as a temporary memory in each process performed by the processor 901.
[0028] In a case where a processing circuit is a dedicated hardware set, the processing circuit is an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), or any combination thereof, for example.
[0029] Next, operation in the present embodiment will be explained. FIG. 5 is a diagram illustrating an example of screen information including screen data created by the image creation supporting device 1 of the present embodiment. As described above, the screen information is stored in the storage unit 13 of the image creation supporting device 1. FIG. 5 illustrates a state in which n screens from screen 1 to screen n (n is an integer of 1 or larger) have already been created by a user. The screen information includes screen attribute information 7 that is attribute information for each screen. In addition, screen data corresponding to one screen include screen attribute information 7 and object information that is information on each object placed in the screen. In FIG. 5, for example, screen data 6 that is screen data corresponding to a screen 1 includes screen attribute information 61 and an object information group 62 that is a set of the object information. The screen attribute information 61 includes
"screen 1" as information for identifying the screen, and also includes attribute information of the screen 1. In addition, in the example illustrated in FIG. 5, m objects AAA1-1 to AAAl-m (m is an integer of 1 or larger) are to be placed in the screen 1. Thus, the object information group 62 includes an object information piece associated with each of the m objects. The object information piece includes the type and identification information of an object and attribute information of the object. AAA1-1 and so on represent the types and the identification information of the objects. AAA is information representing the type of an object, and numerals and symbols such as 1-1, 1-m, and so on following AAA each represent a number specifying a screen and a number of an object of the same type within the same screen. For example, AAAl-1 represents a first object of the AAA type in the screen 1, AAAl-m represents an m-th object of the AAA type in the screen 1, and AAA2-1 represents a first object of the AAA type in a screen 2. Other screen data constituting the screen information has the same structure as the structure of the screen data 6, but the contents of attribute information and the number of objects for the other screen data are determined depending on a screen or screens. An object of each type is generated in advance in the form of an image. For example, in a case where a type of objects is a meter, images of meters are generated as objects in advance. The image information includes image data of these objects generated in advance. Alternatively, image data corresponding to each object may be included in object information of the screen data.
[0030] Screen data set constituting screen information are created by the creation unit 122. The creation unit 122 generates screen data of a screen to be displayed on
the display device 2 on the basis of an operation received from a user. The method for generating screen data of a screen to be displayed on the display device 2 is not particularly limited, and any typical methods can be used therefor. For example, upon receiving an instruction to start creation of screen data via the input unit 25, the creation unit 122 displays a creation screen in blank for new creation on the display unit 24. The creation unit 122 displays a list of objects that can be selected on the display unit 24, and a user selects the objects and sequentially places the objects in the creation screen for new creation via the input unit 25, for example. As a result, the objects are arranged in the screen for new creation. When the objects are arranged in the screen and an instruction to save the screen is inputted via the input unit 25, the creation unit 122 stores data representing the screen in which the objects are arranged, as screen data, in the storage unit 13.
[0031] Next, creation of a screen to be displayed on the terminal 3 of the present embodiment will be explained. FIG. 6 is a flowchart illustrating an example of a procedure for creation of a screen to be displayed on the terminal 3 of the embodiment. When an instruction to start creation of a screen to be displayed on the terminal 3 is inputted via the input unit 15, a process illustrated in FIG. 6 is started. The creation unit 122 first displays a creation screen for new creation on the display unit 14 (step S1). FIG. 7 is a diagram illustrating an example of a state in which a creation screen for creating a new screen is displayed. In the example illustrated in FIG. 7, a creation screen 101 for creating a new screen and a menu bar 102 are displayed on the display unit 14. The menu bar 102 includes a screen call button 103. When a user wants
to place existing screen data in the creation screen 101 to be displayed on the terminal 3 by a screen call, the user clicks the screen call button 103 with the input unit 15, when the input unit 15 is a mouse. As a result, the screen call is selected.
[0032] Subsequently, when the screen call is selected via the input unit 15 (step S2: Yes), the calling unit 123 displays a list of screen images on the display unit 14, and receives selection of a screen to be called (step S3). The list of screen images is display of a list of images corresponding to screen data. Images corresponding to screen data refer to reduced-size images of screens represented by the screen data, for example. Alternatively, a list of names or identification information of screen data, or the like may be displayed as a list of screen images. Hereinafter, an example in which reduced-size images of screens corresponding to screen data are displayed as the list of screen images will be explained.
[0033] Subsequently, the calling unit 123 determines whether or not an instruction to select a subject to be called is made (step S4). Selecting a subject to be called is a process for placing objects in the screen called by the screen call, into the new screen in units of objects, not for placing the entire screen into the new screen. In selecting a subject to be called, the user selects an object to be placed into the new screen, that is, an object to be called via the input unit 15.
[0034] When an instruction to select a subject to be called is not made (step S4: No), the calling unit 123 places the called screen in the creation screen (step S7). When an instruction to select a subject to be called is not made, the entire called screen is placed in the creation screen. That is, in this case, the called image is a first
screen. FIG. 8 is a diagram illustrating an example of a screen containing a list of screen images and a creation screen in which a called screen is placed. The left part of FIG. 8 illustrates an example of a screen 200 containing a list of screen images 201, and the right part of FIG. 8 illustrates an example of a creation screen in which a called screen is placed. In the example illustrated in FIG. 8, the list of screen images 201 is displayed together with a button 202 that is a button for "selecting a subject to be called", an OK button 203, and a cancel button 204 in the screen 200. In the list of screen images 201, an image 205 that is a reduced-size image of a screen 1, and an image 206 that is a reduced-size image of a screen 2 are displayed. When the user selects the image 205 from the list of screen images 201 and clicks the OK button 203 via the input unit 15, screen data of the screen 1 corresponding to the image 205 is placed in the creation screen 101. A called screen 207 represents the screen 1 corresponding to the image 205 placed in the creation screen 101. When the called screen 207 is placed in the creation screen 101, a handle 208 is displayed together with the called screen 207. The user can operate the handle 208 via the input unit 15 to change the size of the called screen 207. Note that, before the size adjustment, the called screen 207 is displayed in the creation screen 101 with the same size as the screen displayed on the display device 2, for example.
[0035] When size adjustment of the called screen is received (step S8: Yes), the adjustment unit 124 calculates a ratio from the size obtained by the size adjustment, and sets the calculated ratio in the screen data (step S9). Specifically, for example, when an enter button, which is not illustrated, or the like is clicked after the handle
208 is operated, the calling unit 123 determines that size adjustment of the called screen is received. When an enter button, which is not illustrated, or the like is clicked without operation of the handle 208, the calling unit 123 determines that size adjustment of the called screen is not received.
[0036] FIG. 9 is a diagram for explaining a method for calculating a ratio. The left part of FIG. 9 illustrates a screen 301 created for the display device 2, and the right part of FIG. 9 illustrates a creation screen 302 currently being created for display on the terminal 3. A screen 301 in FIG. 9 is called by a screen call and placed as a called screen 303 in the creation screen 302. As illustrated in FIG. 9, this example is based on the assumption that the screen 301 has a size of SXlxSYl, the creation screen 302 has a size of DX×DY, and the called screen resulting from size adjustment has a size of 0X1×0Y1. In this case, the adjustment unit 124 calculates ratios X and Y by the following expression (1). Note that SX1, DX, and 0X1 represent values in the horizontal direction, that is, in the X axis direction, and SY1, DY, and OY1 represent values in the vertical direction, that is, in the Y axis direction. In addition, the ratio X represents the ratio in the horizontal direction, and the ratio Y represents the ratio in the vertical direction.
X=0X1÷SX1, Y=GY1÷SY1 ...(1) [0037] In the present embodiment, the ratios are used as information indicating the size of a called image, and the ratios are information indicating the ratios of the size of a called image to the size of a first screen as shown by the above expression (1).
[0038] The adjustment unit 124 also calculates start point coordinates (PX1, PY1) of the called screen 303 in
the creation screen 302. In the example illustrated in FIG. 9, start point coordinates of a switch object 304, which is an object in the screen 301, are (soxl, soyl), and start point coordinates of a switch object 305, which corresponds to the switch object 304, in the creation screen 302 are (doxl, doyl). (soxl, soyl) and (doxl, doyl) satisfy the relation expressed by the following expression (2). Note that, hereinafter, coordinate values for screens have a positive sense in the leftward direction of the horizontal direction and have a positive sense in the upward direction of the vertical direction, respectively.
doxl=PXl+soxl×X,
doyl=PYl+soyl×Y ...(2) [0039] If size adjustment of the called screen is not received (step S8: No), the data generation unit 125 determines whether or not an instruction to terminate creation of the screen is received (step S10), and if the instruction is received (step S10: Yes), the data generation unit 125 stores screen data corresponding to the creation screen in the storage unit 13 and terminates the process. At this point, if size adjustment has been performed, the data generation unit 125 generates object information associated with the called screen using the ratios calculated by the adjustment unit 124 and adds the generated object information to the screen data. If an instruction to terminate creation of the screen is not received (step S10: No), the image creation support processing unit 121 repeats the process from step S2. [0040] FIG. 10 is a diagram illustrating an example structure of screen information in a case where a screen using a screen call is created. In the example illustrated in FIG. 10, a screen 1 is a screen created for the display device 2, and a screen 2 is a screen created for the
terminal 3. The screen 1 is placed in the screen 2 by a screen call. Thus, object information associated with the screen 2 includes information on a called screen 2-1 that is a called screen placed in the screen 2. In this example, a called screen is also treated as one object in this manner. Attribute information of the called screen 2-1 includes the aforementioned ratios X and Y. In the example illustrated in FIG. 10, attribute information of each screen includes a screen identifier (ID) and a size, and attribute information associated with an object includes an object ID, a size, and start point coordinates. Start point coordinates are coordinates of the upper-left end of an object in a screen. An object has a square or rectangular shape, and even if a drawn object has a circular shape, for example, the object is regarded as a square or rectangular shape including the circle. A screen ID is a number for identifying a screen. In a case where an object is a called screen, the attribute information includes an object ID, a screen ID that is an ID of the called screen, a target object ID, a called area, start point coordinates, and ratios. An object ID is a number for identifying an object. A target object ID and a target area are used in a case where instruction to select a subject to be called is made, described later. The object ID and the target area will be described later. Note that, in a case where the color of an object can be changed, a color may be included in the attribute information of each object.
[0041] If an instruction to select a subject to be called is made in step S4 (step S4: Yes), the calling unit 123 displays a screen for selecting a subject to be called on the display unit 14 (step S5). If an instruction to select a subject to be called is made, a called image is
specified in units of objects which are images constituting an area or a called screen. The selection screen to be called is a screen for receiving selection of an object to be called. After step S5, the calling unit 123 determines whether or not a subject to be called is selected (step S6), and if a subject to be called is selected (step S6: Yes), the calling unit 123 places the subject to be called, in the creation screen (step S7). A subject to be called is specified in units of areas or in units of objects, for example, as described later. In a case where a subject to be called is specified in units of areas, an object contained in the specified area is an object to be called. If no subject to be called is selected (step S6: No), the calling unit 123 repeats step S6.
[0042] FIG. 11 is a diagram illustrating an example of a screen containing a list of screen images and a screen for selecting a subject to be called. The left part of FIG. 11 illustrates a screen 200 containing a screen image list 201, the central part of FIG. 11 illustrates an example of a screen 310 for selecting a subject to be called, and the right part of FIG. 11 illustrates a creation screen 101. The screen 200 is the same as that in the example illustrated in FIG. 8. When the button 202, which is a button for "selecting a subject to be called", is selected after an image is selected in the screen image list 201 in the screen 200, the screen 310 for selecting a subject to be called is displayed. In the screen 310 for selecting a subject to be called, a screen corresponding to the image selected in the screen image list 201, that is, a called screen is displayed. In the called screen displayed in the screen 310 for selecting a subject to be called, an object in the called screen can be selected in units of areas or in units of objects. When selecting it in units of objects,
the user checks a radio button of "individually select" at an upper position in the screen 310 for selecting a subject to be called, and when selecting it in units of areas, the user checks a radio button of "select area" at the upper position in the screen 310 for selecting a subject to be called.
[0043] The example illustrated in FIG. 11 presents a state in which "select area" is checked, and a selected area 311 is selected. The user selects the selected area
311 by a drag operation, for example. When the selected area 311 is selected, a part of the called screen corresponding to the selected area 311 is placed as an area
312 in the creation screen 101. Similarly to the case illustrated in FIG. 8, the user can adjust the size of the area 312 with a handle. Note that, in a case where "individually select" is checked, selection in units of objects can be made in the screen 310 for selecting a subject to be called, and a selected object is placed in the creation screen 101. Similarly to the case illustrated in FIG. 8, the user can adjust the size of the placed object with a handle.
[0044] FIG. 12 is a diagram illustrating an example of object information in a case where a subject to be called is selected in units of areas. In the example illustrated in FIG. 12, a screen 1 is called as a called screen from screen information into a screen 2, and a partial area of the screen 1 is selected as a subject to be called. In the example of FIG. 12, an object corresponding to the subject to be called is a called screen 2-1. In the example illustrated in FIG. 12, start point coordinates and end point coordinates of the selected area are stored as a target area in the object information of the called screen 2-1. Note that the start point coordinates and the end
point coordinates are represented by coordinate values in the screen 1. The start point coordinates are coordinates of the upper-left end and the end point coordinates are coordinates of the lower-right end of the target area. In a case where a subject to be called is selected in units of objects, an object ID associated with a selected object in the screen 1 is stored as a target object ID. For example, in a case where a meter 1-1, which is an object included in the screen 1, is selected as an object to be called to be placed in the screen 2, "001" that is the object ID of the meter 1-1 is stored as the target object ID in the object information of a called screen 2-1.
[0045] The description refers back to FIG. 6, in which the calling unit 123 proceeds to step S8 after step S7, followed by step S9 and subsequent steps. As described with reference to FIG. 11, however, in step S8 in the case where a subject to be called is selected, the size of a selected area or a selected object is adjusted instead of the entire called screen. Thus, in step S9 in the case where a subject to be called is selected, the calling unit 123 uses the size of the selected area having been adjusted in size or the size of the selected object having been adjusted in size as OXlxOYl in calculation of the ratios according to the expression (1).
[0046] If the screen call is not selected in step S2 (step S2: No), the calling unit 123 proceeds to step S10. In addition, if size adjustment of the called screen is not received in step S8 (step S8: No), the calling unit 123 proceeds to step S10. In this case, the ratios X and Y are both set to 1.
[0047] While the operation in the case where the screen call is selected is explained in the above description, a process other than the screen calling, such as placing of a
new object in a creation screen, may be performed. A process other than the screen calling is performed at any timing of processes illustrated in FIG. 6.
[0048] As described above, in the image creation supporting device 1, screen data for the terminal 3 is generated, and the generated screen data is stored in the storage unit 13. The display device 2 acquires screen information containing the screen data for the terminal 3 from the image creation supporting device 1, and stores the acquired screen information in the storage unit 23. The terminal 3 acquires the screen information from the display device 2, and performs display of a screen using the screen data for the terminal 3 contained in the screen information. Alternatively, the terminal 3 may acquire the image information from the image creation supporting device 1 without using the display device 2.
[0049] FIG. 13 is a flowchart illustrating an example of a processing procedure of screen display on the terminal 3. First, the terminal 3 acquires screen information from the display device 2 (step S21). More specifically, the acquisition unit 322 of the terminal 3 transmits a request for acquisition of screen information to the display device 2 via the communication unit 31. The computation unit 22 of the display device 2 then transmits the screen information stored in the storage unit 23 to the terminal 3 via the communication unit 21. The acquisition unit 322 of the terminal 3 receives the screen information transmitted from the display device 2 via the communication unit 31, and stores the screen information in the storage unit 33. While an example in which the terminal 3 acquires the whole screen information is explained here, the terminal 3 may alternatively acquire screen data corresponding to a screen to be displayed and screen data called from the screen data.
Specifically, in this case, the terminal 3 checks whether a called screen is in screen data on the basis of the screen information, and if the called screen is in the screen data, the terminal 3 acquires the relevant screen data, for example.
[0050] Subsequently, the display control unit 323 of the terminal 3 acquires information of the called screen, that is, object information of the called screen from the screen data to be displayed (step S22). More specifically, the display control unit 323 extracts screen data to be displayed from the screen information in storage unit 33, and acquires information of the called screen, that is, object information of the called screen from the screen data. As illustrated in FIG. 12, the object information of the called screen includes an object ID, a screen ID, a called object, a called area, and ratios. Note that among these information items, an empty of a value indicating that nothing is set is stored in an information item that is not set. For example, in a case of calling in units of screens, the target object and the target area are unset information items.
[0051] Next, the display control unit 323 acquires a screen ID from the information of the called screen, that is, the object information of the called screen (step S23). Subsequently, the display control unit 323 determines whether or not the target object ID is set in the information of the called screen, that is, the object information of the called screen (step S24). When the target object ID is set (step S24: Yes), the display control unit 323 sets the object with the target object ID of the acquired screen ID to be a subject to be displayed (step S25). More specifically, the display control unit 323 searches the screen information in the storage unit 33
for screen data of the acquired screen ID, and searches the object information of the screen data obtained by the search for information including the object ID corresponding to the target object ID mentioned above. The display control unit 323 sets the object of the object ID obtained by the search as a subject to be displayed.
[0052] Subsequently, the display control unit 323 calculates the size with which the subject to be displayed is displayed and coordinates at which the subject to be displayed is displayed, from the ratios X and Y in the information of the called screen, that is, the object information of the called screen (step S26). The size and coordinates when displaying the subject to be displayed are the size and the start point coordinates of the called screen or the subject to be called when the called screen or the subject to be called is displayed. More specifically, the display control unit 323 calculates the size and coordinates of displayed form of the subject to be displayed, using the ratios X and Y in the object information. A method of calculating the size and coordinates of the subject to be displayed will be described later.
[0053] The display control unit 323 displays the subject to be displayed on the display unit 34 on the basis of the calculated size and coordinates (step S27), and terminates the process. Note that, in a case where a subject other than the called screen is displayed in the creation screen created for display on the terminal 3, an object is subsequently displayed on the basis of the screen data.
[0054] If the target object ID is not set in step S24
(step S24: No), the display control unit 323 determines whether or not the target area is set (step S28). If the target area is set (step S28: Yes), the display control
unit 323 sets the object in the target area of the screen associated with the screen ID acquired in step S23 to be a subject to be displayed (step S29), and proceeds to step S26.
[0055] If the target area is not set (step S28: No), the display control unit 323 sets all the objects in the screen associated with the screen ID acquired in step S23 to be subjects to be displayed (step S30), and proceeds to step S26.
[0056] The method of calculating displaying size and coordinates in step S26 will now be described. The display control unit 323 determines the size and the start point coordinates of each object in a display screen to be displayed on the display unit 34 as follows. The size of the entire display screen to be displayed on the display unit 34, that is, the creation screen described above is represented by (DX, DY). In a case where the subject to be displayed is an object specified by the target object ID, the display control unit 323 acquires the size (rx1, ry1) of the object from the object information of the object associated with the target object ID in the screen data associated with the screen ID acquired in step S23. The display control unit 323 also extracts the start point coordinates (PX1, PY1) from the object information of the called screen acquired in step S22. The display control unit 323 calculates the size (0X1', 0Y1') with which the object is displayed and the start point coordinates (PX11, PY1') at which the object is displayed by the following expressions (3) and (4).
PX1'=PX1, PY1'=PY1 ...(3)
0Xl'=rxl×X, OYl'=ryl×Y ...(4) [0057] In a case where the subject to be displayed is an object in a target area, the display control unit 323
extracts the start point coordinates and end point coordinates of the target area from the object information of the called screen acquired in step S22. The display control unit 323 extracts the object information of the object included in the target area among the screen data associated with the screen ID acquired in step S23 on the basis of the extracted start point coordinates and end point coordinates and the object information of the screen data associated with the screen ID. The display control unit 323 then acquires the start point coordinates (bx1, by1) of each object and the size (rx1, ry1) of each object. For each object to be displayed, the display control unit 323 calculates the size (0X1', 0Y1') of the object to be displayed and the start point coordinates (PX1', PY1') of the object to be displayed, by the following expressions (5) and (6). (PX1, PY1) is start point coordinates included in the object information of the called screen acquired in step S22.
PXl'=PXl+bxl×X,
PYl'=PYl+byl×Y ...(5)
0Xl'=rxl×X, 0Yl'=ryl×Y ...(6) [0058] In a case where the subject to be displayed is an object in a target area, the display control unit 323 calculates, for all the objects constituting the screen data associated with the screen ID acquired in step S23, the size (0X1', 0Y1') of the object to be displayed and the start point coordinates (PX1', PY1') of the object to be displayed on the basis of the object information by the above expressions (5) and (6).
[0059] The image creation supporting device 1 of the present embodiment may further automatically perform size adjustment as follows in a case where two or more screens are placed by a screen call. FIG. 14 is a flowchart
illustrating an example of a processing procedure of automatic size adjustment in a case where two or more screens are placed by a screen call. When an instruction to start creation of a screen to be displayed on the terminal 3 is inputted via the input unit 15, a process illustrated in FIG. 14 is started. The creation unit 122 first displays a creation screen for creating a new screen on the display unit 14 (step S41). Subsequently, the calling unit 123 determines whether or not a call for two or more screens is selected (step S42). Selection of a call for two or more screens is based on a button for selecting a call for a plurality of screens, the button being provided on the menu bar 102 illustrated in FIG. 7, and in response to a click of this button, the call for the screens is selected. If the call for screens is not selected (step S42: No), the calling unit 123 terminates the process.
[0060] If the call for screens is selected (step S42: Yes), the calling unit 123 displays a screen image list on the display unit 14 (step S43). FIG. 15 is a diagram illustrating an example of a screen displayed in step S42. In the left part of FIG. 15, a screen 500 including a screen image list 501 is displayed on the display unit 14. In the screen 500, a check box 502 for setting whether or not to specify the number of partitions for display, an entry field 503 for inputting the number of vertical partitions, and an entry field 504 for inputting the number of horizontal partitions are displayed. For specifying the number of partitions for display, the user can check the check box 502, and input numerical values in the entry field 503 and the entry field 504. The number of partitions is a value indicating the number of areas into which the creation screen is divided for display. For
example, in a case where the number of horizontal partitions is specified to be two and the number of vertical partitions is specified to be two, the creation screen is horizontally divided into two and vertically divided into two, and so a total of four divisional areas are thus defined. A called screen can be placed in each of the divisional areas.
[0061] When screens, that is, called screens and the number of partitions are selected (step S44 Yes), the calling unit 123 determines ratios and arrangement depending on the number of partitions for the called screens arranged in the divisional areas obtained by the division (step S45). The arrangement is indicated by start point coordinates, for example. The calling unit 123 arranges the selected called screens in the creation screen on the basis of the determined ratios and arrangement (step S46). The right part of FIG. 15 illustrates a state in which a plurality of called screens is displayed in the creation screen 101.
[0062] This example is based on the assumption that the number of divisional areas obtained by the division and the number of selected screens are equal. When the number of selected screens is larger than the number of divisional areas obtained by the division, the calling unit 123 may make an error indication, or may arrange some of the selected called screens in the creation screen. When the number of the selected called screens is smaller than the number of divisional areas, the calling unit 123 does not place any called screen in some of the divisional areas.
[0063] In step S45, the calling unit 123 determines the ratios X and Y and the start point coordinates for each called screen as follows, for example. Assume that the size of the creation screen is DX×DY, the number of
horizontal partitions is KX, the number of vertical partitions is KY, and the original size of the called screen created for the display device 2 is (SX1, SY1). In this case, the ratios X and Y are calculated by the following expression (7).
X=(DX÷KX)÷SX1, Y=(DY÷KY)÷SY1 ...(7) [0064] The start point coordinates (PXi,j, PYi,j)of a called screen placed at the i-th position from the left-hand end (i is an integer of 1 or larger) and the j-th position from the top (j is an integer of 1 or larger) are calculated by the following expression (8).
PXi,j=(i-l) × (DX÷KX) ,
PYi,j=(j-l)×(DY÷KY) ...(8) [0065] Which called screen is an area and in which area the called screen is placed may be determined using any predetermined rule, or may be selected by the user. [0066] The description refers back to FIG. 14, in which, after step S4 6, it is determined whether or not an instruction to terminate creation of the screen is received (step S47) similarly to step S10 of FIG. 6, and if the instruction is received (step S47: Yes), the screen data corresponding to the creation screen is stored in the storage unit 13 and the process is ended. On this occasion, the data generation unit 125 generates object information for the called screen using the calculated ratios and start point coordinates, and adds the generated object information to the screen data. If the instruction to terminate creation of the screen is not received (step S47: No), the image creation support processing unit 121 repeats the process from step S42. A normal calling process is the process from step S2 of FIG. 6.
[0067] As described above, the screen information including the screen data corresponding to the creation
screen in which a number of called screens are arranged is received by the terminal 3 via the display device 2 similarly to the screen information including the screen data created by the process of FIG. 6. The terminal 3 can display the screen in which two or more called screens are arranged, by the process illustrated in FIG. 13 using the screen information. Specifically, in this case, the called images originate from two or more first screens, and the calling unit 123 receives an input of the number of partitions for dividing a new screen, calculates the positions of arrangement and the sizes of the first screens for arranging the first screens in the new screen on the basis of the number of partitions, and arranges the first screens in the second screen on the basis of the calculated positions of arrangement and sizes.
[0068] The image creation supporting device 1 of the present embodiment may further set information on whether or not editing is permitted for each screen. The creation unit 122 receives, for each screen, a setting operation for whether or not editing is permitted when the screen is called as a called screen from the user via the input unit 15. Specifically, when a first screen is used as a called image, the creation unit 122 receives an input of information indicating whether or not editing of the called image is permitted. FIG. 16 is a diagram illustrating an example of a screen for setting whether or not editing is permitted. A setting screen 401 illustrated in FIG. 16 is displayed on the display unit 14 at the time of creation of a screen, for example. The setting screen 401 includes a check box 402 for setting whether or not a change in size is permitted, and a check box 403 for setting whether or not a change in color is permitted. The setting screen 401 further includes a check box 404 for setting whether or not
a change in position is permitted, a check box 405 for setting whether or not addition of an object is permitted, and a check box 406 for setting whether or not deletion of an object is permitted. The creation unit 122 receives setting of whether or not various items of edition are permitted by the setting screen 401 illustrated in FIG. 16, for example.
[0069] FIG. 17 is a diagram illustrating an example of screen data in a case where whether or not editing is permitted is set. As illustrated in FIG. 17, the screen data include information indicating whether or not editing is permitted for each of edit items for which setting of editable or non-editable is performed. Specifically, the first screen data includes information indicating whether or not editing is permitted. The information indicating whether or not editing is permitted has "1" for an editable state or "0" for a non-editable state, for example. In addition, in FIG. 17, an example in which the color of each object can be changed is illustrated, and color is included in attribute information. FIG. 18 is a diagram illustrating an example of a creation screen in a case where a screen set as change in size not being permitted is called as a called screen. In the example illustrated in FIG. 18, a handle for changing the size is not displayed in a called screen 600. When a screen set as change in size being permitted is called, a handle is displayed to enable change in size thereof.
[0070] As described above, in the present embodiment, a change in size of an existing screen to be placed in a new screen is accepted in creation of the new screen to be displayed on a device other than the device on which the existing screen is displayed, using the existing screen. This enables the size of existing screen data to be easily
changed when the existing screen data is used to create a display screen. In addition, in the present embodiment, a subject to be placed in a new screen can be selected in units of areas or in units of objects in an existing screen. This enables a new screen to be flexibly created depending on the size of a device on which the screen is to be displayed, the purpose of display, and the like. [0071] The configurations presented in the embodiment above are examples of the present invention, and can be combined with other publicly known techniques and partly omitted and/or modified without departing from the scope of the present invention.
Reference Signs List
[0072] 1 image creation supporting device; 2 display device; 3 terminal; 5 display system; 11, 21, 31 communication unit; 12, 22, 32 computation unit; 13, 23, 33 storage unit; 14, 24, 34 display unit; 15, 25, 35 input unit; 121 image creation support processing unit; 122 creation unit; 123 calling unit; 124 adjustment unit; 125 data generation unit.
We Claim
1. An image creation supporting device comprising:
a storage unit to store first screen data that is screen data of a first screen;
a calling unit to place a called image in a second screen using the first screen data stored in the storage unit, the called image being at least part of the first screen; and
an adjustment unit to adjust a size of the called image.
2. The image creation supporting device according to claim 1, wherein the called image is an image of the first screen.
3. The image creation supporting device according to claim 1, wherein the called image is specified by an area of the first screen.
4. The image creation supporting device according to claim 1, wherein the called image is specified in units of objects, the objects being images constituting the first screen.
5. The image creation supporting device according to any one of claims 1 to 4, wherein information indicating a size of the called image is added to screen data of the second screen.
6. The image creation supporting device according to claim 5, wherein the information indicating the size is information indicating a ratio of a size of the called
image to a size of the first screen.
7. The image creation supporting device according to
claim 1, wherein
the called image is two or more first screen images each corresponding to the first screen, and
the calling unit receives an input of the number of partitions for dividing the second screen, calculates positions of arrangement and sizes of the first screen images for arranging the first screen images in the second screen on the basis of the number of partitions, and arranges the first screen images in the second screen on the basis of the calculated positions of arrangement and sizes.
8. The image creation supporting device according to any
one of claims 1 to 7, comprising:
a creation unit to receive an input of information indicating whether or not editing of the called image is permitted when the first screen is used as the called image, wherein
the first screen data includes the information indicating whether or not editing is permitted.
9. The image creation supporting device according to any one of claims 1 to 8, wherein the first screen is a screen to be displayed on a programmable display device.
10. A display system comprising:
the image creation supporting device according to any one of claims 1 to 9; and
a terminal to display a screen on the basis of screen data created by the image creation supporting device.
11. An image creation supporting method performed by an image creation supporting device, the image creation supporting method comprising:
a first step of storing first screen data that is screen data of a first screen, in a storage unit;
a second step of placing a called image in a second screen using the first screen data stored in the storage unit, the called image being at least part of the first screen; and
a third step of adjusting a size of the called image.
| # | Name | Date |
|---|---|---|
| 1 | 201927024566-TRANSLATIOIN OF PRIOIRTY DOCUMENTS ETC. [20-06-2019(online)].pdf | 2019-06-20 |
| 2 | 201927024566-STATEMENT OF UNDERTAKING (FORM 3) [20-06-2019(online)].pdf | 2019-06-20 |
| 3 | 201927024566-REQUEST FOR EXAMINATION (FORM-18) [20-06-2019(online)].pdf | 2019-06-20 |
| 4 | 201927024566-PROOF OF RIGHT [20-06-2019(online)].pdf | 2019-06-20 |
| 5 | 201927024566-POWER OF AUTHORITY [20-06-2019(online)].pdf | 2019-06-20 |
| 6 | 201927024566-FORM 18 [20-06-2019(online)].pdf | 2019-06-20 |
| 7 | 201927024566-FORM 1 [20-06-2019(online)].pdf | 2019-06-20 |
| 8 | 201927024566-FIGURE OF ABSTRACT [20-06-2019(online)].pdf | 2019-06-20 |
| 9 | 201927024566-DRAWINGS [20-06-2019(online)].pdf | 2019-06-20 |
| 10 | 201927024566-DECLARATION OF INVENTORSHIP (FORM 5) [20-06-2019(online)].pdf | 2019-06-20 |
| 11 | 201927024566-COMPLETE SPECIFICATION [20-06-2019(online)].pdf | 2019-06-20 |
| 12 | 201927024566.pdf | 2019-06-28 |
| 13 | 201927024566-ORIGINAL UR 6(1A) FORM 1-280619.pdf | 2019-07-11 |
| 14 | 201927024566-FORM-26 [15-07-2019(online)].pdf | 2019-07-15 |
| 15 | 201927024566-MARKED COPIES OF AMENDEMENTS [09-08-2019(online)].pdf | 2019-08-09 |
| 16 | 201927024566-FORM 13 [09-08-2019(online)].pdf | 2019-08-09 |
| 17 | 201927024566-AMMENDED DOCUMENTS [09-08-2019(online)].pdf | 2019-08-09 |
| 18 | 201927024566-ORIGINAL UR 6(1A) FORM 26-170719.pdf | 2019-08-14 |
| 19 | Abstract.jpg | 2019-10-31 |
| 20 | 201927024566-FORM 3 [03-12-2019(online)].pdf | 2019-12-03 |
| 21 | Abstract1.jpg | 2020-01-13 |
| 22 | 201927024566-FORM 3 [06-06-2020(online)].pdf | 2020-06-06 |
| 23 | 201927024566-FER_SER_REPLY [15-06-2021(online)].pdf | 2021-06-15 |
| 24 | 201927024566-COMPLETE SPECIFICATION [15-06-2021(online)].pdf | 2021-06-15 |
| 25 | 201927024566-CLAIMS [15-06-2021(online)].pdf | 2021-06-15 |
| 26 | 201927024566-Information under section 8(2) [16-06-2021(online)].pdf | 2021-06-16 |
| 27 | 201927024566-FORM 3 [16-06-2021(online)].pdf | 2021-06-16 |
| 28 | 201927024566-FER.pdf | 2021-10-19 |
| 29 | 201927024566-Response to office action [19-08-2022(online)].pdf | 2022-08-19 |
| 30 | 201927024566-PatentCertificate22-08-2023.pdf | 2023-08-22 |
| 31 | 201927024566-IntimationOfGrant22-08-2023.pdf | 2023-08-22 |
| 1 | 2021-02-2417-48-45E_25-02-2021.pdf |