FORM 2
THE PATENTS ACT, 1970
(39 of 1970)
&
THE PATENTS RULES, 2003
COMPLETE SPECIFICATION
[See section 10, Rule 13]
DISPLAY DEVICE, DISPLAY METHOD, AND RECORDING MEDIUM
MITSUBISHI ELECTRIC CORPORATION. A CORPORATION ORGANIZED AND
EXISTING UNDER THE LAWS OF JAPAN, WHOSE ADDRESS IS 7-3,
MARUNOUCHI 2-CHOME, CHIYODA-KU, TOKYO 1008310, JAPAN
THE FOLLOWING SPECIFICATION PARTICULARLY DESCRIBES THE
INVENTION AND THE MANNER IN WHICH IT IS TO BE PERFORMED.
2
DESCRIPTION
Technical Field
[0001] The present disclosure relates to a display device, a display method, and a
program.
Background Art5
[0002] A manufacturing system includes a display as an operation panel for
controlling the manufacturing system and as a monitoring screen for displaying the
production status (for example, the production number and quality information) of the
manufacturing system. A technique is known for displaying, on the display, content
different from the operation screen or the monitoring screen for the manufacturing10
system.
[0003] Patent Literature 1 describes a technique for displaying web content on a
programmable display to respond to a variety of items of content to be displayed on the
display. More specifically, the programmable display includes a multitasking operating
system (OS). When the programmable display is online and displays the operating15
status of a programmable logic controller (PLC), a browser can be started to view
manuals as web content.
Citation List
Patent Literature
[0004] Patent Literature 1: Unexamined Japanese Patent Application Publication20
No. 2001-282501
Summary of Invention
Technical Problem
[0005] However, the above technique switches between a display function to
display the operating status of the PLC and a browsing function using a browser as25
requested by a user, and does not allow content from different sources, or content
acquired from a PLC and web content, to be combined on a single screen.
3
[0006] Under such circumstances, an objective of the present disclosure is to
display content in multiple formats simultaneously on the same display.
Solution to Problem
[0007] To achieve the above objective, a display device according to an aspect of
the present disclosure includes a display and a controller to cause the display to display5
content. The controller includes a display area setter to set, on a same screen, a first
display area to display first content and a second display area to display second content
having a display format different from a display format of the first content, a first display
engine to generate the first content, a second display engine to generate the second
content, and a screen display control unit to display the first content in the first display10
area and the second content in the second display area simultaneously. The controller
displays the first content and the second content on the same screen in a manner
associated with each other.
Advantageous Effects of Invention
[0008] The technique according to the above aspect of the present disclosure can15
display content in multiple formats simultaneously on the same display.
Brief Description of Drawings
[0009] FIG. 1 is a diagram of an overall system including a display device
according to an embodiment of the present disclosure;
FIG. 2 is a diagram of a screen of a display in the display device according to the20
embodiment;
FIG. 3 is a diagram of the display device according to the embodiment, illustrating
the hardware components;
FIG. 4 is a functional block diagram of the display device according to the
embodiment;25
FIG. 5 is a flowchart of a screen display process in the embodiment;
FIG. 6 is a flowchart of an update process in the embodiment;
4
FIG. 7 is a flowchart of another update process in the embodiment;
FIG. 8 is a diagram of a screen of the display in the display device according to the
embodiment; and
FIG. 9 is a diagram of a screen of the display in the display device according to the
embodiment.5
Description of Embodiments
[0010] A display device according to one or more embodiments of the present
disclosure is described with reference to the drawings. Like reference signs denote like
or corresponding components in the drawings.
[0011] A display device 1 according to the present embodiment is a programmable10
display and displays information about machines 4 connected to a control device 2. The
display device 1 displays content associated with operation control over the machines 4
connected to the control device 2. Examples of the content include information such as
images, text, audio, and videos. The content also includes, for example, items of
information such as screen data corresponding to multiple screens for receiving input15
operations. The display device 1 is connected to the control device 2 through, for
example, an industrial network to allow communication with each other.
[0012] The control device 2 is typically a programmable logic controller (PLC) that
controls one or more machines in cooperation with other machines to operate a
production line, a processing line, an inspection line, and other processing lines. Each20
machine 4 is, for example, a sensor for detecting workpieces being transported by a
conveyor belt, a machining tool for machining the workpieces, an inspection device for
determining whether the workpieces are acceptable, a robot for excluding defective
products from the production line, or another factory automation (FA) device.
[0013] For example, the control device 2 controls a machine having a robotic arm25
based on the sensing results from the machine being a sensor to control the workpieces
sequentially transported on the conveyor belt. Although FIG. 1 illustrates a single
5
control device 2 as a typical example, multiple control devices 2 may cooperate with one
another to control one or more machines.
[0014] The control device 2 and each machine 4 are connected to each other
through a communication line to transmit a voltage signal or a current signal, or are
connected through a communication line to transmit serial data. The control device 25
and each machine 4 may be connected to each other through an industrial network.
[0015] A cloud server 3 as an external device is connected between the industrial
network and a network through a communication device 5 as a gateway. The network
may be a wide area communication network such as the Internet, a virtual network such
as a virtual private network (VPN), or a dedicated network. The cloud server 3 acquires10
data associated with the control of the machines 4 from the control device 2 through the
communication device 5. Data associated with the control of the machines 4 may be,
for example, results of sensing performed by the machines 4 being sensors, control
instructions to the machines 4 from the control device 2, the execution status of the
control program in the control device 2, device values stored in a memory in the control15
device 2, or other information.
[0016] The cloud server 3 provides the processing results of the data to the display
device 1. The information provided from the cloud server 3 to the display device 1 may
be, for example, analysis data or diagnostic data about manufacturing system data such as
the operating status of the multiple machines 4 or the operating rate of the production20
line, or may be operating manuals for the machines 4 or other information. The cloud
server 3 distributes these sets of data as web content to the display device 1. Examples
of the web content include data such as text files written in hypertext markup language
(HTML), image files, audio files, and video files embedded in documents.
[0017] The display device 1 functions as a human-machine interface (HMI) in the25
control device 2 for controlling the machines 4. The display device 1 includes a display
screen including a touchscreen. The display screen serves as a graphical user interface
6
(GUI) for controlling the machines 4 and for checking the operating status of the
machines 4. An on-site user can control the machines 4 through the PLC or can check
the operating status of the machines 4 on the display screen by manipulating an object on
the screen on which HMI content (hereafter referred to as first content) for the monitoring
function and the operating function of the machines 4 are displayed.5
[0018] The display device 1 also displays web content (hereafter referred to as
second content) distributed from the cloud server 3 on the display screen. The web
content includes, for example, the operating status of the machines 4, analysis data such
as the operating rate of the production line, and diagnostic data.
[0019] The display device 1 divides the display screen into multiple display10
formats, and arranges and displays the content items having display formats
corresponding to the divided areas, thus simultaneously displaying content items having
different display formats. The different display formats herein refer to display formats
that differ from each other due to different display engines that perform image processing
to display dedicated content and image processing to display general-purpose content.15
The dedicated content is defined as first content, such as HMI content interpretable by
industrial machine monitoring and control systems. The general-purpose content is
defined as second content, such as web content interpretable by any machine on a
general-purpose web browser.
[0020] FIG. 2 illustrates an example display screen of the display device 1 on which20
HMI content (hereafter, the first content) acquired from a machine 4 through the control
device 2 and web content (hereafter, the second content) provided from the cloud server 3
are displayed simultaneously. The display screen is divided into five areas. More
specifically, the display screen is divided into a first display area 11 and second display
areas 21, 22, 23, and 24. Of these areas, the first content is displayed in the first display25
area 11. The second content is displayed in the second display areas 21, 22, 23, and 24.
[0021] More specifically, in the first display area 11 illustrated in FIG. 2, objects for
7
the monitoring function and the operating function of a machine 4 are displayed based on
data acquired from the machine 4 and transmitted from the control device 2. In this
example, an activation button for the machine 4 is displayed in the first display area 11.
[0022] In the second display area 21 illustrated in FIG. 2, for example, a
management screen is displayed. The screen displays an analysis of the operating status5
of the machine 4 as manufacturing equipment. Data about the manufacturing
equipment is transmitted to the cloud server 3. The cloud server 3 analyzes the received
data about the manufacturing equipment. The data analysis results are distributed to the
display device 1 from the cloud server 3. The display device 1 then causes the display
to display the analysis results as the second content. The second content is updated to10
the latest details upon every updating of the data analysis results, and is distributed to the
display device 1. The operating status of the machine, the operating rate, the frequency
of alarms, and other data are displayed in FIG. 2. In addition, the display format of data
analysis can be updated to accommodate display methods with high visibility.
[0023] In the second display area 22 illustrated in FIG. 2, for example, the status of15
the machine 4 diagnosed by the cloud server 3 is displayed based on the data about the
manufacturing equipment. The second content displayed in the second display area 22
is also updated with the latest details upon every update of the data diagnostic results, and
is distributed to the display device 1.
[0024] In the second display area 23 illustrated in FIG. 2, for example, news, new20
functions, and other content of a target machine are displayed. The display device 1
registers the distribution of information about the news and the new functions of the
target machine with the cloud server 3. When the cloud server 3 receives the latest
information about the news, the new functions, and other content of the target machine,
the cloud server 3 updates the details and distributes the details to the display device 1.25
[0025] In the second display area 24 illustrated in FIG. 2, for example, the schedule
of visits by the equipment manufacturer of the target machine is displayed. The display
8
device 1 registers a schedule management service with the cloud server 3. When the
schedule is updated, the cloud server 3 updates the details and distributes the latest
schedule to the display device 1. This allows the user to inquire the visit date and time
of a maintenance worker for maintenance on the machine 4. The maintenance plan and
the results of the maintenance of the machine 4 may also be displayed in the second5
display area 24, allowing the user to inquire such information. In addition to the inquiry
screen, an input screen for receiving an input of new information such as the visit date
and time of the maintenance worker or the maintenance plan and the results of the
maintenance are displayed in the second display area 24. The information input through
the input screen is transmitted to the cloud server 3, and the details are updated10
accordingly. The user can thus input new information including the visit date and time
of the maintenance worker or the maintenance plan and the results of the maintenance,
and can view the details updated by the input.
[0026] Additionally, the second content may include information representing a
screen for describing the monitoring status of the machine 4 included in the first content.15
Information representing the screen for describing the monitoring status of the machine 4
is distributed from the cloud server 3. The information is included in the second content
as information associated with the first content and is displayed regularly on the display
device 1. The second content is updated as appropriate. The second content may
include information representing an image of a robot used in the manufacturing20
equipment. The image of the robot is used to manage an alarm generated in the robot.
The image of the robot is managed by the cloud server 3. The resolution and the color
tone of the image are updated to the latest and distributed to the display device 1.
[0027] As illustrated in FIG. 3, the display device 1 includes, as hardware
components, a processor 31, a main storage 32, an auxiliary storage 33, an input device25
34, a display 35, and a communicator 36. The main storage 32, the auxiliary storage 33,
the input device 34, the display 35, and the communicator 36 are connected to the
9
processor 31 with an internal bus 37.
[0028] The processor 31 includes a central processing unit (CPU). The processor
31 executes a program P1 stored in the auxiliary storage 33 to implement various
functions of the display device 1.
[0029] The main storage 32 includes a random-access memory (RAM). The5
program P1 is loaded from the auxiliary storage 33 into the main storage 32. The main
storage 32 is used as a work area for the processor 31.
[0030] The auxiliary storage 33 includes a nonvolatile memory such as an
electrically erasable programmable read-only memory (EEPROM) or a hard disk drive
(HDD). The auxiliary storage 33 stores, in addition to the program P1, various types of10
data used in processing performed by the processor 31. The auxiliary storage 33
provides data usable by the processor 31 to the processor 31 as instructed by the
processor 31, and stores data provided by the processor 31. Although FIG. 3 illustrates
the single program P1 as a typical example, multiple programs may be stored in the
auxiliary storage 33 or loaded into the main storage 32.15
[0031] The input device 34 as a touchscreen acquires information input by the user
of the display device 1, and provides the acquired information to the processor 31.
[0032] The display 35 is, for example, a liquid crystal display (LCD) or an organic
electro-luminescent display (OLED), and is a touchscreen integral with the input device
34.20
[0033] The communicator 36 includes a network interface circuit for
communicating with an external device. The communicator 36 receives an external
signal and outputs data indicated by the signal to the processor 31. The communicator
36 also transmits a signal indicating data output from the processor 31 to the external
device.25
[0034] With the hardware components described above operating in cooperation
with one another, the display device 1 performs various functions. More specifically, as
10
illustrated in FIG. 4, the display device 1 includes, as functional components, the display
35, a controller 40, a first screen content unit 45, and a second screen content unit 46.
The controller 40 includes a display area setter 44, a first screen creator 47, a second
screen creator 48, a first display engine 49, a second display engine 50, and a screen
display controller 51.5
[0035] The display 35 displays the first content and the second content. The first
content is displayed in the first display area 42. The second content is displayed in the
second display area 43. The first content may be displayed in multiple display areas.
The second content may be displayed in a single display area. The first content and the
second content may be superimposed on each other.10
[0036] The display area setter 44 sets the first display area 42 and the second
display area 43 on the screen of the display 35. When the first display area 42 is set on
the screen of the display 35, the second display area 43 is defined, in a predetermined
format, based on the position of the set first display area 42 on the screen. The
predetermined format refers to a pre-registered rule for the positional relationship15
between the first display area 42 and the second display area 43. More specifically, the
first content to be displayed in the first display area 42 and the second content to be
displayed in the second display area 43 are associated with each other based on the
positional relationship. The first content and the second content are arranged, as
illustrated in FIG. 4, for example, with multiple second content items (second display20
area 43) in a manner associated with the first content (first display area 42). For
example, the second content is superimposed on the first content in a manner associated
with the first content. Being associated with each other refers to (1) based on the details
of one content, the details of the other content being determined, and (2) based on the
positional relationship with one content, the other content being located. The conditions25
for such association may include both the detail-based determination in (1) and the
location-based determination in (2) being satisfied, or one of the detail-based
11
determination in (1) or the location-based determination in (2) being satisfied. In other
words, the condition may be satisfied when the details of the other content are determined
based on the details of one content and the other content is located based on the positional
relationship with one content, or when the details of the other content are determined
based on the details of one content or when the other content is located based on the5
positional relationship with one content. In the present embodiment, “one content”
refers to the content displayed in the first display area, and “the other content” refers to
the content displayed in the second display area. The first display area is not limited to
the area displayed first on the display screen, and may be any area selected by the user as
the first display area. The detail-based determination in (1) allows the maintenance10
worker to have higher understanding of the content displayed in the first display area. In
addition, the location-based determination in (2) increases visibility of the display,
allowing the maintenance worker to acquire information more easily. In addition, by
superimposing the detail-based determination in (1) and the location-based determination
in (2), visibility is increased with the positional relationship, the maintenance worker can15
recognize the information more easily, and the information is supplemented by the
recognized information. This allows the maintenance worker to have still higher
understanding of the content displayed in the first display area.
[0037] The first screen content unit 45 stores first template data for displaying the
first content and display data to be displayed in the first display area 42. The display20
data indicates, for example, the operating status (for example, normal, abnormal, or
rotational speed) of the machine 4 and is transmitted from the control device 2. The
display data is then reflected on the first template data to generate the first content. The
display data may be displayed in the first display area 42 through the first display engine
49 without being stored into the first screen content unit 45. The first screen content25
unit 45 may analyze and process the data acquired from the control device 2 and display
the resultant data in the first display area 42.
12
[0038] The second screen content unit 46 stores template data for displaying the
second content and display data to be displayed in the second display area 43. The
second template data is downloaded from the cloud server 3 storing the template data.
When template data stored in the cloud server 3 is updated, the template data stored in the
second screen content unit 46 is also updated. The second screen is thus displayed5
based constantly on the latest template data. The display data is, for example, data
representing the analysis results of the operating status (for example, normal, abnormal,
or rotational speed) of the machine 4. In other words, the display data is data resulting
from analysis of the operating data about the machine 4that is collected by the cloud
server 3. The display data may be displayed in the second display area 43 through the10
second display engine 50 without being stored into the second screen content unit 46.
[0039] The first screen creator 47 selects the first template data stored in the first
screen content unit 45, places the first template data in a screen creation area in the
memory, and prepares to create the first content to be displayed in the first display area
42. The first display engine 49 creates the first content by reflecting the display data on15
the first template data placed in the screen creation area, and performs image processing
to cause the display 35 to display the created first content.
[0040] The second screen creator 48 selects the second template data stored in the
second screen content unit 46, places the second template data in a screen creation area in
the memory, and prepares to create the second content to be displayed in the second20
display area 43. The second display engine 50 creates the second content by reflecting
the display data on the second template data placed in the screen creation area, and
performs image processing to cause the display 35 to display the created second content.
[0041] The screen display controller 51 is implemented by a multitasking
middleware (M/W) and acquires the first content on which the image processing is25
performed by the first display engine 49 and displays the acquired first content in the
predetermined first display area 42. The screen display controller 51 also acquires the
13
second content on which the image processing is performed by the second display engine
50 and displays the acquired second content in the predetermined second display area 43.
[0042] An example screen display process performed by the display device 1 is
now described with reference to FIGS. 5 to 7. To display on the screen, as illustrated in
FIG. 5, for example, the user first specifies the display area on the screen of the display5
35 on which the HMI content for displaying the monitoring function and the operating
function of the machine 4 is displayed. The HMI content is transmitted from the control
device 2. The display area setter 44 then sets the first display area 42 (step S101).
[0043] When the first display area 42 is set, the display area setter 44 sets, in a
predetermined display format registered in advance, the second display area 43 that is a10
display area on the display 35 in which web content is displayed to display analysis data
and diagnosis data distributed from the cloud server 3 (step S102). The second display
area 43 can be set manually, but is displayed in a manner associated with the selected first
display area 42.
[0044] When the display area setter 44 sets the first display area 42 and the second15
display area 43 on the screen of the display 35, the first screen creator 47 selects the first
template data from the first screen content unit 45 and places the template data in the first
display area 42 (step S103).
[0045] In parallel with step S103, the second screen creator 48 selects second
content corresponding to the first content from the second screen content unit 46, and20
places the second content in the second display area 43 (step S105).
[0046] When step S103 is performed, the first display engine 49 prepares for
causing the display 35 to display the first content reflecting the data included in the
control device 2 (step S104). More specifically, the first display engine 49 collects data
from the control device 2 and reflects the collected data on the first content to update the25
details of the first content. The first display engine 49 performs image processing for
causing the display 35 to display the updated first content.
14
[0047] When step S105 is performed, the second display engine 50 prepares for
causing the display 35 to display the second content reflecting the latest data included in
the cloud server 3 (step S106). More specifically, the second display engine 50 collects
the latest data from the cloud server 3, reflects the acquired latest data on the second
content, and updates the details of the second content. The second display engine 505
performs image processing for causing the display 35 to display the updated second
content.
[0048] When step S104 is performed to prepare the first content reflecting the data
included in the control device 2 to be displayed on the display 35 and step S106 is
performed to prepare the second content reflecting the latest data included in the cloud10
server 3 to be displayed on the display 35, the multitasking M/W causes the display 35 to
display the first content in the first display area 42 and the second content in the second
display area 43 simultaneously (step S107).
[0049] The procedure of an update process for updating the second content and
displaying the resultant content in the second display area 43 is now described with15
reference to the flowchart in FIG. 6.
[0050] As in the processing in step S107 in FIG. 5, the multitasking M/W causes
the display 35 to display the first content in the first display area 42 and the second
content in the second display area 43 simultaneously (step S201).
[0051] After step S201 is performed, or more specifically, after the first content and20
the second content are displayed, the first display engine 49 prepares for causing the
display 35 to display the first content reflecting data included in the control device 2 (step
S202). More specifically, the first display engine 49 collects the latest data from the
control device 2 and reflects the collected data on the first content to update the details of
the first content. The first display engine 49 performs image processing for causing the25
display 35 to display the updated first content.
[0052] After step S201 is performed, the second display engine 50 refers to, in
15
parallel with step S202, the cloud server 3 and determines whether the cloud server 3 has
an update screen (step S203).
[0053] When determining that the cloud server 3 has an update screen (Yes in step
S203), the second display engine 50 acquires the latest data including update data for the
update screen from the cloud server 3 (step S204).5
[0054] After step S204 is performed, the second display engine 50 reflects the
collected latest data on the second content to prepare for causing the display 35 to display
the latest data (step S205).
[0055] The timing when the update data for the update screen is created in the cloud
server 3 may be the timing when the cloud server 3 collects operating data from the10
control device 2 and updates the analysis results based on the collected data. In another
example, when the table or the graph indicating the analysis results is updated, when the
text describing the analysis results is updated, or when the text describing the response to
the analysis results is updated, update data may be created. In this case, the second
content is also updated as the operating data is updated from the manufacturing system.15
More specifically, the second content is displayed in a manner associated with the first
content, and the details of the first content are further supplemented in a timely manner.
Displaying the details of the first content in the second content allows the user to
understand the data correctly. When the first content is updated, the second content is
updated and displayed to properly transmit the intended information.20
[0056] When step S202 is performed to prepare the updated first content to be
displayed on the display 35 and step S205 is performed to prepare the updated second
content to be displayed on the display 35, the multitasking M/W causes the display 35 to
display the updated first content in the first display area 42 and the updated second
content in the second display area 43 simultaneously (step S206).25
[0057] When determining that the cloud server 3 has no update screen (No in step
S203), the second display engine 50 causes, in step S206, the display 35 to display the
16
first content reflecting the latest data included in the control device 2 in the first display
area 42 and the second content displayed in step S201 with no update in the second
display area 43 simultaneously (step S206).
[0058] The procedure of another update process for updating the second content is
now described with reference to the flowchart in FIG. 7. As in the processing in step5
S201 in FIG. 6, the multitasking M/W causes the display 35 to display the first content in
the first display area 42 and the second content in the second display area 43
simultaneously (step S301).
[0059] After the first content and the second content are displayed, the first display
engine 49 prepares for causing the display 35 to display the first content reflecting the10
latest data included in the control device 2 (step S302). More specifically, the first
display engine 49 collects the latest data from the control device 2 and reflects the
collected latest data on the first content to update the details of the first content. The
first display engine 49 performs image processing for causing the display 35 to display
the updated first content.15
[0060] In contrast, the controller 40 detects that a predetermined operation input is
performed on the first content by the user touching the screen of the display 35 on which
the first content is displayed (step S303).
[0061] When detecting the predetermined operation input on the first content, the
controller 40 requests, from the cloud server 3, update data corresponding to the20
predetermined operation input (for example, a touch on a specific display object or a
change in a value) and acquires, from the cloud server 3, update data (for example,
images, text, audio, and videos) corresponding to the predetermined operation input (step
S304).
[0062] When step S304 is performed, the acquired update data is reflected on the25
second content and the resultant content is prepared to be displayed on the display 35
(step S305).
17
[0063] The timing when the update data for the update screen is created in the cloud
server 3 may be the timing when the details of a relevant operation input are provided to
the cloud server 3 upon selection of a portion of the first display area 42 in which the first
content is displayed. More specifically, when an alarm is displayed in the display area
in which the first content is displayed and the user selects an intended alarm, the cloud5
server 3 recognizes the selected alarm and provides update data specifying an error
indicated by the alarm, or text or a video indicating a response to the alarm. More
specifically, the second content is displayed in a manner associated with the first content,
and the details of the first content are further supplemented in a timely manner.
[0064] FIG. 8 illustrates a list of alarm information for the equipment in a first10
display area 61. In FIG. 8, information to respond to an alarm is displayed in the second
display area 62 in which the second content is displayed. More specifically, when a
specific alarm displayed in the first display area 61 on the display screen of the display 35
is selected by a user, update data such as a response manual and a video indicating a
response to the selected alarm is downloaded from the cloud server 3. The second15
content reflecting the update data is displayed in the second display area 62. In this
state, the second content is superimposed on the first content.
[0065] The second screen content unit 46 may prestore update data corresponding
to an object associated with an operation input included in the first content. When, for
example, the object associated with the operation input included in the first content20
displayed in the first display area 42 is selected, the update data corresponding to the
selected object may be read from the second screen content unit 46 and reflected on the
second content and the resultant second content may be displayed.
[0066] When step S302 is performed to prepare the updated first content to be
displayed on the display 35 and step S305 is performed to prepare the updated second25
content to be displayed on the display 35, the multitasking M/W causes the display 35 to
display the updated first content in the first display area 42 and the second content in the
18
second display area 43 simultaneously (step S306).
[0067] In the example illustrated in FIG. 9, the second content is displayed as the
background of the first content. The second display area 63 surrounds the first display
area 11 indicating an activation screen of the machine 4 as the first content. The second
display area 63 displays wallpaper as the second content as the background of the first5
content. This improves the visibility of the activation screen of the machine 4 as the
first content.
[0068] In the above embodiment, the functions of the display device 1 may be
implemented by dedicated hardware or a common computer system.
[0069] For example, the program P1 executable by the processor 31 may be stored10
in a non-transitory computer-readable recording medium for distribution. The program
P1 is installed in a computer to provide a device that performs the above processing.
Examples of such a non-transitory recording medium include a flexible disk, a compact
disc read-only memory (CD-ROM), a digital versatile disc (DVD), and a magneto-optical
(MO) disk.15
[0070] The program P1 may be stored in a disk device included in a server on a
communication network, typically the Internet, and may be, for example, superimposed
on a carrier wave to be downloaded to a computer.
[0071] The processing described above may also be performed by the program P1
activated and executed while being transferred through a communication network.20
[0072] The processing described above may be performed by entirely or partially
executing the program P1 on a server while a computer is transmitting and receiving
information about the processing through a communication network.
[0073] In the system with the above functions implementable partly by the
operating system (OS) or through cooperation between the OS and applications, portions25
executable by applications other than the OS may be stored in a non-transitory recording
medium that may be distributed or may be downloaded to a computer.
19
[0074] Means for implementing the functions of the display device is not limited to
software. The functions may be partly or entirely implemented by dedicated hardware
including circuits.
[0075] The foregoing describes some example embodiments for explanatory
purposes. Although the foregoing discussion has presented specific embodiments,5
persons skilled in the art will recognize that changes may be made in form and detail
without departing from the broader spirit and scope of the invention. Accordingly, the
specification and drawings are to be regarded in an illustrative rather than a restrictive
sense. This detailed description, therefore, is not to be taken in a limiting sense, and the
scope of the invention is defined only by the included claims, along with the full range of10
equivalents to which such claims are entitled.
Industrial Applicability
[0076] One or more embodiments of the present disclosure is widely applicable to a
display device that displays the monitoring function and the operating function of a
manufacturing system.15
Reference Signs List
[0077]
1 Display device
2 Control device
3 Cloud server20
4 Machine
5 Communication device
11, 42, 61 First display area
21, 22, 23, 24, 43, 62, 63 Second display area
31 Processor25
32 Main storage
33 Auxiliary storage
20
34 Input device
35 Display
36 Communicator
37 Internal bus
40 Controller5
44 Display area setter
45 First screen content unit
46 Second screen content unit
47 First screen creator
48 Second screen creator10
49 First display engine
50 Second display engine
51 Screen display controller
21
We Claim:
[Claim 1] A display device (1), comprising:
a display (35); and
a controller (40) to cause the display (35) to display content,
wherein the controller (40) includes5
a display area setter (44) to set, on a same screen, a first display area (42) to
display first content and a second display area (43) to display second content having a
display format different from a display format of the first content, the first content being
human-machine interface content for monitoring and operating a machine (4) that is a
control, the second content being web content indicating analysis data and diagnosis data10
of an operating status of the machine (4),
a first display engine (49) to perform image processing for displaying the
first content,
a second display engine (50) that is different from the first display engine
(49) to perform image processing for displaying the second content, and15
a screen display control unit (51) to display the first content in the first
display area (42) and the second content in the second display area (43) simultaneously,
the first display area (42) is set by a user specifying, and
the controller (40) determines details of the second content based on details of the
first content, and determines a positional relationship of the second content with the first20
content, to display the first content and the second content on the same screen in a
manner associated with each other.
[Claim 2] The display device (1) according to claim 1, wherein
when the first display area (42) is set, the controller (40) sets the second display25
area (43) based on a position of the first display area (42) to determine the positional
relationship of the second content with the first content.
22
[Claim 3] The display device (1) according to claim 1, wherein
the controller (40) updates the second content in response to an update of the first
content to determine the details of the second content based on the details of the first
content.
5
[Claim 4] The display device (1) according to claim 1, wherein
the controller (40) displays the first content and the second content simultaneously
on the same screen in a manner associated with each other.
[Claim 5] The display device (1) according to claim 1, wherein10
the display device (1) is connected to a control device (2) controlling the machine
(4), and data for the human-machine interface content is transmitted from the control
device (2), and
data for the web content is transmitted from an external device (3) connected
externally through a network.15
[Claim 6] The display device (1) according to claim 3 or 4, wherein
the second content is distributed from an external device (3) connected externally
through a network, and the display device (1) sends to the external device (3) a signal for
registering distributed content with the external device (3).20
[Claim 7] The display device (1) according to claim 1, wherein
the second display area (43) is divided into a plurality of display areas to display a
plurality of content items.
25
[Claim 8] A display method for displaying content on a display device (1), the
method comprising:
setting, on a same screen, a first display area (42) to display first content and a
23
second display area (43) to display second content having a display format different from
a display format of the first content, the first content being human-machine interface
content for monitoring and operating a machine (4) that is a control target, the second
content being web content indicating analysis data and diagnosis data of an operating
status of the machine (4);5
performing, by a first display engine (49), image processing for displaying the first
content;
performing, by a second display engine (50) that is different from the first display
engine (49), image processing for displaying the second content; and
displaying the first content in the first display area (42) and the second content in10
the second display area (43) simultaneously in a manner associated with each other,
wherein the first display area (42) is set by a user specifying, and
details of the second content is determined based on details of the first content, and
a positional relationship of the second content with the first content is determined.
15
[Claim 9] A non-transitory computer-readable recording medium storing a
program for displaying content on a display device (1), the program causing a computer
to perform operations comprising:
setting, on a same screen, a first display area (42) to display first content and a
second display area (43) to display second content having a display format different from20
a display format of the first content, the first content being human-machine interface
content for monitoring and operating a machine (4) that is a control target, the second
content being web content indicating analysis data and diagnosis data of an operating
status of the machine (4);
performing, by a first display engine (49), image processing for displaying the first25
content;
performing, by a second display engine (50) that is different from the first display
engine (49), image processing for displaying the second content; and
24
displaying the first content in the first display area (42) and the second content in
the second display area (43) simultaneously in a manner associated with each other,
wherein the first display area (42) is set by a user specifying, and
details of the second content is determined based on details of the first content, and
a positional relationship of the second content with the first content is determined.5