SP326010WO00
DESCRIPTION
DISPLAY SYSTEM, DISPLAY DEVICE, AND RELAY DEVICE
TECHNICAL FIELD
5 [0001]
The present invention relates to a display system that
outputs reproduction signals output f roma reproduction device
to two or more display devices, a display device that is used
being mounted on the head of a user, and a relay device that
10 relays between the reproduction device and two or more display
devices including the display device that is used being mounted
on the head of a user.
BACKGROUND ART
15 [0002]
A display device that is mounted on the head and used
for viewing an image, i.e. a head-mounted display (HMD), is
widely Icnown. The head-mounted display includes display
units for left and right eyes, and is configured to be able
20 to control vision and hearing when a headphone is used in
combination. If it is configured such that when mounted on
the head, the outside world is completely shut out, the effect
of virtual reality at the time of viewing is enhanced. Also,
the head-mounted display is capable of showing different images
25 to the left and right eyes, and if images with a disparity
are displayed to the left and right eyes, a 3D image may be
presented.
[0003]
The head-mounted display is a display system for
30 presenting a virtual image to a user (that is, for forming
a virtual image on the retina of an eye) . Here, the virtual
SP326010WO00
image is formed on the side of an object in a case the object
is at a position closer to a lens relative to the focal length.
[0004]
In the case of making a user view a virtual image, the
5 distance, for example, to the user for whom the virtual image
is formed is preferably changed depending on the image. For
example, there is proposed a display device that presents a
virtual image in a manner suitable for an image (for example,
see Patent Document 1). This display device includes a
10 magnifying optical system that arranges the same virtual image
to be observed by the left eye and the right eye of the user
on the same plane, and controls the distance between the virtual
image and the user and the size of the virtual image according
to the aspect ratio of the image. For example, with an image
15 of a movie or a drama with an aspect ratio of 16 : 9 according
to high vision broadcasting, a large virtual image is formed
on the retina at a position about 15 meters away from the user,
and with an image of a television signal with an aspect ratio
of 4 : 3 according to an NTSC (National Television System
20 Committee) method, a medium-sized virtual image is formed on
the retina at a relatively close position of about 3 meters
away from the user, and the user is allowed to feel a sense
of presence, and also, a sense of fatigue felt at the time
of viewing a virtual image is reduced.
25 [0005]
If an appropriate angle of view is set by an optical
system while using high-resolution elements such as EL
(Electro-Luminescence) elements for display units of a
head-mounted display for the left and right eyes, and multiple
30 channels are reproduced by a headphone, a sense of presence
of as if viewing in a movie theater may be realized.
i SP326010WO00
CITATION LIST
PATENT DOCUMENT
[0006]
5 Patent Document 1: Japanese Patent Application
Laid-open No. 2007-133415
SUMMARY OF THE INVENTION
PROBLEMS TO BE SOLVED BY THE INVENTION
10 [0007]
An object of the present invention is to provide an
excellent display system that outputs reproduction signals
output from a reproduction device to two or more display devices,
an excellent display device that is used being mounted on the
15 headof auser, and an excellent relay device that relays between
the reproduction device and two or more display devices
including the display device that is used being mounted on
the head of a user.
20 SOLUTIONS TO PROBLEMS
[0008]
The present application was made in view of the above
object, and the invention described in claim 1 is a display
system including: an image information supply device for
25 supplying image information; a first display device for being
mounted on and for being used by a user; one or more second
display devices; and an output switching device for connecting
the first display device and the second display device, and
for outputting the image information supplied by the image
30 information supply device preferentially to the first display
device.
¥ SP326010WO00
[0009]
Note that the "system" here refers to a logical
collection of a plurality of devices (or function modules for
realizing specific functions), and each device or function
5 module may be or may not be in a single housing.
[0010]
Further, the invention described in claim 2 of the
present application is a display device including: a mounting
portion for being fixed to a head of a user; a user operation
10 unit for being used by a user to perform an operation input;
a display unit for a left eye for displaying an image for a
left eye; a display unit for a right eye for displaying an
image for a right eye; a signal processing unit for processing
image signals to be displayed by the display unit for a left
15 eye and the display unit for a right eye; a display control
unit for controlling display driving of the display unit for
a left eye and the display unit for a right eye; and an orbital
processing unit for causing a GUI region to orbit, where the
GUI region is for being superimposed on images to be displayed
20 on the display unit for a left eye and the display unit for
a right eye.
[0011]
According to the invention described in claim 3 of the
present application, the orbitalprocessingunit of thedisplay
25 device according to claim 2 causes the GUI region to operate
every time the GUI region is output or at every specific
interval.
[0012]
According to the invention described in claim 4 of the
30 present application, the orbitalprocessingunit of thedisplay
device according to claim 2 stops an orbital operation while
4
SP326010WO00
a user is operating a GUI via the user operation unit.
[0013]
Further, the invention described in claim 5 of the
present application is a display device including: a mounting
5 portion for being fixed to a head of a user; a user operation
unit for being used by a user to perform an operation input;
a display unit for a left eye for displaying an image for a
left eye; a display unit for a right eye for displaying an
image for a right eye; a signal processing unit for processing
10 image signals to be displayed by the display unit for a left
eye and the display unit for a right eye; and a display control
unit for controlling display driving of the display unit for
a left eye and the display unit for a right eye, wherein a
brightness correction parameter different for an image display
15 region and a black image display region is set for screens
of the display unit for a left eye and the display unit for
a right eye for when images with a different aspect ratio are
displayed, and a brightness correction process for an image
signal is performed by the signal processing unit.
20 [0014]
Further, the invention described in claim 6 of the
present application is a display device including: a mounting
portion for being fixed to a head of a user; a user operation
unit for being used by a user to perform an operation input;
25 a display unit for a left eye for displaying an image for a
left eye; a display unit for a right eye for displaying an
image for a right eye; a signal processing unit for processing
image signals to be displayed by the display unit for a left
eye and the display unit for a right eye; and a display control
30 unit for controlling display driving of the display unit for
a left eye and the display unit for a right eye, wherein the
I SP326010WO00
display control unit causes timings for display data signals
to be output, respectively, to the display unit for a left
eye and the display unit for a right eye to be different.
[0015]
5 According to the invention described in claim 7 of the
present application, the display control unit of the display
device according to claim 6 changes, between left and right,
one of a phase, a frequency and a polarity of display data
signals to be output, respectively, to the display unit for
10 a left eye and the display unit for a right eye.
[0016]
Further, the invention described in claim 8 of the
present application is a display device including: a mounting
portion for being fixed to a head of a user; a user operation
15 unit for being used by a user to perform an operation input;
a display unit for a left eye for displaying an image for a
left eye; a display unit for a right eye for displaying an
image for a right eye; a signal processing unit for processing
image signals to be displayed by the display unit for a left
20 eye and the display unit for a right eye; and a display control
unit for controlling display driving of the display unit for
a left eye and the display unit for a right eye, wherein the
signal processing unit changes viewing peaJc brightness
according to elapsed time from start of using of the device
25 by a user.
[0017]
According to the invention described in claim 9 of the
present application, the signal processing unit of the display
device according to claim 8 gradually reduces viewing peak
30 brightness for dark adaptation that is higher than set viewing
peak brightness that is normally set, to the set viewing peak
$
SP326010WO00
brightness over specific time.
[0018]
According to the invention described in claim 10 of the
present application, the signal processing unit of the display
5 device according to claim 9 adjusts the time over which the
viewing peak brightness for dark adaptation is returned to
the set viewing peakbrightness, according to a dark adaptation
characteristic of a user wearing the device.
[0019]
10 According to the invention described in claim 11 of the
present application, the display device according to claim
9 further includes a brightness sensor. Further, the signal
processing unit adjusts the viewing peak brightness for dark
adaptation according an amount of visible light in an outside
15 world detected by the brightness sensor.
[0020]
Further, the invention described in claim 12 of the
present application is a display device including: a mounting
portion for being fixed to a head of a user; a mounting sensor
20 for detecting mounting of the mounting portion to a head of
a user; a user operation unit for being used by a user to perform
an operation input; a display unit for a left eye for displaying
an image for a left eye; a display unit for a right eye for
displaying an image for a right eye; an optical system provided
25 to each of the display unit for a left eye and the display
unit for a right eye, the optical system having a designed
predetermined visual distance to a virtual image; a signal
processing unit for processing image signals to be displayed
by the display unit for a left eye and the display unit for
30 a right eye; and a display control unit for controlling display
driving of the display unit for a left eye and the display
SP326010WO00
unit for a right eye, wherein in response to detection of
mounting by the mounting sensor, a splash screen including
visual information serving as a clue for a user to feel the
visual distance is displayed on the display unit for a left
5 eye and the display unit for a right eye.
[0021]
According to the invention described in claim 13 of the
present application, in the display device according to claim
12, the splash screen is a stereoscopic image of a state where
10 a screen is being seen from a position of a seat in a movie
theater before showing, or a stereoscopic image of a stage
of a concert hall, and an image outside the screen of the movie
theater or the stage of the concert hall is the visual
information serving as a clue for a user to feel the visual
15 distance.
[0022]
Further, the invention described in claim 14 of the
present application is a display device including: a mounting
portion for being fixed to a head of a user; a user operation
20 unit for being used by a user to perform an operation input;
a display unit for a left eye for displaying an image for a
left eye; a display unit for a right eye for displaying an
image for a right eye; a signal processing unit for processing
image signals to be displayed by the display unit for a left
25 eye and the display unit for a right eye; and a display control
unit for controlling display driving of the display unit for
a left eye and the display unit for a right eye, wherein at
a time of viewing of an image, an original image is displayed
being reduced relative to a screen size, and visual information
30 serving as a clue for a visual distance is displayed outside
the original image.
k SP326010WO00
[0023]
Further, the invention described in claim 15 of the
present application is a display device including: a mounting
portion for being fixed to a head of a user; an accelerometer
5 for detecting acceleration acting on the device; a user
operation unit for being used by a user to perform an operation
input; a display unit for a left eye for displaying an image
for a left eye; a display unit for a right eye for displaying
an image for a right eye; a signal processing unit for processing
10 image signals to be displayed by the display unit for a left
eye and the display unit for a right eye; and a display control
unit for controlling display driving of the display unit for
a left eye and the display unit for a right eye, wherein an
amount of motion of a head of a user is tracked based on a
15 measurement result of the accelerometer, and image display
regions of the display unit for a left eye and the display
unit for a right eye are moved according to the amount of motion.
[0024]
According to the invention described in claim 16 of the
20 present application, the display device according to claim
15 further includes an optical system provided to each of the
display unit for a left eye and the display unit for a right
eye, the optical system having a designed predetermined visual
distance to a virtual image. An amount of movement of the
25 image display regions according to the amount of motion is
determined based on the visual distance to the virtual image.
[0025]
Further, the invention described in claim 17 of the
present application is a relay device including: an input unit
30 for connecting a reproduction device, and for inputting a
reproduction signal from the reproduction device; a first
* 10
SP326010WO00
output unit for connecting a first display device and
outputting the reproduction signal; a second output unit for
connecting a second display device and outputting the
reproduction signal; and an output switching unit for
5 exclusively outputting the reproduction signal to the first
output unit or the second output unit, and for preferentially
performing output from the first output unit to the first
display device, wherein the relay device relays between the
reproduction device, and the first display device and the
10 second display device.
[0026]
According to the invention described in claim 18 of the
present application, the output switching unit of the relay
device according to claim 17 monitors a power state of the
15 first display device via the second output unit, and outputs
the reproduction signal from the first output unit to the first
display device in response to turning on of power of the first
display device, and outputs the reproduction signal from the
second output unit to the second display device in response
20 to turning off of power of the first display device.
[0027]
According to the invention described in claim 19 of the
present application, the reproduction device and the input
unit, and the second display device and the second output unit
25 are connected by an HDMI interface. Further, the output
switching unit of the relay device according to claim 17 enables
a repeater function of the input unit for the second output
unit in response to detection of a +5V signal at the input
unit.
30 [0028]
According to the invention described in claim 20 of the
4 11
SP326010WO00
present application, the reproduction device and the input
unit, and the second display device and the second output unit
are connected by an HDMI interface. Further, the output
switching unit of the relay device according to claim 17 enables
5 a repeater function of the input unit for the second output
unit in response to detection of a +5V signal at the input
unit and detection of an HPD signal at the second output unit.
EFFECTS OF THE INVENTION
10 [0029]
According to the present invention, it is possible to
provide an excellent display system that outputs reproduction
signals output from a reproduction device to two or more display
devices, an excellent display device that is used being mounted
15 on the head of a user, and an excellent relay device that relays
between the reproduction device and two or more display devices
including the display device that is used being mounted on
the head of a user.
[0030]
20 Other objects, characteristics and advantages of the
present invention will be made clear by the detailed
description based on the embodiment and accompanying drawings
of the present invention described later.
25 BRIEF DESCRIPTION OF DRAWINGS
[0031]
Fig. 1 is a diagram schematically showing a configuration
of an image display system including a head-mounted display.
Fig. 2 is a diagram schematically showing an internal
30 configuration of a head-mounted display 10.
Fig . 3A is a perspective view of the head-mounted display
i 12
SP326010WO00
10 seen at an angle from the front left side.
Fig. 3B is a diagram showing the head-mounted display
10 in an exploded state.
Fig. 4 is a diagram showing a top surface of a main body
5 of the head-mounted display 10.
Fig. 5 is a diagram schematically showing an internal
configuration of a front end box 40.
Fig. 6 is a diagram for describing a mechanism for
projecting a virtual image by the head-mounted display 10.
10 Fig. 7 is a diagram showing an example structure of an
inside premise of a movie theater.
Fig. 8 is a diagram showing an example arrangement of
an optical system 402L (402R) and a display panel 401R (401L)
for forming on a retina a virtual image of about 750 inches
15 at 20 meters away from an eye of a user.
Fig. 9 is a diagram showing an example of a screen
displaying a GUI.
Fig. 10 is a diagram schematically showing application
of orbital processing on a GUI region.
20 Fig. IIA is a diagram showing generation of a black image
display region at a time of displaying an image signal with
a different aspect ratio.
Fig. IIB is a diagram showing generation of a black image
display region at a time of displaying an image signal with
25 a different aspect ratio.
Fig. 12A is a diagram showing an example where phases
of display data signals output in parallel to left and right
display units 208L and 208R are shifted by 180 degrees between
the left and right.
30 Fig. 12B is a diagram showing an example where
frequencies of display data signals output in parallel to the
13
SP326010WO00
left and right display units 208L and 208R are shifted between
the left and right.
Fig. 12C is a diagram showing an example where polarities
of display data signals output in parallel to the left and
5 right display units 208L and 208R are shifted between the left
and right.
Fig. 13A is a diagram showing an example characteristic
for changing viewing peak brightness to be output from the
head-mounted display 10 according to dark adaptation of a
10 person.
Fig. 13B is a diagram showing several example
characteristics for changing viewing peak brightness to be
output from the head-mounted display 10 according to individual
variation in dark adaptation.
15 Fig. 13C is a diagram showing an example characteristic
where the level of viewing peak brightness immediately after
the head-mounted display 10 is mounted is adjusted according
to the amount of visible light in the outside world.
Fig. 14 is a diagram showing an example configuration
20 of a mounting sensor 221.
Fig. 15A is a diagram showing an example display of a
splash screen serving as a clue for a visual distance.
Fig. 15B is a diagram showing an example display of a
splash screen serving as a clue for a visual distance.
25 Fig. 16 is a diagram showing an example configuration
of an image display area where, at the time of viewing of an
image, an original image is displayed being reduced relative
to the screen size, and an image (a stereoscopic still image)
serving as a clue for a visual distance is displayed on the
30 outer side.
Fig. 17 is a diagram showing movement of display images
14
SP326010WO00
of display panels 401L and 401R based on a result of tracking
movement of the head of a user.
Fig. 18A is a diagram showing an example where the size
of a virtual image is different according to an assumed visual
5 distance even with the same angle of view.
Fig. 18B is a diagram showing an example where a visual
shift is different according to a visual distance.
Fig. 19A is a diagram for describing a mechanism for
causing a power state of the head-mounted display 10 and output
10 switching by an output switching unit 504 to be in conjunction
with each other.
Fig. 19B is a diagram for describing a mechanism for
causing a power state of the head-mounted display 10 and output
switching by the output switching unit 504 to be in conjunction
15 with each other.
Fig. 20 is a diagram showing a front end box 40 detecting
a +5V signal emitted from an HDMI source appliance, and enabling
an HDMI repeater function.
Fig. 21 is a diagram showing the front endbox 40 detecting
20 both a +5V signal emitted from an HDMI source appliance and
an HPD signal emitted from an HDMI sink appliance, and enabling
the HDMI repeater function.
MODE FOR CARRYING OUT THE INVENTION
25 [0032]
Hereinafter, an embodiment of the present invention will
be described in detail with reference to the drawings.
[0033]
A. System Configuration
30 Fig. 1 schematically shows a configuration of an image
display system including a head-mounted display. The system
4 15
SP326010WO00
shown is configured from a main body of a head-mounted display
10, a Blu-ray disc reproduction device 20 to be a source of
viewing content, a high vision display (an HDMI-compatible
TV, for example) 30 to be another output destination of a
5 reproduced content of the Blu-ray disc reproduction device
20, and a front end box 40 for processing an AV signal output
from the Blu-ray disc reproduction device 20.
[0034]
The front end box 40 corresponds to an HDMI repeater
10 that, when an AV signal output from the Blu-ray disc
reproduction device 20 is HDMI-input, performs signal
processing and HDMI-outputs the signal, for example. Also,
the front end box 40 is a two-output switcher for switching
an output destination of the Blu-ray disc reproduction device
15 20 between the head-mounted display 10 and the high vision
display 30.
[0035]
In the example shown, the front end box 4 0 has two outputs,
but three or more outputs may be included. However, with the
20 front end box 40, the output destination of AV signals is
exclusive, and the highest priority is on the output to the
head-mounted display 10. When the power of the head-mounted
display 10 is on, or when a user is using the head-mounted
display 10, the AV signals are output only to the head-mounted
25 display 10. In other words, the AV signals are output to the
high vision TV 30 (or other display, not shown, that is connected
to the front end box 40) with a low priority only when a user
is not using the head-mounted display 10, such as when the
power of the head-mounted display 10 is off, or when the
30 head-mounted display 10 is not connected.
[0036]
Il 16
SP326010WO00
Additionally, the HDMI (High-Definition Multimedia
Interface) is an interface standard for digital home appliances
used mainly for transmission of audio and images, and is based
on a DVI (Digital Visual Interface) , and uses TMDS (Transition
5 Minimized Differential Signaling) for a physical layer. The
present system is compatible with HDMI 1.4, for example.
[0037]
The Blu-ray disc reproduction device 20 and the front
end box 40, and the front end box 40 and the high vision display
10 30 are connected by HDMI cables. A configuration is also
possible where the front endbox 40 and the head-mounted display
10 are connectedby anHDMI cable, but in the present embodiment,
they are connected by a proprietary cable, and the AV signals
are serially transferred. However, the AV signals and power
15 may be supplied by one cable connecting the front end box 40
and the head-mounted display 10, and the head-mounted display
10 may be supplied with drive power by this cable.
[0038]
The head-mounted display 10 includes independent
20 display units for the left eye and the right eye. Each display
unit uses organic EL elements, forexample. Also, each display
unit is equipped with a wide viewing angle optical system of
low distortion and high resolution.
[0039]
25 Fig. 2 schematically shows an internal configuration
of the head-mounted display 10.
[0040]
A signal transmission/reception unit 201 receives AV
signals or transmits information signals processed by a CPU
30 via a cable connected to the front end box 40. In the present
embodiment, since the AV signals are serially transferred via
« 17
SP326010WO00
the cable, the signal transmission/reception unit 201 performs
serial-parallel conversion on received signals.
[0041]
A signal processor 202 separates an AV signal received
5 by the signal transmission/reception unit 201 into an image
signal and an audio signal, and performs image signal
processing and audio signal processing on the signals.
[0042]
An audio signal on which audio signal processing has
10 been performed by the signal processor 202 is converted into
an analog signal by an audio DAG (a digital-analog converter)
211, and is output from left and right speakers 212L and 212R.
[0043]
The signal processor 202 performs, as the image signal
15 processing, brightness level adjustment, contrast adjustment,
and other image quality enhancements. Also, the signal
processor 202 applies various types of processing on an
original image signal based on an instruction from a CPU 206.
For example, OSD (On Screen Display) information including
20 text, figures and the like is generated, and is superimposed
on the original image signal. Signal patterns necessary for
generating the OSD information are stored in a ROM 205, and
the signal processor 202 reads out information stored in the
ROM 205 . One example of the OSD information to be superimposed
25 on the original image information is a GUI (Graphical Uer
Interface) for adjusting output of audio, a screen and the
like. Moreover, screen information generated by the image
signal processing is temporarily stored in a VRAM (a frame
memory) 203. If an image signal supplied by the front end
30 box 40 is different for left and right, such as a stereoscopic
image signal, the signal processor 202 separates the signal
i
SP326010WO00
into the left and right image signals, and generates screen
information.
[0044]
Left and right display units 208L and 208R are each formed
5 from a display panel formed from organic EL elements, and a
gate driver and a data driver for driving the display panel.
Also, the left and right display units 208L and 208R are each
equipped with an optical system with a wide viewing angle.
Additionally, the optical system is omitted from Fig. 2.
10 [0045]
A panel controller 204 reads out the screen information
from the VRAM 203 in predetermined display cycles, and converts
the same into signals to be input to the display units 208L
and208R, and also, generates pulse signals such as horizontal
15 synchronization signals or vertical synchronization signals
to be used in the operation of the gate driver and the data
driver.
[0046]
The CPU 206 executes programs loaded on a RAM 210 from
20 a ROM 209, and controls the overall operation of the
head-mounted display 10 in an integrated manner. Also, the
CPU 206 controls transmission/reception of information
signals to and from the front end box 40 via the signal
transmission/reception unit 201.
25 [0047]
The main body of the head-mounted display 10 is equipped
with a user operation unit 220 including one or more operators
which a user can operate with a finger or the like. Although
not shown, the operators is a combination of left, right, top
30 and bottom cursor keys, and an enter key at the center, for
example. The CPU 206 performs processing related to image
4 19
SP326010WO00
output from the display units 208R and 208L, audio output from
headphones 212L and 212R, and the like, according to
instructions from a user input from the user operation unit
220.
5 [0048]
Also, in the present embodiment, the head-mounted
display 20 is equipped with a plurality of sensors such as
a mounting sensor 221, an accelerometer 222, a brightness
sensor 223 and the like. Outputs of these sensors are input
10 to the CPU 206.
[0049]
The mounting sensor 221 is configured from a mechanical
switch or the like, for example (to be described later) . The
CPU 206 may determine, based on an output of the sensor, whether
15 the head-mounted display 20 is mounted on a user, that is,
whether the head-mounted display 20 is currently being used.
[0050]
The accelerometer 222 includes three axes, for example,
and detects the magnitude and direction of acceleration acting
20 on the head-mounted display 20 . The CPU 206 may track movement
of the head of a user wearing the head-mounted display 10,
based on acceleration information acquired. Also, the CPU
206 may control screens to be displayed on the display units
208L and 208R, according to the amount of movement of the head
25 of the user (to be described later).
[0051]
The brightness sensor 223 detects brightness of the
environment where the head-mounted display 20 is currently
placed. The CPU 206 may control brightness level adjustment
30 to be applied to an image signal, based on brightness
information acquired by the brightness sensor 223 (to be
i 20
SP326010WO00
described later).
[0052]
Furthermore, the CPU 206 transmits, where necessary,
sensor information acquired from each sensor 221 from the
5 signal transmission/reception unit 201 to the front end box
40.
[0053]
A power source unit 230 supplies drive power supplied
by the front end box 40 to each circuit component surrounded
10 by a dashed line in Fig. 2. Also, the main body of the
head-mounted display 10 is equipped with a power switch 231
which a user can operate with a finger or the like. The power
source unit 230 switches between on and off of power supply
to a circuit component according to operation of the power
15 switch 231.
[0054]
Additionally, a state where the power is turned off by
the power switch 231 is a "standby" state of the head-mounted
display 10 where the power source unit 230 is waiting in a
20 power supplied state. Moreover, the front end box 40 side
may determine whether it is a used state, that is, a state
where each circuit component is supplied with power and is
operating, or an unused state, based on a change in a voltage
level of a signal line connected to the power source unit 230.
25 [0055]
Fig. 3 shows an example configuration of an external
appearance of the head-mounted display 10. Here, Fig. 3A is
a perspective view seen at an angle from the front left side,
and Fig. 3B is a diagram showing a roughly exploded state.
30 As shown in Fig. 3B, the head-mounted display 10 is formed
from a display unit portion 302 including most of the main
i 21
SP326010WO00
parts shown in Fig. 2, including a display system, a housing
301 covering the display unit portion 302, a forehead support
304 protruding from the upper surface of the housing 301, a
headband 305 including upper bands 305Aand305B, and headphone
5 portions 303L and 303R accommodating left and right headphones
212L and 212R. The display units 208L and 208R, and a circuit
board are accommodated inside the display unit portion 302.
[0056]
When a user wears the head-mounted display 10 on the
10 head, the forehead support 304 abuts the forehead of the user,
and the headband 305 abuts the backside of the head. Although
details are omitted from Figs. 3A and 3B, the head band 305
is adjustable with respect to the length, and is made of a
stretchable material, and the head-mounted display 10 is fixed
15 to the head by the head band 305 strapped around the head.
[0057]
Fig. 4 shows a top surface, seen f romabove, of the display
unit portion 302 of the head-mounted display 10. Each of the
left and right display units 208L and 208R includes the display
20 panel 401L or 401R formed from organic EL elements, and a gate
driver and a data driver for driving the display panel (as
described above). Also, optical systems 402L and 402R, each
with a wide viewing angle, are arranged on the backside of
the display units 208L and 208R (on the side of the eyes).
25 Additionally, the height of the eye and the interpupillary
distance are different for each user, and the wide viewing
angle optical system and the eye of the user wearing the same
have to be aligned. To this end, an interpupillary adjustment
mechanism for adjusting the interpupillary distance is
30 provided between the display unit for the right eye and the
display unit for the left eye.
i 22
SP326010WO00
[0058]
Fig. 5 schematically shows an internal configuration
of the front end box 40.
[0059]
5 An HDMI input unit 501 is compatible with an HDMI
interface, and inputs, via an HDMI cable, an AV signal
reproduced and output from the Blu-ray disc reproduction device
20 connected by an HDMI cable, and performs signal processing
such as equalization processing.
10 [0060]
Also, the head-mounted display 10 is connected to a first
output unit 502, and the high vision display 30 is connected
to a second output unit 503.
[0061]
15 The second output unit 503 is compatible with an HDMI
interface, and outputs AV signals to the high vision display
30 connected by an HDMI cable. Additionally, a configuration
is also possible where the front end box 40 is equipped with
a plurality of second output units 503, and outputs AV signals
20 to two or more HDMI-compatible TVs.
[0062]
In contrast, the first output unit 502 is compatible
with proprietary interface specifications. Of course, the
first output unit 502 may also be configured so as to be
25 compatible with the HDMI interface. The first output unit
502 is connected to the head-mounted display 10 by one cable
which is compatible with the proprietary interface
specifications, and performs transmission of AV signals,
transmission of various information signals, and supply of
30 drive power via this cable.
[0063]
i 23
SP326010WO00
A control unit 506 controls the operation of each unit
inside the front end box 40 in an integrated manner.
[0064]
The output switching unit 504 selectively switches the
5 output destination of AV signals input to the HDMI input unit
501 to the first output unit 502 or the second output unit
503, that is, to the head-mounted display 10 or the high vision
display 30. In the present embodiment, with the output
switching unit 504, the output destination of AV signals is
10 exclusive, and the highest priority is on the output to the
head-mounted display 10. When the power of the head-mounted
display 10 is on, or when a user is using the head-mounted
display 10, the AV signals are output only to the head-mounted
display 10. In other words, the AV signals are output to the
15 high vision TV 30 with a low priority only when a user is not
using the head-mounted display 10, such as when the power of
the head-mounted display 10 is off, or when the head-mounted
display 10 is not connected. Details of the operation of the
output switching unit 504 will be given later.
20 [0065]
The control unit 506 determines the use state of the
head-mounted display 10 according to an information signal
received at the first output unit 502 from the head-mounted
display 10, the voltage level of a signal line supplying drive
25 power to the head-mounted display 10, or the lilce, and issues
an instruction to the output switching unit 504 regarding the
output destination of the AV signals.
[0066]
Furthermore, the main body of the front end box 40 is
30 equipped with a user operation unit 509 including one or more
operators that a user can operate with a finger or the like.
4 24
SP326010WO00
A user may also issue an instruction about switching of the
output destination of the AV signals by the user operation
unit 509.
[0067]
5 An audio DAC 505 analog-converts an audio signal
separated by the HDMI input unit 501, and outputs the same
from a headphone (HP) connector 507.
[0068]
Now, a mechanism of the head-mounted display 10 for
10 projecting a virtual image will be described with reference
to Fig. 6. Each piece of image information for the left eye
and the right eye, which is a source of a stereoscopic image,
is created assuming a predetermined angle of convergence (the
angle of eye crossing). Then, the head-mounted display 10
15 projects these images for the left eye and the right eye on
separate screens, and allows human eyes to combine the screens
and to observe a stereoscopic image. Images projected by the
left and right display panels 401L and 401R are virtual images
magnified by the optical systems 402L and 402R. When these
20 images are formed on the retinae of the left and right eyes,
they enter the brain as separate pieces of information, and
are overlapped with each other in the brain to form one
stereoscopic image. At this time, a certain angle of
convergence 9 according to the positions of viewpoints is given
25 between the left and right display panels 401L and 401R, and
between the optical systems 402L and 402R. Then, the image
for the left eye and the image for the right eye are created
according to the angle of convergence 9 that is set.
[0069]
30 Next, the mechanism of reproducing an image such as to
be viewed in a movie theater by using the head-mounted display
4 25
SP326010WO00
10
10 will be described.
[0070]
Fig. 7 shows an example structure of an inside premise
of a movie theater. A total of 19 rows of seats, B to E, F
to S, and T (the row at the end) , are arranged in the inside
premise shown. Among these, rows K and J are premium seats.
In this drawing, the width of the screen is 16.5 meters, and
when this is corrected to an aspect ratio of 16 : 9, the width
will be 16.5 meters, the height will be 9.3 meters, and the
image size will be 745.3 inches . Also, the distance from each
seat to the screen is as shown in Table 1 below.
[0071]
[Table 1]
Location
Front row to screen center
Premiumseat (rowK) to screen center
Row at the end to screen center
Foremost row to screen center
Premium seat (row K) to screen
vertical direction
Symbol
A
B
C
E
D
Distance [m]
4.25
17
26.5
2.53
16.5
15 [0072]
Now, when the angle of view is calculated with respect
to the position of seat in each of rows J, K, L, M, N, 0, P,
and T, it will be as shown in Table 2 below. Additionally,
the angle of view is calculated using the position of the center
20 of the screen.
[0073]
[Table 2]
Seat position
J
K
L
M
N
Distance [m]
15.7
17.0
18.1
19.2
20.3
Angle of view [deg]
55.4
51.8
49.0
46.5
44.2
''^^h
26
SP326010WO00
0
p
T
21.4
22.5
26.5
42.2
40.3
35
10
15
20
25
[0074]
The angle of view is about 50 to 55 degrees for rows
J and K, which are premium seats, and the angle of view is
too wide. For example, one has to move his face to read a
subtitle displayed near the edge of the screen, which may cause
a stiff neck, and the image is hardly easy to view. The premium
seats take into account the acoustic environment of the inside
premise rather than merely the viewing of an image, and the
angle of view itself with respect to the screen is not the
best. Moreover, the present inventors assiame that the angle
of view that is suitable for viewing an image and that does
not result in a stiff neck is narrower than 55 degrees, and
about 45 degrees. As can be seen from Table 2 above, the angle
of view of 45 degrees in the movie theater shown in Fig. 7
corresponds to around row N. When taking into account the
distance from a seat position in row N to the center of the
screen, reproduction by the head-mounted display 10 with the
angle of view of 45 degrees in the movie theater corresponds
to forming, on a retina, of a virtual image of about 750 inches
at 20 meters away from the eye of a user, as shown in Table
3 below.
[0075]
[Table 3]
Image size [inch]
Width [m]
Distance [m]
Angle of view [deg]
750
16.6
20.0
45.09
[0076:
w 27
SP326010WO00
When taking only the angle of view into account, if a
virtual image, about 300 inches and several meters away, is
formed on a retina, an approximately same angle of view of
about 45 degrees is obtained. However, in the case of
5 displaying a 3D image with a disparity between the left and
right images, if the distance is made long with the same angle
of view, there is a sense of depth on the farther side, and
a more natural stereoscopic image is obtained. The distance
may be made long with the same angle of view by using a wide
10 viewing angle optical system as each of the left and right
display units 208L and 208R. Fig. 8 shows an example
arrangement of the optical system 402L (402R) and the display
panel 401R (401L) for reproducing an angle of view of 45 degrees
in a movie theater, that is, for forming on a retina a virtual
15 image of about 750 inches at 20 meters away from an eye of
a user.
[0077]
B. Measures against Deterioration of Display Panel
Use of organic EL elements for the left and right display
20 units 208L and 208R to provide a high-resolution image has
been mentioned above. The organic EL element is known to be
susceptible to burn-in when display is performed over a long
period time. When the burn-in occurs, the brightness of the
organic EL element is reduced. Thus, when an image is displayed
25 on a display panel formed from the organic EL elements, the
brightness of a region where there is a deterioration will
be lower than other regions, that is, the region will be darker,
and a viewer will see the contour of the region where the burn-in
has occurred.
30 [0078]
For example, there is known orbital (ORBIT) processing
4 28
SP326010WO00
for periodically displacing the entire image displayed ort a
display panel in vertical and horizontal directions at a slow
speed unperceivable to a viewer. With the orbital processing,
the contour of the burn-in is blurred and obscured.
5 [0079]
The burn-in of a display panel is known to occur when
a still image is displayed over a long period of time. The
present inventors believe that an artificial image also tends
to be a cause of the burn-in. This is because when displaying
10 white text or the like, an image signal with a high degree
of brightness, which is not of a natural image, is output.
A typical example of an artificial image is OSD information,
such as a GUI, which is superimposed on an original image signal
by the signal processor 202. Fig. 9 shows an example of a
15 display screen where a GUI is superimposed on a natural image.
[0080]
Accordingly, in the present embodiment, burn-in by GUI
display is suppressed by applying an orbital operation on a
GUI region. Fig. 10 schematically shows application of the
20 orbital processing on a GUI region. Of course, the orbital
operation for the GUI region may be performed together with
the orbital operation on the entire screen described above.
[0081]
For example, the GUI region is randomly moved by one
25 pixel vertically or horizontally by one orbital operation.
Also, the amount of vertical or horizontal movement is about
±15 pixels at the most so that the orbital operation is
inconspicuous to an observing user.
[0082]
30 The orbital operation may be started every time a GUI
region is output, or the orbital operation may be performed
4 29
SP326010WO00
at every specific interval. Also, while a GUI is being operated
(while an operator of the user operation unit 220 is being
operated), the orbital operation is not to be performed,
because a user is paying attention to the GUI region and will
5 easily notice the orbital operation.
[0083]
The orbital processing described above is realized by
the CPU 206 issuing an instruction for the orbital processing
to be performed, at the time of instructing the signal processor
10 202 to OSD-display a GUI according to a user operation via
the user operation unit 220, for example.
[0084]
Also, when an image signal with a different aspect ratio
is supplied, the problem of burn-in may arise due to generation
15 of a black image display region. As described above, in the
present embodiment, the aspect ratio of the display panel is
16 : 9, which corresponds to the standard screen size of HDTV,
but in the case of displaying an image signal with an aspect
ratio of 4 : 3 according to NTSC (National Television System
20 Committee) method, a black image display region is generated
on the left and right of the display panel, as shown in Fig.
IIA. On the other hand, in the case of displaying a
horizontally-long image signal with an aspect ratio of 2 :
lor more, such as Cinemascope (registered trademark) , a black
25 image display region is generated at the top and bottom of
the display panel, as shown in Fig. IIB. If such an image
signal with a different aspect ratio is displayed over a long
period of time, the deterioration in the brightness of the
organic EL element does not progress in the black image display
30 region, but the deterioration in the brightness of the organic
EL element does progress in an image display region. If an
4 30
SP326010WO00
image signal with the same aspect ratio is displayed afterward,
the boundary with the black image display region which was
generated at the time of image display shown in Fig. IIA or
Fig. IIB will be conspicuous.
5 [0085]
Accordingly, in the present embodiment, a parameter for
burn-in correction for each region of a display panel is
determined according to the aspect ratio of an image to be
displayed, and the contour of burn-in at the time of displaying
10 an image signal with the same aspect ratio is blurred and made
inconspicuous.
[0086]
The aspect ratio may be acquired based on title
information of content to be reproduced by the Blu-ray disc
15 reproduction device 20, for example. Additionally, the means
for acquiring the title information of content at the
head-mounted display 10 side is not particularly specified,
and also, the aspect ratio may be determined based on
information other than the title information.
20 [0087]
When the aspect ratio is determined, black image display
time is measured for each pixel or region of the display panel
based on the time of outputting an image signal. The brightness
of the organic EL element deteriorates more greatly as the
25 black image display time is shorter. Accordingly, a
brightness correction parameter for each pixel or region of
the display panel may be determined based on the measurement
result of the black image display time.
[0088]
30 For example, after determining the aspect ratio based
on the title information or the like of content of an image
4 31
SP326010WO00
signal supplied via the front end box 40, the CPU 206 measures
the black image display time of each pixel or region of the
display panel, determines a brightness deterioration
correction parameter for each pixel or region of the display
5 panel based on the measurement result, and notifies the signal
processor 202 of the same. Then, the signal processor 202
performs image quality enhancement process such as brightness
level correction for each pixel or region of the display panel
based on the brightness deterioration correction parameter
10 which has been input.
[0089]
C. Reduction of Radiation Noise of Display Panel
Although simplified in Fig. 2, in between the panel
controller 204 and the left and right display units 208L and
15 208R are bundles of a plurality of display data signal lines
that operate at a high frequency. When signals that are output
in parallel in this manner operate in synchronization,
unnecessary radiation is increased, and also, a simultaneous
switching noise of a power source is increased.
20 [0090]
Accordingly, in the present embodiment, display data
signals to be output in parallel from the panel controller
204 to the left and right display units 208L and 208R are made
different for the left and right with respect to the phase,
25 the frequency or the polarity.
[0091]
Fig. 12A is a diagram showing an example where phases
of display data signals output in parallel to the left and
right display units 208L and 208R are shifted by 180 degrees
30 between the left and right. Also, Fig . 12B is a diagram showing
an example where frequencies of display data signals output
4 32
SP326010WO00
in parallel to the left and right display units 208L and 208R
are shifted between the left and right. Moreover, Fig. 12C
is a diagram showing an example where polarities of display
data signals output in parallel to the left and right display
5 units 208L and 208R are shifted between the left and right.
As can be seen by referring to the part surrounded by a dashed
line in each of the drawings, the number of simultaneous
switchings or the polarity is changed between the left and
right, and thus, the radiation noise is reduced. Moreover,
10 with the simultaneous switching noise of a power source being
reduced, the load on the power source is also reduced.
[0092]
In the case of the head-mounted display 10, since there
is a correlation between the left and right image signals,
15 the effect of shifting the phase, the frequency or the polarity
as described above is considered to be significant.
[0093]
D. Coping with Dark Adaptation
The eyes of a human are known to have a "dark adaptation"
20 function by which, when a drastic change from an environment
with a great amount of visible light to an environment with
a small amount thereof takes place, eyesight gradually recovers
over time. The head-mounted display 10 is designed to
completely shut out the outside world when mounted on the head
25 so as to increase the sense of virtual reality at the time
of viewing. The environment includes a great amount of visible
light immediately be fore the head-mounted display 10 is mounted,
and the pupil diameter is adapted to the environment. When
the head-mounted display 10 is mounted, the environment changes
30 to that where the light is blocked and the amount of visible
light is significantly small, and the pupil diameter gradually
4 33
SP326010WO00
adapts to the mounted state over the course of 10 to 30 minutes.
[0094]
For example, in the case the brightness level of images
output from the display panels 401L and 401R (the viewing peak
5 brightness) is constant at all times, the eyes of a user cannot,
immediately after the mounting of the head-mounted display
10, adapt to the environment where the light is blocked, and
the environment may be felt as being too dark, but thereafter,
the eyes gradually adapt to the dark and the environment may
10 be felt as being sufficiently bright. In other words, there
is an inconvenience that an image may be felt as being too
dark immediately after the mounting.
[0095]
Accordingly, in the present embodiment, the viewing peak
15 brightness is changed according to the elapsed time from the
mounting of the head-mounted display 10 on a user so as to
make the user feel that the brightness of a display image is
constant, thereby overcoming the inconvenience described
above.
20 [0096]
The present embodiment intends to reproduce, by the
head-mounted display 10, an image such as viewed in a movie
theater. Digital Cinema Initiative, LLC specifies viewing
peak brightness of 48 nit (here, if the luminance of a planar
25 light source of one square meter is one candela in a direction
perpendicular to the plane, "nit" is the brightness in that
direction) . Due to the difference from a virtual environment
where the outside world is blocked by the head-mounted display
10, the present inventors assume that peak brightness of 60
30 nit of the display panels 401L and 401R of the head-mounted
display 10 corresponds to 48 nit in a movie theater. Viewing
<
34
SP326010WO00
peak brightness for dark adaptation of 100 nit, which is higher
than normal, is set for immediately after the mounting of the
head-mounted display 10, and then normal viewing peak
brightness of 60 nit is reached over the course of 10 to 30
5 minutes. Fig. 13A shows an example characteristic for
changing viewing peak brightness to be output from the
head-mounted display 10 according to dark adaptation of a
person.
[0097]
10 Furthermore, the speed of dark adaptation is different
for each person. For a user who quickly adapts to dark, if
the viewing peak brightness is slowly returned to 60 nit, the
image may be felt as being too bright during the process. On
the other hand, for a user who slowly adapts to dark, if the
15 viewing peak brightness is returned to 60 nit at a high pace,
the image may be felt as being too dark during the process.
[0098]
Accordingly, as shown in Fig. 13B, a plurality of
characteristics with different time over which the viewing
20 peak brightness is lowered from the viewing peak brightness
for dark adaptation, 100 nit, to the normal viewing peak
brightness, 60 nit, may be prepared, and the brightness may
be adjusted while switching the dark adaptation characteristic
for each user. A user may be enabled to issue an instruction
25 for the switching via the user operation unit 220. The CPU
206 may instruct the signal processor 202 to perform a
corresponding brightness correction process upon receiving
the instruction via the user operation unit 220.
[0099]
30 Moreover, the degree to which a user who has just worn
the head-mounted display 10 feels that a display image is dark
/
# 35
SP326010WO00
is not constant, and is different according to the amount of
light received in the outside world before the mounting. The
greater the amount of visible light in the outside world, the
smaller the pupil diameter, and thus, the darker the display
5 image immediately after the mounting. On the other hand, if
the amount of visible light in the outside world is small in
the first place, the pupil diameter is large to the extent
of the darkness, and the darkness is not greatly felt. In
other words, if the viewing peak brightness immediately after
10 the mounting is set to be constant regardless of the amount
of visible light in the outside world, the brightness of a
display image immediately after the mountingmay be appropriate
for a user who has worn the display in an environment with
a great amount of visible light, but the display image
15 immediately after the mounting may be too bright for a user
who has worn the display in an environment with a small amount
of visible light.
[0100]
Thus, as shown in Fig. 13C, the level of the viewing
20 peak brightness for dark adaption that is to be set for
immediately after the mounting of the head-mounted display
10 may be adjusted according to the amount of visible light
in the outside world. If the amount of visible light in the
outside world is great, high viewing peak brightness may be
25 set, and if the amount of visible light in the outside world
is small, lower viewing peak brightness may be set. As shown
in Fig. 2, in the present embodiment, the head-mounted display
10 includes the brightness sensor 223 . The CPU 206 may notify
the signal processor 202 of the viewing peak brightness for
30 dark adaption at the time of reducing the viewing peak
brightness according to dark adaptation based on the amount
4 36
SP326010WO00
of visible light in the outside world detected by the brightness
sensor 223.
[0101]
Additionally, to perform adjustment of the viewing peak
5 brightness that copes with dark adaption as described above,
the signal processor 202 has to be notified of the time of
start, that is, the mounting of the head-mounted display 10
on a user. For example, a user himself/herself may instruct
the start of viewing peak brightness adjustment at the time
10 of mounting via the user operation unit 220. As shown in Fig.
2, in the present embodiment, the head-mounted display 10 is
equipped with the mounting sensor 221, and thus, the CPU 206
may instruct the signal processor 202 to adjust the viewing
peak brightness when mounting is detected by the mounting
15 sensor 221.
[0102]
Fig. 14 shows an example configuration of the mounting
sensor 221. In the example shown, a forehead support 102 is
supported on a housing of the head-mounted display 10 by a
20 rotation shaft 142 in a freely rotatable manner. When not
mounted, the forehead support 102 is pushed to the back of
the head-mounted display 10, that is, toward the forehead side
of a wearing user, to a non-mounted position, by a restoring
force of a spring 144. Then, when mounted, it is pushed back
25 to a mounted position in the front by being abutted against
the forehead of the user. Furthermore, an arm 143 protruding
to the front is attached to the rotation shaft 142. Then,
when the forehead support 102 is pushed back to the front by
being mounted on the user, the arm 143 moves in conjunction,
30 and operates a tact switch 141 (corresponding to the mounting
sensor) by its tip end portion. The CPU 206 may detect mounting
^ 37
SP326010WO00
of the head-mounted display 10 on the user based on the operation
of the tact switch 141.
[0103]
E. Recognition Support for Virtual Image Distance
5 As has been described in the section "A. System
Configuration", with the head-mounted display 10, the optical
systems 402L and 402R of the display units 208L and 208R are
designed such that the seeming distance to the screens on the
display panels 401L and 401R and the seeming size thereof are
10 about the same as in a movie theater (for example, about 750
inches at a position 20 meters away) . It is thus sought to
enable a user wearing the head-mounted display 10 to view an
image as if the user is in a movie theater.
[0104]
15 However, the head-mounted display 10 is a device to be
mounted on the head of a user, and an effect similar to mechanical
myopia is possible caused. Moreover, there are the actual
size of the head-mounted display 10 itself and the preconceived
notion that the display panels 401L and 402R are inside the
20 head-mounted display 10, and also, parts other than the screen
are blacJc at the time of mounting and there is no visual
information indicating the distance to the image. Perception
of a visual distance is different for each person, but there
are cases where a user feels the distance to a virtual image
25 to be shorter than designed, and cannot feel like he/she is
seeing a large screen as in a movie theater.
[0105]
Thus, in the present embodiment, images including visual
information serving as a clue for a visual distance are
30 displayed on the display panels 401L and 402R. An image
including visual information serving as a clue for a visual
38
SP326010WO00
distance may be a stereoscopic image of a state where a screen
is being seen from the position of a seat in a movie theater
before the showing (see Fig. 15A), or a stereoscopic image
(a still image or a moving image) of the stage of a concert
5 hall (see Fig. 15B), for example. The image, in an image
display region of the display panel 401L or 402R, outside the
screen of a movie theater or the stage of a concert hall
corresponds to the visual information serving as a clue for
a viewing user to grasp the visual distance.
10 [0106]
If a stereoscopic image, as shown in Fig. 15A or Fig.
15B, perceived to have an actual size at the actual position
on the screen or the stage is displayed as a so-called splash
screen at the time of the power of the head-mounted display
15 10 being turned on or at the time of the head-mounted display
10 being mounted on a user, for example, when the screen or
the stage is later expanded over the entire screens of the
display panels 401L and 402R, the user will maintain the sense
of distance to the screen or the stage that is shown (i.e.
20 the impression of the visual distance intended at the time
of design). Additionally, mounting of the head-mounted
display 10 on a user may be detected by the mounting sensor
220 (as described above).
[0107]
25 Alternatively, as shown in Fig. 16, at the time of viewing
of an image, an original image of a movie, a concert or the
like may be displayed being reduced relative to the screen
size of the display panels 401L and 402R (an original image
may be displayed in an outlined region in the center in the
30 drawing) , and an image (a stereoscopic still image) seemingly
of an actual size may be displayed in the peripheral region.
39
SP326010WO00
The stereoscopic image seemingly of an actual size, which is
displayed outside the image display regions of the display
panels 401L and 402R, is the visual information serving as
a clue for grasping the visual distance, and a user who views
5 an original image may recognize the size of the screen or the
stage and the distance.
[0108]
F. Screen Display following Movement of User's Neck
A user wears the head-mounted display 10 on the head
10 and views an image, and thus, unlike a case of viewing a usual
monitor display, an image is constantly in the field of view
even if the user turns the neck to a side to look away from
the screen. Therefore, the user may get an uncomfortable
feeling or may feel sick when viewing using the head-mounted
15 display 10.
[0109]
In the present embodiment, the head-mounted display 10
is equipped with the accelerometer 22, and the movement of
the head of the user wearing the head-mounted display 10 may
20 be tracked based on the output of the sensor.
[0110]
Thus, as shown in Fig. 17, the image display images of
the display panels 401L and 401R may be moved based on the
result of tracking the movement of the head of the user. At
25 this time, of the display image, the end region opposite to
the movement of the head (the region shown with diagonal lines
in Fig. 17) drops behind the image display regions of the display
panels 401L and 401R and becomes hidden. Accordingly, a user
may avoid an image which may make him/her feel sick by turning
30 his/her neck to a side. Also, of the image display regions
of the display p anels 401L and 401R, the end region in the
40
SP326010WO00
movement direction of the head moves past the image frame and
thus there is no image information, and a black image is
displayed at a part outside the image frame. In this manner,
when a user turns his/her neck to a side, he/she may view an
5 image in the same way he/she views the image with a normal
monitor display, and the sense of discomfort may be overcome.
[0111]
The CPU 206 is capable of calculating the amount of
movement of a user' s head (the amount of rotation of the neck)
10 by acquiring sensor information from the accelerometer 222.
Accordingly, with the CPU 206 instructing the signal processor
202 to move the image to be displayed in accordance with the
calculated amount of motion, image display as shown in Fig.
17 may be realized.
15 [0112]
Also, as described above, due to the preconceived notion
that the display panels 401L and 402R are inside the
head-mounted display 10, for example, a user may feel the visual
distance to be shorter than the designed distance to a virtual
20 image. Accordingly, if the amount of motion of an image is
determined based on the designed distance to a virtual image
at the time of moving an image to be displayed in accordance
with the amount of motion of the head of a user, an impression
of the visual distance intended at the time of design may be
25 given to the user.
[0113]
As shown in Fig. 18A, even with the same angle of view,
the size of a virtual image is different according to the assumed
visual distance. A visual shift with respect to the screen
30 at the time of movement of the position of the head becomes
smaller in inverse proportion to the visual distance. If the
41
SP326010WO00
visual distance doubles as shown in Fig. 18A, the visual shift
is reduced to half as shown in Fig. 18B. That is, the number
of pixels for movement will be half at the time of moving a
display image as shown in Fig. 17.
5 [0114]
At the time of moving an image to be displayed in
accordance with the amount of motion of the head of a user
in the manner described above, when a shift in the position
of the head is detected based on acceleration information
10 acquired from the accelerometer 222, the CPU 206 determines
the amount of movement of the display position based on the
designed visual distance to thereby give an illusion to the
user with respect to the visual distance to the position of
a virtual image.
15 [0115]
G. Output Switching by Front End Box (1)
The front end box 40 corresponds to an HDMI repeater
for inputting/outputting AV signals output from the Blu-ray
disc reproduction device 20. Also, the front end box 40 is
20 a two-output switcher according to which the output destination
is exclusive, and output is performed to the head-mounted
display 10 or the high vision display 30.
[0116]
If the front end box 40 is the main appliance existing
25 at the "front end" of the head-mounted display 10, the highest
priority should be placed on the output to the head-mounted
display 10.
[0117]
Here, a case of performing output switching of the front
30 endbox 40 by a user operation will be considered. Forexample,
if one wants to stop viewing with the head-mounted display
42
SP326010WO00
10 and to start viewing with the high vision display 30, at
least the following two user operations have to be performed,
and this may be burdensome.
[0118]
5 (1) Operate the power switch 231, and turn off the power
of the head-mounted display 10.
(2) Operate the user operation unit 509, and switch the
output destination of the front end box 40 to the high vision
display 30.
10 [0119]
In the present embodiment, using the fact that the output
destination of AV signals from the output switching unit 504
is exclusive, switching of a viewing operation from the
head-mounted display 10 to the high vision display 30 is
15 performed with a smaller number of user operations.
Specifically, when the power switch 231 is operated and the
power of the head-mounted display 10 is turned off, this is
detected by the control unit 506 via the first output unit
502, and the output switching unit 504 is instructed to switch
20 the output destination of AV signals to the high vision display
30. That is, with the power state of the head-mounted display
10 and the output switching by the output switching unit 504
being in conjunction with each other, automatic switching to
viewing with the high vision TV 30 may be performed by one
25 user operation of turning off the power of the head-mounted
display 10.
[0120]
As shown in Fig. 19A, when the power switch 231 is operated
and the power of the head-mounted display 10 is turned on,
30 the front end box 40 outputs, exclusively to the head-mounted
display 10, the AV signals reproduced and output by the Blu-ray
43
SP326010WO00
disc reproduction device 20.
[0121]
Here, while the AV signals are being output to the
head-mounted display 10, the front end box 40 assumes at the
5 output switching unit 504 the same state as where the HDMI
cable at the high vision display 30 is unplugged. As a result,
the high vision display 30 will be not be seen by the Blu-ray
disc reproduction device 20 on the HDMI interface.
[0122]
10 Subsequently, when the power switch 231 is operated and
the power of the head-mounted display 10 is turned off (standby
state) as shown in Fig. 19B, the front end box 40 stops output
of the AV signals to the head-mounted display 10, and instead,
switches the output of the AV signals to the high vision display
15 30.
[0123]
Also, while the AV signals are being output to the high
vision display 30, the front end box 40 assumes at the output
switching unit 504 the same state as where the HDMI cable at
20 the head-mounted display 10 is unplugged. As a result, a state
is achieved where the Blu-ray disc reproduction device 20 will
not see the head-mounted display 10 but will see the high vision
display 30 instead on the HDMI interface.
[0124]
25 H. Output Switching by Front End Box (2)
In the example system configuration shown in Fig. 1,
AV signals output from the Blu-ray disc reproduction device
20, which is an HDMI source appliance, are transferred to the
high vision display 30 corresponding to an HDMI sink appliance
30 by the front end box 40 corresponding to an HDMI repeater.
[0125]
I» 44
SP326010WO00
On the other hand, as described above, the front end
box 40 is also a two-output switcher that places the highest
priority on the output to the head-mounted display 10. While
the AV signals are output exclusively to the head-mounted
5 display 10, the high vision display 30 may be in a standby
state, or the power of the high vision display 30 may be turned
off, or the high vision display 30 may not be connected in
the first place.
[0126]
10 Here, if the front end box 40 is to realize the HDMI
repeater function with respect to the high vision display 30,
power has to be supplied at all times to a circuit portion
for repeating the HDMI signal, and this may result in the
increase in the power consumption during the standby for output
15 to the high vision display 30 as an HDMI source appliance.
[0127]
Accordingly, in the present embodiment, the front end
box 40 only supplies power to a circuit portion for monitoring
the connection state of an HDMI source appliance and an HDMI
20 sink source while the output to the high vision display 30
as an HDMI source appliance is in standby. Thus, power is
supplied to an HDMI repeater function circuit only when an
HDMI appliance is connected to the front end box 40 as an HDMI
repeater, and the power consumption at the time of standby
25 may be suppressed.
[0128]
For example, a connectionmonitoring circuit in the front
end box 40 monitors a +5V signal of a source appliance that
is HDMI-connected to the HDMI input unit 501. Then, when the
30 Blu-ray disc reproduction device 20, which is an HDMI source
appliance, is connected by an HDMI cable to the HDMI input
45
SP326010WO00
unit 501, the connection monitoring circuit in the front end
box 40 detects a +5V signal emitted from the HDIM source
appliance from a signal line included in the cable, and enables
the repeater function with respect to an HDMI sink appliance
5 (see Fig. 20) . Also, in the case a +5V signal is not detected,
the repeater function is disabled with respect to the HDMI
sink appliance, and the power consumption at the time of standby
is suppressed.
[0129]
10 Alternatively, the connection monitoring circuit in the
front endbox 40 monitors both a +5V signal of a source appliance
that is HDMI-connected to the HDMI input unit 501, and an HPD
(Hot Plug Detect) signal of a sink appliance that is
HDMI-connected to the second output unit 503 . Then, only when
15 an HPD signal emitted by the HDMI sink appliance is detected
together with a +5V signal emitted by the HDIM source appliance
does the connection monitoring circuit in the front end box
40 enables the repeater function with respect to the HDMI sink
appliance (see Fig. 21) . If one of the signals is not detected,
20 the repeater function is disabled, and the power consumption
at the time of standby is suppressed.
INDUSTRIAL APPLICABILITY
[0130]
25 Heretofore, the present invention has been described
in detail with reference to a specific embodiment. However,
it is obvious that those skilled in the art may attain
modifications and alterations of the relevant embodiment
within the scope not departing from the gist of the present
30 invention.
[0131]
46
SP326010WO00
In the present specification, an embodiment where the
present invention is applied to the head-mounted display has
been mainly described, but the gist of the present invention
is not limited to the configuration of a specific head-mounted
5 display. The present invention may be similarly applied to
various types of display systems for forming a virtual image
on the retina of the eye of a user.
[0132]
In short, the present invention has been disclosed in
10 the form of exemplifications, and the described contents of
the present specification should not be construed in a limited
manner. In order to determine the gist of the present invention,
the scope of the claims should be considered.
15 REFERENCE SIGNS LIST
[0133]
10 Head-mounted display
20 Blu-ray disc reproduction device
30 High vision display
20 40 Front end box
102 Forehead support
141 Tact switch
142 Rotation shaft
143 Arm
25 144 Spring
201 Signal transmission/reception unit
202 Signal processor
203 VRAM
204 Panel controller
30 205 ROM
206 CPU
47
SP326010WO00
208L, 208R Display unit
209 ROM
210 RAM
211 Audio DAC
5 212L, 212R Headphone
220 User operation unit
221 Mounting sensor
222 Accelerometer
223 Brightness sensor
10 230 Power source unit
231 Power switch
301 Housing
302 Display unit portion
303L, 303R Headphone portion
15 304 Forehead support
305 Head band, 305A Upper band, 305B Lower band
401L, 401R Display panel
402L, 402R Optical system
501 HDMI input unit
20 502 First output unit
503 Second output unit
504 Output switching unit
505 Audio DAC
506 Control unit
25 507 HP connector
509 User operation unit

48
SP326010WO00
CLAIMS
1. A display system comprising:
an image information supply device for supplying image
5 information;
a first display device for being mounted on and for being
used by a user;
one or more second display devices; and
an output switching device for connecting the first
10 display device and the second display device, and for
outputting the image information supplied by the image
information supply device preferentially to the first display
device.
15 2. A display device comprising:
a mounting portion for being fixed to a head of a user;
a user operation unit for being used by a user to perform
an operation input;
a display unit for a left eye for displaying an image
20 for a left eye;
a display unit for a right eye for displaying an image
for a right eye;
a signal processing unit for processing image signals
to be displayed by the display unit for a left eye and the
25 display unit for a right eye;
a display control unit for controlling display driving
of the display unit for a left eye and the display unit for
a right eye; and
an orbital processing unit for causing a GUI region to
30 orbit, where the GUI region is for being superimposed on images
to be displayed on the display unit for a left eye and the
49
SP326010WO00
display unit for a right eye.
3. The display device according to claim 2, wherein the
orbital processing unit causes the GUI region to operate every
5 time the GUI region is output or at every specific interval.
4. The display device according to claim 2, wherein the
orbital processing unit stops an orbital operation while a
user is operating a GUI via the user operation unit.
10
5. A display device comprising:
a mounting portion for being fixed to a head of a user;
a user operation unit for being used by a user to perform
an operation input;
15 a display unit for a left eye for displaying an image
for a left eye;
a display unit for a right eye for displaying an image
for a right eye;
a signal processing unit for processing image signals
20 to be displayed by the display unit for a left eye and the
display unit for a right eye; and
a display control unit for controlling display driving
of the display unit for a left eye and the display unit for
a right eye,
25 wherein a brightness correction parameter different for
an image display region and a black image display region is
set for screens of the display unit for a left eye and the
display unit for a right eye for when images with a different
aspect ratio are displayed, and abrightness correctionprocess
30 for an image signal is performed by the signal processing unit.
50
SP326010WO00
6. A display device comprising:
a mounting portion for being fixed to a head of a user;
a user operation unit for being used by a user to perform
an operation input;
5 a display unit for a left eye for displaying an image
for a left eye;
a display unit for a right eye for displaying an image
for a right eye;
a signal processing unit for processing image signals
10 to be displayed by the display unit for a left eye and the
display unit for a right eye; and
a display control unit for controlling display driving
of the display unit for a left eye and the display unit for
a right eye,
15 wherein the display control unit causes timings for
display data signals to be output, respectively, to the display
unit for a left eye and the display unit for a right eye to
be different.
20 7. The display device according to claim 6, wherein the
display control unit changes, between left and right, one of
a phase, a frequency and a polarity of display data signals
to be output, respectively, to the display unit for a left
eye and the display unit for a right eye.
25
8. A display device comprising:
a mounting portion for being fixed to a head of a user;
a user operation unit for being used by a user to perform
an operation input;
30 a display unit for a left eye for displaying an image
for a left eye;
51
SP326010WO00
a display unit for a right eye for displaying an image
for a right eye;
a signal processing unit for processing image signals
to be displayed by the display unit for a left eye and the
5 display unit for a right eye; and
a display control unit for controlling display driving
of the display unit for a left eye and the display unit for
a right eye,
wherein the signal processing unit changes viewing peak
10 brightness according to elapsed time from start of using of
the device by a user.
9. The display device according to claim 8, wherein the
signal processing unit gradually reduces viewing peak
15 brightness for dark adaptation that is higher than set viewing
peak brightness that is normally set, to the set viewing peak
brightness over specific time.
10. The display device according to claim 9, wherein the
20 signal processing unit adjusts the time over which the viewing
peak brightness for dark adaptation is returned to the set
viewing peak brightness, according to a dark adaptation
characteristic of a user wearing the device.
25 11. The display device according to claim 9, further
comprising:
a brightness sensor,
wherein the signal processing unit adjusts the viewing
peak brightness for dark adaptation according an amount of
30 visible light in an outside world detected by the brightness
sensor.
52
SP326010WO00
12. A display device comprising:
a mounting portion for being fixed to a head of a user;
a mounting sensor for detecting mounting of the mounting
5 portion to a head of a user;
a user operation unit for being used by a user to perform
an operation input;
a display unit for a left eye for displaying an image
for a left eye;
10 a display unit for a right eye for displaying an image
for a right eye;
an optical system provided to each of the display unit
for a left eye and the display unit for a right eye, the optical
system having a designed predetermined visual distance to a
15 virtual image;
a signal processing unit for processing image signals
to be displayed by the display unit for a left eye and the
display unit for a right eye; and
a display control unit for controlling display driving
20 of the display unit for a left eye and the display unit for
a right eye,
wherein in response to detection of mounting by the
mounting sensor, a splash screen including visual information
serving as a clue for a user to feel the visual distance is
25 displayed on the display unit for a left eye and the display
unit for a right eye.
13. The display device according to claim 12, wherein the
splash screen is a stereoscopic image of a state where a screen
30 is being seen from a position of a seat in a movie theater
before showing, or a stereoscopic image of a stage of a concert
53
SP326010WO00
hall, and an image outside the screen of the movie theater
or the stage of the concert hall is the visual information
serving as a clue for a user to feel the visual distance.
5 14. A display device comprising:
a mounting portion for being fixed to a head of a user;
a user operation unit for being used by a user to perform
an operation input;
a display unit for a left eye for displaying an image
10 for a left eye;
a display unit for a right eye for displaying an image
for a right eye;
a signal processing unit for processing image signals
to be displayed by the display unit for a left eye and the
15 display unit for a right eye; and
a display control unit for controlling display driving
of the display unit for a left eye and the display unit for
a right eye,
wherein at a time of viewing of an image, an original
20 image is displayed being reduced relative to a screen size,
and visual information serving as a clue for a visual distance
is displayed outside the original image.
15. A display device comprising:
25 a mounting portion for being fixed to a head of a user;
an accelerometer for detecting acceleration acting on
the device;
a user operation unit for being used by a user to perform
an operation input;
30 a display unit for a left eye for displaying an image
for a left eye;
54
SP326010WO00
a display unit for a right eye for displaying an image
for a right eye;
a signal processing unit for processing image signals
to be displayed by the display unit for a left eye and the
5 display unit for a right eye; and
a display control unit for controlling display driving
of the display unit for a left eye and the display unit for
a right eye,
wherein an amount of motion of a head of a user is tracked
10 based on a measurement result of the accelerometer, and image
display regions of the display unit for a left eye and the
display unit for a right eye are moved according to the amount
of motion.
15 16. The display device according to claim 15, further
comprising:
an optical system provided to each of the display unit
for a left eye and the display unit for a right eye, the optical
system having a designed predetermined visual distance to a
20 virtual image,
wherein an amount of movement of the image display
regions according to the amount of motion is determined based
on the visual distance to the virtual image.
25 17. A relay device comprising:
an input unit for connecting a reproduction device, and
for inputting a reproduction signal from the reproduction
device;
a first output unit for connecting a first display device
30 and outputting the reproduction signal;
a second output unit for connecting a second display
55
SP326010WO00
device and outputting the reproduction signal; and
an output switching unit for exclusively outputting the
reproduction signal to the first output unit or the second
output unit, and for preferentially performing output from
5 the first output unit to the first display device,
wherein the relay device relays between the reproduction
device, and the first display device and the second display
device.
10 18. The relay device according to claim 17, wherein the
output switching unit monitors a power state of the first
display device via the second output unit, and outputs the
reproduction signal from the first output unit to the first
display device in response to turning on of power of the first
15 display device, and outputs the reproduction signal from the
second output unit to the second display device in response
to turning off of power of the first display device.
19. The relay device according to claim 17, wherein
20 the reproduction device and the input unit, and the
second display device and the second output unit are connected
by an HDMI interface, and
the output switching unit enables a repeater function
of the input unit for the second output unit in response to
25 detection of a +5V signal at the input unit.
20. The relay device according to claim 17, wherein
the reproduction device and the input unit, and the
second display device and the second output unit are connected
30 by an HDMI interface, and
the output switching unit enables a repeater function
56
SP326010WO00
of the input unit for the second output unit in response to
detection of a +5V signal at the input unit and detection of
an HPD signal at the second output unit.