INFORKATION PROCESSING SYSTEM AND INFORMATION
PROCESSING METHOD
Technical Field
[OOOl] The present technofogy relates to an
information proce'ssing system and an information
pzocessing method that control display of image data
obtained by a microscope in the fields of medical
treatment, pathology, biological discipline, materials,
and the like.
Background Art
COO021 In the fields of medical treatment, pathology;
and the like, there is proposed a system in which an '
image of a section of a cell, a tissue, an organ, or
the like of a living body that is obtained by an
optical microscope is digitalized and the section is
inspected or a patient is diagnosed-by a diictor, a
pathologist, or the like based on the digital image.
[0003] For example,.in a method described in Patent
Document 1, an image optically obtained by a microscope
is digitalized by a video camcorder installing a CCD
(Charge Coupled Device) therein, and the digital signal
is inputted into a control computer system and
visualized on a monitor. The pathologist performs an
inspection and the like while viewing the image
displayed on the monitor (e.g., see paragraphs [0027]
and [0028] and Fig. 5 of Patent Document 1) .
[0004] Patent Document 1: Japanese Patent
Application Laid-open No. 2009-37250
Summary of ~nvent'ion
P-roblem to be solved by the Invention
[0005] In the case where a section is imaged using
an optical microscope, a section is placed on a glass
slide to fabricate a prepared slide. However, in the
case where a number of sections are imaged, for example,
a plurality of sections may be, in some cases, placed
on a single glass slide for reasons of efficiency in -
fabrication of a prepared slide, saving of glass y slides,
and the like. When the glass slide on which the
plurality of sections are placed in this manner is
entirely imaged, only an integrate image as the entire
glass slide is obtained, and each of images of the
. .
individual sections is not obtained. Therefore, it is
difficult to separately handle the images of the
individual sections. There is a fear that a convenience
for the user is deteriorated.
[0006] On the other hand, if a plurality of sections
placed on a glass slide are individually imaged, each
of images of the individual sections can be obtained.
Therefore, it is possible to separately handle the
images of the individual s,ections. However, for example,
in the case where a plurality of sections obtained by
slicing a single specimen a plurality of times are
placed on a single- glass slide, it is difficult to
handle images of the individual sections individually
imaged with the images being associated with each other.
T-here is a fear that a convenience for theuser is
deteriorated.
[0007] In view of the above-mentioned circumstances,
it is an object of the present technology to provide an
information processing apparatus and an in'fdrmation
processing method more excellent in convenience for a
user.
Means for solving the Problem
[0008] In order to solve the above-mentioned problem,
an information processing system according to a first
aspect of the present technology includes: an
acquisition unit to acquire image data obtained by
capturing a slide on which a plurality of sections
obtained by cutting a single specimen in the same
direction are discretely placed; a detector to detect a
plurality of specimen areas in the acquired image data
and to calculate position information relatively
indicating positions of the individual specimen areas
in a coordinate space of the image data, the plurality
of specimen areas having the same shape and including
the individual sections; a first storage unit to store
the calculated position information; and a controller
to switch display between the specimen areas based on
the stored position information.
[0009] That is', the controller switches display
b-etween the specimen areas based on the position
information being metadata. With this, the controller
can jump areas other than the specimen areas and switch
display between the specimen areas irrespective of the
fact that the image data acquired by the acquisition
unit is'the image data obtained by capturing the slide
itself on which the plurality of sections are placed. A
Further, by recording the specimen area as the position
information being the metadata, the first storage unit
can switch display between the specimen areas
efficiently and at high speed. In addition, using the
position information being the metadata, even if the
plurality of specimen areas are arranged in image data
of a plurality of slides, the display processing can be
efficiently performed as in the case where a plurality
of specimen areas detected from single image data are
displayed in order.
[OOlO] The information processing system may further
include a generator to generate reduced data by
h
2
a
d
rd .
rb
a,
k
rd
h
rd
4 a
rn
-4 a
rd
rn
rd
rd
a,
k
(d
d
2 -4
U
a, a
0)
a
a,
-4
'i-i
-4
U
a, a
rn
w
0
c,
k
rd a
'i-i
0
rb
a,
L4
rd
h
rb
4-1- a rn
-4 a
a,
A
C,
'i-i
-4
rr:
$
a, . cn
-4
C,
rd
C
E-l
- m
rl
0
0 -
'i-i
0
a
d
a,
d
rd
C,
rd
a
a,
c,
rb
U
0
ri
In
-4
rd
a,
k
rd
3 4
rd
ri
a
rn
-4 a
a,
C
c,
C
a,
C
3 .
-2
c,
-4
3
rn
rb
a,
k
rd
h
rd
r-i a
rn - 4 a
a,
C
C,
m
C
-4
2 E
$4
0
'i-i
d
0
-4
C,
U
9
)-I
c,
cn
C
-4
C
rd . k
a,
rn
7
0
'i-i r:
0 -1
'i-i
0
'i-i
calculated display area is located at an end of the
specimen area in one axial direction of the plurality
of specimen areas in the coordinate space of the image
data and the controller receives, from the user, an
instruction for moving the display area outside the end
in the one axial direction, to display a neighbor
specimen area in the cutting order.while fixing a
ppsition in the other axial dir.ection.
[0015] With this, a position of the display area in
the specimen area at the moving destination corresponds
to a position of the display area in the specimen area
at a moving source at the moving destination. Therefore,
a convenience for the user can be provided.
[0016] The acquisition unit may acquire image data
obtained by capturing a slide on which a plurality of
sections obtained by cutting a single specimen in the
same direction are arranged and placed discretely and
in one row, and the controller may calculate, when the
calculated display area is located at an end of the
. .
specimen area in an arrangement direction of the
plurality of specimen areas in a coordinate space of
the image data and the controller receives, from a user,
an instruction for moving the display area beyond the
end in the arrangement direction, a display area of the
specimen area in the moving destination based on the
stored position information.
a
C
r d '
corresponding display area and perform the display
processing efficiently and at high speed.
[0020] The alignment unit may calculate an affine
transformation matrix for causing the detected feature
points in the plurality of specimen areas to correspond
to each other in a display space, and may calculate,the
offset amount based on the calculated affine
transformation matrix.
[00211 By using the affine transformation matrix, it
is possible to calculate an offset amount in two axial
directions. With this, it is possible to more
accurately calculate the corresponding display area
before and after jumping.
[0022] The controller may divide, when the
controller receives, from a user, specification of a
plurality of specimen areas to be displayed in the
obtained image data, a display space into display
spaces as many as the plurality of specified specimen
areas, and calculates, based on the.stored position . .
information and the stored offset amount, the display
area to be displayed in the plurality of display spaces
such that positions of the feature points in the
specimen areas to be displayed in the plurality of
display spaces correspond to each other.
[0023] That is, based on the offset amount between '
the feature points included in the plurality of
specimen areas that is the metadata, the controller can
cause the positions of the feature points in the
specimen areas to be displayed in the plurality of
display spaces to correspond to each other. Further, by
5 using the metadata for setting the display area, it is
possible to accurately calculate the corresponding
display area and perform display processing efficiently
agd at high speed.
[0024] An information processing method according to
, 10 a second aspect according to the present technology
includes: acquiring, by an acquisition unit, image data
obtained by capturing a slide on which a plurality of
sections. obtained by cutting a single specimen in the
same direction are discretely placed; detecting, by a .
detector, a plurality of specimen areas in the acquired
image data and calculating position information
relatively indicating positions of the individual
specimen areas in a coordinate space of the image data,
the plurality of specimen areas having the same shape
and including the individual sections; storing, by a
first storage unit, the calculated position
information; and switching, by a controller, display
between the specimen areas based on the stored position
information.
Effect of the Invention
i
[0025] As mentioned above, according toxthe present
technology, it is possible to provide an informaticn
processing apparatus and an information processing
method more excellent in convenience for a user.
Brief Description of Drawings
[0026]
[Fig. 11 A view showing a configuration of an
information processing system according to an
. 10 embodiment of the present technology.
[Fig. 21 A view showing functional configurA ations of
an image server realized using a typical computer
system. ,
[Fig. 31 A view for explaining a slide image.
15 [Fig. 41 A view for explaining feature matching.
[Fig. 51 A view for explaining the feature matching.
[Fig. 61 A view for explaining the feature matching.
[Fig. 71 A view for explaining the feature matching.
[Fig. 81 A view for explaining the. feature matching.
20 [Fig. 91 A view showing functional configurations of a
viewer realized using the typical computer system.
[Fig. 101 A view for explaining setting of the numbers
of specimen areas.
[Fig. 111 A view for explaining the setting of the
25 numbers of the specimen areas.
[Fig. 121 A view for explaining the setting of the
numbers of the specimen areas.
[Fig. 131 A view for explaining discrete display.
[Fig. 141 A flowchart showing discrete display
processing by a viewer.
[Fig. 151 A view showing a specimen area selection
screen.
[Fig. 161 A view for explaining jump display.
[Fig. 171 A flowchart showing jump display processing
by the viewer.
[Fig. 181 A view for explaining synchronous display.
[Fig. 191 A view showing a hardware configuration of a
typical computer.
[Fig. 201 A view showing a configuration of an
information processing apparatus according to a
modified example.
Modes for Carrying Out the Invention
[0027] Hereinafter, embodiments according to the
present technology will be described with reference to
the drawings.
[0028] [Information Processing System]
Fig. 1 is a view showing a configuration of an
information processing system according to an
embodiment of the present technology.
This information processing system 1 includes an
image server 100 and one or more viewers 200A and 200B.
Those can be connected to one another over a network
300. The network 300 may be a WAN (Wide Area Network)
such as the Internet or may be a LAN (Local Area
Network). Further, the network 300 may be ,wired or
wireless. Here, for easy description, a case where the
>
two viewers 200A, 30B are connected is shown. However,
the number of viewers may be three or more. Herein,
when the viewers are not individually specified, those
will be referred to as "viewers 200." The image server
100 and the one or more viewers 200 may be configured
by, for example, a typical computer.
[0029] [Image Server 1001
Functional configurations of the image server 100
will be described.
Fig. 2 is a view showing the iunctional
configurations of the image servsr 100 realized using a
typical computer system.
[0030] The image server 100 includes an image
acquisition unit 109 (acquisition unit), a slide image
accumulation unit 101, a thumbnail image generator 110
(generator), a thumbnail image storage unit 102, a
specimen area detector 103 (detector), an offset
coordinate storage unit 104 (first storage unit), a
feature matching unit 105, a triangle and matrix
storage unit 106, a server controller 107, and a server
communication unit 108. Each functional unit is
realized in a computer resource based on programs
loaded into a RAM (Random Access Memory).
[0031] For example, the image acquisition unit 109
acquires an image over a network or data of a slide
image recorded in a removable recording medium. The
image acquisition unit 109 accumulates this data of the
slide image and a' slide ID in the slide image
a-ccumulation unit 101 with this data of the slide image
being associated with the slide ID. The term of "slide
image" means, as shown in Fig. 3, an image obtained by
capturing a glass slide 610 on which a plurality of
sections 601 to 607 obtained by cutting a single
specimen 600 in the same direction are placed, the
plurality of sections 601 to 607 being arranged
discretely and in one row. For example, in the case
where a large number-of sections are obtained from the
single specimen 600, a plurality of glass slides on
which a plurality of sections are placed are fabricated.
TheSterm of "slide ID" means an ID for individually
identifying ,data of a plurality of slide images. Note
that the phrase of "arranged in one row ..." means an
arrangement state in a direction from one end to the
other end of a glass slide, not limited to the
precisely linearly arrangement state.
[0032] The thumbnail image generator 110 generates
thumbnail images of the slide images accumulated in the
slide image accumulation unit 101. The thumbnail image
generator 110 records data of the thumbnail images and
the above-mentioned slide ID in the thumbnail image
storage unit 102 with the data of the thumbnail images
being associated with the above-mentioned slide ID. The
term of "thumbnail image" means reduced data obtained
by reducing a resolution of data of a slide image. The
slide image accumulation unit 101 and the thumbnail
image storage unit 102 are set in a rewritable nonvolatile
memory.
[0033] The specimen area detector 103 reads out the
data of the thumbnail image from the thumbnail image
s,torage,unit 102. The specimen area detector 103
detects, from the read-out data of the thumbnail image,'
a plurality of areas including the plurality of
sections placed on the glass slide (hereinafter,
referred to as specimen areas). The detection of the
specimen areas is performed as follows, for example.
That is, the specimen area detector.103 recognizes a
point in an image at which the luminance sharply
changes, as a boundary of an object on the glass slide
(edge extraction). The specimen area detector 103
recognizes a closed curve having a size larger than a
threshold, as an edge (contour) of the section.
Subsequently, the specimen area detector 103 extracts
specimen areas including the recognized section from
m < w C X u
C m . 0 a, 0 a a,
G -4
u a ,
O C : - 4 Q > a,
c, -4 rd .- C , c , m c L 4 l c l r - I a, 0 e m u C a a, 3 rn rd
a, U -4 O z W Q a , r d C a , a , u ~ m - O O m C: . w -d M
a , m a , , C o c , C 2 ~ C C u ~ r d d O r d2 c 0
C
-4 rd -G
a a - ~ c r l . ~ s a , w u r d c a c , - r l a, m
O a , uU u & U mU Om W w o a ,u r- dr cd~ ac ,, aa )a , -
-i a , o o o a , aW 3 2 -U 0 - 1 o aa c m .wr l a~, c ,r d
u c g w . , + r u u c m . a , rd w m u c
m . 0 G a, -4 o ~ d c ~ o o .-4 ~ ~ c a r d -4 4J a c , ~ -
m -4 0
C, U O O
a , - r d a , c,
- u c, G c a 4 , a u w a , u C uO c~ ,C aU - Lr Jl Q~ ~u ~Q aC ,~ , c - m -I a, -4 -4 O r d r d O Ca a, ,m' ~H $ a, 0m - a ' g ww
a , m u u - r l m W Q C - r i . C , c n c n a , 3 0 2 u-l a , O u " - 4 a , g m c p ~ o u r d a , l c l m a , ~ c m
-4 m sa m, ta na h r d a , ~ u ~ ~m~' - wW- aL~, a) ,~c La ,I O c, ~ rd W ~a, ~a, U @ U G
d O C , c, a c 0 - r l a r d c ,
-4 rl a, a, --4 m -4 rd o a a , . u r i - r i a - r i
a u c c a a , a s c a , ~ C - - I C C
u0 Cm i ~ ~ u r o , k u r i m z -4
r d U A 0 0 u o c r ~d a" ,$ haa, -24 0 m a , 4 m
a u o o a w u . - 4 - c , - I u ?i u u a , G u c ,
C @ G .O - a, r d @ X 0 N . U @ r d
- G Q U M Q 5 C , a , C 6 @ - 4 - r i a . C , C , r d 1L T3
W a , t n d O @ M O - 4 G D X U-I m a w a m r d
c u a c n c , ~ u . c r d - r l u ~ c , ~ r d c l u a c n d c c,
.G c r d a , l d c , w c, C -4 c u o a ,
" 3 3 2
rd c,
U r d r d a , c a , k l c l C r d 0 - 4 r d w -
a, a U C, 3 0 rn h V l 3 0 - i
2
2 E a, 0 . 4 G
I, k Q rd . ~c a , a , c , a a , u~ m ~ a ,
o r d r d a , C, m - r l 0 4 0 4 )-1 m a , a r d a a , a , A
G C $ C ~ u W r d r d r d P I d h C - i - 4 a, a c , m u
r d C c U - r i a a ) a , c 7 E u x r i u r d r i 4 c c , m r d C
c, C A E rd a -4 a -4 -4 a, r d . ~ ~ c t n rd c -rl m
r d Z L ~ c , - r i m -ri w C Q U ~2 4 a , . r l a a e a m - 4 m - a =I $ a , - r i a , . r l c , a , r n r l = l ~ a ~ - l
a, : : 2 r n r , s : - r l a ~ ~ - ~ - r r , ~ u c o ~ r d d - r i a , d . r i . ~ d r d 0 r - I O U U
a a m o , r d r d a , c - ~ a r d u ~ ~ a r d w o ~ a ,
c , m c n r d - 4 r d a , - ? u a , - 4 m m ~ o ( d o a , U o U - r i h
unit 104. This "number" reflects a section cutting
order, that is, an arrangement order of the sections in
a direction almost orthogonally to a cutting surface.
For example, the "number" is expressed by an integer
5 equal to or larger than one and set by the specimen
area detector 103. The offset coordinate storage unit
104 is set in a rewritable non-volatile memory.
[9 0 3 5 1 Now, a setting method for the slide number
and the specimen area number will be described.
. 10 First, as described above, the specimen area
detector 103 performs feature matching between images
of a plurality of specimen areas detected from data of
a thumbnail image. The feature matching only needs to
be performed by the same manner as the feature matching'
15 by a feature matching unit 150 to be described later.
Based on a result of the feature matching, the specimen
area detector 103 determines degrees of similarity
among sections A to F within the plurality of specimen
areas included in one sli'de image. .Then, as shown in . .
20 Fig. 10, the specimen area detector 103 performs
grouping such that the specimen areas including the
sections B and C having high degree of similarity are
located close to each other and the specimen areas
including the sections D and E having high degree of
25 similarity are located close to each other. Then, as
shown in Fig. 11, the specimen area detector 103
determines that the sections are continuous from the
large section A on one side of the specimen 600 (e.g.,
root) to the small section F (e.g., tip). As shown in
Fig. 12, the specimen area detector 103 sets continuous
5 specimen area numbers such that position intervals of
feature points decrease.
[0036] When the specimen area number of the
plurality of specimen areas inc-luded in all the slide
images are set, the specimen area detector 103
10 determines degrees of similarity between specimen areas
at both ends of a certain slide image and specimen
areas at both ends of a different slide image. The
specimen area detector 103 determines the slide images
including the specimen areas having a high degree of -
15 similarity as continuous slide images, and sets
continuous slide numbers. The specimen area detector
103 rewrites the slide IDS recorded in the slide image
accumulation unit 101 and the thumbnail image storage
unit 102, using the set slide numbers. .. .
I 20 COO371 Note that the specimen area number and the
I slide number may be modified by the user through the
viewer 200. Alternatively, for example, when the user
arranges the sections in order from the left to the
right on the glass slide or when the user wishes to
25 place a specimen area suspected of having a disease at
the head, the' specimen area number and the slide number
may be set by the user through the viewer 200.
Alternatively, information inputted into an LIS
(Laboratory Information System) may be loaded into the
viewer 200 to set the. specimen area number and the
5 slide number.
[0038] The feature matching unit 105 performs the
feature matching between images of the specimen areas
of each of the slide images accumulated in the slide
image accumulation unit 101 (to be described later in
10 detail). Specifically, the feature matching unit 105
reads out data of the slide image from the slide image
accumulation unit 101. Further, the feature matching
unit 105 reads out, from the offset coordinate storage
unit 104, the plurality of specimen area numbers and
15 offset coordinates associated with the slide number
associated with data of the read-out slide image. The
feature matching unit 105 detects the plurality of
specimen areas from the slide image, based on the readout
offset coordinates and a size common to each
20 specimen area. The feature matching unit 105 performs
the feature matching between images of the plurality of
detected specimen areas, and calculates a triangle and
an affine transformation matrix. The feature matching
unit 105 records, in the triangle and matrix storage
25 unit 106, metadata of data of the calculated triangle
and affine transformation matrix, the specimen area
number that identifies each specimen area, and the
slide number with the metadata being associated with
each other. The triangle and matrix storage unit 106 is
set in a rewritable non-volatile memory.
5 [0039] In response to a request from the viewer 200,
the server controller 107 reads out corresponding image
data from the slide image accumulation unit 101, and
p~ovides the image data to the viewer 200 through the
server communication unit 108.
, 10 [0040] [Feature Matching]
Now, a specific method for the feature matching
between he images of the specimen areas by the feature
matching unit 105 will be described.
First, the feature matching unit 105 extracts a
15 point in which a change of a luminescence value is
above a threshold (referred to as feature point; black
point in the figure) from an image of an arbitrary
detection area (referred to as detection area A) being
a reference as shown in Fig. 4 using, for example, an . .
20 extraction algorithm such as Harris algorithm. The
Harris algorithm has an advantage in that it is robust
against rotation of an image and feature points are not
taken on gradation.
[0041] Subsequently, the feature matching unit 105
25 determines which position in an image of a different
detection area (hereinafter, referred to as detection
area B) each of the feature points in the image of the
detection area c corresponds to, using a normalized
correlation between the images. Specifically, as shown
in Fig. 5, in the image of the detection area B, the
feature matching unit 105 sets a search area SA with a
feature point AP (see Fig. 4) in the image of the
detection area A to be a reference being a reference.
The feature matching unit 105 searches the search area
SA of the detection area B and calculates a normalized
correlation between a texture pattern of the detection
area B and a texture pattern of the detection area A.
The feature matching unit 105 determines a point having
a hi9hes.t value obtained (hereinafter, referred to as
highest point) as a corresponding point BP, (white poinc
in the figure) to a feature point AP (black point in
the figure) . In the example shown in the figure, the
feature matching unit 105 determines a point having a
highest value of 0.98 among values of 0.04, 0.87, and
0.98 that are obtained by calculating the normalized
correlation, as the corresponding point BP. Note that,
if the highest point is lower than a predetermined
threshold (e.g., 0.90), the feature matching unit 105
determines that the feature point AP cannot be employed
for matching. Further, if the number of feature points
determined to be employed does not reach a
predetermined threshold, the feature matching unit 105
determines that matching between the detection areas A
and B is impossible because similarity betyeen the
detection areas A and B is low.
[0042] When normalized correlations between all the
feature points are calculated in the above-mentioned
manner, as shown in Fig. 6, using division algorithm
such as Delaunay algorithm, the feature matching unit
105 divides the image of the detection area A into a
plurality of triangles having the employed feature
points (black points in the figure) as vertices. As
shown in Fig. 7, while maintaining the division
topology .of the detection area A, the feature matching
unit 105, aiso divides the image of the detection area B
into a plurality of triangles having the corresponding '
points (white points in the figure) corresponding to '
the employed feature points (black points in the
figure) as vertices.
[0043] Subsequently, the feature matching unit 105
identifies a triangle AT including display center . .
cobrdinates AC of the image of the detection area A by
determining whether it is an interior point or an
exterior point. The feature matching unit 105
calculates an affine transformation matrix for
converting a triangle BT of the detection area B
corresponding to the triangle AT of the detection area
A into the triangle AT. The calculated affine

unit 202. Each functional unit is realized in a
computer resource based on programs loaded into the RAM.
[0046] The viewer controller 207 performs processing
of transmitting a request to the image server 100
5 through the viewer communication unit 204, providing
received data to each functional unit of the viewer 200,
and controlling each functional unit.
1-00471 Based on the data of the triangle and affine
transformation matrix obtained by the feature matching,
10 the alignment data generation unit 208 calculates an
offset amount in the two axial directions between the
plurality of specimen areas in the coordinate space of
the slide image. More specifically, the alignment data
generation unit 208 calculates, as alignment data, an -
offset amount of coordinates in the two axial
directions in the coordinate space of the specimen area
between a triangle including a point located at center
coordinates of a certain specimen area as a .reference
point and a triangle including a point corresponding to
the reference point in a different specimen area, for
example. The alignment data generation unit 208 records
the calculated alignment data in the alignment data
storage unit 209. The alignment data storage unit 209
is set in a rewritable non-volatile memory.
[0048] The first coordinate calculation unit 203
performs processing of, for example, calculating the

i
areas other than the specimen areas and displaying only
the specimen areas in order
2. .operation (jump display) for displaying
corresponding areas of the specimen areas in order
3. Operation (synchronous display) for dividing
the display screen and displaying the plurality of
specimen areas in'synchronization
[00531 [I. Discrete Display]
In the discrete display, processing for jumping
, 10 the areas other than the specimen areas in the slide
image (area in which no sections are placed) and
displaying only the specimen areas in order is
[0054] Fig. 13 is a view showing a specific example
15 of the discrete display. The figure shows a first glass
slide 610 and a second glass slide 620. All sections
obtained from a single specimen cannot be placed on a
single glass slide, those sections are placed on a
plurality of glass slides. The figure shows an example
20 in which, out of the plurality of sections cut in the
order of the first to fourteenth sections 601 to 614,
the first to seventh sections 601 to 607 are placed on
the first glass slide 610 in this order and the eighth
to fourteen sections 608 to 614 are placed on the
25 second glass slide 620 in this order. Further, first to
fourteenth specimen areas 621 to 634 including the
first to fourteenth sections 601 to 614 are detected.
First, a rectangular area at a lower left corner of the
first specimen area 621 is displayed on the display
unit 201 as a display area 641. The user uses the input
unit 202 such as a mouse to input an order for moving
an image of the display area. 641 up, down, left, and
right. When an instruction of moving the display area
641 in a right-hand direction is inputted, the display
area horizontally moves within the first specimen area
621 up to a display area 641a at a lower right corner
of the first specimen area 621 (arrow A) . In addi-tion,
when an instruction of moving in the right-hand
direction is inputted, jumping the area in which no
sections are placed between the first and second
specimen areas 621 and 622, the display are- a moves a
display area 641b at a lower left corner of the second
specimen area 622 (arrow B). It is assumed that such
movements between the specimen areas are repeated, the
display area moves to a display area 641c at a lower
right corner of a seventh specimen area 621, and
further an instruction of moving in the right-hand
direction is inputted. In this case, no specimen areas
are present on the right-hand side of a seventh
specimen area 627 on the first glass slide 610.
Therefore, the display area nloves to a display area
641d at a lower left corner of an eighth specimen area
628 on. the second glass slide 620 (arrow C) .
[0055] Next, the discrete display processing will be
described in more detail.
Fig. 14 is a flowchart showing the discrete
display processing by the viewer 200.
[0056] Using, for example,, the input unit 202, the
user selects the discrete display as a display mode.
when the viewer controller 207 receives a selection
instruction, the viewer controller 207 uses the viewer
communication unit 2C4 to read out the thumbnail image
of the slide image associated with the slide number and
rekorded in the thumbnail image storage unit 102 of the
image server 100. The viewer controller 207 causes the
display processor 205 to generate a specimen area
selection screen based on the read-out slide number and
thumbnail image of the slide imaqs. The viewer
controller 207 causes the display unit 201 to display
the specimen area selection screen.
[0057] Fig. 15 is a view showing.the specimen area ...
selection screen.
As shown in the figure, a specimen area selection
screen 220 includes a slide tray 221, a specimen area
tray 222, an observation display section 223, and a
display-area display section 224. In the slide tray 221,
thumbnail images 230, 231, and 232 of a slide image
read oyt by the viewer controller 207 from the image
SP329920W000
28
server 100 are displayed as a list. The thumbnail
images 230, 231, and 232 of the slide image are
arranged in a slide number order from the upper side to
the lower side. Using the input unit 202 such as a
5 mouse, the user selects the one thumbnail image 231
from the plurality of thumbnail images 230, 231, and
232 displayed in 'the slide tray 221. The viewer
controller 207 causes the display processor 205 to
display the selected thumbnail image 231 in an
, 10 identifiable form with a frame line (231A) or the like
and to display a thumbnail image 231C corresponding to
the selected thumbnail image 231 in the display-area
display section 224.
COO581 The viewer controller 207 use the viewer
15 communication unit 204 to read out the specimen area
number and the offset coordinates being the metadata
associated with the slide number associated with the
selected thumbnail image and recorded in the offset
coordinate storage unit 104 of the image server 100.
2 0 Further, the viewer controller 207 uses the viewer
communication unit 204 to read out the specimen area
number and the triangle and affine transformation
matrix being the metadata associated with the slide
number and recorded in the triangle and matrix storage
25 unit 106 of the image server 100. Based on the read-out
offset coordinates and slide number being the metadat&,
the viewer controller 207 causes the display processor
205 to display thumbnail images 231a to 2319 of the
plurality of specimen areas within the selected
thumbnail image 231, in the specimen area tray 222 as a
5 list. The thumbnail images 231a to 231g of the specimen
areas are arranged in a specimen area number order from
the left to the right.
[-0 0 5 9 I Using the input unit -202 such as a mouse, the
user selects one thumbnail image 231d among the
. 10 plurality of thumbnail images 231a to 2319 displayed in
the specimen area tray 222. The selected thumbnail
image 231d is displayed to be identifiable with a frame
line (231B) or the like. Further, the image of the
specimen area of the selected thumbnail image 231d is
displayed in the observation display section 223. In
the observation display section 223, in addition to the
image of the entire specimen area is displayed in this
manner, part of the specimen area (display area) is
displayed at an arbitrary resolution. Further, in the . .
thumbnail image 231C displayed in the display-area
display section 224, a position of the specimen area
currently displayed in the observation display sectioc
223 is displayed to be identifiable with a frame line
(224a) or the like. Note that the selection operations
for a slide being a display target and the specimen
area are common in the discrete display, the jump
display, and the synchronous display.
. [00601 The viewer controller 207 detects an input by
i
the user into the input unit 202 and determines the
slide number and the specimen area number of the slide
5 and the specimen area to be first displayed. Then, the
viewer controller 207 provides the offset coordinates
associated with the slide number and the specimen area
ngmber being the metadata to the first coorqinate
calculation unit 203 that performs processing for the
10 discrete display. The first coordinate calculation unit
203 calculates the position information of the display
area to be first displayed, based on the offset
coordinates of the specimen area that is the metadata
and on a size and an initial position (e.g., lower left'
corner of specimen area) that are common to the display
areas. The size and the initial position common to the
display areas are recorded in a rewritable non-volatile
memory. The first coordinate calculation unit 203
provides the calculated position information to the
viewer controller 207. The viewer controller 207
transmits a request for acquiring an image
corresponding to the display area to the image server
100 through the viewer communication unit 204.
[0061] , The server controller 107 of the image server
25 100 receives this request through the server
communication unit 108, and reads out the image data of
0 a,
0 a, a, rd
0 : d m a , s c )-I $ : a ,
5 -4 rl a & ) & , + ' 0 s 0 a, N )-I
0 4 0 E - c O 5 N U -4 : s c rd
N m u g N d : a c, W
/ Cn 0 4 c3n @c $ as , -4 O -5 x
a @ : N Q 3 0 W s - I d
N* 4 a, o D L n o o r d a , C\l ~ e W + ; s z
U g h $ , 2 2 2 N ) - I 0 W W - ai a Q, ow mc sc, n . 0 a
14
UI E s) -aI ; , -34 c, 0 -4 O U 4 J r n U
* '0 Qo 4-1 - c -c4 --aI [ rI 4 J 3 0 . ctn rd 0 c,
rd
)-I rd
w ' $ . a a , Q @ * r d 3 3 d 2 2 a -4
c - a @ . ,C +
C O S Q > m C , C 0 3 G ) - I W ) - I - d c 3 4 C a
C, a , o U r d $ . r l a , r d h h O - r l Q C, O a , 3 0 3 C r ) - 1
cn ) - I d & a , u a r d r d . d c , c, o a N u
@ $ c , 4 - 1 h a , U 0 4 4 0 U 3 4 - 1 c c c , ? 2 0
c , o r d a , h a a r d a , a -4 rd 3
d - l ' C 1 0
3 s4 4J rd 0 (J
K 1 5 -c4 r 4a ) - 1 a4, r -b4 r-rnl c n >a, 4 , ac ),-I a 4a w~ as -ar ,l uc
Q o a , a a a a , c n a a , c , - r l c , c , a , o cW,
rd W -4 (0 )-I h U U c, -4 Q
a , z c , c a H $ : - : a , a , Q r d s o a a , c a , ~ r d c , . ~
a a s c o a , s - ; a , . . cn "I
cl r d Q C , O C r d w
rl 4~ +J )-I G a a, -4 -4
* c a , rc ,dc ~w a, ,o- ra l at nc , o ac, nId ~ a., a m c cn, No a c~, aQEO :
- 4 r i t n U O N -4 3 + J @ 4 J I = d m $ : U N a h + O W H
o 4 s4 w a, a a +J o a, S ~ O C a r l c o c r d c ~ = ~ r d a c , c , c , u u - r l
a, c .. .4 )-I c, 3 c, rd -4 -4 5 a a , a, -4 4 a c, - " : a O ~ Uu x c - a~c c n r d + ~ c i
3 -4 c, o a rd a, a , - 4 r d a 3 c u u c n o o
r-i c 3 o rd o c , m m c , a 3 t- a Q -4 -4
U 3 0 U L l a c O O @ O ( d W )-I )-I h O C , - r l U - d C , & '
c I O C W ~ ~ C \ ~ D N0 a~) I d r n W 4 J 4 - 1 - 4 r d
- d c a $ a , - d a, a, v . 4 r n r - i t - l L k a vl c
o r d t n ~ c , 3 a~m Q c a , o - 4
rd -4 a, -4 a a , r d 0 - 4 0 0 c , . cn a , - r l a s a c ,
a , c , ) - I Z 3 g u 5 cn cn D o - r l e 4 a c, [I]
Q rd a, - - 4 a , h r r , a , m w c ~ a o a , t - ) - ~a, a,
r d r - i a ~ c n a , - r l r b a , ~ a , - r l o 4 c, - r l o o o s a
3 s > - - 1 U + J U . cn a , 4 J ) - I c , C \ 1 O Q + J
2 5 a o o o m - ~- G U ~ , u a, tn < 0 a , C r , ) - I b , Q C N r l O U U c O Q 73 Cn c
4 u c n c , o . c . r l a a c , ~ o V) c r ) O C , a , C , ) - I @ - 4
u c, w u u a 4 3 4 - 1 U ~ ~ V , O C , ~
a - s h h h h c m 0 h - r i 4 Q
-4 t n - $ Q 4 - 1 a , r d l d r d r b O n 2 a a a - ; ; (d $4 0 - 4 0 2 2 o s - - 1 - r r - i a m a 4 u s 4 4 - 1 6 3 + ~ a a c , a , w r d m $ u c , -4 u a
r d ' + l o u a , t - c n m % % u c , - a , a a , > 4
$ Q ~ O a , ~ ~ 0 4 - 1 - d - d 4 ~ u ? O ~ 4 - - rId Q4J
- ~ c , c l U r - l ~ ~ ~ o a a a aa c-n r- l~ a ~ o u r d
calculation unit 203 provides the calculated position
information to the viewer controller 207. The viewer
controller 207 transmits a request for acquiring an
image corresponding to the display area to the image
5 server 100 through the viewer communication unit 204.
[0064] After that, as in Step S101, in response to
the request from the viewer 200, the server controller
147 of the image server 100 rea-ds out the image data
corresponding to the slide image accumulation unit 101,
10 and transmits the image data to the viewer 200 through
the server communication unit 108. With this, the
viewer 200 acquires the image data of the display area
at the moving destination, and updates the display
contents of the display unit 201 (Step S102).
15 [0065] If the first coordinate calculation unit 2031
determines, based on the calculated position
information, that the display area at the moving
destination has reached the boundary of the specimen
area (Yes in Step 103), the first coordinate
20 calculation unit 203 determines which end (right end,
lower end, left end, and upper end) of the specimen
area that boundary is located at (steps ~104, S105, and
S106).. If the display area is located at the right end
of the specimen area, the first coordinate calculation
25 unit 203 increments the specimen area number of the
specimen area being a display target when an
33
instruction of moving in the right-hand direction from
, the user is detected (Yes in Step 104). With this, the
obtained specimen area number becomes a specimen area
number of a specimen area to be next displayed. The
5 first coordinate calculation unit 203 sets the display
area within the specimen area corresponding to the
specimen area number obtained by the increment in the
following manner. That is, the first coordinate
calculation unit 203 maintains a Y-offset between the
. 10 upper end of the specimen area and the upper end of the
', -
display area, and sets the display area within the
specimen area at the moving destination such that the
left end of the specimen area and the left end of the
display area correspond to each other (Step 5107).
15 [0066] On the other hand, if the display area is
located at the lower end of the specimen area, when the
first coordinate calculation unit 203 detects an
instruction of moving in a lower direction from the
user (Yes in Step 105), the first coordinate
2 0 calculation unit 203 increments the specimen area
number of the specimen area being the display target.
The first coordinate calculation unit 203 sets the
display area within the specimen area corresponding to
the specimen area number obtained by the,increment in
25 the following manner. That is, the first coordinate
calculation unit 203 maintains an X-offset between the
left end of the specimen area and the left end of the
display area, and sets the display area within the
specimen area at the moving destination such that the
upper end of the specimen area and the upper end of the
display area correspond to each other (Step S108).
[0067] On the other hand;if the display area is
located at the left end of the specimen area, when the
flrst coordinate calculation unit 203 detects an
instruction of moving in the left-hand direction from
the user (Yes in Step 106), the first coordinate
calculation unit 203 decrements the specimen area
number of the specimen area being the display target.
The firs't coordinate calculation unit 203 sets the
display area within the specimen area corresponding to -
the specimen area number obtained by the decrement in
the following manner. That is, the first coordinate
calculation unit 203 maintains the Y-offset between the
upper end of the specimen area and the upper end of the
display area, and sets the display area within the
specimen area at the moving destination such that the
right end of the specimen area and the right end of the
display area correspond to each other (Step S109).
[0068] On the other hand, if the display area is
located at the upper end of the specimen area, when the
first coordinate calculation unit 203 detects an
instruction of moving in an upper direction from the
user (No in Step 106), the first coordinate calculation
unit 203 decrements the specimen area number of the
specimen area being the display target. The first
coordinate calculation unit 203 sets the display area
within the specimen area corresponding to the specimen ,
area number obtained by the decrement in the following
manner. That is, the first coordinate calculation unit
293 maintains the X-offset between the left end of the
specimen area and the left end of the display area, and
sets the display area within the specimen area at the
moving destination such that the lower end of the
specimen area and the lower end of the display area
correspond to each other (Step S110).
[0069] When the display area within the specimen
area at the moving destination is set based on the
moving order by the user that is provided from the
viewer controller 207 as described above (Steps S107 to
SllO), the first coordinate calculation unit 203
provides position information of the set display area
to the viewer controller 207. Then, the viewer
controller 207 transmits a request for acquiring an
image corresponding to the display area to the image
server 100 through the viewer communication unit 204.
[0070] After that, as in Step S101, the server
controller 107 of the image server 100 reads out the
corresponding image data from the slide image
-.
SP329920W000
3 6
accumulation unit 101 in response to the request from
. the viewer 200, and transmits the corresponding image
data to the viewer 200 through the server communication
unit 108. With this, the viewer 200 acquires the image
5 data of the display area at the moving destination, and
update's the display contents'of the display unit 201.
[0071] Note that, if the specimen area number
obtained by the increment in Steps S107 and S108 is not
recorded in the offset coordinate storage unit 104, the
. 10 first coordinate calculation unit 203 increments the
slide number of the currently displayed slide. Then,
the first coordinate calculation unit 203'sets an
inside of the specimen area corresponding to the
specimen area number = 1 associated with the slide
15 number obtained by the increment, as an observation '
target. Further, if the specimen area number obtained
by the decrement in Steps S109 and SllO is not recorded
in the offset coordinate storage unit 104 (the specimen
area number = O), the first coordinate calculation unit
20 203 decrements the slide number of the currently
displayed slide. Then, the first coordinate calculation
unit 203 sets the specimen area corresponding to the
maximum specimen area number associated with the slide
number obtained by the decrement, as the observation
25 target.
[0072] If, as a result~of the above-mentioned
1
calculations, the first coordinate calculation unit 203
. determines that a specimen area to be next displayed is
not present (Yes in Step Ill), the first coordinate
calculation unit 203 terminates the discrete display
5 processing.
[0073]. As mentioned above; the information
processing system 1 according to this embodiment
includes the image acquisition unit 109 that acquires
image data obtained by capturing a slide on which a
. 10 plurality of sections obtained by cutting a single
specimen in the same direction are discretely placed,
the specimen area detector 103 that detects the
plurality of specimen areas in the acquired image data,
and calculates position information relatively
15 indicating positions of the individual specimen areas
in a coordinate space of the image data, the plurality
of specimen areas having the same shape and including
the individual sections, the offset coordinate storage
unit 104 that stores the calculated.position
20 information, and the viewer controller 207 that
switches display between the specimen areas based on
the stored position information.
[0074] That is, the viewer controller 207 switches
display between the specimen areas based on the
25 position information being the metadata. With this, the
viewer controller 207 can jump the areas other than the
specimen areas and switch display between the specimen
areas irrespective of the fact that the image data
acquired by the acquisition unit is the image data
obtained by capturing the slide itself on which the
5 plurality of sections are placed. Further, by recording
the specimen area as the posFtion information being the
metadata, the first storage unit can switch display
between the specimen areas efficiently and at high
speed. In addition, using the position information
. 10 being the metadata, even if the plurality of specimen
areas are arranged in image data of a plurality of
slides, the display processing can be efficiently
performed as in the case where a plurality of specimen
areas detected from single image data are displayed in -
15 order.
[0075] The information processing system 1 according
to this embodiment further includes the thumbnail image
thumbnail image generator 110 110 that generates
reduced data by reducing a resolution of the image data.
20 The specimen area detector 103 detects the plurality of
specimen- areas in the image data by detecting the
plurality of specimen areas from the reduced data.
[0076] That is, by detecting the specimen areas from
the reduced data obtained by the thumbnail image
25 generator 110 reducing the resolution, it is possible
to detect the specimen areas efficiently and at high
speed.
[0077] In the information processing system 1
according to this embodiment, a plurality of image data
items of the plurality of specimen areas are managed in
the cutting order. When the viewer controller 207
receives, from the user, specification of a specimen
.area to be displayed in the acquired image data and, a
r-ange therein, the viewer controller 207 calculates the
range in the specified specimen area as the display
area. If the display area is located at an end of the
specimen area, when the viewer controller 207 receives,
from the user, an instruction of moving the display
area outside the end, the viewer controller 207
switches to display a neighbor specimen area in the
cutting order based on the stored position information:
[0078] That is, even when the display area of part
of the specimen area is displayed, it is possible to
jump the areas other than the specimen areas and
perform switching of the display between the specimen
areas.
[0079] In the information processing system 1
according to this embodiment, if the calculated display
area is located at an end of the specimen area in one
axial direction of the plurality of specimen areas in
the coordinate space of the image data, when the viewer
controller 207 receives, from the user, an instruction
of moving the display area outside the end in the one
. axial direction, the viewer controller 207 performs
switching to the display of a neighbor specimen area in
the cutting order while fixing a position in the other
5 axial direction.
[0080] With this, a position of the display area in
the specimen area' at the moving destination corresponds
to a position of the display area in the specimen area
at a moving source at the moving destination. Therefore,
. 10 a convenience for the user can be provided.
[0081] In the information processing system 1
according to this embodiment, the image acquisition
unit 109 acquires image data obtained by capturing a
slide on which a plurality of sections obtained by
15 cutting a single specimen in the same direction are
placed discretely and in one row. The viewer controller
207 calculates, when the calculated display area is
located at an end of the specimen area in an
arrangement direction of the plurality of specimen .. .
20 areas in a coordinate space of the image data and the
viewer controller 207 receives, from the user, an
instruction of moving the display area in the
arrangement direction beyond the end, the display area
of the specimen area at the moving destination based on
25 the stored position information.
[0082] With this, even when the plurality of
specimen areas arranged in the one row are displayed,
display can be switched between the specimen areas,
jumping the areas other than the specimen areas.
[0083] In the information processing method
5 according to this embodiment, the image acquisition
unit 109 acquires image data'obtained by capturing a
slide on which the plurality of sections obtained by
cutting a single specimen in the same direction are -
discretely placed. The specimen area detector 103
. 10 detects the plurality of specimen areas in the acquired
image data, and calculates position information
relatively indicating positions of the individual
specimen areas in a coordinate space of the image data,
the plurality of specimen areas having the same shape -
15 and including the individual sections. The offset
coordinate storage unit 104 stores the calculated
position information. The viewer controller 207
switches display between the specimen areas based on
the stored position information.
20 [0084] [ 2 . Jump Display]
Next, the jump display will be described. In the
jump display, processing for displaying corresponding
areas of the specimen area in order is performed.
[0085] Fig. 16 is a view showing a specific example
25 of the jump display. The figure shows an example in
which, as in Fig. 13, the first to fourteenth sections
601 to 614 are placed on the first and second glass
slides 610 and 620 in this order and the first to
fourteenth specimen areas 621 to 634 respectively
including the first to fourteenth sections 601 to 614
are detected. In a state in which a display area 642 at
an arbitrary position in the first specimen area 621 is -
displayed, the thumbnail image of the specimen area 622
Qn the right next to the thumbnail image of the
currently displayed first specimen area 621 is selected
from the specimen area tray 222 (Fig. 15) of the
specimen area selection screen 220, as the specimen
area at the moving destination. In this manner, when an
order for moving display to the image of the different
specimen area is inputted, the display area moves to a A
display area 642a of the second specimen area 622
(arrow D). Here, the display areas 642 and 642a are
located at the same position in the coordinate space of
the specimen areas 621 and 622 having the same shape;
That is, sites continuous in the direction almost
orthogonal to the cutting surface of the specimen are
displayed as the display areas 642 and 642a. It i's
assumed that movements between the specimen areas are
repeated and the display area moves to the display area
642b of the seventh specimen area 621 (located at the
same position as the display areas 642 and 642a in the
coordinate space of the specimen areas having the same
shape). In addition, it is assumed that an instruction
for moving to the second glass slide 620 is inputted by
operating the thumbnail image of the second glass slide
620 located below the thumbnail image of the first
glass slide 610 in the specimen area tray 222 (Fig. 15) .
In this case, the display area (located at the same
position as the display area 642b in the coordinate
$pace of the specimen areas having the same shape)
moves to the display area 642c of the eighth specimen
area 628 of the second glass slide 620 (arrow E).
[00861 Next, the jump display processing will be
described in more detail.
Fig. 17 is a flowchart showing the jump display
processing by the viewer 200.
[0087] As in selection of the slide and the specimen
area to be first displayed in the above-mentioned
discrete display, a slide and a specimen area to be
first displayed are selected. Further, the user selects
the jump display as the display mode, for example,
using the input unit 202.
[0088] When the selection of the jump display is
determined, the viewer controller 207 provides the
slide number, the specimen area number, the data of the
triangle and affine transformation matrix being the
metadata to the alignment data generation unit 208.
When the alignment data generation unit 208 acquires
the metadata, the alignment data generation unit 208
calculates offsets in the two axial directions between
the specimen areas in the coordinate space of the slide
image in all combinations of the plurality of specimen
areas. More specifically, using the affine
transformation 'matrix, the alignment data generation
unit 208 calculates an offset in the two axial
d-irections in absolute coordinates between a triangle
including a point located at center coordinates of a
, 10 certain specimen area, for example, as a reference
point and a triangle including a point corresponding to
this reference point in a different specimen area. This
offset becomes alignment data for adjusting the display
area in the one specimen area with respect to the
15 display area in the other specimen area. The alignment'
data generation unit 208 records the calculated
alignment data in the alignment data storage unit 209
(Step S201). Note that the generation operations for
the alignment data are common on the display modes of . .
the jump display and the synchronous display.
[0089] The viewer controller 207 provides the offset
coordinates~associated with the slide number and the
specimen area number of the slide and the specimen area
being the above-mentioned display targets selected by
the user, to the second coordinate calculation unit 206
%
that performs processing for the jump display. The
-
second coordinate calculation unit 206 calculates,
based on the offset coordinates and on the size and the
initial position (e.g., lower left corner of specimen
area) common to the display areas, position information
of the display area to be first displayed. Those size
and initial position common to the display areas are
recorded in a rewritable non-volatile memory. The
second coordinate calculation unit 206 provides the
calculated position information to the viewer
controller 207. The viewer controller 207 transmits a
request for acquiring an image corresponding to the
display area to the image server 100 through the viewer
communication unit 204.
[0090] The server controller 107 of the image server'
100 receives that request through the server
communication unit 108, and reads out the image data of
the display area included in the request from the slide
image accumulation unit 101. The server controller 107
transmits the read-out image data to the viewer 200 . .
through the server communication unit 108.
[0091] The viewer controller 207 of the viewer 200
receives the image data of the display area through the
viewer communication unit 204, and provides the
*
received image data of the display area to the display
processor 205. The display processor 205 outputs the
'display data for displaying the image data to the,
display unit 201, and causes the display unit 201 to
display the image data in the observation display
section 223 of the specimen area selection screen 220
(Step S202).
[0092] Using the input unit 202 such as a mouse, the
user inputs an order for moving the image of the
display area displayed in the observation display
section 223 up, down, left, and right. The viewer
controller 207 detects an input of a moving order into
the input unit 202 by the user, and provides the
detected moving order to the second coordinate
calculation unit 206. Based on the moving order, the
second coordinate calculation unit 206 calculates the
position information of the display area at the moving A
destination. The second coordinate calculation unit 206
s the calculated position information to the
viewer controller 207. The viewer controller 207
transmits a request for acquiring an image
corresponding to that display area to the image server . .
100 through the viewer communication unit 204.
[0093] After that, as in Step S202, the server -
controller 107 of the image server 100 reads out the
corresponding image data from the slide image
accumulation unit 101 in response to the request from
the viewer 200, and transmits the corresponding image
data to the viewer 200 through the server communication
unit 108. With this, the viewer 200 acquires the image
data of the display area at the moving destination, and
updates the display contents of the display unit 201
(Step S203).
[0094] Using the input unit 202, the user inputs an
order for moving the display.to an image of a different
specimen area from the image of the specimen area
displayed in the observation display section 223. That
input is performed by, for example, selecting a
specimen area on the right or left next to the
currently displayed specimen area among a group of
thumbnail images displayed in the specimen area tray
222 (Fig. 15) of the specimen area selection screen 220.
Alternatively, that input is performed by selecting a '
slide above or below the currently displayed slide
among a group of thumbnail images displayed in the
slide tray 221 (Fig. 15) of the specimen area selection
screen 220. When the viewer controller 207 detects an
input of a moving order into the input unit 202 by the
-
user (Yes in Step 204), the viewer controller 207
determines whether the inputted specimen area at the
moving destination is positioned on the right or left
next to the currently displayed specimen area, or
whether the slide ,at the moving destination is
positioned above or below the currently displayed
specimen area (Steps S205 and S206).
[0095] If the viewer controller 207 determines that
the specimen area at the moving destination is
positioned on the right next to the currently 'displayed
specymen area or the slide at the moving destination is
positioned below the currently displayed specimen area
(Yes in Step 205), the viewer controller 207 increments
the specimen area number-of the specimen area being the
display target. On the other hand, if the viewer
controller 207 determines that the specimen area at the
moving destination is positioned on the left next to
the currently displayed specimen area or the slide at
the moving destination is positioned above the
currently displayed specimen area (Yes in Step 206),
the viewer controller 207 decrements the specimen area '
number of the specimen area being the display target.
With this, the obtained specimen area number becomes
the specimen area number of the specimen area at the
moving ,destination.
[0096] The viewer controller 207- informs the second . .
coordinate calculation unit 206 of the specimen area
number of the specimen area at the moving destination
and the position information of the currently displayed
display area (display area at moving source). The
second coordinate calculation unit 206 reads out, from
the offset coordinate storage unit 104, offset
coordinates associated with the specimen area number at
the moving destination. Further, the second coordinate
calculation unit 206 reads out, from the alignmect data
storage unit 209, the alignment data for causing the
specimen area at the moving destination to correspond
5 to the specimen area at the moving source in the
coordinate space. Then, based on the offset coordinates
and the alignment data being the metadata, the second
coordinate calculation unit 206 sets the display area
in the specimen area at the moving destination
10 corresponding to the display area at the moving source
such that positions of corresponding points in the
display areas at the moving source and the moving
destination correspond to each other in the display
areas.
15 [0097] Indeed, the positions of the point poin- t in the
display area at the moving source (e.g., center point
of display area) and the corresponding point of the
display area at the moving.d.estination may not
correspond to each other in each display area. For
2 0 example, even if a disease is present at the center of
the display area at the moving source, the disease may
be located at a position deviated from the center in
the display area at the moving destination., In view of
this, based on the alignment data, the second
25 coordinate calculation unit 206 adjusts the display
area at the moving destination such that positions of a
certain point in the display area at the moving source
and the corresponding point in the display area at the
moving destination correspond to each other in the
display areas (e.g., center of display area) (Step S207,
S208).
[0098] The second coordinate calculation unit 206
calculates positibn information of the display area
adjusted in Steps S207 to S208. The second coordinate
calculation unit 206 provides the calculated position
information to the viewer controller 207. The viewer
controller 207 transmits a request for acquiring an
image corresponding to that display area to the image
server through the viewer communication unit 204.
[0099] After that, as in Step S202, in response to
the request from the viewer 200, the server controller'
107 of the image server 100 reads out the corresponding
image data from the slide image accumulation unit 101,
and transmits the corresponding image data to the
viewer 200 through the server communication unit 108. . .
With this, the viewer 200 acquires the image data of
the display area at the moving destination, and updates
the display contents of the display unit 201.
[OlOO] If, as a result of the above-mentioned
calculations, the second coordinate calculation unit
206 determines that a specimen area to be next
displayed is not present (Yes in Step 209), the second
coordinate calculation unit 206 terminates the discrete
display processing.
[OlOl] As mentioned above, the information
processing system 1 according to this embodiment
5 further includes the alignment data generation unit 208
that detects a feature point of each of the plurality
of specimen areas', and calculates an offset amount of
of the feature point in a coordinate space
of the specimen areas, and the alignment data storage
. 10 unit 209 that stores the calculated offset amount. When
the viewer controller 207 receives, from the user, an
-
instruction of jumping the display area to a different
specimen area, the viewer controller 207 calculates,
based on the stored position information and the stored
offset amount, a display area at a jumping destination
such that positions of the feature points correspond to
each other in the display area before and after jumping.
[0102] That is, the alignment data generation unit
208 sets the display area based on the offset amount . .
20 between the feature points included in the plurality of
specimen areas that is the metadata, and hence the
viewer controller 207 can cause the positions of the
feature points to correspond to each other in the
display area before and after jumping. Further, by
25 using the metadata for setting the display area, it is
possible to accurately calculate the corresponding
- a ;d
m N N
o o a ,
4 U C
0 U a,
u rd tn
obtained by dividing the observation display section
. 223 of the specimen area selection screen 220 (Fig. 15)
into a plurality of areas having almost the same size.
More specifically, the plurality of specimen areas 621
5 to 624 are displayed such that positions of points 621a
to 624a respectively located' at centers of the
plurality of specimen areas 621 to 624 correspond to
e.ach other in the display spaces 651 to 654 (located at
center) .
10 [0107] Next, the synchronous display processing will
be described in more detail.
Using the input unit 202, the user selects a slide
being a.display target from the slide tray 221 (Fig.
15) of the specimen area selection screen 220 displayed-
15 on the display unit 201, and selects a plurality of
(e.g., four) specimen areas being display targets from
the specimen area tray 222. The viewer controller 207
detects an input into the input unit 202 by the user,
and determines a slide number and a-plurality of
20 specimen area numbers of the slide and the plurality of
specimen areas to be displayed. Then, the viewer
controller 207 provides the slide number and the
plurality of specimen area numbers to the third
coordinate calculation unit 210 that performs
25 processing for the synchronous display. In addition,
the viewer controller 207 divides the observation
display section 223 of the specimen area selection
screen 220 (Fig. 15) serving as the display space into
display spaces as many as the plurality of (e.g., four)
specimen areas specified. Then, the viewer controller
207 provides coordinate information of each of the
-
divided display spaces to the third coordinate
calculation unit 210.
CQ1081 Based on the offset coordinates associated
with the specimen area number of the plurality of
specimen areas being the display targets and on the
alignment data for adjusting an offset between the
plurality of specimen areas being the display targets,
the thir,d coordinate calculation unit 210 sets the
display area such that the center points of the
plurality of specimen areas correspond to each other.
That is, based on the offset coordinates being the
metadata and the alignment data, the third coordinate
calculation unit 210 sets the display area such that
the positions of points located at the centers of the
plurality of specimen areas correspond to each other in
the display spaces (located at center). The third
coordinate calculation unit 210 calculates position
information of each of the set display areas. The third
coordinate calculation unit 210 provides the obtained
position information to the viewer controller 207. The
viewer controller 207 transmits a request for acquiring
an image corresponding to that display area to the
. image server 100 through the viewer communication unit
204.
[0109] After that, as in Step S202 descEibed above,
5 the server controller 107 of the image server 100 reads
out the corresponding image data from the slide image
accumulation unit 101 in response to the request from
the viewer 200, and transmits the corresponding image
data to the viewer 200 through the server communication
. 10 unit 108. With this, the viewer 200 acquires image data
of the plurality of display areas and displays the
image data on the display unit 201. Specifically, the
viewer controller 207 divides the observation display
section 223 of the specimen area selection screen 220 -
15 (Fig. 15) to be displayed on the display unit 201 into
areas having almost the same size as many as the
specimen areas to be displayed. Then, the display
processor 205 individually assigns and displays the
image data of the plurality of display areas in the
2 0 display spaces obtained by dividing the observation
display section 223 of the specimen area selection
screen 220 (Fig. 15) displayed on the display unit 201
into the plurality of areas having almost the same size.
[OllO] As mentioned above, in the information
25 processing system 1 according to this embodiment, when
the viewer controller 207 receives, from the user,.
specification of the plurality of specimen areas to be
displayed in the acquired image data, the viewer
controller 207 divides the display space into display
spaces as many as the plurality of specimen areas
5 specified. Then, based on the stored position
information and the stored offset amount, the viewer
controller 207 calculates a display area to be
displayed in the plurality of display spaces such that
positions of feature points to be displayed in the
plurality of display spaces correspond to each other in
the specimen areas.
[Olll] That is, based on the offset amount between
the feature points included in the plurality of
specimen areas that is the metadata, the viewer
15 controller 207 can cause the positions of the feature
points in the specimen areas to be displayed in the
plurality of display spaces to correspond to each other.
Further, by using the metadata for setting the display
area, it is possible to accurately calculate the . .
20 corresponding display area and perform the display
processing efficiently and at high speed.
[0112] [Typical Computer]
Next, a configuration of the typical computer that
can be used for the image server 100 and the viewer 200
25 will be described.
[0113] Fig. 19 is a view showing a hardware
configuration of a typical computer 400.
As shown in the figure, the computer 400 includes
a CPU (Central Processing Unit) 401, a ROM (Read Only
Memory) 402, and a RAM 403. Further, the computer 400
includes an input apparatus 404, an output apparatus
405, a storage apparatus 406; a medium interface
apparatus 407, a network connection apparatus 408, and
a..bus 409 that connect them.
[0114] The CPU 401 functions as an arithmetic
processing apparatus and a control apparatus and
controls general operations of the computer 400
according to various programs. The ROM 402 stores
programs, arithmetic parameters, and the like to be
used by the CPU 401. The RAM 403 temporarily stores
programs to be executed by the CPU 401, parameters
appropriately changing in execution thereof, and the
like.
[0115] A synchronous processor 25 of a synchronous
server 40, viewer controllers 37A and 37B of viewers
30A and 30B, and the like are realized by the CPU 401,
the programs stored in the ROM 402, a working area of
the RAM 403, and the like in the hardware configuration
of the computer 400, for example.
[0116] The input apparatus 404 is constituted of an
input means for the user to input information, such as
a mouse, a keyboard, a touch panel, a button, a
microphone, a switch, and a lever, an input control
circuit that generates an input signal based on an
input by the user and outputs the input signal to the
CPU 401, and the like. By operating the input apparatus
404, the user of the computer 400 can input various
types of data into the CPU 401 and instruct the CPU 401
to execute processing operations.
10117 I The output apparatus 405 includes a display
apparatus, for example, a CRT (Cathode Ray Tube)
display apparatus, a crystal-liquid display (LCD)
apparatus, or an OLED (Organic Light Emitting, Diode)
apparatus. The output apparatus 405 further includes an
ahdio output apparatus such as a speaker and headphones.
[0118] The storage apparatus 406 is an apparatus for'
storing programs and user data. The storage apparatus
406 is constituted of a recording medium, a
reading/writing apparatus that reads/writes data
from/on the recording medium, and the like. The storage
apparatus 106 is constituted of, for example, an HDD
(Hard Disk Drive), an SSD (Solid State Drive), and the
like.
[0119] The medium interface apparatus 407 is a
reader/writer for the recording medium. The medium
interface apparatus 407 reads/writes data from/on a
removable recording medium 2A such as a magnetic disc,
an optical disc, a magneto-optical disc, and a
semiconductor memory installed therein.
[0120] The network connection apparatus 408 is an
interface for connecting to the network 300, for
example. The network connection apparatus 408 may be an
apparatus adapted for a wireless LAN (Local Area
Network), a wireless USB-adapted apparatus, or a wired
communication apparatus that performs a communication
v-i- a a wire.
[ 0 12'1 ] [Modified Example]
Fig. 20 is a view showing a configuration of an
information processing apparatus according to a
modified example.
In the above embodiment, the information
pro.cessing system 1 including the image server 100 and
the one or more viewers 200A and 200B that can be
connected to one another over the network 300 has been
described. Otherwise, a single information processing
apparatu-s 500 may be adopted as the information
processing system. The information.processing apparatus
. .
500 has the same configurations as the functional
configurations of the image server 100 and the viewer
200 according to the above emdodiment. The information
processing apparatus 500 is different from the above
embodiment in that the information processing apparatus
500 does not include the server control'ler 107, the
server communication unit 108, and the viewer
communication unit 204. In addition, a controller 207A
has the same functibn as the viewer controller 207
according to the above embodiment. The controller 207A
reads out data directly from the slide image
5 accumulation unit 101, the thumbnail image storage unit,
the offset coordinate storage unit 104, and the
triangle and matrix storage unit 106. The information
processing apparatus 500 may be constituted of, for
example, the above-mentioned typical computer 400. Also,
10 this information processing apparatus 500 can perform
similar processing as the above embodiment.
[0122] It should be noted that the present
technology may also employ the following configurations.
(1) An information processing system, including: -
An acquisition unit to acquire image data obtained
by capturing a slide on which a plurality of sections
obtained by cutting a single specimen in the same
direction are discretely placed;
a detector to detect a plurality of specimen areas
20 in the acquired image data and to calculate position
information relatively indicating positions of the
individual specimen areas in a coordinate space of the
image data, the plurality of specimen areas having the
same shape and including the individual sections.;
a first storage unit to store the calculated
position information; and
.
a controller to switch display between the
specimen areas based on the stored position information.
[0123] (2) The information processing system
according to Item (I), further including
a generator to generate reduced data by reducing a
resolution of the image data; in which
the detector'detects the plurality of specimen
a-reas in the image data by detecting the plurality of
specimen areas from the reduced data.
[0124] (3) The information processing system
according to Item (1) or ( 2 ) , in which
a plurality of image data items of the plurality
of speci,men areas are managed in a cutting order, and
the controller calculates, when the controller
receives, from a user, specification of thG specimen
area to be displayed in the acquired image data and a
range in the specimen area, the range in the specified
specimen area as a display area, and switches, when the
display area is located at an end of the specimen area
and the controller receives, from the user, an
instruction for moving the display area outside the end,
to display the neighbor specimen area in the cutting
order based on the stored position information.
[0125] (4) The information processing system
25 according to any one of Items (1) to (3), in which
the controller switches, when the calculated

c,
rd s
C,
C
U
7
rn
c, c
7
0
E
rd
c,
a,.
rn
w
4-1
0
a
a,
k
0
C,
rn
a,
C
C,
a
d
rd
C
0
-4
-I-'
rd E
0
W
C
- 4
specimen areas to be displayed in the obtained image
data, a display space into display spaces as many as
the plurality of specified specimen areas, and
calculates, based on the stored position information
and the stored offset amount, the display area to be
displayed in the plurality of display spaces such that
positions of the 'feature points in the specimen areas
to be displayed in the plurality of display spaces
correspond to each other.
[0130] (9) An information processing method,
including:
acquiring, by an acquisition unit, image data
obtained by capturing a slide on which a plurality of
sections obtained by cutting a single specimen in the .
same direction are discretely placed;
detecting, by a detector, a plurality of specimen
areas in the acquired image data and calculating
position information relatively indicating positions of
the individual specimen areas in a coordinate space of . .
the image data, the plurality of specimen areas having
the same shape and including the individual sections;
storing, by a first storage unit, the calculated
position information; and
switching, by a controller, display between the
specimen areas based on the stored position information.
Description of Symbols
[0131]
1 information processing system
103 specimen area detector
5 104 offset coordinate storage unit
109 image acquisition unit '
207 viewer contr.oller

66
Claims
[I] An information processing system, comprising:
an acquisition unit to acquire image data obtained
by capturing a slide on which a plurality of sections
obtained by cutting a single specimen in the same
i
direction are discretely placed;
a detector to detect a plurality of specimen areas
in the acquired image data and to calculate position
information relatively indicating positions of the
individual specimen areas in a coordinate space of the
image data, the plurality of specimen areas .having the
same shape and including the individual sections;
a first storage unit to store the calculated
position information; and
a controller to switch display between the
specimen areas based on the stored position information.
[2] The information processing system according to
claim 1, further comprising
a generator to generate reduced data by reducing a . .
resolution of the image data, wherein
the detector detects the plurality of specimen
areas in the image data by detecting the plurality of
specimen areas from the reduced data.
[3] The information processing system according to
claim 2, wherein
a plurality of image data items of the plurality
of specimen areas are managed in a cutting order, and
the controller calculates, when the controller
receives, from a user, specification of the specimen
area to be displayed in the acquired image data and a
5 range in the specimen area, the range in the specified
specimen area as a display area, and switches, when the
display area is located at an end of the specimen area
and the controller receives, from the user, an
instruction for moving the display area outside the end,
10 to display the neighbor specimen area in the cutting
order based on the stored position information.
The information processing system according
claim 3 , wherein
the controller switches, when the calculated
15 display area is located at an end of the specimen area'
in one axial direction of the plurality of specimen
areas in the coordinate space of the image data and the
controller receives, from the user, an instruction for
moving the display area outside the-end in the one
20 axial direction, to display a neighbor specimen area in
the cutting order while fixing a position in the other
axial direction.
[5] The information processing system according to
claim 4, wherein
25 the acquisition unit acquires image data obtained
by capturing a slide on which a plurality of sections
obtained by cutting a single specimen in the same
direction are arranged and placed discretely and in one
row, and
the controller calculates, when the calculated
5 display area is located at an end of the specimen area
in an arrangement direction Qf the plurality of
specimen areas in a coordinate space of the image data
and the controller receives, from a user, an
instruction for moving the display area beyond the end
. 10 in the arrangement direction, a display area of the
specimen area in the moving destination based on the
stored position information.
[6] The information processing system according to
claim 5, further comprising:
an alignment unit to detect feature points of the
plurality of specimen areas and to calculate an offset
amount between coordinates of the feature points in a
coordinate space of the specimen area; and
a second storage unit to store-the calculated . .
20 offset amount, wherein
the controller calculates, when the controller
receives, from a user, an instruction for jumping the
display area to another specimen area, the display area
at a jumping destination based on the stored position
25 information and the stored offset amount such that
positions of the feature points correspond to each
w a,
0 C
4J
rd crrdd , C-h4 , r-:4
u 4
rd r:
& 2 Z 4 -4
2 % "
-4 a,
rd a
4 rn
- C r l - d u a ,
C7 s -4t 4n
3 C
C -4
o c r n
-4 0
c, rd
-4 a,
r n a t n
-4 -4 C
3 4 -4
t r r n 4 J
U c,
rd rd 3
U
C tn
r d C h
-4 a
h w
a a
C, a, 4 a c
tn rd -4
C U rd
-4 C,
w h a
-4 a 0
3
tr a
U a, 2 a C 0
-4 -4
rd c,
C, U a a, o rn
. .
[I) a
w a,
h 0 r n '
Id rd
4 h a a c,
rn -4 4
-4 4 rn
a r d a , w C,
4 rl
rd U
V a , 4
r d C r d a u u
same direction are discretely placed;
detecting, by a detector, a plurality of specimen
areas in the acquired image data and calculating
position information relatively indicating positions of
5 the individual specimen areas in a coordinate space of
the image data, the plurality of specimen areas having
the same shape and incluGing the individual sections;
- storing, by a first storag-e unit, the calculated
--
position information; and
switching, by a controller, display between the
specimen areas based on the stored position information.
_ - _ - --. - - - - - --
Dated this 12.04.201 3
ATTOR$EY FOR THE APPLICANT[S] - -