Technical field
[0001]
　This technology is, for example, an information processing apparatus, an observation system for observing the cells in culture, observation method, a program.
BACKGROUND
[0002]
　Recently, Husbandry, in the field of regenerative medicine or the like, to the analysis and evaluation of the cultured living cells or living tissues sequentially acquired in time series image living cells or living tissues, analysis and evaluation apparatus have been developed there.
[0003]
　For example, Patent Document 1 obtains the time-series images of the embryo, when the difference in pixel values ​​between sequential images, embryo quality evaluation support method for observing and evaluating the state of development of the embryo is disclosed .
CITATION
Patent Document
[0004]
Patent Document 1: JP 2010-181402 JP
Summary of the Invention
Problems that the Invention is to Solve
[0005]
　However, in the period of the cell, for the degree of change in the state of cells are not constant as divided cell division stage and interphase, as embryo quality evaluation support method according to Patent Document 1, throughout at regular intervals If fertilized egg continues to imaging, such as in a significant cell stage state change, there is a possibility to miss take an important photographing timing. On the other hand, if continued to shot at short shooting interval in accordance with the cell division stage, its addition to the capacity of the photographed image becomes enormous, it takes a lot of time in the analysis, a realistic difficult.
[0006]
　In view of the circumstances as described above, an object of the present technology is to provide an information processing apparatus capable of preventing the take missed in critical photographing timing, observation system, an observation method, and a program.
Means for Solving the Problems
[0007]
　The information processing apparatus according to an embodiment of the present technology includes a control unit.
　Wherein the control unit, based on the optical image of the cells in culture taken by the first imaging interval to detect the presence or absence of a state change of a cell, upon detection of the state change, a shooting mode in the first imaging interval from switching to shorter second imaging interval than the first imaging interval.
[0008]
　Thus, it is possible to prevent the take missed the critical photographing timing.
[0009]
　The control unit may be configured to detect the presence or absence of thermal images from the cells of the state change of cells in culture.
　As a result, while reducing the damage to the cells, it can be switched more accurately shooting interval.
[0010]
　The optical image is a three-dimensional image obtained from a plurality of optical images taken from the multi-view, the control unit, in response to changes in the characteristics of quantified cells based on the information of the three-dimensional image Te may be configured to detect a change of state of the cells.
　From this, more can be switched accurately photographing interval, it is possible to prevent the missed taking important photographing timing.
[0011]
　The cells, a fertilized egg, the feature quantity of the cells, the volume of the fertilized egg, the surface area, sphericity, surface asperity, and cleavage of may be uniform degree.
[0012]
　Observation system according to an embodiment of the present technology includes a cell culture vessel, and the imaging unit, and a control unit.
　The cell culture vessel for culturing cells.
　The photographing unit has an optical image capturing unit configured to acquire an optical image of cells in culture at the first shooting distance.
　The control unit detects the presence or absence of a state change of a cell from the image of the cells in culture taken by the first imaging interval, when detecting the state change, the first imaging mode from the first imaging interval switch to short the second imaging interval than the first imaging interval.
[0013]
　The photographing unit has a thermal imaging unit for obtaining a thermal image of the cells in culture continuously, the control unit is based on the thermal image in which the thermal image photographing unit is taken, the state changes in cell the presence or absence of may be detected.
[0014]
　The optical imaging unit may acquire the multi-viewpoint optical image of said cell.
　The observation system includes an optical image database unit, a three-dimensional reconstruction unit may further include a.
　The optical image database unit stores the multi-viewpoint optical image.
　The three-dimensional reconstruction unit acquires the multi-viewpoint optical image from the optical image database unit reconstructs three-dimensional.
[0015]
　The control unit, based on the three-dimensional reconstructed the multi-view optical image, it may detect a change in the state of the cells.
[0016]
　Observation method according to an embodiment of the present disclosure, based on the optical image of the cells in culture taken by the first imaging interval to detect the presence or absence of a state change of a cell, upon detection of the state change, a shooting mode from the first shooting distance is switched to the short second imaging interval than the first imaging interval.
[0017]
　A program according to an embodiment of the present disclosure, the information processing apparatus, detecting the presence or absence of the state change of the cells based on the optical image of the cells in culture taken by the first imaging interval, detects the state change when, to the photographing mode and a step of switching to a shorter second imaging interval than the first imaging interval from the first shooting distance.
Effect of the invention
[0018]
　As described above, according to this technique, it is possible to prevent the take missed the critical photographing timing.
　Here, the advantages described in the present invention is not necessarily limited, it may be any of the effects described in the present disclosure.
BRIEF DESCRIPTION OF THE DRAWINGS
[0019]
FIG. 1 is a block diagram showing the schematic configuration of an information processing apparatus according to an embodiment of the present technology.
FIG. 2 is a block diagram showing a main part of the observation system.
3 is a flowchart showing an operation example of the observation system.
4 is a diagram showing a specific example of an operation in which photographing interval is switched in the imaging unit 21 of the observation system.
5 is a diagram showing an example of the configuration of an optical imaging unit (configuration example 1) in the observation system.
A [6] shows an example of the configuration of an optical imaging unit in the observation system (Configuration Example 2).
7 is a diagram showing an example of an optical imaging unit and culture vessel arrangement of the observation system (Configuration Example 3).
A [8] shows an example of the configuration of an optical imaging unit in the observation system (Configuration Example 4).
Is a [9] shows an example of the configuration of an optical imaging unit in the observation system (Configuration Example 5).
Diagrams [10] shows a general method for obtaining an image obtained by correcting the optical axis.
11 is a diagram illustrating a method of acquiring an image obtained by correcting the optical axis of the optical imaging unit (configuration example 1) in the observation system.
It is a block diagram showing a configuration of a three-dimensional reconstruction unit according to the third embodiment of FIG. 12 the present technology.
13 is a diagram illustrating a general method for stereo matching from the left and right images.
14 is a diagram showing an example of a method for stereo matching from the left and right images of the optical imaging unit (configuration example 1) in the observation system.
15 is a diagram for explaining an operation example of the three-dimensional reconstruction unit according to the third embodiment of the present technology.
16 is a block diagram showing the configuration of an observation system according to a fourth embodiment of the present technology.
17 is a flowchart for explaining an operation example of the observation system.
DESCRIPTION OF THE INVENTION
[0020]
　Hereinafter, the embodiments of the present disclosure will be described with reference to the drawings.
[0021]

[Observation System Overview
　Figure 1 is a block diagram showing an observation system 10 of an embodiment of the present invention. Figure 2 is a block diagram showing the main part of the observation system 10.
[0022]
　Observation system 10 includes a culture vessel 1, an imaging unit 2, an information processing apparatus 3.
[0023]
　Culture container 1 is configured to accommodate the culture and one or more cells C, a light-transmitting enough to be photographed cell C from the outside. The shape of the culture vessel 1 is not particularly limited, typically, flat dish shape of the petri dish or the like is used. The number of the culture container 1 is not particularly limited, it may be a single or a multiple.
[0024]
　As used herein, "cell" (singular) comprises a single cell, and a group of a plurality of cells at least conceptually. As "cell", as cultured in the culture container 1, for example, organisms of unfertilized egg cells in Husbandry, etc. (ova), fertilized eggs, or embryos or the like, regenerative medicine, in the field of such pathobiology, stem cells, immune cells, biological samples, etc. taken from the living body such as cancer cells include, but are not particularly limited thereto.
[0025]
　Capturing unit 2, a cell C that is accommodated in the culture vessel 1 taken at a predetermined imaging interval, acquires the optical image of the cell C. Capturing unit 2, CMOS (Complementary Metal Oxide Semiconductor), includes a CCD (Charge Coupled Device) or the like of the solid-state imaging device (imaging unit 21), the drive control unit 22 for controlling the driving of the imaging unit 21. Photographing unit 2 is typically formed of a visible light camera may be a built-in flash. Capturing unit 2, instead of the visible light camera or in addition to, may comprise a near-infrared camera.
[0026]
　Culture container 1 and the photographing unit 2 is supported respectively on the observation platform 5 that holds these relative distance constant. Photographing unit 2 is typically, but is fixed to a position opposed to the cell C in the culture vessel 1, it may be installed to be movable relative to the culture vessel 1. The number of the photographing unit 2 is not particularly limited, it may be a single or a multiple. If the photographing unit 2 is more established, with the cells C can be observed from the multi-view, it is possible from these multi-viewpoint image synthesizing a three-dimensional image of the cell C.
[0027]
　The information processing apparatus 3 includes an imaging interval control unit 31 which controls the photographing interval of the photographing unit 2. The information processing apparatus 3 obtains an optical image of the cell C in the taken culture in the first imaging interval from the image DB (database) unit 4. The information processing apparatus 3, based in the photographing interval control unit 31 into an optical image of the cells C, to determine the presence or absence of a predetermined state change of the cell C, when it detects the state change, shorter than the first imaging interval control signal S to switch to the second shooting distance photographing interval 0 to generate. The information processing apparatus 3, the control signal S 0 and outputs a to the photographing unit 2.
[0028]
　Imaging unit 2, the control signal S on imaging interval outputted from the information processing apparatus 3 0 based on, to obtain the optical image of the cell C at a predetermined imaging interval. Capturing unit 2 transmits an optical image of the cell C taken by the photographing interval to the image DB 4.
[0029]
　Image DB unit 4 stores the optical image of the captured cells C in the photographing unit 2, and transmits an optical image of the cell C to the time series information processing apparatus 3. Image DB unit 4 may be configured by a general-purpose computer may be configured with a cloud server connected via the photographing unit 2 and the information processing apparatus 3 and the internet.
[0030]
[Information Processing Apparatus]
　The following describes the details of the information processing apparatus 3. The information processing apparatus 3 includes an imaging interval control unit 31, a transceiver 32, and a memory 33.
[0031]
　Imaging interval control unit 31, having an analysis unit 34 and the update section 35. Analyzer 34 and the update unit 35 is an example of a non-transitory computer-readable recording medium ROM (Read Only Memory) the recorded program by loading into a RAM (Random Access Memory) in CPU (Central Processing Unit) is achieved by the run.
[0032]
　Imaging interval control unit 31 in response to changes in the status of the cells C, configured to be capable of selectively switching the photographing mode to the first imaging interval and the second imaging interval. The second imaging interval, shorter than the first imaging interval. The first imaging interval and the second imaging interval is not particularly limited, the type and rating type of state change to be in cell C, can be set as appropriate according to the speed and the like of the state change. For example, the first imaging interval several seconds to several tens of minutes, the second imaging interval can be set to several tens of milliseconds to several minutes. That is, in the second imaging mode, imaging unit 2 may be taken by moving the cells C.
[0033]
　Analysis unit 14 based on the time-series images of a cell C, by analyzing the optical image of the cell C, configured to detect the presence or absence of the state change of the cell C. For example, by generating a difference image between two cells C of the optical images of different shooting times, it is possible to detect the state change of the cell C. Details of which will be described later.
[0034]
　Updating unit 15, in accordance with the analysis result of the analysis unit 14, the signal S switches between the shooting interval and the first imaging interval and the second imaging interval 0 to generate.
[0035]
　Transceiver unit 32 obtains an optical image of a photographed cell C from the image DB 4. Transceiver unit 32, directly from the imaging unit 2 may be configured to acquire an optical image of the cell C. The transmitting and receiving unit 32, the signal S for controlling the shooting interval photographing unit 2 0 transmits the. Transceiver unit 32 includes, for example, a communication circuit and an antenna, which constitutes an interface for communication with the imaging unit 2 and the image DB 4. The communication performed by the transmission and reception unit 32 may be a well-wired or wireless. Wireless communication is communication or by using the electromagnetic wave (including infrared), or a communication using an electric field.
[0036]
　Memory 33 has a ROM and RAM, etc., and algorithms for determining the presence or absence of the state change of the cells, a program for controlling the shooting interval, the program for correction processing of the image data, the image DB 4 ( storing an image or the like of the cells C obtained from the imaging unit 2). Further, various parameters or data for executing these programs may be stored in the memory 33.
[0037]
[Operation example of an observation system]
　Hereinafter, as shown in FIG. 3, an operation example of the observation system 10 of the present embodiment.
[0038]
　Observation system 10 of the present embodiment acquires the optical image of the cell C every predetermined imaging interval Tx has elapsed (S101 and S102), and saves the optical image of the captured cells C in the image DB unit 4 (S103 ), an optical image of the stored cell C analyzes the information processing apparatus 3 (S104). Observation system 10, from the analysis results, to detect the presence or absence of a state change of the cell C (S105), to change the photographing intervals Tx in accordance with the detection result (S106,107).
[0039]
　Here, (No in S105) when the state change of the cell C is not detected, the photographing interval control unit 31, the photographing interval T 0 to maintain the (default) (S106). On the other hand, if the state change of the cells were detected (Yes in S105), the imaging interval control unit 31, the photographing interval T 0 shorter T than 1 switches to (S107). Photographing unit 2 is photographing interval T 1 to the shooting at (S101, S102).
[0040]
　Figure 4 is a schematic diagram showing an example of a state change of a fertilized egg (cell C). If the state change of the fertilized egg is not detected, the photographing unit 2, the photographing interval T 0 to shoot fertilized with. If a change to the 2-cell stage embryo was detected, the photographing unit 2 is short shooting interval T 1 taking a fertilized egg in. Then, when a change in two-cell stage is stopped (i.e., when no detection of the state change), the photographing unit 2 is photographing interval T again 0 to shoot embryo at. Further, when a change from two-cell stage to the 4-cell stage were detected, the photographing unit 2 is again photographing interval T 1 is taken with.
[0041]
　Flow typical operation is as follows. Imaging interval control unit 31, when the state change of the cells is not detected, shooting interval T 0 to execute the control to shoot cells C in the imaging unit 2, upon detecting a state change of the cell C is T 0 short shooting interval T than 1 in executing the control to shoot the cell C to the photographing unit 2. Thereafter, when the state change of the cell C is not detected, the photographing interval control unit 31, the imaging interval of the cells C T 1 T from 0 back to. From this, in accordance with the developmental stage of the cell, the imaging interval adaptively be varied and can be photographed without missing taken in critical timing involved in the evaluation of the cell.
[0042]
　The shooting interval, for example, resting before cell division 5min intervals (T 0 and), when detecting a change in the state of the cells C, 30 msec (T 1 ) and spacing. Incidentally, imaging interval, depending on the state change of the cell may be switched stepwise.
[0043]
　Imaging interval control unit 31 in order to detect the state change cell C starts cell division, for example, occurrence of cell boundary surface and the inner cell mass, an increase in the surface area and volume of the cells, the sphericity of the cell detecting a change in the characteristic quantity of change or the like. By detecting these, in critical timing cell C starts cell division, thereby enabling photographing at a fine interval between shots.
[0044]
Description of specific operation example of the imaging interval control unit]
　An example of a specific operation of the imaging interval control unit 31 according to the present embodiment will be described.
[0045]
　Imaging interval control unit 31 (analyzer 34), for example, calculates a difference value between different two optical images shooting time, it compares the difference value whether more than a predetermined threshold value. Analyzer 34, if the predetermined threshold value or more, as an image change is large, detects a state change of the cell C to (determination). The different two optical images shooting time, specifically, a current cell of the optical image and the past cells optical image (a predetermined plurality of captured images to the previous captured image or last), the current by detecting changes in the cells of the optical image, for any significant time cell division begins, real-time switching the imaging interval can be photographed. Method of detecting a state change of two optical images of different shooting time, in addition to the method of calculating a difference value of each pixel of the optical image, as will be described later, and three-dimensional reconstruction from multi-viewpoint optical image, obtained may be detected based on the change amount of the extracted feature value from the three-dimensional image, the method is not particularly limited.
[0046]
　Here, the cells C in culture to a rotary motion and translate slightly in the culture vessel, there are cases where the position and size of the cell image captured is changed. To solve this problem, rotating the optical image of the cell C, respectively, translation, scaling, after correcting the position and size of the cells may be performed difference calculation between two images. In this case, the difference between the cell image after the correction, to employ a smallest value for example, determines. From this, it is possible to detect a more state change accurately cells C. The information processing apparatus of this embodiment, CPU executing the above correction processing may be separately a memory.
[0047]
(Summary)
　state change of a cell, the type of cells being cultured, depending on the developmental stage of the cell proceeds at different degrees. Previous street, when the cells were taken at regular intervals, in significant cell stage state change of a cell, which may miss taking the state of division involved in the evaluation of the cell. On the other hand, when taken in small shooting interval, the amount of image data becomes enormous, consuming a lot of time for the process. In contrast, according to this embodiment, in response to changes in the status of cells, can be switched photographing interval can be captured at high density in critical timing cell changes state. Further, only when the key timing and shooting at a high density, in the normal shooting mode by shooting a low density, it is possible to suppress the image volume to be stored and processed. Further, by not increasing the number of shots than necessary, it is possible to reduce damage to the cells by irradiation light irradiated at the time of shooting.
[0048]

　Subsequently, a description will be given of a second embodiment of the present technology. Hereinafter, the configuration different from the first embodiment mainly describes, the same configuration as the first embodiment are denoted by the same reference numerals, be omitted or simplified.
[0049]
　Observation system 20 according to this embodiment, in that it has a obtainable imaging unit 12 to the multi-view image of the cells C, differs from the first embodiment. Than to observe the cell C from the multi-view, it is possible to detect more accurately the state change of the cell C.
[0050]
(Configuration Example 1)
　observation system 20 shown in FIG. 5 has an imaging unit 12 for capturing a cell C that is accommodated in the culture vessel 1 consisting of a flat dish such as a Petri dish with a plurality of cameras a1 ~ a3. Camera a1 ~ a3 may be arranged in the circumferential direction along the cell C surface around the cell C. From this, the multi-viewpoint image can be observed the upper hemisphere of the cell can get a can be detected more change of state accurately cells. As described below, three-dimensionally reconstructed from multi-view image, it may form a three-dimensional image. Although the number of placement for the camera is not particularly limited, as the number of cameras is large, you can complete the image of the occlusion area, can be more accurately detect the state change.
[0051]
　Imaging interval control unit 31 (FIG. 2) may be individually controlled imaging interval for each camera a1 ~ a3, may control the photographing interval in common for each camera a1 ~ a3. For example, imaging interval control unit 31 may control the photographing unit 12 to acquire the above predetermined imaging interval from each camera a1 ~ a3 optical image of the cell C individually in the predetermined imaging interval switch the camera a1 ~ a3 may control the photographing unit 12 to acquire an optical image of the cell C from the camera.
[0052]
(Configuration Example 2)
　observation system 20 shown in FIG. 6 includes a photographing unit 12 for photographing the cells C, which is housed in the culture vessel 1 consisting of a flat dish such as a Petri dish movably camera b1. Camera b1 is about the cells C, in the circumferential direction along the cell C surface configured to be moved to a position of the camera b1 '. From this, in the same manner as described above, it is possible to obtain multi-viewpoint images on the cell C hemisphere. Furthermore, since it is possible to reduce the number of cameras that are arranged, the apparatus compact, cost reduction is also achieved.
[0053]
(Configuration Example 3)
　In the observation system 20 shown in FIG. 7A, with the container housing the cells C are constituted by a cylindrical container 11 made of a circular pipe or the like having a light-transmitting camera d1 of the side surface of the cylindrical container as observable cell C from the entire circumferential direction P1, movable in. From this, not only the hemispherical image onto the cells C, can also be obtained lower hemisphere image. That it is possible to acquire the entire periphery image of the cell C, it can be detected more change of state accurately cells.
[0054]
(Configuration Example 3 ')
　on the other hand, in the observation system shown in FIG. 7B, with a cylindrical container 11 is rotatable in a circumferential direction (about the Z axis), the camera d2 for photographing a side of the cylindrical container 11 It is fixed to a predetermined position on the Y axis orthogonal to the Z axis. From this, it is possible to acquire the entire periphery image of the cell C as well as configuration example 2. Further, the reduction of the number of cameras can, for space to move the camera also does not require, the apparatus compact, cost can be reduced.
[0055]
(Configuration Example 3 ")
　In addition to the above configuration example (configuration example 3 '), in the observation system shown in FIG. 7C, as the Z-axis direction of the cylindrical container 11 can image the cell C, the camera d3 (d3 ') is installed movably. for example, in X-Z plane as shown (Y-Z plane), the camera d3 around the cell C (d3') is a circular motion. than this, since it is possible to obtain an optical image from all directions, and more precisely to detect a change in the state of cells can be taken at short shooting interval in critical timing.
[0056]
(Configuration Example 4)
　FIG. 8A, the observation system 20 shown in B has a horizontal surface disposed mirror at equiangular intervals so as (X-Y plane) surrounding the cells C that arranged on the (M1 ~ M3). Then, as shown in FIG. 8B, the camera e1 arranged vertically top of the cell C may be photographed reflection image of the cell C and the mirror (M1 ~ M3). From this, it is possible to obtain an optical image from the upper vertical cells C, an optical image from a circumferential direction around the cell C in the horizontal plane. As will be described later, and three-dimensional reconstruction of the multi-view image, they may form a three-dimensional image. Although the number of arrangement for the mirror is not particularly limited, as the number of mirrors is large, can complete the image of the occlusion area, it can be more accurately detect the state change.
[0057]
　Furthermore, as shown in FIG. 8B, may be a camera e2 is further arranged to photograph the cell C from the bottom. From this, it is possible to obtain an optical image of the cell C of the lower visual field, it is possible to obtain the cell image viewed from all directions.
[0058]
(Configuration Example 5)
　observation system shown in FIG. 9 includes a culture vessel 12 containing a plurality of cells C1 ~ C3, and a plurality of cameras f1 ~ f3 respectively disposed in the vertical direction the top of each cell, each camera f1 ~ f3 is, not only the cell directly below, also has a viewing angle that is capable of simultaneously photographing the cells of its surroundings. As a result, for example with respect to cell C2, not only the viewpoint image from the camera f2 (viewpoint F2), the camera f1 (viewpoint F12) and the viewpoint image from, obtaining a view image from the camera f3 (viewpoint F32) can. Than this, it is possible to observe from the multi-viewpoint for each cell C1 ~ C3. Further, it is possible to reduce the number of cameras to be placed.
[0059]
　Here, the optical axes of the cameras f1 ~ f3 in FIG. 9 for parallel to each other, for example, viewpoint images of the cells C1 captured by the camera f2 may be positioned and appearance by the difference in the optical axis are different. In this case, the image of the cell C1 captured by the camera f2, the optical axis of the camera f2 may be converted to an image for the cell C1. Thus, without changing the position and orientation of each camera can observe a single cell from a plurality of viewpoints.
[0060]
　Method of converting an optical axis of the camera is not particularly limited, various methods can be adopted. For example, as shown in FIG. 10A, 'by projecting a vertical image plane P, the optical axis from A1 A1' image of the optical axis A1 optical axis A1 can make an image that has been converted to. For example, when photographing a checkerboard, and the image of the optical axis A1, an image of the optical axis A1 of converting the optical axis' is FIG. 10B, images of different visible side as shown in C are obtained.
[0061]
　Therefore, as shown in FIG. 11A, B, when observing the cells C2 which are arranged in the center, the optical axis F1, F3 of the adjacent cameras f1, f3, the optical axis around the cell C2 F1 ', F3' in image V1 when converted ', V3' to acquire. Image converted to the optical axis, reflection object on the optical axis in the center of the image, a distant relative to the optical axis is small, becomes the reflected large nearby object. Thus, making an image by changing the optical axis, by integrating the cell images from multiple viewpoints, it detects a state change of the cell more accurately.
[0062]
　Also, to acquire images of two viewpoints from a plurality of cameras as described later, the stereo matching may be a three-dimensional reconstruction. The image conversion processing method for camera stereo matching, described later.
[0063]
(Summary)
　state change by the cell division of a cell, depending on the angle of shooting may not be able to shoot like interface division. Also, when shooting from a viewpoint, a situation in which sites have can be taken up to now by the dynamic changes, such as rotational movement of the cells can not shoot occurs. In the configuration of this embodiment, by acquiring an optical image of the cell from the multi-view, without missing more state changes of cells can be detected. Therefore, it is possible to realize more accurately the switching of the photographing interval for any significant time in the development process of cell.
[0064]

　Subsequently, a description will be given of a third embodiment of the present technology. 12, the following is a block diagram showing the configuration of the observation system 30 according to this embodiment, first, mainly describes the different configurations the second embodiment, first, the same as in the second embodiment denoted by the same reference numerals structure will be omitted or simplified.
[0065]
　This embodiment utilizes the image of multi-viewpoint obtained by the second embodiment in that it has a three-dimensional reconstruction unit 5 for reconstructing a three-dimensional, differs from the embodiments described above. Method for the three-dimensional reconstruction, for example, a method by general multiview vision, but is roughly classified into methods by the stereo vision technique by stereo vision with excellent reproducibility of the recess of the cell surface is employed in this embodiment that.
[0066]
　The three-dimensional reconstruction unit 5 includes an image database (DB) unit 51, a stereo image acquisition unit 52, a stereo matching unit 53, and a three-dimensional reconstruction data base (DB) unit 54. Incidentally, the three-dimensional reconstruction unit 5 may be configured as part of the information processing apparatus 3. Further, the image DB 51 and the three-dimensional reconstruction DB 54, the three-dimensional reconstruction unit 5 may be configured as a separate device.
[0067]
　Image DB 51 stores the multi-viewpoint of cell images obtained by the photographing unit 12. Stereo image acquisition unit 52 acquires the two view image among the multi-view cell image acquired from the image DB 51, and acquires the collimated image the optical axis of the two viewpoints. Stereo matching unit 53, stereo matching images collimated above two viewpoints, to obtain a three-dimensional image. 3D reconstruction DB unit 54 stores the three-dimensional reconstructed image by the stereo matching unit 53.
[0068]
　In general, in order to stereo matching, it is necessary to collimate the optical axes of the right and left images. For example, as shown in FIG. 13A, when the optical axis G1, G2 is captured samples S mutually nonparallel camera g1, g2, images v1, v2 is an image as shown acquired by each camera g1, g2 It is different. Accordingly, the optical axis G1 of the camera g1, g2 as shown in FIG. 13B ', G2' images v1 to projective transformation so as to be parallel to each other ', v2' to generate. Incidentally conversion method of the optical axis are as described above.
[0069]
　In addition, (see FIG. 5) when the camera a1 ~ a3 are arranged along the circumferential direction on the cell C hemisphere as shown in Figure 14A, when the stereo matching process, for example, as shown in FIG. 14B, the camera a1, a2 combinations and camera a2, a combination of a3 may collimate respective optical axes. In other words, the optical axis A1 A2, and collimates the optical axis A2 and A3, respectively the optical axis A1 'and A2', to generate the converted image to the optical axis A2 "and A3 'and.
[0070]
　Figure 15 is a flowchart showing an operation example of the three-dimensional reconstruction unit 5.
[0071]
　3D reconstruction unit 5 first acquires a combination of two viewpoints from the image of the cells taken from a plurality of viewpoints (N sheets) (S201). 3D reconstruction unit 5, after the stereo image obtained by collimating an optical axis created (S202), creates stereo matching images (S203), stores the three-dimensional image created in the three-dimensional image DB 54 ( S204). If it has a combined picture of two different viewpoints, the same operation is repeated (S205). In all combinations, by stereo matching, it is possible to obtain a three-dimensional image of the cell.
[0072]
　Three-dimensional image created in the above manner, is referred to in the information processing apparatus 3 to detect the state change of the cell. According to this embodiment, only the difference between the two-dimensional image irregularity or could not be detected surface, such as changes in volume can be accurately detected a change in the state of the cells.
[0073]
(Operation Example)
　The information processing apparatus 3, the image stored in the three-dimensional reconstruction DB unit 54, respectively quantify the characteristics of the current cell image and a past cell image, the change amount of the quantified characteristic quantity based determines the presence or absence of the state change of the cell. For example, if the cell is a fertilized egg, the volume of the embryo, the surface area, sphericity, surface asperity, such as cleavage of the uniformity of the quantified, to reflect the variation in the presence or absence of the detection of the state change it may be. Further, from the movement of the various characteristic points of the embryo, for the movement of the time variation of such rotation and migration of cells in three-dimensional space, can follow. From this, the state change of a cell can be detected accurately, it is possible to switch adaptively photographing interval in accordance with the change of a fertilized egg.
[0074]

　Subsequently, a description will be given of a fourth embodiment of the present technology. Hereinafter, the configuration different from the first embodiment mainly describes, the same configuration as the first embodiment are denoted by the same reference numerals, be omitted or simplified.
[0075]
　Observation system 40 according to this embodiment, the imaging unit 42, and an information processing apparatus 43. Imaging unit 42 in the present embodiment has a thermal imaging unit 201, the information processing apparatus 43 in that it has a thermal image analyzing unit 301, it differs from the first embodiment described above.
[0076]
　Thermal imaging unit 201 is typically constituted by an infrared camera. Thermal imaging unit 201 continuously acquires the thermal image of the cell C in culture at a predetermined frame rate. Thermal image analyzing unit 301 constitutes a part of the analyzer 34, the thermal image of the obtained cells C and analyzed at all times, is configured to detect the presence or absence of the state change of the cell C in culture.
[0077]
　Incidentally, the photographing unit 2 may be formed of a single camera as in the first embodiment, is constituted by the second embodiment similarly to the multi-viewpoint images that the obtainable one or more cameras it may be. Also in the observation system 40 of this embodiment may include a three-dimensional reconstruction unit 5 described in the third embodiment.
[0078]
　Figure 17 is a flowchart illustrating a typical operation example of the observation system 40 of this embodiment.
[0079]
　Observation system 40 of the present embodiment acquires the thermal image of the cell in the thermal image capturing unit 201 (S301). Then, the information processing apparatus 43 analyzes the acquired thermal image (S302), detects the presence or absence of the state change of the cell C (S303). The information processing apparatus 43 (No in S303) If not detected a change in the state of the cell C, shooting interval T 0 is maintained (initial set value) (S304), detects a change in the state of the cells If (Yes in S303), the photographing interval T 0 shorter T than 1 switches to (S305).
[0080]
(Summary)
　for shooting a state change constantly cells optical imaging means, it is necessary to emit continuously light the cell, and thus exert a great deal of damage to the cells. According to this embodiment, as a tool for the detection of the state change of the cells, by employing the thermal imaging device in place of the optical imaging means, with minimal damage to the cells, at all times the state change It can be observed. That is, even when the imaging interval of the optical imaging means is not shoot the cells, it is possible to detect the state change of a cell can be in a critical imaging timing involved in the evaluation of the cell, to obtain the time lag less optical image photographing .
[0081]
　In particular, the thermal imaging unit according to this embodiment requires no light source, it can be taken with non-invasive to the cell. Therefore, it is suitable to obtain the cell image at all times.
[0082]
　Having described embodiments of the present technology, the technology is not limited to the embodiments described above, can of course be modified variously.
[0083]
　The present technology may also be configured as follows.
(1) based on the optical image of the cells in culture taken by the first imaging interval to detect the presence or absence of a state change of a cell, upon detecting the status change, the shooting mode from the first imaging interval control unit for switching the short second imaging interval than the first imaging interval
　information processing apparatus having a.
(2) The information processing apparatus according to (1),
　wherein the control unit detects the presence or absence of the state change of the cells from the thermal image of the cells in culture
　the information processing apparatus.
(3) The information processing apparatus according to (1) or (2),
　the optical image is a three-dimensional image obtained from a plurality of optical images taken from the multi-view,
　wherein the control unit , in accordance with a change in the characteristic quantity of quantified cells based on the information of the three-dimensional image, detecting a state change of a cell
　information processing apparatus.
(4) above (1) to (3) The information processing apparatus according to any one of
　the cells, a fertilized egg,
　the feature quantity of the cells, the volume of the fertilized egg, the surface area, sphericity, surface asperity, and cleavage of the uniformity
　information processing apparatus.
(5) and the cell culture vessel for culturing cells,
　imaging unit and having an optical imaging unit for obtaining an optical image of the cells in culture in the first imaging interval
　of cells in culture taken by the first imaging interval detecting the presence or absence of a state change of a cell from the image, upon detecting the status change, and a control unit for switching the imaging mode from the first imaging interval short second imaging interval than the first imaging interval,
　observation system comprising a.
(6) The observation system according to (5),
　wherein the imaging unit includes a thermal imaging unit for obtaining a thermal image of the cells in culture continuously,
　the control unit, the thermal image capturing portion based on the thermal image captured, it detects the presence or absence of the state change of the cell
　observation system.
(7) The observation system according to the above (5) or (6),
　wherein the optical imaging unit acquires a multi-viewpoint optical image of said cell,
　the observation system, stores the multi-viewpoint optical image acquires an optical image database unit, the multi-viewpoint optical image from the optical image database unit further comprises a three-dimensional reconstruction unit which reconstructs a three-dimensional, the to
　observation system.
(8) The observation system according to the above (7),
　the control part, based on the multi-view optical image reconstructed three-dimensional, it detects a state change of a cell
　observation system.
　Observation system.
(9) based on the optical image of the cells in culture taken by the first imaging interval to detect the presence or absence of a state change of a cell,
　upon detecting the status change, the shooting mode from the first imaging interval switch to short the second imaging interval than the first imaging interval
　observation method.
(10) to the information processing apparatus,
　detecting the presence or absence of the state change of the cells based on the optical image of the cells in culture taken by the first imaging interval,
　upon detecting the status change, the shooting mode a step of switching to a shorter second imaging interval than the first imaging interval from the first imaging interval
　program for executing.
DESCRIPTION OF SYMBOLS
[0084]
1, 11, 12 ... culture vessel
2,12,42 ... imaging unit
3, 43 ... information processing apparatus
4,51 ... image DB unit
5 ... three-dimensional reconstruction unit
10, 20, 30, 40 ... observation system
11 ... cylinder Jo container
14 ... analyzer
15 ... update unit
31 ... imaging interval control unit
32 ... transceiver
33 ... memory
34 ... analyzer
30, 40 ... observation system
52 ... stereo image acquisition unit
53 ... stereo matching unit
54 ... 3D reconstruction DB unit
201 ... heat imaging unit
301 ... thermal image analysis unit
a1 ~ a3, b1, d1 ~ d3, f1 ~ f3, g1 ~ g2 ... cameras
M1 ~ M3 ... mirrors

The scope of the claims
[Requested item 1]
　Based on the optical image of the cells in culture taken by the first imaging interval to detect the presence or absence of a state change of a cell, when detecting the state change, a shooting mode from the first imaging interval the first control unit for switching the short second imaging interval than the imaging interval
　information processing apparatus having a.
[Requested item 2]
　The information processing apparatus according to claim 1,
　wherein the control unit detects the presence or absence of the state change of the cells from the thermal image of the cells in culture
　the information processing apparatus.
[Requested item 3]
　The information processing apparatus according to claim 1,
　wherein the optical image is a three-dimensional image obtained from a plurality of optical images taken from the multi-view,
　wherein, based on the information of the three-dimensional image in accordance with a change in the characteristic quantity of quantified cells Te, detects a state change of a cell
　information processing apparatus.
[Requested item 4]
　The information processing apparatus according to claim 1,
　wherein the cell is a fertilized egg,
　the feature quantity of the cells, the volume of the fertilized egg, the surface area, sphericity, surface asperity, and cleavage of Hitoshi at one time is
　an information processing apparatus.
[Requested item 5]
　A cell culture vessel for culturing cells,
　imaging unit and having an optical imaging unit for obtaining an optical image of the cells in culture in the first imaging interval
　cell from an image of cells in culture taken by the first imaging interval detecting the presence or absence of the state change when it detects the state change, and a control unit for switching the short second imaging interval than the first imaging interval shooting mode from the first imaging interval
　comprises a observation system.
[Requested item 6]
　A viewing system according to claim 5,
　wherein the imaging unit includes a thermal imaging unit for obtaining a thermal image of the cells in culture continuously,
　the control unit, the thermal image photographing unit photographing the heat on the basis of the image, to detect the presence or absence of the state change of cells
　observed system.
[Requested item 7]
　A viewing system according to claim 5,
　wherein the optical imaging unit acquires a multi-viewpoint optical image of said cell,
　the observation system includes an optical image database unit for storing the multi-viewpoint optical image, wherein acquiring the multi-viewpoint optical image from the optical image database unit further comprises a three-dimensional reconstruction unit which reconstructs a three-dimensional, the
　observation system.
[Requested item 8]
　A viewing system according to claim 7,
　wherein, based on the multi-view optical image reconstructed three-dimensional, detects a state change of a cell
　observation system.
[Requested item 9]
　Based on the optical image of the cells in culture taken by the first imaging interval to detect the presence or absence of a state change of a cell,
　when detecting the state change, a shooting mode from the first imaging interval the first switch to short the second imaging interval than the imaging interval
　observation method.
[Requested item 10]
　The information processing apparatus,
　detecting the presence or absence of the state change of the cells based on the optical image of the cells in culture taken by the first imaging interval,
　upon detecting the status change, the shooting mode the first a step of switching to a shorter second imaging interval than the first imaging interval from photographing interval
　program for executing.