Abstract: The invention relates to a multi-aperture imaging device comprising an image sensor and an array of optical channels wherein each optical channel comprises an optical unit for the imaging of a partial field of vision of a total field of vision onto an image sensor region of the image sensor. The multi-aperture imaging device comprises a beam deflection device for deflecting a beam path of the optical channels. A first optical channel of the array is designed to image a first partial field of vision of a first total field of vision wherein a second optical channel of the array is designed to image a second partial field of vision of the first total field of vision. A third optical channel is designed to completely image a second total field of vision. The second total field of vision is an incomplete cut-out of the first total field of vision.
A multi-aperture imaging apparatus, imaging system and method of providing an ultrapure imaging apparatus
description
The present invention relates to a multi-aperture imaging apparatus, an imaging system, and a method of providing a multi-aperture imaging apparatus. The present invention further relates to multi-aperture linear channel array imaging systems of small or smallest size.
Conventional cameras have an imaging channel that maps the entire object field. The cameras have adaptive components that allow a relative lateral, two-dimensional displacement between the lens and the image sensor to realize an optical image stabilization function. Multi-aperture linear channel array imaging systems consist of multiple imaging channels, each of which accommodates only a portion of the object and includes a deflection mirror.
Desirable would be concepts for multi-channel detection of object areas or fields of view, which allow a compact implementation.
Therefore, the object of the present invention is to provide a multi-aperture image forming apparatus and a method for providing a multi-aperture image forming apparatus which enables a compact image having a high image quality, that is, having a small space.
This object is solved by the subject matter of the independent patent claims.
An insight of the present invention is to have realized that the above object can be achieved by arranging optics with different optics in an array so that different partial fields of vision are detected by the optics. This is achieved both for the combination of single-channel total field views as well as for a combination of a single-channel acquisition of a Gesamtge-field of view with a multi-channel detection of a total field of view by detecting multiple partial fields.
According to one embodiment, a multi-aperture imaging device comprises an image sensor and an array of optical channels, each optical channel comprising optics for imaging at least a partial field of view of an overall visual field onto an image sensor region of the image sensor. The multi-aperture scraping apparatus comprises a beam deflecting device for deflecting a beam path of the optical channels. A first optical channel of the array is configured to image a first partial field of view of a first total field of view, wherein a second optical channel of the array is configured to image a second partial field of view of the first total visual field. A third optical channel is configured to fully image a second total field of view.
According to another embodiment, a multi-aperture imaging device comprises an image sensor and an array comprising at least first and second optical channels. Each optical channel comprises an optical system for imaging a total field of view onto an image sensor region of the image sensor. A beam deflecting device is configured to jointly deflect a beam path of the optical channels. The optics of the first optical channel has a focal length that is at least 10% different from a focal length of the optics of the second optical channel.
The Multiaperturabbiidungsvorrichtung according to both embodiments are designed to fully detect an overall field of view with an optical channel and to detect a further total field of view one-channel or multi-channel. The optical channels used for this purpose are arranged in the same array and are deflected by the same beam deflection device. This makes it possible to use the multi-aperture imaging apparatus to image different total fields of view in combination with a beam deflecting device for switching the viewing direction common to all the channels, so that multiple arrangement of components can be avoided and space-saving realization is enabled.
Further embodiments relate to an imaging system and methods for providing a multi-aperture imaging device.
Further advantageous embodiments are the subject of the dependent claims.
Preferred embodiments of the present invention will be explained below with reference to the accompanying drawings. Show it:
1 a is a schematic perspective view of a multi-aperture imaging device according to an embodiment;
FIG. 1 b is a comparison of two total fields of view, the gem of the multi-aperture imaging device. Fig. 1 a are detectable;
FIG. 1 c shows a schematic perspective view of a multi-aperture imaging device according to an exemplary embodiment, which is formed compared to the multi-aperture imaging device from FIG. 1 a in order to compare the total fields of view according to FIG. Fig. 1 b to detect in temporal change;
FIG. 1 d is a schematic perspective view of a multi-aperture imaging device, according to an embodiment, which has two groups of optical channels for complete group-wise complete imaging of a total field of view; FIG.
FIG. 1 e is a schematic view of the multi-aperture imaging device according to FIG
Fig. 1 d detected total fields of view
FIG. 1f is a schematic perspective view of a multi-aperture imaging device according to an embodiment, which is designed to detect two total fields of view by means of a common beam deflection device; FIG.
Fig. 1g is a schematic view of the Ultiaperturabbildvorrichtung according to
Fig. 1f detected total fields of view;
FIG. 2a is a schematic view of a multi-aperture imaging apparatus according to an embodiment; FIG.
Fig. 2b is a schematic view of a multi-aperture imaging apparatus according to an embodiment in which an actuator is connected to an image sensor;
3a shows a schematic side sectional view of another multiaperture imaging device according to an embodiment;
FIG. 3b is a schematic side sectional view of the multi-aperture imaging apparatus of FIG. 2a; FIG.
4 shows a schematic plan view of a multiaperture imaging device in which a beam deflecting device comprises different beam deflecting elements, according to an exemplary embodiment;
5a is a schematic perspective view of a multi-aperture imaging device with single-line optical channels, according to one embodiment;
5b shows a schematic perspective view of the multi-aperture imaging device from FIG. 5a, with the aid of which an advantageous embodiment of a combination of the optical image stabilization and the electronic image stabilization is explained;
6a is a schematic representation of a beam deflection device, which is formed as an array of facets according to an embodiment Ausführungsbeispiei:
FIG. 6b shows a schematic view of the beam deflection device according to an embodiment, in which facets have a different sorting compared with the illustration in FIG. 6a;
7a-h advantageous embodiments of a beam deflecting device according to embodiments;
8 is a schematic perspective illustration of an imaging system according to an exemplary embodiment;
a schematic perspective view of a portable device comprising two uitiaperturabbildungsvorrichtungen, according to one embodiment;
10 shows a schematic structure comprising a first multi-aperture imaging device and a second multi-aperture imaging device having a common image sensor, a common array and a common beam deflection unit;
1 ae are schematic representations of an embodiment of the electronic image stabilizer according to an exemplary embodiment;
12 shows a schematic representation of a method according to an exemplary embodiment for providing a multi-aperture imaging device;
13 is a schematic flow diagram of a method for providing a
Multiaperture imaging device according to another embodiment; and
14 shows a schematic representation of a method according to a further exemplary embodiment for providing a multi-aperture imaging device.
Before embodiments of the present invention are explained in more detail in detail with reference to the drawings, it is pointed out that identical, functionally identical or equivalent elements, objects and / or structures in the different figures are provided with the same reference numerals, so that in different Described embodiments of these elements is interchangeable or can be applied to each other.
FIG. 1 a shows a schematic perspective view of an ultrapure imaging apparatus 10 according to one embodiment. The multi-aperture imaging apparatus includes an image sensor 12 and an array 14 of optical channels 16a-e. Each optical channel 16a-e comprises an optical system 64a-e for imaging at least one partial field of an overall visual field on an image sensor area 24a-e of the image sensor 12. At least one partial field of view means that an overall visual field can also be imaged by means of optics, as shown in FIG 1 b is described. For example. the optical channels 16a-d of the array 14 are designed to respectively image a partial field of view of a first total field of view, while a further optical channel 16e is formed, to fully depict a second total field of view different from the first partial field of view. Although the total fields of view are different, they may overlap partially or completely. For example. The total visual fields may overlap completely but differ in size. According to further embodiments, the total fields of vision may also partially not overlap or even be disjoint.
Optical channels can be understood as a course of optical paths. The beam paths can be influenced by the optics 64a-e arranged in the array 14, for example by scattering or bundling. The individual optical channels can each form a complete imaging optical system and can have at least one optical component or optic, for example a refractive, diffractive or hybrid lens, and can image a section of the overall object recorded with the multi-aperture imaging device. This means that one, several or all of the optics 64a-e can also be combinations of optical elements. With respect to one, several or all of the optical channels, an aperture stop may be arranged.
The multi-aperture imaging apparatus 10 includes a beam deflector 18 for deflecting a beam path of the optical channels 16a-e. The multi-aperture imaging device 10 is designed to detect the two total fields of view in a position of the beam deflection device 18. In embodiments, it is provided that the beam deflection device 18 is moved translationally or rotationally in order to deflect the beam paths in the changed position in a different direction so that different total fields of view are detected in the changed position. Although four optical channels 16a-d are used to collectively represent a total field of view, another number may be utilized, such as two, at least three, at least four, at least ten, at least twenty or even more.
FIG. 1 b shows a schematic representation of two total fields of view 70 a and 70 b that can be detected by the multi-aperture imaging device 10. In the following, for example, the optics 64a-d of the optical channels 16a-d according to FIG. 1a are configured to image the partial fields 72a-d of a total field of view 70a, wherein a different association or a different number of channels is also possible. The optic 64e of the optical channel 16a, which is additionally arranged in the array 14, is designed to completely image the total field of view 70b shown in FIG. 1b. Compared with the total field of view 70a, which is multi-channeled, ie, piecemeal, by a plurality or plurality of partial visual fields, the total field of view 70b is imaged by a single optical channel. As shown in Fig. 1 b, For example, the total field of view 70b may overlap at least partially or completely with the total field of view 70a. Alternatively, it is also possible that the total fields of view 70a and 70b are at least partially different from each other. The total field of view 70b may be part of the total field of view 70a, that is, the second total field of view may be an incomplete section of the first total field of view, or vice versa. Compared with the total face field 70a, the total field of view preferably has a smaller aperture angle, which may result in the imaged portion of the object area in the total field of view 70b being smaller compared to the total field of view 70a. That is, an opening angle i i of the visual field 70a is larger than an opening angle ε2 of the total field of view 70b, wherein the angles can be directly related to an optical property, such as the focal lengths of the optics. The opening angle ε, of the field of view 70a may be greater than the opening angle ε 2 by at least 10%, at least 20% or at least 50%of the field of view 70b. A larger opening angle leads to a shorter focal length and allows a thinner design of the optics and / or a small diameter of the optics. Compared with the combination of the optics 16a-d for detecting the total field of view 70a and in combination with the second total field of view 70b being an incomplete portion of the first total field of view 70a, the total field of view 70b optic 16e may represent or may be a telephoto or zoom lens at least provide a corresponding function, while conversely, the combination of the optics 16a-d compared to the optics 16e represent a wide-angle lens or at least provide a corresponding function.
The optical channel 16e may have its own beam deflection region 46e associated with the beam deflection device 18, which is different from beam deflection regions 46a-d associated with the optical channels 16a-16d. This allows, for example, a simultaneous detection of the total fields of view 70a and 70b and thus the receipt of two images. Further, for an overlapping area of the total facial fields 70a and 70b
a stereoscopic or 3D information is obtained. Beam redirecting areas may be areas of a large area element such as a mirror and may be unobstructed from other beam areas. Alternatively, however, beam deflection regions can also be visually or mechanically delimited from one another, for example by the beam deflection regions being formed as facets.
The array 14 has optics 64a-d and 64e with intentionally different optical properties. For example. For example, the optics 64a-d are formed equal within manufacturing tolerances, while the optics 64e have deviations from the optics 64a-d which exceed a degree caused by manufacturing tolerances. The optics 64e has, for example, a desired different focal length and / or an intentionally different opening angle with respect to the optics 64a-d, that is to say that it differs in optical property with respect to the optics 64a-d by at least 10%, at least 20% or at least 30% but also higher, at least 50% or even 100% or more.
The multi-aperture imaging device 10 may include an optional electronic image stabilizer 41 to at least partially compensate for any changes received from any optical image stabilization or from images obtained by relative movement between the components 12, 14, and 18.
For example, an image evaluator that retrieves the image sensor areas 24a-e of the multi-aperture imaging device 10 and may be part of the multi-aperture imager 10 is configured to merge the images of the sub-faces 72a-d into a first overall image of the overall field of view 70a by means of stitching and / or to provide a second overall image of the Gesamtgesichtsfeides 70b based on a reading of the image sensor area 24e.
Fig. 1c shows a schematic perspective view of a multi-aperture imaging device 10 'formed as compared to the multi-aperture imaging device 10 for alternately detecting the total facial fields 70a and 70b, that is, in temporal change. This allows the synergistic use of components, so that a further reduced space is required and / or a small amount of individual elements can be provided. Thus, the beam deflection region 46e can be used to alternately deflect the optical path of the optical channels 16d and 16e, so that an arrangement of the beam deflection region 16d from FIG. 1a can be dispensed with. For this purpose, the beam radius area 46e can have a size, for example. the sufficient for the Umienkung of the Gesamtgesichtsfeid 70b optical channel 16e, so that the Umienkung of the used for imaging the comparatively small field of view 72d optical channel 16d is thus easily possible, as shown by the dashed line in Strahlumienkbereich 46e. Alternatively or additionally, the image sensor area 24e may be usable to alternately detect the total field of view 70b and the partial field of view 72d. The image sensor area 24e may at least partly overlap with the image sensor area 24d or may even include the image sensor area 24d, so that the image sensor area 24d need not be arranged separately in the overlap area and may possibly be saved. so that the Umienkung of the used for the imaging of the comparatively small partial field of view 72 d optical channel 16 d is thus easily possible, as shown by the dashed line in Strahlumienkbereich 46 e. Alternatively or additionally, the image sensor area 24e may be usable to alternately detect the total field of view 70b and the partial field of view 72d. The image sensor area 24e may at least partly overlap with the image sensor area 24d or may even include the image sensor area 24d, so that the image sensor area 24d need not be arranged separately in the overlap area and may possibly be saved. so that the Umienkung of the used for the imaging of the comparatively small partial field of view 72 d optical channel 16 d is thus easily possible, as shown by the dashed line in Strahlumienkbereich 46 e. Alternatively or additionally, the image sensor area 24e may be usable to alternately detect the total field of view 70b and the partial field of view 72d. The image sensor area 24e may at least partly overlap with the image sensor area 24d or may even include the image sensor area 24d, so that the image sensor area 24d need not be arranged separately in the overlap area and may possibly be saved. Alternatively or additionally, the image sensor area 24e may be usable to alternately detect the total field of view 70b and the partial field of view 72d. The image sensor area 24e may at least partly overlap with the image sensor area 24d or may even include the image sensor area 24d, so that the image sensor area 24d need not be arranged separately in the overlap area and may possibly be saved. Alternatively or additionally, the image sensor area 24e may be usable to alternately detect the total field of view 70b and the partial field of view 72d. The image sensor region 24e may at least partially overlap with the image sensor region 24d or may even include the image sensor region 24d, so that the image sensor region 24d need not be arranged separately in the overlap region and may possibly be saved.
For alternate switching, the multi-aperture imaging device 10 'may include a switching unit 67 configured to provide relative movement between the image sensor 12, the array 14, and the beam deflector 18 such that the optical channel 16e collects the total field of view 70b to detect the total field of view 70b images the image sensor area 24e through the optics 64e and, so that the partial field of view 72d images the partial field of view 72d onto the image sensor, ie the image sensor area 24d or 24e, through the optics 64d in order to detect the partial field of view 72d. The switching unit may comprise one or more actuators for this purpose. The multi-aperture imaging device 10 'may include an optical image stabilizer.
The preceding explanations make it clear that the beam radius area 46e can also be used for the reconnection of the optical channel 64d, so that the beam radius area 46d can be saved and / or the image sensor area 24e can also be used for the imaging of the field of view 72b, thus saving the image sensor area 24d can be. Both savings can be implemented together but also independently.
As an alternative to the above embodiments, one of the other beam deflection regions 46a-c shown in FIG. 1a can also be used to alternately deflect the optical path of two optical channels. Although the optic 64e is shown as being at the edge of a row of the array 14, it may be located anywhere along the row or arranged in a separate row. As an alternative to the above embodiments, one of the other image sensor regions 24a-c shown in FIG. 1a can also be used to alternately image the total facial field 70b and a partial facial field 72a-d.
An aspect described herein according to which an electronic image stabilizer is used to compensate for differently varying imaging variations between optical channels, and another aspect in which two different sized total fields of view 70a and 70b are detected by a multi-aperture imaging device, ie, using at least one of common image sensor 12, a common array 14 and a common beam deflecting device 18 are independently but also in combination with each other implemented, so that the aspect of the electronic image stabilization represents an advantageous development of the aspect of different sized total fields of view.
1 d shows a schematic perspective view of a multi-aperture ablation device 10 "according to an embodiment. Compared to the multi-aperture imager 10, the multi-aperture imaging device 10" has two optical channels 16c and 16d compared to the optical channels 16a and 16b of FIG have different optical properties. This can be understood to mean that in addition to the optical channel 16e of the ulti-aperture imaging device 10, which is comparable, for example, to the optical channel 64c of the multi-aperture imaging device 10 ", another optical channel 64d is arranged in the multi-aperture imaging device 10" having a comparable optical characteristic so that the optical channels 64c and 64d form a group of optical channels. The optical property of the optical channels 16c and 16d may be equal within a tolerance of at most 10%. Likewise, the optical characteristic of the optical channels 16a and 16b may be the same within such a tolerance range. Between the optical channels of different groups, the optical property of the optics may be at least ± 10% (or 1/1, 1), at least ± 20% (or 1/1, 2) or at least ± 30% (or 1 / 1, 3) but also higher, approximately at least ± 50% (or 1/1, 5) or even ± 100% (or 1/2) or more deviate from the first value of the optical property of the other group. The optical property of the channels may in particular be the resulting focal length of the optics present in the respective channel.
and, conversely, the optical channels 16a and 16b are a wide angle lens for the optical channels 16c and 16d.
The optical channels 16a and 16b may form a first group of optical channels. The optical channels 16c and 16d may form a second group of optical channels. Each of the groups may be configured to capture one of the total facial fields 70a or 70b. In simple terms, the total field of view 70b can also be divided relative to the multi-aperture imaging device 10, as illustrated with reference to FIG. 1e. For example. For example, the optical channel 6a may be formed to detect the partial field of view 72a of the total visual field 70a. The optical channel 16b may be configured to detect the partial field of view 72b of the total field of view 70a. The optical channel 16c may be configured to detect the partial field of view 72c of the total field of view 70b. The optical channel 16d may be formed to detect the partial field of view 72d of the total field of view 70b. Each of the groups of optical channels 16a / 16b and 16c / 16d may be configured to completely detect the associated total field of view 70a and 70b, respectively. The total field of view 70b may be an incomplete section of the total field of view 70a. In other words, the total field of view 70a may include the total field of view 70b. Stated another way, the total field of view 70b may completely overlap the total field of view 70a, but the total field of view 70a may be incomplete with the total field of view 70b, for example. The total field of view 70b may be an incomplete section of the total field of view 70a. In other words, the total field of view 70a may include the total field of view 70b. Stated another way, the total field of view 70b may completely overlap the total field of view 70a, but the total field of view 70a, for example, may be incomplete with the total field of view 70b. The total field of view 70b may be an incomplete section of the total field of view 70a. In other words, the total field of view 70a may include the total field of view 70b. Stated another way, the total field of view 70b may completely overlap the total field of view 70a, but the total field of view 70a, for example, may be incomplete with the total field of view 70b.
Although each of the groups comprises only two optical channels 16a and 16b and 16c and 16d, respectively, one or both of the groups may also comprise a different, higher number of optical channels, such as 3, 4, 5 or more. Also, the groups may have different numbers of optical channels, which is in accordance with the multi-aperture imaging devices 10 and 10 ', which describe detection of different total visual fields by a different number of optical channels.
Although only two sets of optical channels are described, according to embodiments, a different, higher number of optical channel groups may be arranged to detect a higher number of total face speakers, such as 3, 4, 5, or more.
Thus, according to the embodiment of the multi-aperture imaging apparatus 10 ", the image sensor 12 and the array 14 may be arranged. Each optical channel 16a-d may comprise an optic 64a-d for imaging a partial field of view 72a-d of a total field of view 70a or 70b on an image sensor area 24a-d of the image sensor array 24a-d Each optical channel of the array 14 may be configured to image the sub-field of view onto an image sensor area 24a-d of the image sensor associated with the optical channel 16a-d, the ultra-aperture imaging device 10 "may be formed such that at least one image sensor area, the associated with an optical channel 16c or 16d of the second group of optical channels, with an image sensor area 24a or 24b associated with an optical channel 16a or 16b of the first group of optical channels,overlaps, as described in connection with FIG. 1 c.
The beam deflector 18 may be arranged to deflect a beam path 26a-d of the optical channels 16a-d. The first group of optical channels with at least two optical channels 16a and 16b of the array 14 is designed to respectively image a partial field of view 72a and 72b of the total field of view 70a. The second group of optical channels with at least two optical channels 16c and 16d of the array 14 is designed to image a respective partial field of view 72c and 72d of the total field of view 70b.
Other details of the multiaperture imaging devices 10 and 10 'are applicable without restrictions to the multiaperture imaging device 10 ", particularly the configuration of the beam director 18 or portions thereof which will be described later Alternatively or additionally, an optical and / or electronic image stabilizer described herein may also be arranged ,
Alternatively, further optics for imaging further total fields of view may be arranged on dedicated image sensor areas or on the image sensor area 24. At least one total field of view 70a, 70b or a further total field of view can each be partially detected by a plurality of optical channels, as described in connection with FIG. 1ae. The multi-aperture imaging device 10 "may comprise an optical image stabilizer as described above and / or optionally the electronic image stabilizer 41.
Fig. 1g shows a schematic view of the total field of view 70a and 70b detectable by the multi-aperture imaging device 10 ". The total field of view 70a may also be captured by subdivision into partial field of view to obtain confi guration according to the multi-aperture imaging device 10. ***" the total field of view 70b may also be detected by means of a subdivision into partial face panels.
FIG. 2 a shows a schematic view of a multi-aperture imaging device 20 according to an exemplary embodiment. The multi-aperture imaging apparatus 20 includes the image sensor 12, the array 14 of optical channels 16a-h, the beam redirector 18, and an optical image stabilizer 22, such as may be used in the multi-aperture imager 10, 10 ', 10 "and / or 10"' is. Each optical channel 16a-h comprises optics 64a-h for imaging a partial field of view of a total field of view on an image sensor area 24a-h of the image sensor 12. Compared to the multi-aperture imaging device 10, more than four optical channels may be useful to provide a total field of view with multiple partial fields of view to capture, such as the optical channels 16a-e, 16g and 16h or any other, while the optical channel 16f is formed, for example, to detect the total field of view 70b. Alternatively, at least one of the optical channels 16a-e, 16g or 16h may also be designed to detect a further, ie, third or higher overall visual field.
The image sensor areas 24a-h may be formed, for example, each from a chip comprising a corresponding pixel array, wherein the image sensor areas may be mounted on a common substrate or a common circuit carrier such as a common board or a common flexboard. Alternatively, it would of course also be possible for the image sensor regions 24a-h to each be formed from a part of a common pixel array which extends continuously over the image sensor regions 24a-h, the common pixel array being formed, for example, on a single chip. For example, only the pixel values of the common pixel array in the image sensor areas 24a-h are then read out. Different mixtures of these alternatives are of course also possible, such as the presence of a chip for two or more channels and another chip for other channels or the like. In the case of a plurality of chips of the image sensor 12, for example, they may be mounted on one or more boards or circuit boards, such as all together or in groups or the like. Furthermore, a solution is possible in which a single chip is used which has many individual pixel fields. Alternative embodiments have multiple chips, which in turn have individual pixel fields. all together or in groups or the like. Furthermore, a solution is possible in which a single chip is used which has many individual pixel fields. Alternative embodiments have multiple chips, which in turn have individual pixel fields. all together or in groups or the like. Furthermore, a solution is possible in which a single chip is used which has many individual pixel fields. Alternative embodiments have multiple chips, which in turn have individual pixel fields.
The beam deflection device 18 is designed to deflect a beam path 26 of the optical channels 16a-h. The optical image stabilizer 22 is designed to enable optical image stabilization along a first image axis 28 and along a second image axis 32 based on a relative movement between the image sensor 12, the array 14 and the surrounding device 18. The first image axis 28 and the second image axis 32 may be influenced by an arrangement or orientation of the image sensor regions 24a-h or of the image sensor 12. According to one embodiment, the image axes 28 and 32 are arranged perpendicular to one another and / or coincide with directions of extension of pixels of the image sensor regions 24a-d. The image axes 28 and 32 may alternatively or additionally indicate an orientation, along which a partial field of view or the total field of view is scanned or detected. In simplified terms, the image axes 28 and 32 may be first and second directions in an image captured by the multi-aperture imaging device 20, respectively. The image axes 28 and 32 have, for example. An angle of Φ 0 ° to each other, for example, be arranged perpendicular to each other in space.
Optical image stabilization may be advantageous if, during a capture operation during which partial field of view or the total field of view is detected, the multi-aperture imaging device 20 is moved relative to the object region whose field of view is detected. The optical image stabilizer 22 may be configured to counteract this movement, at least in part, to reduce or prevent blurring of the image. For optical image stabilization along the image axis 28, the optical image stabilizer 22 may be configured to generate a first relative motion 34 between the image sensor 12, the array 14, and the beam deflector 18. For the optical image stabilization along the image axis 32, the optical image stabilizer 22 is formed, to generate a second relative movement between the image sensor 12, the array 14 and the beam deflector 18. For the first relative movement 34, the optical image stabilizer 22 may comprise an actuator 36 and / or an actuator 37 for generating the relative movement 34 by displacing the array 14 or the image sensor 12 along the image axis 28. In other words, although the actuator 36 is illustrated as translating or moving the array 14, in other embodiments, the actuator 36 may alternatively or additionally be coupled to the image sensor 12 and configured to position the image sensor 12 relative to the array 14 to move. Alternatively or additionally, the optical image stabilizer may comprise an actuator 42, which is formed in order to generate a translational movement 39a of the beam deflection device 18 along the image axis 28. The optical image stabilizer 22 is configured so that it performs the movements of the actuators 36, 37 and / or 42, that between the image sensor 12, the array 14 and the beam deflection 18, the relative movement 34 is formed. That is, although the relative movement 34 is shown on the array 14 in FIG. 2a, alternatively or additionally, other components may also be moved. The relative movement 34 can be executed parallel to a line extension direction 35 and perpendicular to the beam paths 26. However, it may be advantageous to translate the array 14 in translation relative to the image sensor 12,
To generate the second relative movement, the optical image stabilizer 22 can be designed to generate or enable a rotational movement 38 of the beam deflection device 18 and / or a relative translational motion between the image sensor 12 and the array 14 along the image axis 32 and / or a relative translatory movement between the array 14 and the beam deflector 18.
provide, for which purpose the actuators 36, 37 and / or 42 may be arranged. For the generation of the rotational movement 38, the optical image stabilizer 22 may comprise, for example, the actuator 42, which is designed to generate the rotational movement 38. Alternatively, the optical image stabilizer 22 may be configured to generate a translational motion 39b along the image axis 32 using the actuator 42. Based on the first relative movement 34 and / or 39a, optical image stabilization along an image direction parallel thereto, for example along or opposite to the image axis 28, can be obtained. Based on the second relative movement 38 and / or 39b, optical image stabilization along an image direction can be obtained. which is arranged perpendicular to a rotation axis 44 of the rotation movement 38 in a main side plane of the image sensor 12, approximately along the image axis 32. A main page may be understood as having a large or largest dimension compared with other sides. Alternatively or additionally, a focusing device, as described, for example, in connection with FIG. 4, may be arranged, which is designed to change a focus of the multi-aperture imaging device. Although one embodiment of the optical image stabilizer 22 is such that it controls the first and the second relative movement as relative translational movements for obtaining the optical image stabilization, an embodiment of the second linear movement as rotational movement 38 may be advantageous. since in this case a translational movement of components along the second image axis 32 can be avoided. This direction may be parallel to a thickness direction of the multi-aperture imaging device 20 which, according to some embodiments, should be minimized. By the rotational movement, such a goal can be achieved.
In simple terms, instead of a translational movement perpendicular to the relative movement 34, the rotational movement 38 can be used to obtain the optical image stabilization along the second image axis 32. This makes it possible that a space requirement for enabling the translational relative movement perpendicular to the relative movement 34 can be saved. For example, the translational relative movement can be arranged perpendicular to a thickness direction of the device, so that the device can be made with a small thickness, ie thin. This offers advantages, in particular in the field of mobile devices, since they can be carried out with a flat housing.
The multi-aperture imaging apparatus 20 includes the electronic image stabilizer 41, which is configured to electronically stabilize the subpictures imaged on the image sensor areas 24a-h, that is, by manipulating the image data. For this purpose, different methods can be used individually or in combination, such as electronic vibration reduction (e-VR), Coo! Pix S4, anti-shaking DSP (Anti-Shake DSP) and / or Advanced Shake Reduction (Advanced Shake Reduction - ASR). The electronic image stabilizer 41 is designed to stabilize a first partial image of the image sensor regions 24a-h of a first optical channel 16a-h of the array 14 to a first extent. Furthermore, the electronic image stabilizer 41 may be formed, to additionally stabilize a second partial image of the image sensor regions 24a-h of another optical channel 16a-h of the array 14 in a second circumference different from the first circumference, ie, channel-individually. The other optical channel can be an optical channel with the same or comparable optical properties but also an optical channel with a different optical properties, in particular the focal length. The scope refers to an image correction carried out along the first and second image axes 28 and 32, which also includes rotations about image axes and the like. stabilize channel-individually. The other optical channel can be an optical channel with the same or comparable optical properties but also an optical channel with a different optical properties, in particular the focal length. The scope refers to an image correction carried out along the first and second image axes 28 and 32, which also includes rotations about image axes and the like. stabilize channel-individually. The other optical channel can be an optical channel with the same or comparable optical properties but also an optical channel with a different optical properties, in particular the focal length. The scope refers to an image correction carried out along the first and second image axes 28 and 32, which also includes rotations about image axes and the like.
In embodiments, the electronic image stabilizer 41 is configured to perform the electronic image stabilization channel-by-channel for each optical channel, ie, each of the sub-images of the image sensor regions 24a-h. Thus, different aberrations or even channel-specific aberrations can be corrected for the first and second optical channels 16a-h.
The optics 64a-h of the optical channels may have different optical properties from each other. A different optical property is obtained, for example, by manufacturing tolerances such that the optics 64a-h differ from each other in a tolerance range of at most ± 10%, at most ± 5% or at most ± 3% with respect to one or more optical characteristics, such as a focal length , a visual field angle, an optical diameter, or the like.
It has been recognized that in the context of production-related different optical properties of the optics 64a-h, an optical image stabilization by a relative movement between the image sensor 12, the optics 64a-h of the respective optical channel and the beam deflector 18 causes the Illustrations in the
Change image sensor areas 24a-d differently. This is at least partly due to the fact that the mechanical movement performed equally for all optical channels, ie channel-global, to achieve optical image stabilization leads to a different change in the beam path through the optics 64a-h. The mutually different optical properties now have different or even channel-specific effects in the images of the image sensor regions 24a-h. In other words, channel displacements result, in particular, from the different focal lengths of the channels, with different relative movements acting between the beam deflecting unit and / or array and / or image sensor for all channels. By combined with the optical image stabilization electronic image stabilization this can be reduced, ie, at least partially compensated or compensated. This should be clarified by the optical property focal length. With two differing values of the optical focal length in the case of optics which are directed at the same total field of view, the relative movement in the context of the optical image stabilization leads to the visual axis and / or direction of the optical channels being changed equally. Due to the different focal lengths in the optics 64a-h but the Teiibilder move in the image sensor areas 24a-h different, which can lead to high computational effort or even image errors when joining the fields, the stitching. at least partially offset or compensated. This should be clarified by the optical property focal length. With two differing values of the optical focal length in the case of optics which are directed at the same total field of view, the relative movement in the context of the optical image stabilization leads to the visual axis and / or direction of the optical channels being changed equally. Due to the different focal lengths in the optics 64a-h but the Teiibilder move in the image sensor areas 24a-h different, which can lead to high computational effort or even image errors when joining the fields, the stitching. at least partially offset or compensated. This should be clarified by the optical property focal length. With two differing values of the optical focal length in the case of optics which are directed at the same total field of view, the relative movement in the context of the optical image stabilization leads to the visual axis and / or direction of the optical channels being changed equally. Due to the different focal lengths in the optics 64a-h but the Teiibilder move in the image sensor areas 24a-h different, which can lead to high computational effort or even image errors when joining the fields, the stitching. With two differing values of the optical focal length in the case of optics which are directed at the same total field of view, the relative movement in the context of the optical image stabilization leads to the visual axis and / or direction of the optical channels being changed equally. Due to the different focal lengths in the optics 64a-h but the Teiibilder move in the image sensor areas 24a-h different, which can lead to high computational effort or even image errors when joining the fields, the stitching. With two differing values of the optical focal length in the case of optics which are directed at the same total field of view, the relative movement in the context of the optical image stabilization leads to the visual axis and / or direction of the optical channels being changed equally. Due to the different focal lengths in the optics 64a-h but the Teiibilder move in the image sensor areas 24a-h different, which can lead to high computational effort or even image errors when joining the fields, the stitching.
For example, the array 14 may include a carrier 47 through which the optical channels 16a-h pass. For this purpose, the carrier 47 may be formed, for example, opaque and have transparent regions for the optical channels 16a-h. Within or adjacent to the transparent areas and / or at end portions thereof, the optics 64a-h of the optical channels 16a-h may be disposed. Alternatively or additionally, the carrier 47 may be formed transparently and comprise, for example, a polymer material and / or a glass material. The optics (lenses) 64a-h, which influence the imaging of the respective partial field of view of the total field of view onto the respective image sensor region 24a-h of the image sensor, can be arranged on a surface of the carrier 47.
The actuators 36 and / or 42, for example, as a pneumatic actuator, as a hydraulic actuator, as a piezoelectric actuator, as a DC motor, as a stepping motor (stepper motor), as a thermally actuated actuator, as an electrostatic actuator, as an electrostrictive Ak-gate, as a magnetostrictive actuator or be formed as a dive coil drive.
The beam deflecting device 18 may be formed reflecting in regions. By way of example, the beam deflection device 18 can comprise regions or beam deflection elements 46a-d which are designed to deflect the beam paths 26 in such a way that the deflected beam paths have a different angle from one another and capture a different field of view of a total field of view. The different angles can be generated by the beam deflector 18 and / or the optics 64a-h of the optical channels 16a-h. For example, the regions 46a-d may be formed as facets of a facet mirror. The facets may have a different inclination with respect to the array 14. This can be a distraction, influence, Control and / or scattering of the beam paths 26 to enable each other differently arranged partial fields of view. Alternatively, the beam deflecting device 18 may be formed as a surface formed on one side or on both sides reflecting, for example as a mirror. The surface may be continuously or partially continuously curved or flat and / or partially discontinuously curved or just formed in sections. A deflection of the beam paths 26 can alternatively or additionally be obtained by means of the optics 64a-h of the optical channels 16a-h. The surface may be continuously or partially continuously curved or flat and / or partially discontinuously curved or just formed in sections. A deflection of the beam paths 26 can alternatively or additionally be obtained by means of the optics 64a-h of the optical channels 16a-h. The surface may be continuously or partially continuously curved or flat and / or partially discontinuously curved or just formed in sections. A deflection of the beam paths 26 can alternatively or additionally be obtained by means of the optics 64a-h of the optical channels 16a-h.
In other words, a relative movement for optical image stabilization causes the same mechanical deflection in all channels of the multi-aperture camera. The achieved image shift, which is the actual mechanism of action of the optical image stabilization, however, additionally depends on the focal length of the imaging optics of each channel. One finding is therefore that in addition to the optical image stabilization, which is performed the same for all channels globally, a channel-specific electronic image stabilization is additionally introduced. The beam deflection device can be used both for deflecting the viewing direction and for optical image stabilization.
The beam deflection device can be flat over the region of all channels, have a continuous or discontinuous profile and / or piecewise flat, ie be faceted, wherein the transitions between individual continuous or discontinuous profiles can additionally have local maskings for reducing the reflectivity or mechanical structures, to reduce aberrations or to allow a stiffening of the structure, so that motion-induced or thermally induced aberrations may be low.
Switching between the first position and the second position of the beam deflecting device can take place rotationally about the axis of rotation and / or translationally along the axis of rotation 44. A translational movement along the axis of rotation 44 can be continuous or discontinuous, for example bistable or multiply stable. This can be understood, for example, as position-discrete positions, between which the beam deflection device 18 is moved. Simply stable, bistable or multi-stable positions can be obtained, for example, by the actuator 42 or another actuator is designed as a stepper motor. For example, if the beam deflector 18 is configured to reciprocate between two positions, For example, one of the positions may be, or based on, a rest position of the actuator. The actuator may for example be designed to perform the translational movement with respect to a spring force, which exerts a counterforce when reaching the respective other position, which moves the beam deflecting back to its starting position at a removal of the force of the actuator. This means that a stable position can also be obtained in areas of a force diagram that have no local minimum force. For example, it can be a maximum force. Alternatively or additionally, a stable position may be obtained based on magnetic or mechanical forces between the beam deflector 18 and an adjacent housing or substrate. That means, the actuator 42 or the other actuator for translational movement of the beam deflecting device can be configured to move the beam deflecting device in a bistable or multi-stable position. Alternatively, simple mechanical stops can be provided for bistable arrangements of the positions, which define two end positions, between which a position circuit takes place in the defined end positions.
The electronic image stabilizer 41 may be employed in the multi-aperture imaging apparatus 10, such as in combination with the optical image stabilizer 22, but also independently thereof. In particular, a combination with the optical bi-stabilizer 22 offers advantages to compensate for differences in optical properties in the optics that are associated with a common field of view and / or that are designed the same, but in fact have slight differences. Alternatively, the electronic image stabilizer 41 in the multi-aperture imaging apparatus 10 may be used without the optical image stabilizer, such as to correct the optical channel 16e with respect to the optical channels 16a-d, or vice versa.
FIG. 2b shows a schematic view of a multi-aperture imaging device 20 'according to an embodiment. The multiaperture imaging device 20 'is modified from the multiaperture imaging device 20 in that the actuator 36 is mechanically coupled to the biosensor 12 and is configured to move the image sensor 12 relative to the array 14. The relative movement 34 can be executed parallel to the line extension direction 35 and perpendicular to the beam paths 26.
3a shows a schematic side sectional view of a multi-aperture imaging device 30 according to an embodiment. The multi-aperture imaging device 30 may, for example, modify the ultrapaper imaging device 20 such that the actuators 36 and / or 42 are arranged to be at least partially disposed between two planes 52a and 52b which are defined by sides 53a and 53b of a cuboid 55. The sides 53a and 53b of the cuboid 55 may be aligned parallel to each other and parallel to the row extension direction of the array and a part of the optical path of the optical channels between the image sensor and the beam deflection device. The volume of the cuboid 55 is minimal and yet comprises the image sensor 12, the array 14 and the Strahiumlenkeinrichtung 18 and their operational movements. Optical channels of the array 14 have optics 64 which may be the same or different for each optical channel.
A volume of the multi-aperture imaging device may have a small or minimal space between the planes 52a and 52b. Along the lateral sides or extension directions of the planes 52a and / or 52b, a construction space of the multi-aperture imaging device may be large or arbitrarily large. The volume of the virtual cuboid is, for example, influenced by an arrangement of the image sensor 12, the single-line array 14 and the beam deflecting device, wherein the arrangement of these components according to the exemplary embodiments described herein can be such that the installation space of these components along the direction perpendicular to the planes and hence the distance of the planes 52a and 52b from each other becomes small or minimal. A thinnest possible design of the ulti-aperture imaging device is particularly in the field of mobile applications, as desired for mobile phones or tablets. Compared to other arrangements of the components, the volume and / or the distance between other sides of the virtual cuboid can be increased.
Dotted lines show the virtual cuboid 55. The planes 52a and 52b may comprise or be spanned by two sides of the virtual cuboid 55. A thickness direction 57 of the multi-aperture imaging device 30 may be normal to the planes 52a and / or 52b and / or parallel to the y-direction.
The image sensor 12, the array 14 and the beam deflector 18 may be arranged so that a vertical distance between the planes 52a and 52b along the thickness direction 57, which may be referred to simplifying but without limiting effect as the height of the cuboid, is minimal a minimization of the volume, which means the other dimensions of the cuboid can be dispensed with. An extension of the cuboid 55 along the direction 57 may be minimal and essentially predetermined by the extent of the optical components of the imaging channels, ie the array s 14, the image sensor 12 and the beam deflector 18 along the direction 57.
A volume of the multi-aperture imaging device may have a small or minimal space between the planes 52a and 52b. Along the lateral sides or extension directions of the planes 52a and / or 52b, a construction space of the multi-aperture imaging device may be large or arbitrarily large. The volume of the virtual cuboid is, for example, influenced by an arrangement of the image sensor 12, the single-line array 14 and the beam deflection device, wherein the arrangement of these components according to the exemplary embodiments described herein can be such that the installation space of these components along the direction perpendicular to the planes and hence the distance of the planes 52a and 52b from each other becomes small or minimal.
The actuators, such as the actuator 36 and / or 42 of the multi-aperture imaging device, may have a dimension or extent parallel to the direction 57. An amount of at most 50%, at most 30%, or at most 10% of the dimension of the actuator or actuators may protrude beyond the plane 52a and / or 52b from an area between the planes 52a and 52b or may protrude from the area. This means that the actuators protrude at most insignificantly beyond the plane 52a and / or 52b. According to embodiments, the actuators do not protrude beyond the planes 52a and 52b. The advantage of this is that an expansion of the multi-aperture imaging device 10 along the thickness direction or direction 57 is not increased by the actuators.
The image stabilizer 22 or the actuators 36 and / or 42 may have a dimension or extent parallel to the thickness direction 57. A proportion of at most 50%, at most 30% or at most 10% of the dimension may protrude beyond the area 52a and / or 52b, or protrude from the area starting from an area between the levels 52a and 52b, as may be the case for the actuator 42 'is shown, which indicates a staggered arrangement of the actuator 42. This means that the actuators 36 and / or 42 protrude at most insignificantly beyond the plane 52a and / or 52b. According to embodiments, the actuators 36 and / or 42 do not protrude beyond the levels 52a and 52b. Advantageously, an expansion of the multi-aperture imaging device 30 along the thickness direction 57 is not increased by the actuators 36 and 42, respectively.
Although terms such as top, bottom, left, right, front or back are used for clarity, they are not intended to be limiting. It is understood that based on a rotation or tilt in space, these terms are mutually interchangeable. For example, the x-direction from the image sensor 12 to the beam deflector 18 may be understood to be forward or forward. For example, a positive y-direction may be understood as above. An area along the positive or negative z-direction apart from the distance of the image sensor 12, the array 14 and / or the beam deflection device 18 can be understood as being adjacent to the respective component. In simple terms, the image stabilizer may comprise at least one actuator 36 or 42.
In other words, the actuators 36 and / or 42 may be arranged in front of, behind or beside the image sensor 12, the array 14 and / or the beam deflection device 18. According to embodiments, the actuators 36 and 42 are arranged with a maximum circumference of 50%, 30% or 10% outside the area between the planes 52a and 52b. This means that the at least one actuator 36 and / or the image stabilizer 22 along the thickness direction 57 perpendicular to the plane 48 by at most 50% of the dimension of the actuator 36 and 42 of the image stabilizer along the thickness direction 57 from the plane or the area between the maximum dimensions 52a-52b.
protrudes. This allows a small dimension of the multi-aperture imaging device 30 along the thickness direction 57.
3 b shows a schematic side sectional view of the ultrapure imaging device 30, wherein the beam paths 26 and 26 'indicate different viewing directions of the multi-aperture imaging device 30. The multi-aperture imaging device 30 can be configured to change a tilt of the beam deflection device by an angle α, so that mutually different main sides of the beam deflection device 18 are arranged facing the array 14. This means that the different viewing directions can be obtained based on a rotational movement of the beam deflecting device 18, as already mentioned above. The ultrapure aberration device 30 may include an actuator configured to tilt the beam deflector 18 about the axis of rotation 44. For example, the actuator can be designed to move the beam deflecting device 18 into a first position, in which the beam deflecting device 18 deflects the beam path 26 of the optical channels of the array 14 in the positive y direction. For this purpose, the beam deflecting device 18 in the first position, for example, an angle α of> 0 ° and <90 °, of at least 10 ° and at most 80 ° or at least 30 ° and at most 50 °, for example 45 °. The actuator may be configured to deflect the beam deflecting device about the axis of rotation 44 in a second position such that the beam deflecting device 18 deflects the optical path of the optical channels of the array 14 toward the negative y direction as viewed through the beam path 26 'and the beam path Dashed representation of the beam deflector 18 is shown. For example, the beam deflecting device 18 may be designed to be reflective on both sides, so that in the first position a first beam path 26 or 26 'is deflected or reflected. According to an advantageous embodiment, the ultrapaper imaging device 30 is configured to perform a switchover between the first position and the second position such that between the two positions a minor side is associated with the array 14, but an orientation according to which one major side faces the array 14 completely , is avoided. This can also be understood2 of at least 10 ° with respect to a direction towards the image sensor and possibly parallel to a surface normal of the image sensor 12 have. This will prevent one of the win-
k γτ and γ 2 0 ° or 180 °, which may mean a high or approximately maximum extension of the beam deflecting device 18 along the thickness direction.
4 shows a schematic plan view of a multi-aperture imaging device 40 according to one exemplary embodiment. The multi-aperture imaging device 40 may be modified from previous multi-aperture imaging devices such that the ultrapaper imaging device 40 includes a focusing device 54 configured to change a focus of the multi-aperture imaging device 40. This may be done based on a variable distance 56 between the image sensor 12 and the array 14, as represented by the distance 56 '.
The focusing device 54 may include an actuator 58 that is configured to deform upon actuation and / or to provide relative movement between the image sensor 12 and the array 14. By way of example, this is illustrated for the multi-aperture imaging device 40 such that the actuator 58 is configured to displace the array 14 along the positive and / or negative x-direction with respect to the image sensor 12. For example, the array 14 may be mounted on one side such that it experiences movement along a positive or negative x-direction based on actuation of the actuator 58 and remains substantially non-moving along a positive and / or negative z-direction. An additional movement along the positive and / or negative z-direction for optical image stabilization can be obtained, for example, based on an actuation of the actuator 36. According to further embodiments, the actuator 58 or the focusing device 54 is designed to obtain the relative movement between the image sensor 12 and the array 14 along the x-axis based on a translational displacement of the image sensor 12 relative to the array 14. According to further embodiments, the image sensor 12 and the array 14 may be moved. According to further embodiments, the focusing device 54 may comprise at least one further actuator. For example, a first actuator and a second actuator may be arranged on two opposite regions of the array 14, so that upon actuation of the actuators, a requirement for storage of the moving array 14 (alternatively or in addition to the image sensor 12) is reduced. In addition, the actuator 58 or another actuator may be configured to keep a distance between the single-row array 14 and the beam deflector 18 substantially constant or even using no additional actuator, ie, to move the beam adjuster 18 to an extent such as The one-line array 14. The focusing device 54 may be configured to enable an autofocus function by a relative translational movement (focusing movement) between the image sensor 12 and the array 14 along a surface normal of the image sensor 12. The beam deflecting device 18 can be moved by appropriate structural design or use of the actuator 42 or another actuator simultaneously to the fo-kussierungsbewegung. This means that a distance between the array 14 and the beam deflection device remains unchanged and / or that the beam deflection device 18 is moved simultaneously or with a time offset to the same or comparable extent as the focusing movement, so that at least at a time of taking the field of view through the multi-aperture imaging device unchanged compared to a distance before a change of focus. This can be done in such a way that the beam deflecting device 18 is moved jointly, ie, simultaneously with the actuator 42, such that a distance between the array 14 and the beam deflector remains constant or is compensated. This means that a distance between the array 14 and the beam deflection device 18 can remain unchanged and / or that the beam deflection device 18 is moved simultaneously or with a time offset to the same or comparable extent as the focusing movement, such that the distance between the array 14 and the beam deflection device 18 at least at a time of taking the field of view through the multi-aperture imaging device unchanged compared to a distance before a change in focus. Alternatively, the beam deflector 18 may be at rest or excluded from the autofocus movement. a distance between the array 14 and the beam deflection device 18 can remain unchanged and / or that the beam deflection device 18 is moved simultaneously or with a time offset to the same or comparable extent as the focusing movement, so that the distance between the array 14 and the beam deflection device 18 is at least one Time of acquisition of the field of view by the multi-aperture imaging device is unchanged compared to a distance before a change in focus. Alternatively, the beam deflector 18 may be at rest or excluded from the autofocus movement. a distance between the array 14 and the beam deflection device 18 can remain unchanged and / or that the beam deflection device 18 is moved simultaneously or with a time offset to the same or comparable extent as the focusing movement, so that the distance between the array 14 and the beam deflection device 18 is at least one Time of acquisition of the field of view by the multi-aperture imaging device is unchanged compared to a distance before a change in focus. Alternatively, the beam deflector 18 may be at rest or excluded from the autofocus movement. such that the distance between the array 14 and the beam deflector 18 is unchanged as compared to a distance before a change in focus at least at a time of taking the field of view through the multi-aperture imaging device. Alternatively, the beam deflector 18 may be at rest or excluded from the autofocus movement. such that the distance between the array 14 and the beam deflector 18 is unchanged as compared to a distance before a change in focus at least at a time of taking the field of view through the multi-aperture imaging device. Alternatively, the beam deflector 18 may be at rest or excluded from the autofocus movement.
The actuator 58 can be embodied, for example, as a piezoelectric actuator, for example as bending bakes (for example a bimorph, trimorph or the like). Alternatively or additionally, the focusing device 54 may include a plunger coil drive, a pneumatic actuator, a hydraulic actuator, a DC motor, a stepping motor, a thermally actuatable actuator or bending beam, an electrostatic actuator, an actuator with shape memory alloys, an electrostrictive and / or a magnetostrictive drive include.
As described in connection with the image stabilizer and an arrangement thereof in the plane 48 or in an area between the planes 52a and 52b, the at least one actuator 58 of the focusing device 54 can be arranged at least partially between the planes 52a and 52b. Alternatively or additionally, the at least one actuator 58 may be arranged in a plane in which the image sensor 12, the array 14 and the beam deflection device 18 are arranged. For example, the actuator 58 of the focusing device 54 along the thickness direction 57 perpendicular to the plane 48, in which the image sensor 12, the array 14 and the beam deflecting device 18 are arranged, by at most 50% of the dimension of the actuator 58 of the focusing device 54 along the thickness direction 57 from the area between the planes 52a and 52b protrude. According to embodiments, the actuator protrudes by at most 30% out of the area between the planes 52a and 52b. According to another embodiment, the actuator 54 projects out of the range by at most 10% or is completely within the range. This means that along the thickness direction 57 no additional space requirement for the focusing device 54 is required, which is advantageous. For example, if the array 14 has a transparent substrate (carrier) 62 with lenses 64a-d disposed thereon, a dimension of the array 14 and possibly the multi-aperture imaging device 40 along the thickness direction 57 may be small or minimal. With reference to FIG. 3a, this may mean that the cuboid 55 has a small thickness along the direction 57 or that the thickness of the substrate 62 is unaffected. The substrate 62 may be passed by the optical paths used for imaging in the individual optical channels. The optical channels of the multi-aperture imaging device may traverse the substrate 62 between the beam deflector 18 and an image sensor 12.
The lenses 64a-d may, for example, be liquid lenses, ie an actuator may be configured to drive the lenses 64a-d. Liquid lenses can be designed to adapt and vary the refractive power and hence the focal length and image position channel by channel individually.
FIG. 5a shows a schematic perspective view of a multi-aperture imaging apparatus 50 according to one embodiment. Compared with the multi-aperture imager 20, the array 14 is formed into a single line, as in the multi-aperture imaging device 10, that is, all of the optical channels 16a-d may be arranged along a row extension direction of the array 14 in a single row. The term single-line may mean an absence of further lines. A single-row design of the array 14 allows a small dimension of the array and possibly the multi-aperture imaging device 50 along the thickness direction 57. The optical image stabilizer includes actuators 36a and 36b which together form the actuator 36, which means
The multi-aperture imaging device 50 may be configured to detect fields of view in directions different from each other based on the beam deflection device 18. For example, the beam deflecting device may have a first position or position Pos1 and a second position or position Pos2. The beam deflection device can be switchable between the first position Pos1 and the second position Pos2 based on a translatory or rotational movement. For example. For example, the beam deflection device 18 can be translationally movable along the line extension direction z of the single-line array 14, as indicated by a translatory movement 66. The translational movement 66 may, for example, be arranged substantially parallel to a line extension direction 65, along which the at least one row of the array 14 is arranged. For example, the translational motion may be usable to place different facets in front of the optics of the optical channels 16a-d to obtain different viewing directions of the multi-aperture imaging device 50. The beam deflecting device 18 can be designed to deflect the beam paths 26a-d in a first direction in the first position Pos1, for example at least partially in a positive y direction. The beam deflecting device 18 can be designed to direct the beam paths 26a-d, ie each optical channel 16a-d, in a different direction, for example at least partially along the negative y direction, in the second position Pos2. For example, the actuator 42 may be formed to move the beam deflector 18 from the first position Pos1 to the second position Pos2 based on a movement of the beam deflecting device 18 along the direction of movement 66. The actuator 42 may be configured to superimpose the translational movement along the direction of movement 66 with the rotational movement 38. Alternatively, the multiaperture imaging device 50 may also include another actuator configured to move the beam umbo along the direction of travel 66 or opposite thereto. to superimpose the translational movement along the direction of movement 66 with the rotational movement 38. Alternatively, the multiaperture imaging device 50 may also include another actuator configured to move the beam umbo along the direction of travel 66 or opposite thereto. to superimpose the translational movement along the direction of movement 66 with the rotational movement 38. Alternatively, the multiaperture imaging device 50 may also include another actuator configured to move the beam umbo along the direction of travel 66 or opposite thereto.
As described in connection with FIG. 3b, the actuator 42 may be configured to obtain the first and second positions of the beam deflection device 18 based on a rotation thereof. The movement between the first position Pos1 and the second position Pos2 can be overlaid with the rotational movement 38 both for a rotational movement for switching between the positions and for the translatory movement along the direction 66.
With reference to FIG. 1b, which shows a schematic illustration of two total fields of view 70a and 70b, as can be detected, for example, with a multi-aperture imaging device described above, such as the multi-aperture imaging device 10 ', 10 ", 10'", 20, 20 ', 30, 40 and / or 50, wherein about the multi-aperture imaging device 20 may also divide the total field of view 70a into a higher or lower number of sub-field fields 72a-d. The beam paths of the optical channels of the ulti-aperture imaging devices may be steerable on mutually different partial fields of view 72a-d, wherein a partial field of view 72a-d may be assigned to each optical channel. For example, the partial fields 72a-d overlap with each other, to allow a joining of individual partial images to a total image. If the multi-aperture imaging device has one of four different numbers of optical channels, the total field of view 70 may have one of four different numbers of partial-field views. Alternatively, or in addition, at least a partial field of view 72a-d from a second or a higher number of optical channels of a higher number of modules (multi-aperture imaging devices) may be acquired to construct stereo, trio, quattro cameras to record three-dimensional object data can. The modules may be designed individually or as a coherent system and may be located anywhere in a housing of the multi-aperture imaging device. The images of the different modules, which together form the stereo, Form trio or quattro cameras, may be shifted by fractions of a pixel, and be designed to implement methods of superresolution. For example, a number of optical channels and / or a number of multi-aperture imaging devices and / or a number of sub-field fields may be any number and may have a number of at least two, at least three, at least four, at least ten, at least 20, or even higher. The optical channels of the further line can likewise each receive overlapping partial areas and together cover the total field of view. This allows one to obtain a stereo, trio, quattro, etc. structure of array cameras consisting of channels that partially overlap and cover the overall field of view within their subgroup.
Fig. 5b is a schematic perspective view of the multi-aperture imaging device 50, with reference to which an advantageous embodiment of a combination of the optical image stabilization and the electronic image stabilization will be explained. The optical image stabilizer 22 comprises actuators 36a, 36b and 42, wherein the actuators 36a and 36b are designed to achieve the optical image stabilization of the images of the partial fields in the image sensor areas 24a to 24d by a displacement of the array 14 along the line extension direction 65. Further, the optical image stabilizer is formed, for example, to obtain optical image stabilization along the image axis 32 by the rotational movement 38. For example. have the optics 64a-d of the array 14 within a tolerance of at most 10%,5 , which is at least 10% different therefrom, as described for the optic 64e of the multi-aperture imaging device 10. The channel-global rotational movement 38, in conjunction with the between the focal lengths f 5 and f, to f 4 and possibly in conjunction with different focal lengths fi to f leads to a different shift 69, to 69 fifththe images in the image sensor areas 24a-e. This means that the optical image stabilizer 22 achieves different effects in the images due to the channel-global rotational movement 38, so that at least one, several or all images deviate from a theoretical error-free state. The optical image stabilizer 22 may be configured to globally minimize the aberrations of all images, which, however, may result in errors in each of the images. Alternatively, the optical image stabilizer 22 may be configured to select a reference image in one of the image sensor areas 22 and to perform the control of the actuator 42 so that the image in the reference image or reference channel is as accurate as possible, which may also be termed error free. That means,5 deviate from this reference image. The other channels can be at least one optical channel with the same or comparable optical property and / or at least one optical channel with a different optical property, wherein the optical property can be, in particular, the focal length. In other words, a channel is corrected with the mechanical realized optical image stabilizer which works for all channels but does not keep all channels stable. These other channels are additionally corrected with the electronic image stabilizer.
The electronic image stabilizer 41 may be configured to perform channel-specific electronic image stabilization in each channel according to a predetermined functional relationship that depends on the relative movements between the image sensor 12, the array 14, and the beam deflector 18. The electronic image stabilizer 41 may be configured to stabilize each image individually and individually. The electronic image stabilizer 41 can use global values for this, such as the camera movement or the like, in order to increase the optical quality of the images. It is particularly advantageous if the electronic image stabilizer 41 is designed to carry out an electronic image correction on the basis of a reference image of the optical image stabilizer 22.
A multiaperture abatement device (10; 10 '; 10 "; 10'"; 20; 30; 40) comprising:
an image sensor (12);
an array (14) of optical channels (16a-h), each optical channel (16a-h) comprising optics (64a-h) for imaging at least a partial field of view (72a-d) of a total field of view (70) on an image sensor area (24a -h) of the image sensor (12); and
a beam deflecting device (18) for deflecting a beam path (26a-h) of the optical channels (16a-h);
wherein a first optical channel (16d) of the array (14) is adapted to image a first partial field of view (72d) of a first total field of view (70a), wherein a second optical channel (16c) of the array (14) is formed to form a second Imaging a partial field of view (72c) of the first total field of view (70a), and wherein a third optical channel (16e) is configured to fully image a second total field of view (70b); and
wherein the second total field of view (70b) is an incomplete section of the first total field of view (70a);
wherein the multi-aperture imaging device further comprises:
an image evaluator reading the image sensor areas configured to combine and provide an image of the first partial field of view (72d) and an image of the second partial field of view (72c) into a first overall image of the first total visual field (70a) and a second overall image of the second total visual field (70b).
2. A multi-aperture imaging device according to claim 1, wherein a first value of an optical property of the optics of the first optical channel and the optics of the second optical channel are within a tolerance of at most 10%.
is equal, and wherein a second value of the optical property of the optics of the third optical channel deviates by at least 10% from the first value.
A multi-aperture imaging apparatus according to claim 2, wherein the optical characteristic is a focal length.
A multi-aperture imaging apparatus according to any one of the preceding claims, wherein the beam redirecting means (18) comprises a plurality of facets (46a-d), the first optical channel (16d) being associated with a first facet (46d), the second optical channel (16c) being one associated with the second facet (46c) and the third optical channel (16e) is associated with the first (46d) or a third facet (46e).
5. multi-aperture imaging device according to claim 4,
wherein the third optical channel (16e) is associated with the third facet (46d);
wherein the first, second and third facets (46a, 46b, 46e) each have a first and a second main reflective side, the beam diverter (18) being adapted to rotate the optical channels (16a, 16a) in a first rotational position of the beam deflector (18) 16b, 16e) with the first main sides deflecting in a first direction and in a second rotational position of the beam deflecting device (18) deflecting the optical channels (16a, 16b, 16e) with the second main sides in a second direction; and
wherein the major sides of the first and second facets (16a, 16b) are inclined to each other at a first angle (δι), and wherein the major sides of the third facet (46e ) are inclined to each other at a second angle (δ 2 ).
Multiaperture imaging device according to claim 5, wherein the first angle (δι) is smaller than the second angle (δ 2 ) or wherein the second angle (δ 2 ) is smaller than the first angle (δι).
A multi-aperture imaging apparatus according to any one of the preceding claims, wherein the first optical channel (16d) is adapted to image the first partial field of view (72d) on a first image sensor area (24d) of the image sensor (12) in which the second optical channel (16c) is formed to image the second partial field of view (72c) onto a second image sensor area (24c) of the image sensor (12), and wherein the third optical channel (16e) is arranged to project the second total field of view (70b) onto a third image sensor area (24e). map.
The multi-aperture image forming apparatus according to claim 7, wherein said third image sensor area (24e) at least partially overlaps with said first image sensor area (24d).
9. A multi-aperture imaging device according to any one of the preceding claims, further comprising:
an optical image stabilizer (22) for image stabilization along a first image axis (28) by generating a first relative motion (34; 39a) between the image sensor (12), the array (14) and the beam redirector (18) and image stabilization along a second image axis (32) by generating a second relative movement (38; 39b) between the image sensor (12), the array (14) and the beam deflector (18); and
an electronic image stabilizer (41) for image stabilizing the first optical channel (16a) of the array (14) along the first and second image axes (28, 32).
10. The multi-aperture imaging device according to claim 9, wherein the first relative movement (34; 39a) of at least one of a translational relative movement (34) between the image sensor (12) and the array (14), a translational relative movement (39a) between the image sensor (12 ) and the beam deflection device (18) and a translatory relative movement (39a) between the array (14) and the beam deflection device (18), and wherein the second relative movement (38; 39b) at least one of a rotational movement (38) of the beam deflection device (38). 18), a translatory relative movement between the image sensor (12) and the array (14) and a translational relative movement (39b) between the array (14) and the beam deflecting device (18).
The multi-aperture imaging apparatus of claim 9 or 0, wherein the electronic image stabilizer (41) is configured to stabilize the first optical channel (16a-h) along the first and second image axes (28, 32) in a first circumference further for image stabilizing another optical channel (16a-h) of the array (14) in a second circumference along the first and second image axes (28, 32).
12. The multi-aperture image forming apparatus according to claim 9, wherein the optical image stabilizer is configured to perform the optical image stabilization such that the optical image stabilization is related to an image of a first of the sub-field fields the electronic image stabilizer (41) is adapted to stabilize an image of a second partial field of view (72a-d) relative to the image of the first partial field of view (72a-d).
A multi-aperture imaging apparatus according to any one of claims 9 to 12, wherein the optical image stabilizer (22) is adapted to form an image of the imaged partial field of view (72a-d) of a reference channel from a group comprising the first optical channel (16a-h) and the second optical channel Channel (16a-h) and in which the electronic image stabilizer (41) is adapted to perform image stabilization channel-by-channel for optical channels (16a-h) other than the reference channel, the multi-aperture imaging device being arranged to optically source the reference channel only to stabilize.
A multi-aperture image forming apparatus according to any of claims 9 to 13, wherein said electronic image stabilizer (41) is adapted to perform image stabilization channel-by-channel for each optical channel (16a-h).
A multi-aperture imaging apparatus according to claim 14, wherein the electronic image stabilizer (41) is adapted to perform the channel-specific electronic image stabilization in each channel according to a predetermined functional relationship, that of the relative movements between the image sensor (12), the array (14) and the beam deflector (18) depends.
A multi-aperture imaging device according to claim 15, wherein the functional relationship is a linear function.
The multi-aperture imaging apparatus of any one of claims 14 to 16, wherein the optical image stabilizer (22) is configured to provide optical image stabilization along one of the image directions based on rotational motion of the beam redirecting device, the functional relationship being one
Angular function, which images a rotation angle of the beam deflecting device (18) to a level of electronic image stabilization along the image direction.
The multi-aperture imaging apparatus of any of claims 14 to 17, wherein the electronic image stabilizer (41) is formed in a first field of a first field of view (72a-d) and in a second image of a second field of view (72a-d) a matching feature and to provide electronic image calibration based on a comparison of motions of the feature in the first and second images.
The multi-aperture image forming apparatus according to any one of claims 14 to 18, wherein said electronic image stabilizer (41) is adapted to identify a coincident feature in a first partial image of a first partial visual field (72a-d) at a first time and at a second time to provide the electronic image stabilization based on a comparison of motions of the feature in the first image.
The multi-aperture imaging apparatus of any one of claims 9 to 19, wherein focal lengths of optics (64a-d) of the first and second optical channels (16a-h) differ, and movement of the beam deflector (18) results in a mutually different change in the images to the image sensor areas (24a-h), the electronic image stabilizer (41) being designed to compensate for differences between the different changes in the images.
21. A multi-aperture imaging apparatus according to any one of claims 9 to 20, wherein a first optic (64a) associated with the first optical channel (16a) and a second optic (64b) associated with the second optical channel (16b) are equal within a tolerance of at most 10% As a result of deviations within the tolerance range, image stabilization of the optical image stabilizer (22) leads to a mutually different change in the images caused by the first optical system (64a) and the second optical system (64b) to the image sensor regions (24a, 24b) ,
22. The multi-aperture image forming apparatus according to claim 9, wherein the optical image stabilizer comprises at least one actuator and is disposed at least partially disposed between two planes is, which are spanned by sides of a cuboid (55), wherein the sides of the cuboid to each other and to a line extension direction (35, 65, z) of the array (14) and a part of the beam path of the optical channels (16a-h) between the Image sensor (12) and the optics (64a-h) are aligned parallel and whose volume is minimal and yet the image sensor (12) and the array (14).
23. A multi-aperture imaging device according to claim 22, wherein the optical image stabilizer (22) comprises at most 50% of a region between the planes (52a,
52b) protrudes.
24. The multi-aperture imaging apparatus according to claim 9, further configured to receive a sensor signal from a sensor and to evaluate the sensor signal for information correlated with a relative movement between the multi-aperture imaging apparatus and the object, and an image sensor To drive the optical or electronic image stabilizer (22, 41) using the information.
25. An ultrapaper imaging device (10; 10 '; 10 "; 10' '; 20; 30; 40) comprising:
an image sensor (12);
an array (14) of optical channels (16a-h), each optical channel (16a-h) comprising optics (64a-h) for imaging at least a partial field of view (72a-d) of a
Total field of view (70) on an image sensor area (24a-h) of the image sensor (12) comprises; and
a beam deflecting device (18) for deflecting a beam path (26a-h) of the optical channels (16a-h);
wherein a first optical channel (16d) of the array (14) is adapted to image a first partial field of view (72d) of a first total field of view (70a), wherein a second optical channel (16c) of the array (14) is formed to form a second Imaging a partial field of view (72c) of the first total field of view (70a), and wherein a third optical channel (16e) is configured to fully image a second total field of view (70b); and
wherein the second total field of view (70b) is an incomplete section of the first total field of view (70a);
wherein the multi-aperture imaging device further comprises:
an optical image stabilizer (22) for image stabilization along a first image axis (28) by generating a first relative motion (34; 39a) between the image sensor (12), the array (14), and the beam deflector (18) and image stabilizing along a second image axis (32) by generating a second relative movement (38; 39b) between the image sensor (12), the array (14) and the beam deflector (18); and
an electronic image stabilizer (41) for image stabilizing the first optical channel (16a) of the array (14) along the first and second image axes (28, 32);
wherein the optical image stabilizer (22) is adapted to stabilize an image of the imaged partial field of view (72a-d) of a reference channel from a group comprising the first optical channel (16a-h) and the second optical channel (16a-h); wherein the electronic image stabilizer (41) is adapted to perform image stabilization channel-by-channel for optical channels (16a-h) other than the reference channel, the multi-aperture imaging device being adapted to optically stabilize the reference channel only.
26. Multi-Aperture Imaging Device (10 ") with:
an image sensor (12);
an array (14) of optical channels (16a-d), each optical channel (16a-d) having optics (64a-d) for imaging a partial field of view (72a-d) of an overall field of view (70a-b) onto an image sensor area ( 24a-d) of the image sensor (12); and
a beam deflecting device (18) for deflecting a beam path of the optical channels (16a-d);
wherein a first group of optical channels is formed with at least two optical channels (16a, 16b) of the array (14) for respectively imaging a partial field of view (72a, 72b) of a first total field of view (70a), a second group of optical channels having at least two optical channels (16c, 16d) of the array (14) are formed to image a respective partial field of view (72c, 72d) of a second total field of view (70b); and
wherein the second total field of view (70b) is an incomplete section of the first total field of view (70a);
wherein the multi-aperture imaging device further comprises:
an image evaluator reading the image sensor areas configured to combine and provide an image of the first partial field of view (72d) and an image of the second partial field of view (72c) into a first overall image of the first total visual field (70a) and a second overall image of the second total visual field (70b).
27. The multi-aperture imaging apparatus of claim 26, wherein an optical property of optics (64a, 64b) of the first group of optical channels is within a tolerance of at most 10% equal to a first value, and wherein a second value of the optical property of the optics second group of optical channels deviates by at least 10% from the first value.
28. The multi-aperture imaging apparatus according to claim 27, wherein the optical characteristic is a focal length.
A multi-aperture imaging apparatus according to any of claims 26 to 28, wherein the beam redirecting means (18) comprises a plurality of facets (46a-e), each optical channel (16a, 16b) of the first group of optical channels of a facet (46a, 46b ) is associated with a first group of facets, and wherein each optical channel (16c, 16d) of the second group of optical channels of a facet (46e) is associated with a second group of facets or a facet of the first group of facets.
30. A multi-aperture imaging device according to claim 29,
wherein each optical channel (16c, 16d) of the second group of optical channels is associated with a facet of a second group of facets;
wherein the facets (46a-e) of the first and second groups of optical channels each have a first and a second main reflective side, the beam redirecting means (18) being arranged to rotate the first in a first rotational position of the beam deflector (18) deflecting optical channels (16a-d) with the first main sides in a first direction and, in a second rotational position of the beam deflection device (18), diverting the optical channels (16a-d) with the second main sides in a second direction,
and wherein the major sides of the first group of facets (46a, 46b) are inclined at a first angle (δ <,) to each other, and wherein the major sides of the second group of facets are inclined to each other at a second angle (δ 2 ).
Multiaperture imaging device according to claim 30, wherein the first angle (δι) is smaller than the second angle (δ 2 ) or wherein the second angle (δ 2 ) is smaller than the first angle (δι).
A multi-aperture imaging apparatus according to any of claims 26 to 31, wherein each optical channel (16a-d) of the first and second groups of optical channels is configured to connect the sub-field of view (72a-d) to an image sensor area associated with the optical channel (16a-d) (24a-d) of the image sensor (12).
The multi-aperture imaging apparatus of claim 32, wherein at least one image sensor region associated with an optical channel (16c, 16d) of the second group of optical channels comprises an image sensor region (24a, 24b) corresponding to an optical channel (16a, 16b) of the first group of optical channels is overlapped.
34. The multi-aperture imaging device of claim 26, further comprising:
an optical image stabilizer (22) for image stabilization along a first image axis (28) by generating a first relative motion (34; 39a) between the image sensor (12), the array (14) and the beam redirector (18) and image stabilization along a second image axis (32) by generating a second relative movement (38; 39b) between the image sensor (12), the array (14) and the beam deflector (18); and
an electronic image stabilizer (41) for image stabilizing the first optical channel (16a) of the array (14) along the first and second image axes (28, 32).
35. The multi-aperture imaging device according to claim 34, wherein the first relative movement (34; 39a) of at least one of a translational relative movement (34) between the image sensor (12) and the array (14), a translational relative movement (39a) between the image sensor (12 ) and the beam deflection device (8) and a translatory relative movement (39a) between the array (14) and the beam deflection device (18), and wherein the second relative movement (38; 39b) at least one of a rotational movement (38) of the beam deflection device (38). 18), a translatory relative movement between the image sensor (12) and the array (14) and a translational relative movement (39b) between the array (14) and the beam deflecting device (18).
36. The multi-aperture imaging apparatus of claim 34 or 35, wherein the electronic image stabilizer (41) is configured to stabilize the first optical channel (16a-h) along the first and second image axes (28, 32) in a first circumference and further for image stabilization of another optical channel (16a-h) of the array (14) in a second circumference along the first and second image axes (28, 32).
37. The multi-aperture image forming apparatus according to claim 34, wherein the optical image stabilizer is configured to perform the optical image stabilization such that the optical image stabilization is related to an image of a first one of the sub-field fields (72a-d) electronic image stabilizer (41) is adapted to stabilize an image of a second partial field of view (72a-d) with respect to the image of the first partial field of view (72a-d).
The multi-aperture imaging apparatus of any of claims 34 to 37, wherein the optical image stabilizer (22) is adapted to form an image of the imaged partial field of view (72a-d) of a reference channel from a group comprising the first optical channel (16a-h) and the second optical channel Channel (16a-h) and in which the electronic image stabilizer (41) is adapted to perform image stabilization channel-by-channel for optical channels (16a-h) other than the reference channel, the multi-aperture imaging device being arranged to optically source the reference channel only to stabilize.
A multi-aperture imaging apparatus according to any one of claims 34 to 38, wherein the electronic image stabilizer (41) is adapted to perform image stabilization channel-by-channel for each optical channel (16a-h).
A multi-aperture imaging device according to claim 39, wherein the electronic image stabilizer (41) is adapted to perform the channel-specific electronic image stabilization in each channel according to a predetermined functional relationship, that of the relative movements between the image sensor (12), the array (14) and the beam deflector (18) depends.
The multi-aperture ablation device of claim 40, wherein the functional relationship is a linear function.
The multi-aperture imaging apparatus of any one of claims 39 to 41, wherein the optical image stabilizer (22) is configured to provide optical image stabilization along one of the image directions based on rotational movement of the beam redirecting device, the functional relationship being an angular function representative of a rotation angle of the beam redirecting device (12). 18) to an extent of electronic image stabilization along the image direction.
A multi-aperture imaging apparatus according to any of claims 39 to 42, wherein the electronic image stabilizer (41) is adapted to identify a matching feature in a first partial image of a first partial visual field (72a-d) and in a second image of a second partial visual field (72a-d) , and around the
provide electronic image stabilization based on a comparison of motions of the feature in the first and second images.
A multi-aperture image forming apparatus according to any one of claims 39 to 43, wherein said electronic image stabilizer (41) is adapted to identify a coincident feature in a first partial image of a first partial visual field (72a-d) at a first time and at a second time provide electronic image stabilization based on a comparison of motions of the feature in the first image.
A multi-aperture imaging apparatus according to any one of claims 34 to 44, wherein focal lengths of optics (64a-d) of the first and second optical channels (16a-h) are different and movement of the beam deflector (18) to a mutually different change of the images to Image sensor areas (24a-h), wherein the electronic image stabilizer (41) is formed to compensate for differences between the different changes of the images.
A multi-aperture imaging apparatus according to any one of claims 34 to 45, wherein a first optic (64a) associated with the first optical channel (16a) and a second optic (64b) associated with the second optical channel (16b) are equal within a tolerance of at most 10% As a result of deviations within the tolerance range, image stabilization of the optical image stabilizer (22) leads to a mutually different change in the images caused by the first optical system (64a) and the second optical system (64b) to the image sensor regions (24a, 24b).
The multi-aperture imaging apparatus of any one of claims 34 to 46, wherein the optical image stabilizer (22) comprises at least one actuator (36, 37, 42) and is arranged to be at least partially disposed between two planes (52a, 52b) passing through Sides of a cuboid (55), wherein the sides of the cuboid to each other and to a line extension direction (35, 65, z) of the array (14) and a part of the beam path of the optical channels (16a-h) between the image sensor (12) and the optics (64a-h) are aligned in parallel and whose volume is minimal and yet comprises the image sensor (12) and the array (14).
48. The multi-aperture image forming apparatus according to claim 47, wherein the optical image stabilizer (22) protrudes by at most 50% from an area between the planes (52a, 52b).
49. The multi-aperture imaging apparatus according to claim 34, configured to receive a sensor signal from a sensor, and to evaluate the sensor signal for information correlated with a relative movement between the multi-aperture imaging apparatus and the object, and one To drive the optical or electronic image stabilizer (22, 41) using the information.
50. Multi-aperture imaging device (10 '') with:
an image sensor (2);
an array (14) comprising at least first and second optical channels (16a, 6b), each optical channel (16a-b) comprising optics (64a, 64b) for imaging an overall field of view (70a, 70b) onto an image sensor area (16); 24) of the image sensor (12); and
a beam deflecting device (18) for jointly deflecting a beam path of the optical channels (16a-b);
wherein the optical system of the first optical channel (16a) has a focal length different by at least 10% from a focal length of the optical system of the second optical channel (16b).
51. The ulti-aperture imaging device of claim 50, further comprising:
an optical image stabilizer (22) for image stabilization along a first image axis (28) by generating a first relative motion (34; 39a) between the image sensor (12), the array (14) and the beam redirector (18) and image stabilization along a second image axis (32) by generating a second relative movement (38; 39b) between the image sensor (12), the array (14) and the beam deflector (18); and
an electronic image stabilizer (41) for image stabilizing the first optical channel (16a) of the array (14) along the first and second image axes (28, 32).
52. The multi-aperture imaging apparatus of claim 51, wherein the electronic image stabilizer (41) is configured to stabilize the first optical channel (16a-b) along the first and second image axes (28, 32) in a first circumference and further for image stabilization of the second optical channel (6a-b) is formed in a second circumference along the first and second image axes (28, 32).
53. A multi-aperture image forming apparatus according to claim 51 or 52, wherein said optical image stabilizer (22) is adapted to perform the optical image stabilization such that the optical image stabilization relative to a reference image is one of that of the first and second total visual field (70a) electronic image stabilizer (41) is adapted to stabilize an image of another total field of view (70b) relative to the reference image.
54. The multi-aperture imaging device of claim 53, configured to exclusively optically stabilize the reference image.
A multi-aperture image forming apparatus according to any one of claims 51 to 54, wherein said electronic image stabilizer (41) is adapted to perform image stabilization channel-by-channel for each optical channel (16a-b).
56. The multi-aperture image forming apparatus of claim 55, wherein the electronic image stabilizer (41) is adapted to perform the channel-specific electronic image stabilization in each channel according to a predetermined functional relationship determined by the relative movements between the image sensor (12), the array (14), and the Strahlumienkeinrichtung (18) depends.
57. The multi-aperture imaging device of claim 55, wherein the functional relationship is a linear function.
58. The multi-aperture ablation apparatus of claim 56, wherein the optical image stabilizer is configured to provide optical image stabilization along one of the image directions based on rotational movement of the beam redirector, the functional relationship being an angular function representative of a rotation angle of the beam redirector. 18) to an extent of electronic image stabilization along the image direction.
The ulti-aperture imaging apparatus of any one of claims 51 to 58, wherein focal lengths of optics (64a-b) of the first and second optical channels (16a-b) differ and movement of the beam deflector (18) results in a mutually different change in the images to the image sensor areas (24a-h), the electronic image stabilizer (41) being designed to compensate for differences between the different changes in the images.
60. The multi-aperture imaging device according to claim 51, wherein the optical image stabilizer comprises at least one actuator and is arranged such that it is arranged at least partially between two planes, 52a, 52b. which are spanned by sides of a cuboid (55), wherein the sides of the cuboid to each other and to a line extension direction (35, 65, z) of the array (14) and a part of the beam path of the optical channels (16a-b) between the image sensor ( 12) and the optics (64a-b) are aligned in parallel and whose volume is minimal and yet comprises the image sensor (12) and the array (14).
61. The multi-aperture imaging device of claim 60, wherein the optical image stabilizer (22) protrudes by at most 50% from an area between the planes (52a, 52b).
62. The multi-aperture imaging apparatus according to claim 51, further configured to receive a sensor signal from a sensor and to evaluate the sensor signal for information correlated with a relative movement between the multi-aperture imaging apparatus and the object To drive the optical or electronic image stabilizer (22, 41) using the information.
63. The multi-aperture imaging device according to one of the preceding claims, wherein the beam deflection device (18) has a first main side (174a) and a second main side (174b) and is designed to be in a first operating state beam paths of the optical channels (64a-h) with the first main side (174a) in a first viewing direction of the multi-aperture imaging device, and in a second operating state to direct the optical paths of the optical channels (64a-h) with the second main side (174b) in a second viewing direction of the multi-aperture imager.
A multi-aperture image forming apparatus according to claim 63, wherein said first main side (174a) and said second main side (174b) are arranged at an angle (δ, δ, δ 2 ) of at most 60 ° inclined to each other.
A multi-aperture imaging device according to claim 63 or 64, adapted to perform a change between the first and second operational states by a rotational movement (38), wherein during the rotational movement a first surface normal (51 a) of the first major side and a second surface normal (51 b) the second main page at any time an angle (.ι. Y 2 ) of at least 10 ° with respect to a direction towards the image sensor (12).
An imaging system (60; 80) comprising first and second multiaperture imaging devices (10; 10 '; 20; 30; 40) according to any one of the preceding claims, configured to at least partially capture an overall field of view (70) stereoscope.
67. A method of providing a multi-aperture imaging device (10; 10 '; 10 ";
10 '"; 20; 30; 40) with the following steps:
Providing an image sensor;
Providing an array of optical channels such that each optical channel comprises optics for imaging at least a partial field of view of an overall visual field onto an image sensor area of the image sensor; and
Arranging a beam deflection device for deflecting a beam path of the optical channels;
such that a first optical channel of the array is configured to image a first partial field of view of a first total field of view such that a second optical channel of the array is formed to image a second partial field of view of the first total field of view, and a third optical channel is formed, to fully depict a second total field of view; and
such that the second total field of view (70b) is an incomplete section of the first total field of view (70a); the method further comprising:
Providing an image evaluator reading out the image sensor regions such that the image evaluator is configured to assemble and provide an image of the first subfield (72d) and an image of the second subfield (72c) to a first overall image of the first global field (70a) and a second one To provide the overall picture of the second total field of view (70b).
A method of providing a multi-aperture imaging device (10; 10 '; 10 "; 10'"; 20; 30; 40) comprising the steps of:
Providing an image sensor;
Providing an array of optical channels such that each optical channel comprises optics for imaging at least a partial field of view of an overall visual field onto an image sensor area of the image sensor; and
Arranging a beam deflection device for deflecting a beam path of the optical channels;
such that a first optical channel of the array is configured to image a first partial field of view of a first total field of view such that a second optical channel of the array is formed to image a second partial field of view of the first total field of view, and a third optical channel is formed, to fully depict a second total field of view; and
such that the second total field of view (70b) is an incomplete section of the first total field of view (70a); the method further comprising:
Arranging an optical image stabilizer (22) for image stabilization along a first image axis (28) by generating a first relative movement (34; 39a) between the image sensor (12), the array (14) and the beam deflector (18) and image stabilizing along a second image Image axis (32) by generating a second relative movement (38; 39b) between the image sensor (12), the array (14) and the beam deflector (18); and
Arranging an electronic image stabilizer (41) for image stabilizing the first optical channel (16a) of the array (14) along the first and second image axes (28, 32);
such that the optical image stabilizer (22) is designed to stabilize an image of the imaged partial field of view (72a-d) of a reference channel from a group comprising the first optical channel (16a-h) and the second optical channel (16a-h), and the electronic image stabilizer (41) is configured to perform image stabilization channel-by-channel for optical channels (16a-h) other than the reference channel so that the ulti-aperture imaging device is configured to optically stabilize the reference channel only.
A method of providing an ultrapure imaging device (10 ") comprising the steps of:
Providing an image sensor;
Providing an array of optical channels such that each optical channel comprises optics for imaging a partial field of view of a total facial image onto an image sensor region of the image sensor; and
Arranging a beam deflection device for deflecting a beam path of the optical channels;
such that a first group of optical channels is formed with at least two optical channels (16a, 16b) of the array (14) for imaging a respective partial field of view (72a, 72b) of a first total field of view (70a), wherein a second group of optical channels comprises at least two optical channels (16c, 16d) of the array (14)
is configured to image a respective one partial field of view (72c, 72d) of a second total field of view (70b); and
such that the second total field of view (70b) is an incomplete section of the first total field of view (70a); the method further comprising:
Providing an image evaluator reading out the image sensor regions such that the image evaluator is configured to assemble and provide an image of the first subfield (72d) and an image of the second subfield (72c) to a first overall image of the first global field (70a) and a second one To provide the overall picture of the second total field of view (70b).
A method (1400) of providing a multi-aperture imaging device (10 "') comprising the steps of:
Providing (1410) an image sensor;
Providing (1420) an array comprising at least first and second optical channels, each optical channel including optics for imaging an overall visual field onto an image sensor area of the image sensor; and
Arranging (1430) a beam deflection device for jointly redirecting a beam path of the optical channels;
such that the optical system of the first optical channel has a focal length which differs by at least 10% from a focal length of the optical system of the second optical channel.
| # | Name | Date |
|---|---|---|
| 1 | 201937041219.pdf | 2019-10-11 |
| 2 | 201937041219-STATEMENT OF UNDERTAKING (FORM 3) [11-10-2019(online)].pdf | 2019-10-11 |
| 3 | 201937041219-FORM 1 [11-10-2019(online)].pdf | 2019-10-11 |
| 4 | 201937041219-FIGURE OF ABSTRACT [11-10-2019(online)].pdf | 2019-10-11 |
| 5 | 201937041219-DRAWINGS [11-10-2019(online)].pdf | 2019-10-11 |
| 6 | 201937041219-DECLARATION OF INVENTORSHIP (FORM 5) [11-10-2019(online)].pdf | 2019-10-11 |
| 7 | 201937041219-COMPLETE SPECIFICATION [11-10-2019(online)].pdf | 2019-10-11 |
| 8 | 201937041219-FORM 18 [25-10-2019(online)].pdf | 2019-10-25 |
| 9 | 201937041219-MARKED COPIES OF AMENDEMENTS [31-10-2019(online)].pdf | 2019-10-31 |
| 10 | 201937041219-FORM 13 [31-10-2019(online)].pdf | 2019-10-31 |
| 11 | 201937041219-AMMENDED DOCUMENTS [31-10-2019(online)].pdf | 2019-10-31 |
| 12 | 201937041219-Proof of Right (MANDATORY) [06-11-2019(online)].pdf | 2019-11-06 |
| 13 | 201937041219-Information under section 8(2) (MANDATORY) [15-11-2019(online)].pdf | 2019-11-15 |
| 14 | 201937041219-FORM-26 [25-11-2019(online)].pdf | 2019-11-25 |
| 15 | 201937041219-Information under section 8(2) [14-03-2020(online)].pdf | 2020-03-14 |
| 16 | 201937041219-Information under section 8(2) [08-09-2020(online)].pdf | 2020-09-08 |
| 17 | 201937041219-Information under section 8(2) [29-09-2020(online)].pdf | 2020-09-29 |
| 18 | 201937041219-Information under section 8(2) [01-12-2020(online)].pdf | 2020-12-01 |
| 19 | 201937041219-Information under section 8(2) [04-03-2021(online)].pdf | 2021-03-04 |
| 20 | 201937041219-Information under section 8(2) [26-03-2021(online)].pdf | 2021-03-26 |
| 21 | 201937041219-Information under section 8(2) [02-07-2021(online)].pdf | 2021-07-02 |
| 22 | 201937041219-FER.pdf | 2022-02-16 |
| 23 | 201937041219-AbandonedLetter.pdf | 2024-06-28 |
| 1 | 201937041219_SearchE_16-02-2022.pdf |