Specification
Multiaperturabbildungsvorrichtungen, methods for producing the same and imaging system
description
The present invention relates to ultiaperturabbildungsvorrichtungen, in particular those which are suitable for mobile devices, to methods of manufacturing the same, and an imaging system. The present invention further relates to a concept for housing Multiaperturabbildungssysteme linear channel arrangement.
Conventional cameras transmitted in a channel, the entire field of vision and are limited in their miniaturization. In smartphones, two cameras are used, which are oriented in and counter to the sense of direction of the surface normal of the display. In most-th Multiaperturabbildungssystemen each channel a contiguous sub-object area is assigned, which is transformed into a contiguous portion of the image area.
In conventional cameras, smartphones, the housing for the optics are produced by means of injection molding from plastic. Plastics have high thermal-expansion coefficient Ausdeh and a low modulus of elasticity, resulting in a thermal cycling to deformations. Especially in stereo systems using two spaced cameras resulting from the position and attitude changes limitations in the quality of the depth information. For array cameras, in each of which display the individual channels a part of the visual field, may occur in De-adjustment, in addition to errors in the overall composition of the images.
Conventional cameras, as shown for example in Fig. 27, consist of a single imaging channel. The lenses 502a-502d are usually manufactured by injection molding and have a circular disc-shaped geometry. The housing 504 also be made of plastic materials by injection molding, which consequently have large thermal expansion coefficients. The orientation of the lens is based on the diameter of the lenses 502a to 502d and corresponding recesses in the housing 504 (centering), and the thicknesses of the individual lens elements using mechanical stops in the peripheral region of the lenses 502a to 502d to the optical function area around. Between the lenses 502a to 502d spacers may be arranged 506a to 506c. Similarly, the lens stack can have a waste
spacers 506d are completed. Since only creates a coherent picture, temperature changes cause only a change of image quality (sharpness), but not the occurrence of disturbing image artifacts.
two conventional cameras are used for 3D images that form a stereo configuration as shown for example in Fig. 28 for cameras 508a and 508b. Due to the high expansion of the plastic materials negative influences result on the quality of the 3D data, since uncontrolled changes of the cameras 508a and 508b result.
There continues array camera arrangements that are based on the use of several individual cameras and are described in US 2014/01 11650 A1. Fig. 29 shows a corresponding device in which each channel 512a-512d transmits a part of the total field of view. The fields are in arrears on the total field together-volume sets. Changes in temperature cause uncontrollable changes in position of the cameras and thus an erroneous image composition has an adverse effect on the image quality due to occurrence greatly disturbing image artifacts.
Therefore desirable would be a concept that Multiaperturabbildungsvorrichtungen for detecting a total field of view permits, while ensuring a high image quality.
The object of the present invention is Multiaperturabbildungs devices to sheep-fen, enabling method for manufacturing the same, and an imaging system which in operation a reliably high and constant image quality.
This object is achieved by the subject matter of the independent claims.
A core idea of the present invention is to have recognized that obtained by a fixation of optics of the optical channels against each other, that is, a fixation of an optical system with respect to other optics by a wall structure of a housing one of a temperature change only influenced to a small extent picture quality can, so that an almost constant high image quality of the Multiaperturabbildungsvorrichtung obtained at varying ambient conditions. Here, a housing material will not be easily replaced, but a wall structure comprising arranged glass, ceramic or a crystalline material and / or the housing formed from the joined planar or curved plate-like structures and the optics fixed against each other on the housing. This has the advantage,
According to one embodiment, a Multiaperturabbildungsvorrichtung comprises at least an image sensor and an array of juxtaposed optical Ka-nälen, each optical channel having an optical system for imaging at least a portion of a subject region in an image sensor portion of the image sensor. The array includes a housing having an image sensor facing or facing away from the wall structure through which the optical channels. The housing further includes means disposed on the wall structure of the side wall structure, the wall structure or the side wall structure comprising glass, ceramic, glass ceramic or a crystalline material is formed. In the housing, the optics of the optical channels are arranged. The wall structure is connected to optics of the optical channels and fixes the optics against each other. The wall structure is for example a disposed in viewing direction of the optical channels front or rear side of the housing. An array of glass, ceramic or a crystalline material allows for a low temperature-related deformation of the housing, particularly against Ku n ststoff m ate ri a I ie n. Further, the fixation of the optics of the optical channels enables against each other on the wall structure of low deformation forces of optical channels, which act on other optical channels.
According to a further embodiment, a Multiaperturabbildungsvorrich-processing includes at least an image sensor and an array of juxtaposed optical channels, each optical channel having an optical system for imaging at least a portion of a subject region in an image sensor portion of the image sensor. The array has a housing, in which arranged the optics of the optical channels and fixed against one another, wherein the housing is formed from the joined plate-like structures, and at least a surface facing the image sensor or having facing away from the wall structure and at least one side wall structure. An advantage of the plate-shaped structures is a high reproducibility and a high defibrillator nierbarkeit the deformation of the respective structures.
According to a further embodiment, a Multiaperturabbildungsvorrich-tung comprising comprising a housing having a wall structure of glass, ceramic or a crystalline material, as mentioned above, and is designed so that the housing is formed from ANEI nandergefügten plate-shaped structures. This means that the embodiments described above can be combined. This enables the receipt of all the above listed advantages, as well as the synergistic effect that a high rigidity of glass, ceramic or crystalline material-induced deformation of the optics of the optical channels deformation force is transferred into the wall structure does not or only to a small extent.
According to a further embodiment of an imaging system, such as an image capturing device or a device comprises with such image capture device at least one above-described Multiaperturabbildungsvor direction.
According to another embodiment, a method for manufacturing a Multiaperturabbildungsvorrichtung comprises providing at least one image sensor and disposing of optics of optical channels so that they form an array of nebeneinan-the arranged optical channels, and so that each optical channel has an optical system for imaging at least a portion of a subject region has an image sensor portion of the image sensor. Forming the array comprises arranging the optical systems of the optical channels in a housing having an image sensor facing towards or away from the wall structure comprising glass, ceramic or a crystalline material, so that the wall structure is connected to the optics of the optical channels and the optics fixed to each other.
According to another embodiment, a method for manufacturing a Multiaperturabbildungsvorrichtung includes providing at least an image sensor, an on-organize optics of optical channels so that they form an array of juxtaposed optical channels, and so that each optical channel has an optical system for imaging at least a portion of a subject region has an image sensor portion of the image sensor. The method further includes forming a housing of joined-together plate-shaped structures, so that the housing has at least one image sensor facing or facing away from the wall structure and at least one side wall structure. The method further includes arranging the optical systems of the optical channels of the array in the housing, so that the optics are fixed against each other.
Further advantageous embodiments are the subject of the dependent claims.
Preferred embodiments of the present invention will be detailed subsequently referring to the accompanying drawings. Show it:
Fig. 1 is a schematic perspective view of a ultiaperturabbildungs- device according to an embodiment;
Fig. 2 is a schematic perspective view of a further Multiapertur- imaging apparatus according to an embodiment;
Figure 3 is a schematic representation of an optical channel according to an embodiment which has three lenses.
FIG. 4a is a schematic plan view of a Multiaperturabbildungsvorrichtung according to an embodiment in which an at least partially opaque structure is disposed between the image sensor areas of an image sensor, respectively;
Figure 4b is a schematic plan view of a Multiaperturabbildungsvorrichtung according to an embodiment, in which an optical channel is configured to map to two sub-areas.
FIG. 5a is a schematic perspective view of a side wall structure for a Multiaperturabbildungsvorrichtung according to an embodiment;
FIG. 5b is a schematic perspective view of a baffle structure for a Multiaperturabbildungsvorrichtung according to an embodiment;
Fig. 5c is a schematic perspective view of a side wall structure for a ultiaperturabbildungsvorrichtung according to an embodiment which is useful for example as a top and / or bottom of a housing;
Fig. 5D is a schematic perspective view of an alternative structure for a sidewall Multiaperturabbildungsvorrichtung according to an embodiment;
Fig. 5e is a schematic perspective view of a further side wall structure are formed for a Multiaperturabbildungsvorrichtung according to an exemplary embodiment, wherein the elevations as discontinuous frame;
Figure 6 is a schematic perspective view of a section of a wall structure for a Multiaperturabbildungsvorrichtung according to an exemplary embodiment.
Fig. 7a is a schematic perspective view of a possible implementation form of a housing for a Multiaperturabbildungsvorrichtung according to an embodiment;
FIG. 7b shows the housing of Figure 7a, wherein a plurality of lenses are arranged for each optical channel, as described in connection with FIG. 3.
is a schematic perspective view of a Multiaperturabbildungs- device according to an embodiment, in which the housing, as described for example in Figure 7b.
a schematic sectional side view of an apparatus according to an embodiment in a first operating condition;
FIG. 9b is a schematic side sectional view of the device of Figure 9a in a second operating condition.
10a is a schematic side sectional view of a device according to another embodiment having a cover.
a schematic side sectional view of the device of Figure 10a in a second operating condition.
a schematic side sectional view of the device of Figure 10a in a third position.
a schematic side sectional view of a device according to another embodiment, in the first operating state, which has an at least partially transparent cover;
a schematic side sectional view of the apparatus of Figure 1 1 a in the second operating state.
a schematic side sectional view of the device of Figure 11a, in which a beam deflecting device is additionally movable in translation.
a schematic sectional side view of an apparatus according to an embodiment in the first operating state with a translational sliding cover;
a schematic side sectional view of the device of Figure 12a in the second operating state.
a schematic sectional side view of an apparatus according to an embodiment in which the cover is disposed rotationally movable;
a schematic side sectional view of the device of Figure 13a in which a carriage is movable in translation.
a schematic side sectional view of the device of Figure 13a in the second operating state.
a schematic sectional side view of an apparatus according to an embodiment in the first operating condition, has at least over the apparatus of Figure 13 partly transparent covers.
a schematic side sectional view of the device of Figure 14a, in which the beam deflecting device comprises an intermediate position between a first position and a second position.
a schematic side sectional view of the device of Figure 14a, in which the beam deflecting device is moved completely out of a housing volume.
.. A schematic side sectional view of the device of Figure 14a, wherein a distance between the at least partially transparent covers compared with the Fig 14a is enlarged-c;
is a schematic perspective view of an apparatus according to an embodiment having three Multiaperturabbildungsvorrichtungen;
an enlarged perspective view of a detail of the device of Fig. 15;
is a schematic perspective view of an apparatus according to an embodiment in which the beam deflecting device is connected by means of fastening elements with the Multiaperturabbildungsvorrichtung;
is a schematic perspective view of an apparatus according to an embodiment in the first operating state with an exemplary form of a cover;
a schematic view of the apparatus of Figure 18a in the second operating state according to an embodiment.
a schematic representation of an alternative to Figure 18a according to an embodiment.
detailed illustrations of a Multiaperturabbildungsvorrichtung according to an embodiment;
according to embodiments of the Multiaperturabbildungsvorrichtung. Fig 19a-c for the case of a common carrier retained optics of optical channels according to an embodiment.
the Multiaperturabbildungsvorrichtung gem. which is supplemented in accordance with an exemplary embodiment, additional devices for for implementation of relative movements for an optical image stabilization and adjusting the focusing Fig 19a-c.
according to a schematic view of an arranged in a flat housing Multiaperturabbildungsvorrichtung. an embodiment;
a schematic construction of a stereoscopic Multiaperturabbildungsvorrichtung for detecting a total field of view;
a schematic view of a 3D Multiaperturabbildungsvorrichtung according to an embodiment;
a schematic view of another ultiaperturabbildungsvorrich-processing according to an embodiment, which is supplemented in accordance with an exemplary embodiment, additional devices for for implementation of relative movements for a focus control and to the optical image stabilizer;
schematic side views of a beam bending apparatus according to an embodiment;
a schematic view of a Multiaperturabbildungsvorrichtung with a setting means for channel-specific adjustment of optical properties, according to an embodiment;
Fig 24b shows a variant of a Multiaperturabbildungsvorrichtung with the setting means according to an embodiment.
Figure 25 is a schematic view of the supplemented by additional actuators device of Figure 23a in accordance with a Ausführungsbeispiei..;
Fig. 26 is a schematic view of an arrangement of actuators in a multi- tiaperturabbildungsvorrichtung according to an embodiment;
Figure 27 is a view of components of a conventional camera with a single imaging channel.
FIG. 28 is a view of a stereo structure of conventional cameras; and
Fig. 29 is a view of an array-camera arrangement, the multiple on the use
Individual cameras based.
Before describing embodiments of the present invention are explained in detail with reference to the drawings, it is noted that identical, functionally identical or equivalent elements, objects and / or structures in the different figures by the same reference numerals so that the illustrated, in different embodiments Description of these elements is interchangeable and can be applied to one another.
Fig. 1 shows a schematic perspective view of a Multiaperturabbildungsvor direction 1000 according to one embodiment. The Multiaperturabbildungsvorrichtung includes an image sensor 12 and an array 14 of adjacent optical channels 16a and 16b. Each optical channel 16a and 16b comprises an optical system 64a or 64b for imaging at least a partial area 74a or 74b of an object region 72 to an image sensor portion 58a or 58b of the image sensor 12. Although the part spaces 74a and 74b shown so that they are disjoint in the object region 72, the portions 74a and 74b can also be adjacent to each other directly or in part, that is incomplete overlap with each other. The Multiaperturabbildungsvorrichtung 1000 may be configured to scan the object region completely, ie to provide a complete picture. Alternatively or additionally, the ultiaperturabbildungsvorrichtung may be formed 1000 in order to map at least a partial area 74a and / or 74b of the object region 72 by at least two optical channels to at least two image sensor regions. This allows an image of the object region at a higher resolution by using the Super Resolution, or at least Stereoskope detection of the object region 72nd
The object area 72 may be referred to as field of view of Multiaperturabbildungsvorrichtung 1000 and represent an area that is imaged by the Multiaperturabbildungsvorrichtung 1000th The sections 74a and 74b may be referred to as partial fields of the visual field 72nd
The array 14 comprises a housing 1002. The housing 1002 includes a wall structure 1004 16a-b is disposed along a line extending direction 146 and perpendicular to an axial extension direction of Strahiengängen 17a-b of the optical channels. The wall structure 1004 may the image sensor (not shown) facing 12 from the optics 64a-b may be arranged (shown) and / or away. The spaced apart from the image sensor 12 shown wall structure 1004 may also be described so that it forms an entrance side of the optical paths 17a-b of the optical channels 16a-b of the array fourteenth An alternatively or in addition to the wall structure 1004 facing the image sensor arranged wall structure can be referred to as an exit side of the array fourteenth The housing 1002 has a side wall structure 1006 disposed on the wall structure 1004 and is configured to reduce entry of stray light, the means for receiving the Multiaperturabbildungsvorrichtung 1000 unwanted or interfering radiation or to prevent. Although the side wall structure 1006 is shown to be opposite to a lateral side of the wall structure along 1004 or positioned to the line direction of extension 146, the sidewall structure may be 1006 also disposed on another side of the wall structure 1004, and one side of the optical channels 46a and 64b shield against external light. Alternatively wertere sidewall structures and further, the image sensor 12 facing wall structure can be arranged to form a complete housing. to entry of stray light, for receiving the Multiaperturabbildungsvorrichtung meaning 1000 unwanted or interfering radiation to reduce or prevent. Although the side wall structure 1006 is shown to be opposite to a lateral side of the wall structure along 1004 or positioned to the line direction of extension 146, the sidewall structure may be 1006 also disposed on another side of the wall structure 1004, and one side of the optical channels 46a and 64b shield against external light. Alternatively wertere sidewall structures and further, the image sensor 12 facing wall structure can be arranged to form a complete housing. to entry of stray light, for receiving the Multiaperturabbildungsvorrichtung meaning 1000 unwanted or interfering radiation to reduce or prevent. Although the side wall structure 1006 is shown to be opposite to a lateral side of the wall structure along 1004 or positioned to the line direction of extension 146, the sidewall structure may be 1006 also disposed on another side of the wall structure 1004, and one side of the optical channels 46a and 64b shield against external light. Alternatively wertere sidewall structures and further, the image sensor 12 facing wall structure can be arranged to form a complete housing. to reduce or prevent. Although the side wall structure 1006 is shown to be opposite to a lateral side of the wall structure along 1004 or positioned to the line direction of extension 146, the sidewall structure may be 1006 also disposed on another side of the wall structure 1004, and one side of the optical channels 46a and 64b shield against external light. Alternatively wertere sidewall structures and further, the image sensor 12 facing wall structure can be arranged to form a complete housing. to reduce or prevent. Although the side wall structure 1006 is shown to be opposite to a lateral side of the wall structure along 1004 or positioned to the line direction of extension 146, the sidewall structure may be 1006 also disposed on another side of the wall structure 1004, and one side of the optical channels 46a and 64b shield against external light. Alternatively wertere sidewall structures and further, the image sensor 12 facing wall structure can be arranged to form a complete housing. the side wall structure 1006 may be disposed on another side of the wall structure 1004, and to shield one side of the optical channels 46a and 64b against external light. Alternatively wertere sidewall structures and further, the image sensor 12 facing wall structure can be arranged to form a complete housing. the side wall structure 1006 may be disposed on another side of the wall structure 1004, and to shield one side of the optical channels 46a and 64b against external light. Alternatively wertere sidewall structures and further, the image sensor 12 facing wall structure can be arranged to form a complete housing.
The lenses 64a and 64b are mechanically connected to the wall structure 1004, or mechanically fixed. This is provided, for example, that the optical system 64a via mechanical fastening elements 1008a and / or 1008b mechanically firmly connected to the wall structure 1004. The fasteners 1008a and 1008b can
as holding webs or fastening webs of any material, such as a plastic material, a metal material! be and / or a crystalline material formed. Alternatively or additionally, it may be provided that the optic 64a is mechanically firmly connected by an adhesive to the wall structure 1004th The optics can be connected via fasteners 64b 1008c and / or 1008D to the wall structure 1004 and / or adhesively bonded thereto.
According to a first preferred embodiment, the wall structure 1004 and / or the side wall structure 1006 comprises a glass material, a ceramic material, a Glaske-ramikmaterial or a crystalline material such as silicon or polysilicon. The wall structure 1004 may be formed so that it at least in regions 1014a-b, in which the beam paths 17a-b 16a-b extend the optical channels through the wall structure, is transparent, for example by the glass material, ceramic or crystalline material for a Nutzwellenlängenbereich a to be detected by the radiation Multiaperturabbildungsvorrichtung 1000 is transparent. This allows the optical channels 64a and 64b extend through the material of the wall structure 1004 therethrough. For this transparent areas may be 1014a and 1014b provided which are optionally enclosed by diaphragm structures 1012a and 1012b. The optical channels 16a and 16b may look through the transparent regions 1014a and 1014b toward the object area 72nd An image sensor 12 facing wall structure may have transparent areas 1014a and 1014b, so that the optical channels look toward the image sensor 12th The transparent regions 1014a and 1014b may be made or from the material of the wall structure 1004 include this if it is transparent to the relevant wavelength range, or at least partially transparent. "At least partially-transparent" means that little or acceptable optical attenuation takes place. Alternatively, the transparent areas 1014a and / or 1014b as openings in the wall structure so as recesses, may be formed. Alternatively, the transparent areas can 1014a and / or 1014b have a transparent or at least partially transparent material and be enclosed by a less transparent, that is at least partially opaque material of the wall structure 1004th optically active regions may be formed as lenses on or in the transparent regions 1014a-b. That is, in the transparent region 1014 also includes at least one lens may be formed, which carries out influencing of the respective beam path 17a-b. optically active regions may be formed as lenses on or in the transparent regions 1014a-b. That is, in the transparent region 1014 also includes at least one lens may be formed, which carries out influencing of the respective beam path 17a-b. optically active regions may be formed as lenses on or in the transparent regions 1014a-b. That is, in the transparent region 1014 also includes at least one lens may be formed, which carries out influencing of the respective beam path 17a-b.
The aperture structures 1012a and 1012b may be formed to define a viewing angle or field of view of the optical channels 16a and 16b or reduce entry of Falschücht from areas outside the portions 74a and 74b towards the respective image sensor portion 58a or 58b or prevent. According to one form of execution, the wall structure 1004, with the exception of the areas on which the optical channels 16a and 16b through the wall structure 1004 therethrough extending from an at least partially opaque layer covers, which forms the diaphragm structure 1012a and 1012b. According to a further embodiment, the diaphragm structure is 1012a and / or 1012b formed as edge-shaped structure to the transparent portions 1014a and / or 1014b. This means that on the wall structure 1004 optical diaphragm 1012 may be arranged, which are designed to limit the path of rays 17a and 17b along a direction perpendicular to a path of the beam path 17a or 17b. An advantage of the diaphragm structures 1012a and 1012b that an exact definition of the part of object regions 74a and 74b allows.
According to a further preferred embodiment, the housing 1002 butted plate-like structures, ie at least the wall structure 1004, and the side wall structure 1006 is formed. A concatenation of sheet structures to maintain the housing 1002 axes 17a and 17b or 17c and 17d. The facets 68a and 68b may be formed by a facet and facet 68c and 68d may be formed by a different facet, as is shown by dashed lines between the respective pairs of facets, and the only two facets are merely inclined in a direction and both parallel to the line extending direction.
Further, it could be provided that some optical channels are assigned to the same part of the visual field, such as for the purpose of super resolution or to increase with which the corresponding sub-field is scanned through these channels of the resolution. The optical channels within such a group then ran for example, before beam deflection parallel and would be deflected by a facet on a Teilge field of view. Advantageously, BE REDUCED pixel images of the image sensor of a channel of a group in intermediate positions between images of the pixels of the image sensor of another channel of this group.
Also conceivable without Superresoiutionszwecken, but merely to stereoscopy purposes where their part fields of view to cover a group of immediately adjacent channels in rows extending direction of the overall field of view fully a design, and that a further group of mutually directly adjacent channels would be, for example, in turn, completely cover the entire field of view, and the beam paths both groups of channels through the substrate or a support 66th This means that the Multiaperturabbildungsvorrichtung may include a first plurality of optical channels which are adapted to detect, if necessary, complete a total field of view. A second plurality of optical channels of Multiaperturabbildungsvor direction can be formed to the total field of vision and possibly also to grasp completely. The overall field of view can be so at least stereoscopically er-enclosed by the first plurality of optical channels and through the second plurality of optical channels. The first plurality of optical channels and said second plurality of optical channels can meet at a common image sensor share a common Ar-ray (optical array) and / or are deflected by a common beam deflection. In contrast to an array of individual cameras a zusammenhän-constricting array camera is formed, which is jointly controllable as a device, for example. With respect to a focus and / or an image stabilization, which is advantageous, since all channels simultaneously and using the same actuators are affected. In addition, resulting from the monolithic construction advantages in terms of mechanical stability of the overall arrangement in particular when the temperature changes. This is advantageous for to-composition of the overall image from partial images of the individual channels as well as in obtaining three-dimensional object data for use in stereo, Tripple-, Quattro- etc. systems with multiple scan of the total field of view by different pluralities of channels sixteenth
The following discussion deals with the lenses 64a-d, the lens planes is also parallel to the common plane of the image sensing areas 58a-d. As will be described below, the lenses of the optics 64a-d of the optical channels 16a-d on a page 66a of the substrate 66 are attached via one or more lens holder and mechanically connected with each other via the substrate 66th In particular, the beam paths 17a-d of the plurality of optical channels 16a-d extending through the substrate 66. The substrate 66 is thus at least partially formed from transparent material and is plate-shaped or, for example, has the shape of Parailelepipeds or other convex body having a planar main 66a and an opposite, this also planar main 66b. The main pages are preferably positioned perpendicular to the beam paths 17a-d. As described below, there can be deviations from the pure Paralieiepipedform according to embodiments that are the result of a one-piece with the substrate forming of lenses of the optics.
In the embodiment of Figures 19a-c are in the flat-Trä gersubstrat 66, for example, a substrate of glass or polymer. For example, the carrier substrate 66 may comprise a glass plate. The materia! the substrate 66 may be selected in accordance with aspects of high optical transparency and low temperature coefficient and other mechanical properties such as hardness, elasticity or torsion.
The substrate 66 may be formed as a simple planar portion of the beam path without any additional lenses are placed directly thereto. In addition, apertures, such as aperture or FAISC Yichtbienäen, oäerJund Fi ' ltersc i ' Want, such as IR-blocking filter be mounted on the substrate surfaces or consist of several layers of different substrates, may be mounted on the surfaces of diaphragms and filter layers, which in turn, can differ by channel, for example, in their spectral absorption.
The substrate 66 may be made of material that comprises in different regions of the electromagnetic spectrum, which can be detected by the image sensor, different properties, in particular a non-constant absorption.
In the embodiment of Fig. 19a-c each optics 64a-d includes three lenses. The number of lenses, however, is arbitrary. The number could be 1, 2, or any other number. The lenses may be convex, spherical, aspherical, having a free-form surface, or two, such as two to yield opposed, for example, a convex or a concave lens shape only one optically imaging function surface, such as. Also, multiple optically effective lens surfaces are possible, such as by construction of a lens made of several materials.
A first lens 78a-d of each optical channel 16a-d or optics is in the embodiment of Fig. 19a-c in the main 66a formed. The lenses 78a-d have been manufactured for example by molding on the main 66a of the substrate 66 and consist for example of polymer, for example from UV-curable polymer. The Ab-shaping for example, by a molding tool and the curing can be done, for example, the temperature and / or UV irradiation.
In the embodiment of Fig. 19a-c each optics 64a-d has a still further second and third lenses 82a-d and 84a-d. These lenses are exemplary fixed via axial ver-current tubular lens holder 86a-d to each other in the interior of each lens holder and fixed by the latter to the main side 66b, for example by means of gluing or other joining technology. Openings 88a-d of the lens holder 86a-d are provided for example with a circular cross section, in its inner cylindrical surface, the lenses 82a-d and 84a-d are attached. the lenses are therefore for each look 64a-d koaxi-al to the respective optical axis of the beam paths 17a-d. However, the lens holder 86a-d may also have a varying over its length or along the respective optical axes cross section. Here, the cross-section with smaller as the distance may increasingly have rectangular or square character to the image sensor 12th The outer shape of the lens holder may thus be different from the shape of the öff-voltages. The material of the lens holder may be light-absorbing. According to the previously described in connection with the figures 19d and 19e squinting optics the lens holder can not rotationally symmetric and / or non-coaxial pronounced.
Die Befestigung über die vorerwähnten Linsenhalter geschieht beispielsweise so, dass Linsenscheitel der durch dieselben gehalterten Linsen von dem Substrat 66 beabstandet sind.
As already mentioned above, it is possible that the substrate 66 is planar on both sides, and thus has no refractive power action. However, it would also be possible that the substrate has mechanical structures 66, such as recesses or projections, which allow easy, positive and / or force-locking alignment subsequent components such as the connection of individual lenses or housing parts. In the embodiment of Fig. 19a-c, for example, the substrate could comprise 66 befestigungserleichternde on the main 66b or the orientation facilitating structures on the positions at which the respective end of the tube of
The lens holder 86a-d of the respective optics 64a-d is attached. In these structures, can for example, be a circular depression or a recess having a different shape corresponding to the shape of a side facing the substrate side of each lens holder in which the side of the respective lens holder 84a-d engage neh-men can. It should again be emphasized that other opening cross-sections and corresponding possibly other lens apertures are possible as circular.
The embodiment of Fig. 19a-c thus separates from a classic construction of camera modules having individual lenses and have a surrounding it completely, non-transparent support housing for retaining the individual lenses. Rather, the above embodiment uses a transparent body 66 as substrate support. This extends over several adjacent optical channels 16a-d to be penetrated by the imaging beam path. It does not disturb the picture, but he also does not increase the overall height.
However, it is pointed out in various ways, the embodiment of FIG. 19a-c could be varied. For example, the substrate 66 of the Multiaperturabbildungsvorrichtung 1 extends not necessarily all of the channels 16a-d 1. In contrast to the above described, it would be possible that each optical system 64a-d has, on both sides 66a and 66b on lens carrier supported shouldered lenses, as in Fig. 19f is shown.
The existence of only lenses 82e-h on the main 66a, ie without the lenses 82a-d and / or 84a-d on the other side 66b, would be conceivable, as well as the provision of the lenses 82a-d and / or 84a- d on the other side 66a, that is, the side of the substrate 66 and not the side thereof facing the image sensor 12 is remote, ie 66a. Likewise, the number of lenses in a lens carrier 86a-h is arbitrary. This could also only one lens or there could be more than two in such a carrier 86a-h. As shown in Fig. 19f, it could be that lenses 66a and 66b via respective lens carrier 86a-d and 86e-h are mounted on the respective side 66a and 66b on both sides.
Fig. 12 shows an example that the Multiaperturabbildungsvorrichtung 11 of Fig. 19a-c to one or more of the additional features described below could be added.
For example, FIG. 20, that means 92 could be provided by 18 to rotate the beam deflection about the rotational axis 44 which is parallel to the Zei-lener stretch direction of the array fourteenth The rotational axis 44 is for example in the plane of the beam paths 17a-d or removed less than a quarter of a diameter of the optical systems 64a-d. Alternatively, it would also be possible, of course, that the rotation axis is located farther away, such as less than an optical diameter or less than four optic diameter. The device 92 may for example be provided to control the beam deflecting device 18 with a short response in only small angular range, such as to rotate within a range of less than 1 ° or less 10 ° or less than 20 °, to shake the ultiaperturabbildungsvorrichtung compensate 1 1 during recording, for example, by a user. The device 92 would be triggered in this case, for example, from an image stabilization control.
Alternatively or additionally, the device could be formed 92 with larger angular displacements the total field of view by the total coverage of the partial fields 74a-d (Fig. 19a) is defined to change in its direction. It would also be possible that 18 also distractions be achieved by rotating the beam deflection, in which the total field in the opposite direction is arranged relative to the device 11, for example, the beam deflecting device 18 is formed as a double-sided reflective mirror array.
Again, alternatively or additionally, the device 1 1, a device 94 aufwei-sen to the optics 64a-d by means of the substrate 66 or the substrate 66 itself and thus to move the optics 64a-d in translation along the row direction of extension. The means 94 could for instance also be driven by the above-mentioned image stabilization control to be achieved by a movement along the line 96 extending direction of an image stabilization transverse to the image stabilization, which is implemented by the rotation of the Spiegelumlenkvorrichtung 18th
Furthermore, the device may additionally or alternatively comprise 11, a means 98 for changing the image-side distance between image sensor 12 and optics 64a-d or between image sensor 12 and the carrier 66, to achieve a focus depth setting. The device 98 may be controlled by manual user control or by an auto focus control and focusing means of the device. 11
The device 94 thus serves as a suspension of the substrate 66 and is preferably, as indicated in Fig. 20 arranged laterally adjacent to the substrate 66 along the row extension rich processing so as not to increase the height. also applies to the devices 92 and 98 that the same are preferably arranged in the plane of the optical beam paths in order not to increase the height. The device 98 can also be connected to the beam deflection device 18 and move them simultaneously or nearly simultaneously, so that, for a change of the image-side distance between image sensor 12 and optics 64a-d is a distance between the lenses 64a-d and the beam deflecting device 18 is substantially remains constant or constant. The devices 92, 94 and / or 98 may be based on pneumatic, hydraulic, piezoelectric actuators, DC motors,
It should be noted that the lenses 64a-d not only with each other, such as may be gehaitert about the already mentioned transparent substrate but also relative to the beam deflection in a constant relative position, such as not an appropriate framework, preferably the height increased, and therefore preferably ver-runs in the plane of the components 12, 14 and 18 or in the plane of the beam paths. The constancy of the relative position could be limited to the distance between optics and beam deflection along the optical axis, so that the device 98 moves, for example, the optics 64a-d together with the beam deflecting device in translation along the optical axis. The optical-to-beam deflection distance could be set to a minimum distance, so that the beam path of the channels is not laterally restricted by the segments of the beam deflection device 18, which reduces the overall height, otherwise the segments 68a-d would have to be dimensioned with respect to the lateral extent of the largest optical-to-beam deflection distance to the beam path not to cut. In addition, could the constancy of the relative position of the said frame, the optics and the beam deflecting device along the x-axis hard rigidly to each other, so that the device 94 would move the optics 64a-d together with the beam deflecting device in translation along the row direction of extension. Otherwise the segments 68a-d would have to be dimensioned with respect to the lateral extent of the largest optical-to-beam deflecting-distance so as not to cut the beam path. In addition, could the constancy of the relative position of the said frame, the optics and the beam deflecting device along the x-axis hard rigidly to each other, so that the device 94 would move the optics 64a-d together with the beam deflecting device in translation along the row direction of extension. Otherwise the segments 68a-d would have to be dimensioned with respect to the lateral extent of the largest optical-to-beam deflecting-distance so as not to cut the beam path. In addition, could the constancy of the relative position of the said frame, the optics and the beam deflecting device along the x-axis hard rigidly to each other, so that the device 94 would move the optics 64a-d together with the beam deflecting device in translation along the row direction of extension.
or ~ considering the deflected optical axis - perpendicular to the optical axis and the line extending direction. In addition, the described arrangement can cause perpendicular to the line extending direction of a translational motion of the fixed in the addressed frame Strahlumlenk means and the array 14, such as through the described actuator 98, which can be used for realizing a focusing and an auto-focus function.
Alternatively, or in addition to the rotational movement for obtaining a Biidstabilisierung along the second image axis and a iransfaforische Reiativbewegung between the image sensor 12 can be implemented and the array fourteenth This relative movement can be provided, for example, 98. By the device 94 and / or device.
The latter tasks could also be done from that processor or external. However, the processor could also be an external component to the ultiaperturabbildungsvorrichtung.
FIG. 21a illustrates that devices 1 1 of the previously described alternatives may be incorporated for example in a flat housing of a portable device 130 such as a mobile phone, a smart phone or media player or the like, then, for example, the planes of the image sensor 12 or the image sensor portions and the lens planes of the optics of the optical channels 16 perpendicular to the flat ER-
are stretching direction of the flat housing and oriented parallel to the thickness direction. In this way, the beam deflecting device would provide, for example, 18 that the total field of view of Multiaperturabbildungsvorrichtung 11 is located in front of a front face 102 of the flat housing, which also includes, for example, a screen. Alternatively, a deflection would be possible such that the visual field, is in front of a rear side of the flat housing, opposite the front 102nd The housing 22 of the device 130 or the device itself may be flat, as can be minimized by the illustrated position of the device 11 in the housing, the overall height of the device 11, which is parallel to the thickness of the housing. An ability to switch could also be provided, by a window provided on the side 102 opposite side, and for example, the beam deflecting device between two positions is moved by the latter is carried out, for example, as a forward and rear reflecting mirror and is rotated from one position to the other, or as a facet mirror having a set of facets for which a position and a different set of facets for the other position, wherein the facets rates are in rows extending direction side by side and is switched by translatory reciprocating movement of the beam deflecting device along the line extending direction between the positions. A shoring device 11 to another may not be a portable device such as a car, would of course also possible.
Mehrere Module 11 , deren Teilgesichtsfelder ihrer Kanäle das gleiche Gesichtsfeld vollständig und optional sogar in kongruenter Weise abdecken, können mit einem Basisabstand BA (vgl. Fig. 15) zueinander entlang einer für beide Module gleichen Zeilenerstreckungsrichtung in dem Gerät 130 verbaut sein, wie zum Beispiel zum Zweck der Stereo-skopie. Mehr als zwei Module wären ebenfalls denkbar. Die Zeilenerstreckungsrichtungen der Module 11 könnten auch nicht kollinear, sondern lediglich parallel zueinander sein. Es sei jedoch noch einmal erwähnt, dass, wie im vorgehenden erwähnt, auch eine Vorrichtung 11 bzw. ein Modul mit Kanälen so ausgestattet sein könnte, dass dieselben gruppenweise dasselbe Gesamtgesichtsfeld jeweils vollständig abdecken. Die Module können in einer/mehreren Zeile(n)/Reihe(n) oder an beliebiger Stelle der Vorrichtung angeordnet sein. Bei einer Anordnung mehrerer Module können diese gleich oder verschieden gebildet sein. Bspw. kann ein erstes Modul ausgebildet sein, um eine stereoskopische Erfassung des Gesamtgesichtsfeldes auszuführen. Ein zweites Modul kann ausgebildet sein, um eine einfache Erfassung, eine stereoskopische Erfassung oder eine Erfassung höhe-rer Ordnung auszuführen.
It should be noted that compared the beam deflection in alternative embodiments to the above-described embodiments also play on could be missing. When an only partial mutual overlap of the partial fields is desired, this could be achieved, for example, mutual lateral offsets between the center of the image sensor portion and the optical center of the optical system of the corresponding channel. The actuators shown in FIG. 20 could be applied, of course, still, wherein the substitute for the device 92, for example, the actuator 94 is in addition to a translational movement of the optics and of the support 66 in position.
show again embodied in other words, the above embodiments thus a Multiaperturabbiidungsvorrichtung single-spaced array of adjacent optical channels, in which extends somewhere to improve the stability in the beam path of the Multiaperturabbildungsvor direction an extending over the channels substrate such as glass or polymer. The substrate may additionally contain already on the front and / or back lenses. The lenses can be made of the material of the substrate (such as by Heizprägen created) or molded thereon. Before and after the substrate is further lenses on them, perhaps not on substrates and assembled individually. Several substrates in a structure be present both along and perpendicular to the line extending direction. It would be also possible here, one behind the other switch more substrates containing lenses along the optical paths, that is, they keep otherwise behind the other in a predetermined positional relationship to each other, such as without a joining would be necessary over a frame. In this way, stood for the provision and securing of lenses twice as many pages are available, such as carrier substrates ver-turns are, as a substrate 66, which according to the above examples with lenses can be populated exemplarily shown in FIG. 19b, and a substrate may also be assembled according to the above examples with lenses, that is, inter alia, with lenses that are mounted on the lens holder to the main sides 66a and / or 66b, but is exemplified herein as one piece by, for example, injection molding or the like so that lenses are formed on the two sides 66a and 66b, as well of course as the material of paralleiepipedförmigen substrate 66 would also be possible molded lenses other material as well as lenses on only one of the pages 66a or 66b. Both substrates are transparent and are penetrated by the beam paths, through the main sides 66a and 66b therethrough. Thus, the above embodiments can be in the form of a Multiaperturabbildungsvorrichtung implement, with one-line channel arrangement, each channel transmits a part of the visual field of a total field of view and that the partial fields of view partially overlap. A composition with more of such Multiaperturabbildungsvorrichtungen for stereo Trio, Quattro, etc. Constructions for 3D imaging is possible. The plurality of modules can be designed as a continuous line. The continuous line could use identical actuators and a common beam deflection. One or more may be in the beam path existing mechanically reinforcing substrates over the entire row, which can form a stereo, Trio, Quattro structure, extend. There can be used methods of the super-resolution, wherein a plurality of channels represent the same part of the image. The optical axes can already run without divergent beam deflection so that fewer facets are needed on the beam deflection. The facets then have only one angle component advantageously. The image sensor may be one-piece, only a coherent matrix of pixels or more have broken. The image sensor may be composed of many sub-sensors, which for example are arranged on a printed circuit board next to each other. An autofocus drive a focusing may be performed so that the Strahlumlenkeiement is moved synchronously with the optics or is dormant. In an absence of an on-off divergence it provide embodiments that the optical paths between the image sensor 12 and the Strahlumlenkeinricbtung 18 substantially or completely extend parallel. The image sensor may be composed of many sub-sensors, which for example are arranged on a printed circuit board next to each other. An autofocus drive a focusing may be performed so that the Strahlumlenkeiement is moved synchronously with the optics or is dormant. In an absence of an on-off divergence it provide embodiments that the optical paths between the image sensor 12 and the Strahlumlenkeinricbtung 18 substantially or completely extend parallel. The image sensor may be composed of many sub-sensors, which for example are arranged on a printed circuit board next to each other. An autofocus drive a focusing may be performed so that the Strahlumlenkeiement is moved synchronously with the optics or is dormant. In an absence of an on-off divergence it provide embodiments that the optical paths between the image sensor 12 and the Strahlumlenkeinricbtung 18 substantially or completely extend parallel.
may Fig. 21b shows a schematic structure comprising a first Multiaperturabbildungsvorrichtung 11 a and a second Multiaperturabbildungsvorrichtung 11b, as for example. in the apparatus 130 are arranged. The two Multiaperturabbildungsvorrichtungen 11 a and 1 1 b may form a common Multiaperturabbildungsvorrichtung 11 and have a common image sensor 12 and / or a common array fourteenth The single-line arrays 14a and 14b form eg. A common line in the common array 14. The image sensors 12a and 12b can form the common image sensor 12 and, for example, on a common substrate or on a common circuit board as a common circuit board or a common flexboard be mounted. Alternatively, the image sensors 12a and 12b may also comprise of mutually different substrates. Various mixtures of these alternatives are of course also possible, such as having Multiaperturabbildungsvorrichtungen comprising a common image sensor, a common array and / or a common beam deflection device 18 and other Multiaperturabbildungsvorrichtungen, the separate components. An advantage of a common image sensor, a common single-line array and / or a common beam deflecting device, that a movement of a respective component at a high precision by controlling a small amount of actuators can be obtained and can be reduced synchronization between actuators or avoided. Further, a high thermal stability can be obtained. Alternatively or additionally, further Multiaperturabbildungsvorrich-obligations to a common array, have a common image sensor and / or a common beam deflection. The structure of the device 1 Multiaperturabbildungsvorrich-1 may be used for a stereoscopic detecting a total or partial visual field eg., When optical channels of different sub-Multiaperturabbildungsvorrichtungen 11a and 11b are directed to an equal part of the visual field. In a similar manner, other part-Multiaperturabbildungsvorrichtungen can be integrated into the common Multiaperturabbildungsvorrichtungen so that a higher order detection is made possible compared to stereo. when optical channels of different sub-Multiaperturabbildungsvorrichtungen 11a and 11b are directed to an equal part of the visual field. In a similar manner, other part-Multiaperturabbildungsvorrichtungen can be integrated into the common Multiaperturabbildungsvorrichtungen so that a higher order detection is made possible compared to stereo. when optical channels of different sub-Multiaperturabbildungsvorrichtungen 11a and 11b are directed to an equal part of the visual field. In a similar manner, other part-Multiaperturabbildungsvorrichtungen can be integrated into the common Multiaperturabbildungsvorrichtungen so that a higher order detection is made possible compared to stereo.
Fig. 22 shows a 3D Mu! Tiaperturabbildungsvorrichtung 140 as embodiments described herein can be used in accordance with. It has an image sensor, as is indicated in Fig. 22, in two components 12 i and 12 1 can be divided, one component 12i optical for the "right" channels 16i and the other component 12 2 "Left" for the channels 16 Z . The right and left optical channels 16 1 and 16 222 are identically constructed, but offset by the base BA distance laterally in the example of Fig. spaced from each other in order to obtain as many depth information regarding the scene contained in the visual field of the device 140. For example, it may be formed 11 3D Multiaperturabbildungsvorrichtung by two or more multi-aperture illustration devices. The elements are provided with reference signs, which is provided at the first position from the left with an index 1, thus belonging to the first component 1 or a first module for the right channels, module 1, the device 140 and the elements, which are provided with a reference mark which is provided at the first position from the left with an index 2, thus belonging to the second component 2, or a second module for the left channel,
In the exemplary case of Fig. 22 each plurality 16i and 16 comprises two juxtaposed optical channels of four optical channels. The individual "right" Kanae-le are distinguished by the second subscript. The channels are in the process indexed from right to left. That is, the optical channel 16 ', which is not shown in Fig. 22 for a chosen for the purpose of clarity, partial removal, for example, along the base pitch direction 108 along which the left and right channels are arranged offset from each other under the base distance BA to each other, arranged at the rightmost edge, that is farthest from the plurality 16 2 left channels, the other right channels 16 2 - 16 14follow along the base pitch direction 108th The channels 16 - 18 M thus form a single-line array of optical channels, the rows extending direction of the base pitch direction corresponds to the 08th Likewise, the left channels 16 are 2 constructed. They also may be distinguished by the second subscript of each other. The left channels 16 2 - 16 24 are arranged side-by side and in the same direction successively as the right channels 16n - 16 i4 , namely so that the channel 16 2 i is the right channels at the next and the channel 16 2 4 am furthest away from the latter.
Each of the right channels 16n - 16 14 includes a corresponding optical system, which, as is indicated in Figure 22, may consist of a lens system.. Alternatively, each channel could comprise a lens. Each optical channel 16n - 16 i4 takes a up from the overlapping part of fields of view 74a-d of the total field of vision 72, which overlap each other, as described in connection with Figure 19a.. The channel 16n, for example, forming part of the visual field 74-n to an image sensor area 58n from, the optical channel 16 12 , the part field of 74 12 to an image sensor portion 58 12 , the optical channel 16 13 an associated portion of the visual field 74 13to a corresponding one in Fig. 22 is not visible image sensor portion 58 13 of the Biidsensors 12 and the optical channel 16i an associated portion of the visual field 74 14 to a corresponding image sensor region 58 14 which is also not shown in FIG. 22 because of masking.
In Fig. 22, the image sensor regions 58n are - 58 14 of the image sensor 12 or the component 12i of the image sensor 12 in a plane parallel to the base pitch direction BA or parallel to the line direction of extension 108, and at this level also lens planes of the optics of the optical channels are 16n - 16 14 parallel. In addition, the image sensor regions 58n are - 58 14 to each other arranged with a lateral inter-channel spacing 1 10, with which the optics of the optical channels 16 1 ( - 16 14 are arranged below one another in this direction, so that the optical axes and optical paths of the optical channels 16 n - 16 4 between the image sensor areas 58 r- 58 14 16i - 16n and the lenses 4 are parallel to each other. For example, centers of the image sensor portions 58 are 17 58 - 14 and optical centers of the lenses of the optical ports 16n - 16 14 on the respective optical axis, perpendicular to the aforementioned common plane of the image sensor regions 58 ne different overall visual field division for groups of channels but is also conceivable, as already mentioned above.
Finally, it is noted that the exemplary case has been taken up in the foregoing description is that the processor 112 fuses the images of the right channels. The same procedure could be performed by the processor 1 2 as mentioned above for both or all channel groups or for the left or the like.
Fig. 23a shows an embodiment of a Multiaperturabbildungsvorrichtung 150. When ultiaperturabbüdungsvorrichtung 150 may be, for example, to the Multiaperturabbildungsvorrichtung 1 1, 1000, 2000, 4000 or act 8000th Preferably, the image sensing areas 58a-d are arranged in a common plane, namely the image plane of the optical channels 16 and of those optics, in Fig. 23 this plane is exemplarily parallel to the plane defined by a z- and y-axis of a Cartesian coordinate system spanned, which is shown in FIG. 23 to simplify the following description, and designated by the reference numeral 1 15th
In a linear array of optical channels, the size expansion of the ul-tiaperturabbiidungsvorrichtung 150, as represented by the image sensor 12 and the optics 64 is limited in the downward direction, along the row direction of extension is greater than the diameter of a lens. The minimum expansion of ultiaperturabbiidungsvorrich-processing 150, as determined by the mutual arrangement of image sensor 12 to optics 64 along the z-axis, ie along the optical axis and beam paths of the optical channels 16a-d, it is determined, although smaller than the minimal dimension along the z-axis, but it is as a single-line array is greater than the minimum extent of the Multiaperturabbildungsvorrichtung in the z direction perpendicular to the line extending lateral direction y due to the configuration of the optical channels 16a-d.
As described above, are in the embodiment of Fig. 23a, the optical axes 17a-d prior to or without the deflection by the
Beam deflection device 18 and to, for example, the optics 64a-d parallel to each other, as shown in Fig. 23a, or they depart therefrom from only little. The corresponding thereto centered positioning of optics 64a-d and the image sensing areas 58a-d is easy to manufacture and low in terms of minimizing the construction period. would also that the partial fields which are covered by the individual channels 16a-d respectively mapped to the respective image sensing areas 58a-d, almost entirely overlap the parallelism of the beam paths of the optical channels due without further measures, such as namely the beam deflection, , To a greater total field of vision through the Multiaperturabbildungsvorrichtung 150 cover now be-is another function of the beam deflection device 18 therein,
For example, assume that the optical axes 17a-d of the optical paths of the optical channels 16a-d prior to or without the beam deflecting device 18 are parallel to each other or to a parallel alignment along the averaged across all channels orientation by less than one tenth of the minimum opening angle of the partial fields of view of the optical channels 16a-d differ. Without additional measures, then the partial fields overlapped mostly. The beam deflection device 18 of FIG. 23a, therefore, for each optical channel 16a-d comprising a Channel uniquely assigned reflective facet 68a-d, each of which is optically planar and are inclined towards each other, namely such that the partial fields of view of the optical channels in space and angularly less overlap, and for example, a total field of view to cover, which has an opening angle which is, for example, greater than 1, 5 times the öff-opening angle of the individual partial fields of view of the optical channels 16a-d. In the exemplary case of Fig. 23a, the mutual inclination of the reflecting facet 68a-d ensures, for example, that the actually linearly along the z-axis of adjacent optical channels 16a-d cover the whole field of view 72 according to a two-dimensional arrangement of the partial fields 74a-d ,
Considering in the embodiment of Fig. 23a, the angular deflection of the optical axes 17a-d of the optical channel 16a-d in the plane defined by the gemittel-th direction of the optical axis in front of the beam deflection and the average direction of the optical axis after the beam deflection is clamped, that in the zy plane in the example of Fig. 23a, on the one hand and in the plane enkung perpendicular to the latter plane and parallel to the average direction of the optical axis by Strahlum-!, on the other hand, this corresponds to example of Fig. 23a the exemplary case that the average direction of beam deflection of the y-axis.On average, the optical axes of the optical channels are thus deflected by 90 ° in the YZ plane about the z-axis, and on average, the optical axes are not tilted out of the yz plane.
It describes, for example, SSL the inclination angle of the facet 68a relative to the xz plane, as measured in the xy plane, that is, the tilt of the facet 68a ß about the z-axis with respect to the xz plane in which extend the optical axes 17a-d, = 0 ° ent-speak an orientation of the facet 68a parallel to the xz plane. It is therefore = 2 · ß \. Accordingly SSL defining the inclination angle of the facet 68a relative to a plane that includes the inclination SSL with respect to the xz plane and parallel to the z-axis as measured along the z-axis. It is therefore in accordance with c = 2 - .beta. χ . The same definitions should apply for the other channels: a x = 2 * ß x l = 2 ■ßi. For each optical channel of the angle may be larger than an inclination angle of inclination of the reflecting facet associated with that channel relative to the carrier substrate, through the run, the optical channels. Here, the carrier substrate may be positioned parallel to a line extending direction of the array 14 and the angle of incidence in a plane perpendicular to the line extending direction.
Fig. 23b-23e show side views of a beam bending apparatus according to one embodiment for example, four optical channels that are arranged linearly or on one side. The beam bending apparatus 18 of FIG. 23b-23e may be used as a beam bending apparatus of Fig. 19a, except that then the partial fields not as shown in Fig. Clockwise 3 19, 4, 2, 1 would cover the entire field of view, but in the clockwise direction according to the sequence 4, 2, 1, 3. the angles of inclination of the facets 68a-d 23b-e are shown in Fig.. They are distinguished by superscripts 1-4 from each other, and assigned to the respective channel, ß is here as well as SSL 0 °. The back side of the carrier substrate, ie, the side opposite to the provided with the Fa-cetten 68a-d surface is shown in Fig. 23b-23e shown with the 121st The proportion of the parallelepiped of the supporting substrate 123 forming material is located below the dashed line 125. It can be seen that the additional material that is added thereto little volume, such that an impression is facilitated.
The support substrate 123 is placed inclined at an angle with respect to the image sensor 12, namely the axis around which the average direction of the optical axes of the optical channels is deflected, that is, the z-axis in Fig. 23a. This angle ensures that the image sensor 12 facing surface of the Strahlumlenkvor direction 18 already causes a "coarse deflection" of the optical paths of the optical channels.
This means for the deflection of redirecting of the beam path of each optical channel through the beam bending apparatus 18 that the same are each based on the Anstellwin-angle and on the respective inclination of the associated optical channel reflecting facet relative to the carrier substrate 123 itself. These mentioned facet individual inclinations of facets 68a-d can be as just described by a tilt angle in the xy plane and an angle of inclination relative to the normal of the carrier substrate are disclosed in the plane perpendicular thereto 123rd It is preferred if that is true for each channel of angle a ° greater than the inclination, ie a ® >
for all channels. It is even more preferred when said inequality is already / met for a ° / 2, or even for a% 3. In other words, it is preferable if the angle of incidence compared to the angles of inclination of the facets 68a-d is large, so that the additional material 18 is small compared to a purely parallel-pipedförmigen shape of the beam bending apparatus. «°, for example, between 30 ° and 60 ° are both included.
The preparation of the beam bending apparatus 18 of FIG. 23b-23e may for example take place in that the additional material is molded by a molding tool onto the carrier substrate 123.. The carrier substrate 123 here could be, for example glass, while the molded additional material on polymer. Another possibility would be that the beam bending apparatus 18 of FIG. 23b-23e is integrally formed by injection molding or the like. The result is that the surface facing the image sensor surface of the beam deflecting device at least to the associated optical channels reflecting facets mirror. The carrier substrate can be rotatably mounted in rotation, as for example, in connection with FIG. 12b.
Some aspects of the previously described construction of Multiaperturabbildungsvorrich-obligations concerned quasi instantaneous setting a desired or before or at the time of recording an overall image, for example. The Multiaperturabbildungsvorrichtung 150 of FIG. 23a, for example, includes a processor, such as processor 1 12, the images that have been through the image sensing areas 58a-d for example, to record a same time, and that assembles with the aforementioned settings to an overall image, representing the scene in the overall field of view 72nd The algorithm of the processor used 1 12, the images which have been imaged by the optical channels 16a-d on the image sensor portions 58a-d and received by the latter to assemble, or to merge into the overall image, for example, is designed so that assumptions about compliance with certain parameters of the above components of Multiaperturabbildungsvorrichtung should be adhered to 150 so that the quality of the overall image meets a certain specification or algorithm can be applied at all. For example, the algorithm of the compliance of one or more of the following assumptions:
1) The optic-to-image sensor area distances along the x-axis are the same for all of the optical channels 16a-d;
2) The relative position of the partial fields 74a-d and in particular the overlap between the same corresponds to a vorbesti ' ned specification or differs from the latter by less than a predetermined maximum deviation from.
For various reasons, it may be now, however, that one or more of the just mentioned assumptions are not met or are not sufficiently met. Reasons for non-compliance can consist, for example in the non-observance of manufacturing variances, such as inaccuracies in the relative positions of the lenses 64a-d to one another and 12 relative to the image sensor fabrication inaccuracies can also inaccuracy of installing the Spiegelumlenkvorrichtung 18 and possibly the each other comprise relative positions of the facets 68a-d when the Strahlumienkein direction 18 has facets 68a-d. Additionally or alternatively to the manufacturing tolerance variations in temperature can ensure that one or more of the above assumptions do not apply or is not sufficiently respected.
To a certain extent the operation performed by the processor 1 12 algorithm for joining or fusion of the images of the image sensing areas 58a-d to the overall image can, if necessary, to compensate for deviations from an optimal alignment and arrangement of the components, such as deviations of the positions of the partial fields 74a -d within the overall field of view 72 to each other by a predetermined constellation of relative positions of the partial fields. When joining or fusing the images, the processor 1 12 may compensate for such deviations, for example, to a certain extent. When exceeding certain limits, however, deviation (non-compliance with the assumption 2) would, for example, the processor 112 will not be able to compensate for the deviations.
A production of the ultiaperturabbildungsvorrichtung 150 so that the just mentioned assumptions are always met, such as a certain Temperaturbe-rich away, but tends to increase manufacturing costs of Multiaperturabbildungsvorrich-tung 150th To avoid this, 23a comprises the Multiaperturabbildungsvorrich-tung 50 of FIG. A setting means 116 for channel-changing a relative position between the image sensor 58i of a respective optical channel 16i, optics 64i of the respective optical channel 161 and the beam deflection 18 and of the corresponding segment 68i same or channel-changing an optical property 16i, or an optical property of the deflection of the beam path of each optical channel such segment 68i of Strahlum-ienkeinrichtung 18. The adjustment means 1 16 is driven by default values or performs setting tasks in accordance with the default values by. These are provided by a memory 1 18 and / or a controller 122, which will be explained in the following.
The device 150 for example has a memory 18 1 with stored set values for channel-specific control of the setting means 1 16. The default values may be factory-set and stored in the memory 1 eighteenth In addition, the processor 1 12 may, for example, as is indicated in Fig. 23a with a dashed line 124, to merge on evaluations of captured images, the image sensor sections 58a-d, such as images that merge from the processor 112 and to a total image are to be able to improve the eingespei-cherten default values in the memory 118 or update. For example, the processor 1 12 receives a scene, by the Multiaperturabbildungs device 150 is set through the setting means 1 6 with the stored current default values, as will be described hereinafter in more detail. For this, the standard values from the memory 1 are read 18 and used by the Einstelleinrich-device 1 16 to the channel-associated setting. The processor 1 12 wins by analysis of the captured images as the image sensor sections 58a-d information DAR
about how the saved and just used for receiving default values should be modified in the memory 1 18 to carry on the next recording using this improved or updated default values for the next recording to a more accurate and improved compliance with the above assumptions.
The stored preset values may have a full set of adjustment values, that is, a set of set values, to completely stop the apparatus 150th They are selected as described above and further below to reduce specific channel-specific deviations of the optical properties of the channels from a desired characteristic or eliminate
It may be that the default values of a plurality of sets of setting values such as per a series of adjoining temperature intervals have one, so that an image is always of the set is used by setting values that is just suitable for a current situation. For this example, the controller may access or a look-up in the table of correspondences between set value and sets the discriminated predetermined situations in memory 1 18 122. The controller 122 receives for this access sensor data reflecting the current situation, such as data on temperature, pressure, humidity, position of device 150 in space and / or a current acceleration or instantaneous rotation rate of the device 150, and determines from this data a default value from the plurality of records in the memory 1 18, namely those associated with the predetermined situation which is the current situation, as described by the sensor data at the next. Sensor data can be recovered from the image sensor data Biidsensorbereiche itself. For example, a set is selected by the controller 122, in its associated temperature range the current temperature falls. The default values of the selected set from the memory 118 used for a particular image pickup by the setting means 1 16 may be updated again if the optional feedback is used 124th as described by the sensor data comes closest. Sensor data can be recovered from the image sensor data Biidsensorbereiche itself. For example, a set is selected by the controller 122, in its associated temperature range the current temperature falls. The default values of the selected set from the memory 118 used for a particular image pickup by the setting means 1 16 may be updated again if the optional feedback is used 124th as described by the sensor data comes closest. Sensor data can be recovered from the image sensor data Biidsensorbereiche itself. For example, a set is selected by the controller 122, in its associated temperature range the current temperature falls. The default values of the selected set from the memory 118 used for a particular image pickup by the setting means 1 16 may be updated again if the optional feedback is used 124th
The stored specifications values can for example be formed such that a measure of a dispersion of a distribution of one or more characteristics among the optical channels by the actuation of the adjusting device is reduced by means of the stored specifications values, namely a transverse deviation of the Teilge-sichtsfeider of a regular distribution the partial fields of view, focal lengths of the lenses, or depth of focus distances of the optical channels.
Alternatively, the default values could be determined in the controller 122 without a memory 118, namely, by a mapping of the current sensor data to appropriate default values is permanently integrated for example in the control 122nd The illustration can be described by a functional relationship between the sensor data and default values. The functional relationship could be adapted by parameters. The parameters could be adapted via the feedback 124th
The memory 118 may be, for example, a non-volatile memory. Possibly it is a read-only memory, but a rewritable memory is also possible. The controller 122 and the processor 1 12 may be implemented in software, hardware or programmable hardware. It may be running on a common microprocessor programs. The sensors for supplying the sensor data for the controller 122 may include the device 150, such as the image sensor regions, or be external components, such as components of the equipment in which the device is incorporated, as will be explained with reference to subsequent figures.
Below are now possible configurations for the setting means 116 be-written. The setting means 116 of FIG. 23a can in this case, apply to one or more or all of the variant embodiments described below. To particular combinations are also discussed below.
In the variant shown, the adjustment means 116 comprises for example an actuator 126i for each channel 16L of the optical system 64i of the corresponding channel 16i in the axial direction along the optical axis 17i and along the beam path and / or transversely, or transversely thereto along the z-axis and / or the y-axis moves. Alternatively, the actuator could 126i for example, the image sensor 12 or a single image sensor portion 58i move. In general, the actuator could cause 126i relative movement of image sensing area 58i, 64i optics and / or the corresponding segment 64i of the beam deflecting 24th
Alternatively or additionally, the phase-changing optical element 128i causes a change in the form of an optically active surface, such as through the use of piezoelectric elements, which act mechanically in a flexible, solid, transparent materials and cause deformation or by utilizing the electrowetting effect. The phase change element 128i "could change the refractive index of the optical system 64i, for example. Alternatively, the phase change element 128i" change a form of an optical lens surface of the optics 64i, thus changing the effective refractive power of the lens system 64i. The phase change element 1281 "" could, for example, on an optical surface of the relevant segments 68i, such as produce on the reflective facet, a sinusoidal phase grating, to cause a virtual tilting the corresponding surface. Similarly, the phase change element 128i 'or Phasenänderungseiement 1281 may "deflect the optical axis.
In other words, the phase change caused by the phasenän--promoting optical element 1281 may largely rotationally symmetrical, such as rotationally symmetrical be about the optical axis 17i, and thus in the case 128i ", for example, a change in the focal length of the optics 64i cause . the phase change caused by the element 128i, but may also be substantially linear, such as linear along the z-axis or linearly along the y-axis to a change of the deflection angle and deflection of the optical axis 17i in the to effect corresponding direction.
The rotationally symmetrical phase change can be used for focusing, and the linear phase change for correcting the position of the sub-field of view of entspre-sponding optical channel 16i.
According to another variant, shown in Fig. 24b Einstelleinrich-device 1 16 includes an actuator 132i, the 16i, the segment 68Ϊ, such as the reflective facet of the respective channel for each channel 161, in its angular orientation relative to the optical see axis 17i changes, that is, the angle ß x l . It should be noted that the segment 68i not limited to a reflective facet. Each segment 68! could also be formed as a prism, which deflects the direction of the optical axis 17i in the yz plane, while the prism is traversed by the beam path of the optical channel 16i.
To realize the relative movements by the actuators 1261 and 132i, that is to produce the movement of the optic 68i, which may for example be carried out in translation, as well as for tilting the segment 68i by the actuator 132] and the z-axis, for example, a pneumatic , hydraulic, piezoelectric, thermal, electrostatic or electro-dynamic drive or a DC or stepper motor or again a moving coil drive to be used.
Returning to Fig. 23a is indicated by dashed lines that the ultiapertur imaging device 150 optionally in addition to the setting device 1 16 one or more actuators 134 for generating a channel global, that is the same for all optical channels 16a-d, relative movement between the image sensor 12, optics array 14 and Strahium steering means 18 may include. The one or more additional actuators 134 may / may thereby, as is indicated in Fig. 23a, part of an optional existing auto focus control 136, (focusing means), and / or an optionally provided image stabilization control of the ultiaperturabbildungsvorrichtung.
A concrete example of a supplemented by an additional actuating device 150 of FIG. 23a is shown in Fig. 25. Fig. 25 shows the ultiaperturabbildungsvorrichtung 150 of FIG. 23a, the optics 64a-d of the optical channels 6a-d on the joint carrier 66 are fixed to each other mechanically. Beyond this common holder, it is now possible to subject the lenses 64a-d global an equal for all channels movement, such as by a translatory movement of the carrier 66 in the z-direction, ie, 14 along the row direction of extension of the array is this purpose, a actuator 134a provided. The actuator 134a thus generates a translational movement of the lenses 64a-d, which is equal for all the optical channels 16a-d by the actuator 134a undergoes the common carrier 66 the translational motion along the x-axis. With regard to the type of actuator 134a is made to the Examples, has been to the number references pointed to FIGS. 24a and 24b. Further, the apparatus 150 includes an actuator 134b for global channel, that is the same for all optical channels 16a-d, changing of the image sensor 58i-64i-to-optical distance along the x-axis or along the optical axis 17i. As is indicated in Fig. 25, for example, subjecting the actuator 34b, the optics 64a-d of the translational movement along the z-axis to change the distance of the 17i along the optical axis. As is indicated in Fig. 25, for example, subjecting the actuator 34b, the optics 64a-d of the translational movement along the z-axis to change the distance of the 17i along the optical axis. As is indicated in Fig. 25, for example, subjecting the actuator 34b, the optics 64a-d of the translational movement along the z-axis to change the distance of the
associated Büdsensorabschnitten 58a-d do not have the support 66, but also via the actuator 134a, which is thus also subjected to the translational movement along the x-axis and serves as a kind of suspension for the carrier 66th
Additionally, the apparatus 150 of FIG. 26 includes an actuator 134c for rotating the Strahiumlenkeinrichtung 18 about an axis that is parallel to the z-axis and is not far away from the plane in or in which extend the optical axes 17a-d. Also with respect to the actuators 134b and 134c regarding possible examples of implementations, reference is made to the list of examples, reference was supplied Referring to FIGS. 24a and 24b above. The rotational motion or rotary motion is exerted by the actuator 134c to the Strahiumlenkeinrichtung 18, affects the segments 68a-d of the Strahiumlenkeinrichtung 18 for all the channels 16a-d of equal, that is, channel globally.
Via the actuator 134b auto focus control 136 is now, for example in a position by means for controlling the focus of a recording by the apparatus 150 of the channels 6a-d in the channel giobalen sense. The image stabilization controller 138 is able to stabilize the overall field of view 72 by means of the actuator 134c in a first direction 142 and by means of the actuator 34a in a direction perpendicular thereto 144 Camera shake by a user, for example. The first direction 142 can be obtained through a rotational movement about the axis of rotation 44th As is indicated by the first direction 142 ', alternatively or additionally, a translational movement of the Strahiumlenkeinrichtung 18 and / or the array can be generated by the actuator 14 134th The directions 142, 142 ' and 144 may in this case be parallel to the Bildach-sen in a plane direction or corresponding thereto. Image stabilizers described herein can be designed to work together for two, a plurality or all of the optical paths of the optical channels. That is, on a channel-individual image stabilization may be omitted, which is advantageous.
For example, to the apparatus 50 of Fig. 23a for each channel 16a-d an actuator, such as an actuator 126i on each channel 16i to the image sensing areas 58a-d channel individually a translational movement along the z-axis and / or along the y subjecting axis, for example, Hersteilungsungenauigkeiten or temperature-induced drifts of the partial fields of view within the overall field of view to be compensated for. The device 150 of FIG could alternatively or additionally comprise an actuator 128i "to focal length differences of the optical systems 64a-d, of the preparation, desirably have occurred un-, compensate. 23a. In addition, or alternatively, the device can 150 of FIG. 23a an actuator 128i '" respectively, to each other to compensate for temperature-induced or hersteliungsbedingt resultant deviations of the relative inclinations of the segments 68a-d so that the relative inclinations of the gewünsch-th coverage of the overall field of view perform the partial fields 74a-d 72nd Additionally or alternatively, the device may finally 150 then comprise actuators of the type 128i 'and 128i "'.
Once more in summary, the apparatus 150 can therefore an actuator 134c aufwei-sen, which is formed by 18 to rotate the beam deflection about an axis that is parallel to the line extending direction z of the array fourteenth The axis of rotation is for example in the plane of the optical axes 17a-d or removed less than a quarter of a diameter of the optical systems 64a-d. Alternatively, it would also be possible, of course, that the rotation axis is located farther away, such as less than an optical diameter or less than four optic diameter. The actuator 34c may be, for example, provided to the beam deflection device 18 with a short response time, only in a small angular range, such as to rotate, for example, within a range of less than 5 ° or less than 10 ° to shake the MultiaperturabbiJdungsvorricbtung offset by, for example, a user during a recording 150th The actuator 134c Wür-de be driven in this case, for example, by the image stabilization control 138th
Alternatively or additionally, the actuator could be formed 134c to larger angular displacements the total field of vision 72, by the total coverage of the Teilge fields of view 74a-d (Fig. 23a) is defined to change in its direction. It would also be possible that 18 also distractions be achieved by rotation of the Strahiumlenkeinrichtung in which the total field in the opposite direction is arranged relative to the apparatus 150, for example, the Strahiumlenkeinrichtung 18 is formed as a double-sided reflective mirror array.
Again, alternatively or additionally, the device 150 may include an actuator 134a, which is formed to the optics 64a-d by means of the substrate 66 or the substrate 66 itself and thus to move the optics 64a-d in translation along the row direction of extension. The actuator 134a for example, could also be driven by the vorer--mentioned image stabilization control to the movement 96
to achieve along the line extending direction of an image stabilization transverse to the image stabilization, which is implemented by the rotation of the Spiegelumlenkvorrichtung 18th
Furthermore, the device may additionally or alternatively compare 150 having an actuator 34b for locking-change the image-side distance between image sensor 12 and optics 64a-d or between image sensor 12 and body 66 to provide a depth-setting. Fig. 20. The means 98 may be controlled by manual user control or by an autofocus control of the device 150.
The actuator 134a thus serves as a suspension of the substrate 66 and is preferably, as shown in Fig. 23a indicated disposed laterally next to the substrate 66 along the row direction of extension, so as not to increase the height. also applies to the actuators 134b and 134c that the same are preferably arranged in the plane of the optical beam paths in order not to increase the height.
It should be noted that the lenses 64a-d not only with each other, such as may be mounted on the already mentioned transparent substrate but also relative to the beam deflection in a constant relative position, such as not an appropriate framework, preferably the height increases and therefore preferably extends in the plane of the components 12, 14 and 66 or in the plane of the beam paths. The constancy of the relative position could be limited to the distance between optics and beam deflection along the optical axis, so that the actuator 34b, for example, the optics 64a-d together with the beam deflection device 18 in translation along the optical axes are moved. The optical-to-beam deflection distance could be set to a minimum distance, so that the beam path of the channels is not laterally restricted by the segments of the beam deflection device 18, which reduces the overall height, otherwise the segments would have to be 68i dimensioned with respect to the lateral extent of the largest optical-to-beam deflecting-distance so as not to cut the beam path , In addition, the constancy of the relative position could mean that the said frame supports the optics and the Strahlumienkeinrichtung along the z-axis rigidly to one another so that the actuator 134 would move the optics 64a-d together with the Strahlumienkeinrichtung translationally along the row direction of extension. Otherwise the segments 68i would have to be dimensioned with respect to the lateral extent of the largest optical-to-beam deflecting-distance so as not to cut the beam path. In addition, the constancy of the relative position could mean that the said frame supports the optics and the Strahlumienkeinrichtung along the z-axis rigidly to one another so that the actuator 134 would move the optics 64a-d together with the Strahlumienkeinrichtung translationally along the row direction of extension. Otherwise the segments 68i would have to be dimensioned with respect to the lateral extent of the largest optical-to-beam deflecting-distance so as not to cut the beam path. In addition, the constancy of the relative position could mean that the said frame supports the optics and the Strahlumienkeinrichtung along the z-axis rigidly to one another so that the actuator 134 would move the optics 64a-d together with the Strahlumienkeinrichtung translationally along the row direction of extension.
The Strahlumienkeinrichtung 18 described above for deflecting the beam path of the optical channels enables together with the actuator 134c to generate the rota
tion movement of the beam deflection device 18 and the actuator 134a of an optical image stabilization control of the uitiaperturabbildungsvorrichtung 150 an image or the total image field stabilization in two dimensions, namely by the translational movement of the substrate 66, an image stabilization along a first image axis extending in the We-sentlichen parallel to the line extending direction, and by the generation of the rotational motion of the beam deflection device 18, an image stabilization along a second image axis which is substantially parallel prior to the optical axes and without beam deflection, or - considering the deflected optical axes -senkrecht to the optical axes and the line extending direction.In addition, the described arrangement can cause perpendicular to the line extending direction of a transiatorische movement of the fixed in the mentioned frame beam deflecting device and the array 14, such as through the described actuator 54, which can be used for realizing a focusing and an auto-focus function.
Fig. 26 shows a schematic view of a Multiaperturabbildungsvorrichtung 180 to illustrate one advantageous arrangement of actuators, such as for image stabilization and / or for adjusting a focus. When Multiaperturabbildungsvorrichtung 180 may be, for example. The ultiaperturabbildungsvorrichtung 11, act 150, 1000, 2000, 4000 or 8000th The image sensor 12, the array 14 and the beam deflecting device 18 may span a cube in space. The box can also be understood as a virtual square, and may, for example a minimum volume, and in particular a minimal vertical extension along a direction parallel to the y-direction and a thickness direction, and comprise the image sensor 12, the one-line array 14 and the beam deflecting 18th The minimum volume can also be understood as it describes a cuboid, which is spanned by the arrangement and / or proper operation of movement of the image sensor 12 of the array 14 and / or the beam deflecting 18th The array 14 may comprise a line extending direction 146 along which the optical channels 16a and 16b are next to each other, possibly parallel to each other. The row direction of extension 1 6 may be arranged fixedly in space.
The virtual square may have two sides aligned oppositely parallel to each other, parallel to the line direction of extension 146 of the one-line array 14 and parallel to a portion of the beam path 17a and / or 17b of the optical channels 16a and 6b between the image sensor 12 and the beam deflection 18 are. Simplified, but without limitation, this can, for example, a te Obersei- and be a bottom of the virtual cuboid. The two sides can span 148b a first plane 148a and a second plane. That is, the two sides of the cuboid may be 148a and 148b each part of the plane. Other components of the Mul-tiaperturabbildungsvorrichtung can completely, but at least partially within the area between the planes 148a and 148b may be arranged, so that an installation space requirement of the Multiaperturabbildungsvorrichtung 180 along a direction parallel to a surface normal of the levels 148a and / or 148b is low, which is advantageous. A volume of the ultiaperturabbildungsvorrichtung can have a low or minimum space between the planes 148a and 148b. Along the lateral sides or extending directions of the planes 148a and / or 148b, a space of Muf-tiaperturabbiidungsvorrichtung can be large or arbitrarily large. The volume of the virtual cube is, for example, by an arrangement of the image sensor 12, the single-line array 14 and the beam deflecting device 18 affects the arrangement of these components can be made in accordance with the embodiments described herein as that the installation space of these components along the direction perpendicular to the planes, and thus the spacing of the planes 148a and 148b to each other is small or minimal. Compared to other arrangements of the components, the volume and / or the distance on the other side of virtual rectangular parallelepiped may be increased.
The ultiaperturabbildungsvorrichtung 180 comprises an actuator device 152 for generating a relative movement between the image sensor 12, the single-line array 14 and the beam deflecting device 18. The actuator device 152 is at least partially disposed between the planes 148a and 148b. The actuator device 152 may be configured to at least one of the image sensor 12, the single-line array 14 or 18 Strahiumlenkeinrichtung rotationally about at least one axis and / or translate along one or more directions or to move. For this purpose, the actuator device 152 may comprise at least one actuator, such as the actuator 128i, 132i and / or 134, the channel-changing a relative position between the image sensor 58i of a respective optical channel 161,
The actuator device 152 may have a dimension or extension 154 parallel to the thickness direction. A proportion of at most 50%, at most 30% or at most 10% of the dimension 154 may extend starting from a region between the planes 148a and 148b above the plane 148a and / or 148b or protrude from the area. This means that the actuator device 152 at most slightly protrudes above the plane 148a and / or 148b. According to embodiments, the actuator device 152 does not extend over the plains 148a and 148b out. is advantageous because an expansion of the Multiaperturabbildungsvorrichtung 180 along the thickness direction by the actuator device 152 is not increased.
The devices 20, 30, 40, 50, 60, 70, 90, 100 and / or 140 described above can be referred to as imaging systems.
Although some aspects related to a device have been described, it should be understood that these aspects also represent a description of the corresponding method, so that a block or component of a device is also to be understood as a corresponding method step or a feature of a method step. Analogously, aspects described in connection with or as a method step also represent a description of a corresponding block or details or feature of a corresponding apparatus.
The embodiments described above are merely illustrative of the principles of the present invention. It is understood that modifications and variations of the arrangements and the details described herein will be apparent to others skilled. Therefore, it is intended that the invention be limited only by the scope of the following claims and not by the specific details presented herein with reference to the description and explanation of the embodiments.
claims
Multiaperturabbsldungsvorrichtung (1: 1; 150; 180; 1000; 2000; 4000; 8000) comprising:
at least one image sensor (12); and
an array (14; 14 ') of adjacent optical channels (16a-d; 16N), each optical channel optics (64a-d) for imaging at least a partial region (74a-d) of an object region (72) onto an image sensor region (58a-d) of the image sensor (12), wherein the array (14; 14 ') comprising:
a housing (1002) comprising facing an image sensor (12) or remote from the wall structure (1004, 1004a-b), through which the optical channels, and a wall structure (1004; 1004a-b) disposed sides tenwandstruktur (1006 ; 1006a-b), wherein the wall structure (1004; 1004a-b) or the side wall structure (1006), ceramic, glass ceramic or crystalline material is 1006a-b comprising glass formed, the optics (in the case (1002) 64 -d) of the optical channels (16a-d are disposed 16N), and wherein the wall structure (1004, 1004a-b) (with lenses 64a-d) of the optical channels (16a-d is connected 16N), and the optics (64a-d) fixed to each other.
Multiaperturabbildungsvorrichtung according to claim 1, wherein the housing (1002) of each plate-shaped structures clips (1004, 1006; 1004a-b, 1006a-b) is formed and at least the wall structure (1004; 1004a-b) and at least the side wall structure (1006; 1006a-b) having.
Multiaperturabbildungsvorrichtung (1: 1; 150; 180; 1000; 2000; 4000; 8000) comprising:
at least one image sensor (12); and
an array (14; 14 ') of adjacent optical channels (16a-d; 16N), each optical channel (16a-d; 16N) an optic (64a-d) for imaging at least a partial region (74a-d) of a an image sensor area object region (72) (58a-d) of the image sensor (12);
wherein the array (14; 14 ') comprises a housing (1002), in which the optical systems (64a-d) of the optical channels (16a-d; 16N) are arranged and fixed against one another, wherein the housing (1002) assembled from one another plate-like structures (1004; 1004a-b, 1006; 1006a-b) is formed and at least one image sensor (12) facing or facing away from the wall structure (1004, 1004a-b) and at least a side wall structure (1006; 1006a-b) having.
Multiaperturabbildungsvorrichtung according to claim 3, wherein at least one of the plate-shaped structures (1004; 1004a-b, 1006; 1006a-b) comprising, ceramic, glass ceramic or crystalline material is formed of glass.
Multiaperturabbildungsvorrichtung according to one of the preceding claims, in which the wall structure (1004; 1004a-b) on all the optical channels (16a-d: 16N) and designed to be transparent for a wavelength of a to be detected by the Multiaperturabbildungsvorrichtung radiation, wherein the optical channels by a material of the wall structure (16a-16N d) (1004; 1004a-b) extend therethrough.
Multiaperturabbiidungsvorrichtung according to one of the preceding claims, wherein the wall structure 16N; (1012a-b) are (1004 1004a-b) optical diaphragms arranged, which are adapted to a beam path (17a-d) of the optical channels (16a-d ) to limit perpendicular to a path of the beam path (17a-d) along a direction (6: 1).
Multiaperturabbildungsvorrichtung according to one of the preceding claims, wherein the wall structure; is formed in one piece (1004 1004a-b).
Multiaperturabbildungsvorrichtung according to any one of the preceding claims, wherein the optics (64a-d) of the optical channels (16a-d; 16N) to the wall structure (004; 1004a-b) are connected mechanically and in which the wall structure (1004; 1004a-b ) has a transparent portion (1014a-b) from a wall structure material, wherein the optical channels (16a-d; 16N)) look (through the transparent portion 1014a-b toward the image sensor (12) or towards the object area (72) ,
Multiaperturabbildungsvorrichtung according to one of the preceding claims, wherein the wall structure (1004; 1004a-b) is a first wall structure (1004a), and wherein the housing (1002) has an opposite second wall structure (1004b) of the housing (1002), wherein the an entrance side of optical paths (17a-d) first wall structure (1004a) of the optical channels (16a-d; 16N), wherein the second wall structure (1004b) an exit side of the beam paths (17a-d) of the optical channels (16a-d; 16N) and wherein the first wall structure (004a) and the second wall structure (1004b) on the side wall structure (1006, 1006a-b) of the housing (1002) are connected with each other.
Multiaperturabbildungsvorrichtung gemäß einem der vorangehenden Ansprüche, bei der die Wandstruktur (1004b) eine erste dem Bildsensor (12) zugewandte Wandstruktur ist, und bei der das Gehäuse (1002) eine gegenüberliegende zweite Wandstruktur (1004a) aufweist, die über die Seitenwandstruktur (1006; 1006a-b) mit der ersten Wandstruktur (1004b) verbunden ist, und bei der die Seitenwandstruktur (1006; 1006a-b) in einem Bereich, der dem Bildsensor (12) zugewandt angeordnet ist, eine optisch teilweise streuende oder teilweise absorbierende oder teilweise reflektierende Struktur (1018; 1018a-b) aufweist.
Multiaperturabbildungsvorrichtung according to one of the preceding claims, wherein the array (14; 14 ') (, 1016C 1016b) includes partition structures between the optical channels (16a-d; 16N) are arranged and are formed of an at least partially opaque material, so that a stray light rejection between the optical channels (16a-d; 16N) is obtained.
Multiaperturabbildungsvorrichtung one of the preceding claims, wherein in the housing (1002) between the optical channels (16a-d; 16N) according partition structures (1016a-c) are arranged, wherein the optics (64a-d) relative to (an adjacent baffle structure 1016a- c) are arranged without contact.
Multiaperturabbildungsvorrichtung according to claim 1 1 or 12, wherein the partition structures (1016; 1016a-c; N) consist of a different material than the sidewall structures (1006; 1006a-d).
having mechanical guides (1038), which are designed to support the bulkhead structures (1016a-c) mechanically; 14 Multiaperturabbildungsvorrichtung according to one of claims 1 1 to 13, wherein the side wall structure (1006a-b 1006).
having the; 15 Multiaperturabbildungsvorrichtung according to any one of claims 11 to 14, wherein the partition structures (1016a-c) that faces in a the image sensor (12) region, a partial optical scattering or partially absorbing or partially reflecting structure (1018a-b 1018) is formed to an optical channel (16a-d; 16N) laterally exiting in a first peripheral light incident on the optical part diffusing or partially absorbing or partially reflecting structure (1018, 1018a-b) is true, in a second, lesser to scatter toward the periphery at least one image sensor (12) or reflecting.
16. ultiaperturabbildungsvorrichtung according to one of the preceding claims, wherein the side wall structure (1006; 1006a-b) of the housing (1002) in an image sensor (12) facing the region of adjacent optical channels (16a-d; 16N) is a partial optical scattering or partially absorbent or partially reflecting structure (1018, 1018a-b) which is adapted to (from an optical channel 16a-d in a first circumferential laterally escaping light (on the partial optical scattering or partially absorbing or partially reflecting structure 1018 ; 1018a-b) is true, in a second, lesser extent toward the diffusing at least one image sensor (12) or reflecting.
17. Multiaperturabbildungsvorrichtung according to one of the preceding claims, wherein the optics (64a-d) in the case of a thermally induced deformation along an optical length (1024) of the optical channel deform and along a direction (146) perpendicular to the optical length (1024) deform the optical channel, each optical channel (16a-d; 16N) of the deformation in the direction (146) perpendicular to the optical length (1024) of an adjacent optical channel (16a-d; 16N) is unaffected.
18. Multiaperturabbildungsvorrichtung according to any one of the preceding claims is formed in which an optical channel (16a) to a first portion (74a) of the object region (72) to a first image sensor portion (58a) and a second portion (74b) of the object region (72 ) (on a second image sensor portion 58b) map, and wherein (between the first image sensor portion 58a) and the
second image sensor portion (58b) has an at least partially opaque structure (1032) to reduce stray light between the first image sensor portion (58a) and the second image sensor portion (58b) is arranged.
Multiaperturabbildungsvorrichtung according to claim 18, wherein the at least partially opaque structure (1032) along a said image sensor (12) facing away from the direction (x) is tapered.
Multiaperturabbildungsvorrichtung according to one of the preceding claims, wherein the wall structure (1004; 1004a-b) is a first wall structure (1004a), and wherein a distance between the first wall structure (1004) and an opposing second wall structure (1004b) of the housing (1002 ) is defined via a maximum of two side wall structures (1006a-b).
21. Multiaperturabbildungsvorrichtung construed in accordance with environmentally one of the preceding claims, a plurality of serially arranged wherein one of the lenses (64a-d) optical elements, which are interconnected mechanically, so that the optical system along a direction perpendicular to a Strahiengang (17a-d) through the optics (64a-d) and along a line extending direction (146) of the array (14; 14 ') in a range of at least 50% of a length (1024) of the optical channel (16a-d; 16N) thereof along an optical axis are non-contact arranged opposite to the other mechanical elements.
have Multiaperturabbildungsvorrichtung according to any one of the preceding claims, wherein the optics (64a-d) comprises a first and a second optically active main side (1026) and a first, second, third and fourth minor sides (1028a-b) that the first and second Home connect with each other (1026), wherein the first, second, third and fourth minor sides (1028a-b) are arranged perpendicular to each other substantially.
Multiaperturabbildungsvorrichtung according to claim 22, wherein the optics (64a-d) have a rectangular cross-section.
24. Multiaperturabbildungsvorrichtung according to any one of the preceding claims with a Strahlumienkeinrichtung (18) between the array (14; 14 ') is formed and the Obwalden jektbereich (72) is arranged, and to a beam path (17a-d) of the optical channels (16a-d; 16N) to deflect.
25. Multiaperturabbildungsvorrichtung according to claim 24, wherein the beam deflecting device (18) having a first position and a second position between which the beam deflecting device (18) is movable rotationally or translationally, wherein the beam deflecting device (18) is adapted to in the (17a-d) first position and the beam path in the second position of each optical channel (16a-d; 16N) to deflect in a direction different from each other (19a-b).
26 ultiaperturabbildungsvorrichtung according to claim 25, wherein the beam deflecting device (18) comprises a first main side and a second reflecting reflective page, wherein in the first position, the first reflecting face is disposed facing a Büdsensor (12) and two in the second position te reflective side is disposed the image sensor (12) faces.
27 Multiaperturabbildungsvorrichtung according to claim 24 to 26, wherein the beam deflecting device (18) as an array of facets (68a-d; 68i), the stretching direction along a Zeilener- (z; 146) of the array (14; 14 ') of optical channels ( 16a-d; 16N) are arranged, is formed, and is associated in each optical channel having a facet.
28 Multiaperturabbildungsvorrichtung according to any one of claims 24 to 27, wherein the beam deflecting device (18) as an array of facets (68a-d; 68i) formed along egg ner Zeiienerstreckungsrichtung (z; 146) of the array (14; 14 ') of optical channels
(16a-d; 16N) are arranged, is formed, and in which a first beam path (17a) of a first optical channel (16a) and at least a second beam path (17b) of a second optical channel (16b) of a facet (68a-d ) assigned.
29 Multiaperturabbildungsvorrichtung according to claim 27 or 28, wherein a beam path (17a) of a first optical channel (16a) to a first portion (74a) and a Strahiengang (17b) of the first optical channel (16a) to a second partial region ( 74b) are deflected by the same facet (68a-d).
30 Multiaperturabbildungsvorrichtung according to any one of the preceding claims, further comprising a two, a plurality or all of the beam paths (17a-d) of the optical channels (16a-d; 16N) co-acting optical image stabilizer (94; 134, 138; 152) for image stabilization along a first image axis (4: 1) and a second imaging axis (142) by generating a translatory relative movement (96) between an image sensor (12) and the array (14; 14 ') or a Strahlum- steering device (18) for deflecting the beam paths of the optical channels (16a-d;
16N), the translational motion (parallel to a first image axis 144) and a second Büdachse (142) of an image captured by the Multiaperturabbiidungsvorrichtung extends .;
31 ultiaperturabbildungsvorrichtung according to claim 30, wherein the relative movement (96) is provided by actuators, which is adapted to move the image sensor (12) relative to the housing (1002) or the housing (1002) with respect to the image sensor (12) to move.
32. Multiaperturabbildungsvorrichtung according to any one of the preceding claims, further comprising a two, a plurality or all of the beam paths (17a-d) of the optical channels (16a-d; 16N) co-acting optical image stabilizer (94; 134, 138; 152) for image stabilization along a first imaging axis (144) by generating a translatory relative movement (96) between an image sensor (12) and the array (14; 14 ') and to Bildstabiüsierung along a second imaging axis (142) by generating a rotational movement of the beam deflecting device (18).
33. ultiaperturabbildungsvorrichtung according to any one of claims 30 to 32, wherein the optical image stabilizer (94; 134, 138; 152) at least one actuator (134) includes fully and is arranged such that it at least partially between two planes (148a-b) is arranged, which are spanned by sides of a cuboid, wherein the sides of the box to each other and to a line extending direction (z; 146) of the array (14; 14 ') and a portion of the beam path (17a-d) see the optical channels ( 16a-d; 16N) are aligned in parallel between the image sensor (12) and the optics and whose volume is minimal, and yet the image sensor (12) and the array (14; 14 ') comprises.
34. Multiaperturabbildungsvorrichtung according to claim 33, wherein said image stabilizer (94; 134, 138; 152) by at most 50% from a region between the planes
(148a-b) protrude. '
35. Multiaperturabbildungsvorrichtung according to any one of the preceding claims, further comprising a focusing means (98; 134b, 136) comprising at least one actuator (134b) for adjusting a focus of the Multiaperturabbiidungsvorrichtung formed to a relative movement between at least one optical system (64a-d) and to provide the image sensor (12); one of the optical channels (16N 6a-d);
36. ultiaperturabbildungsvorrichtung according to claim 35, wherein the relative movement is provided by actuators, which is adapted to move the Büdsensor (12) relative to the housing (1002) or the housing (1002) to move relative to the image sensor (12).
37. Multiaperturabbildungsvorrichtung according to claim 35 or 36, wherein the focusing means (98; 134b, 136) is arranged so that it is positioned at least partially between two planes (148a-b), which are spanned by sides of a cuboid, wherein the sides of the cuboid to each other and to a Zeilener- stretch direction (z; 146) of the array (14; 14 ') and a portion of the beam path (17a-d) of the optical channels (16a-d; 16N) between an image sensor (12) and the optics are aligned in parallel and whose volume is minimal, and yet the image sensor (12) and the array (14; 14 ') comprises.
38. ultiaperturabbildungsvorrichtung according to any one of claims 35 to 37, wherein the focusing means (98; 134b, 136) is designed to focus all optical channels (16a-d; 16N) to adjust together.
39. ultiaperturabbildungsvorrichtung according to any one of the preceding claims, wherein each subarea (74a-d) of the object region (72) by at least two optical channels (16a-d; 16N) on at least two image sensing portions (58a-d) is mapped.
40. Multiaperturabbildungsvorrichtung according to any one of the preceding claims, wherein a total amount of the optical channels (16a-d; 16N) of the array (14; 14 ') has a total amount of partial regions (74a-d) of the object region (72) to a total amount of image sensing areas (58a-d) of the mapping at least one image sensor (12) and wherein the total amount of the partial regions (74a-d) to the object to be detected portion (72) fully replicates.
41. Multiaperturabbildungsvorrichtung according to one of the preceding claims, wherein the image sensor (12) and the optical channels (6a-d; 16N) form a first sub-module in the housing (1002) which is adapted to detect the objects Reich (72) wherein the Multiaperturabbildungsvorrichtung is comprises at least a second sub-module, which is adapted to detect the objects Reich (72), and wherein the first partial module and the at least second sub-module in the housing (1002) are arranged and the wall structure (1004; 1004a b) on the optical channels (16a-d; extending the first and second part Teilmoduis module 16N).
42. Multiaperturabbildungsvorrichtung according to claim 41, further comprising a two, a plurality or all of the beam paths (17a-d) of the optical channels (16a-d; 16N) of the first submodule and the second submodule co-acting optical image stabilizer and / or a focussing ( 98; 134b, 136) comprising at least one actuator (134b) for jointly adjusting a focus of the first partial module and the second sub-module and / or a beam deflecting device (18) for common deflecting a beam path (17a-d) (of optical channels 16a-d ; 16N) of the first submodule and the second submodule, and / or wherein the image sensor (12) of the first partial module is formed integrally with the Biidsensor (12) of the second submodule.
43. Multiaperturabbildungsvorrichtung (11; 150; 180; 1000; 2000; 4000; 8000) comprising:
at least one image sensor (12); and
an array (14; 14 ') of adjacent optical channels (16a-d; 16N), each optical channel optics (64a-d) for imaging at least a partial region (74a-d) of an object region (72) onto an image sensor region (58a-d) of the image sensor (12), wherein the array (14; 14 ') comprising:
a housing (1002) comprising facing an image sensor (12) or remote from the wall structure (1004, 1004a-b), through which the optical channels, and a wall structure (1004; 1004a-b) disposed sides tenwandstruktur (1006 ; 1006a-b), wherein the wall structure (1004; 1004a-b) or the side wall structure (1006, 1006a-b) comprising ceramic glass, ceramic, glass or a crystalline material is formed, wherein in the housing (1002), the optics (64a-d) of the optical channels (16a-d; 16N) are arranged, and wherein the wall structure (1004; 1004a-b) with optics (64a-d) of the optical channels (16a-d; 16N) is connected, and the lenses (64a-d) fixed to each other;
wherein the array (14; 14 ') partition structures (1016b, 1016C), which between the optical channels (16a-d; 16N) are arranged and are formed of an at least partially opaque material, such that a stray light rejection between the optical channels ( 16a-d; 16N) is obtained
44. Multiaperturabbildungsvorrichtung (11; 150; 180; 1000; 2000; 4000; 8000) comprising:
at least one image sensor (12); and
an array (14; 14 ') of adjacent optical channels (16a-d; 16N), each optical channel (16a-d; 16N) an optic (64a-d) for imaging at least a partial region (74a-d) of a an image sensor area object region (72) (58a-d) of the image sensor (12);
wherein the array (14; 14 ') comprises a housing (1002), in which the optical systems (64a-d) of the optical channels (16a-d; 16N) are arranged and fixed against one another, wherein the housing (1002) assembled from one another plate-like structures (1004; 1004a-b, 1006; 1006a-b) is formed and at least one image sensor (12) facing or facing away from the wall structure (1004, 1004a-b) and at least a side wall structure (1006; 1006a-b) comprises
wherein the array (14; 14 ') partition structures (1016b, 1016C), which between the optical channels (16a-d; 16N) are arranged and are formed of an at least partially opaque material, such that a stray light rejection between the optical channels ( 16N) is obtained; 16a-d.
45. An imaging system (20; 30; 40; 50; 60; 70; 90; 100; 140) having a Multiaperturabbil--making apparatus according to any one of the preceding claims.
46. The imaging system according to claim 45 having at least a first and a second ultiaperturabbildungsvorrichtung according to any of claims 1 to 39, wherein the first uitiaperturabbildungsvorrichtung and the second Multiaperturabbildungsvorrichtung are arranged so that the object region at least stereoscopically by the first Multiaperturabbildungsvorrichtung and the second Multiaperturabbil- -making device is detected.
47. The imaging system of any of claims 45 or 46, which is designed as mobile phone, smart phone, tablet or monitor.
48. A method of manufacturing a Multiaperturabbildungsvorrichtung (11; 150; 180;
1000; 2000; 4000; 8000) with the following steps:
Providing at least one image sensor (12); and
Arranging optical systems (64a-d) of optical channels (16a-d; 16N) so that this is an array (14; 14 ') of adjacent optical channels (16a-d; 16N) form, and so that each optical channel (16a-d; 16N) an optic (64a-d) for imaging at least a partial region (74a-d) having an object area (72) to an image sensor region (58a-d) of the image sensor (12), wherein forming the Ar rays (14; 14 ') comprises the step of:
Arranging the optical systems (64a-d) of the optical channels (16a-d; 16N) in a housing so that a wall structure (1004, 1004a-b) of the housing (1002) through which the optical channels, the image sensor (12 o- face) which faces away from and one (on the wall structure 1004; arranged 1004a-b) side wall structure (1006, 1006a-b) (on the wall structure 1004; 1004a-b) is disposed, said wall structure (1004; 1004a-b ) or the side wall structure (1006, 1006a-b) comprising, ceramic, glass ceramic or crystalline material is formed of glass, wherein the optics (64a-d) are arranged so that the wall structure (1004, 1004a-b) (with the optics 64a-d) of the optical channels (16a-d is connected 16N) and the optical systems (64a-d) fixed to each other.
49. The method of claim 48, wherein arranging of the optics is such that the optical systems (64a-d) in the case of a thermally induced deformation along an optical see perpendicular length (1024) of the optical channel and along a direction (146) to the optical length (1024) of the optical channel each optical channel (16a-d; 6N) of the deformation in the direction (46) perpendicular to the optical length (1024) of an adjacent optical channel (16a-d; 16N) is unaffected.
A method of manufacturing a Multiaperturabbildungsvorrichtung (11; 150: 180; 1000; 2000; 4000; 8000) with the following steps;
Providing at least one image sensor (12); and
Arranging optical systems (64a-d) of optical channels (16a-d; 16N) so that this is an array (14; 14 ') of adjacent optical channels (16a-d; 16N) form, and so that each optical channel (16a-d; 16N) an optic (64a-d) for imaging at least a partial region (74a-d) having an object area (72) to an image sensor region (58a-d) of the image sensor (12);
Forming a housing (1002) of the joined plate-like structures (1004; 1004a-b, 1006; 1006a-b), so that the housing (1002) at least one image sensor (12) facing or facing away from the wall structure (1004, 1004a-b) and at least a side wall structure (1006; 1006a-b) comprises; and
Arranging the optical systems (64a-d) of the optical channels (16a-d; 16N) of the array (14; 14 ') in the housing (1002) so that the lenses (64a-d) are fixed against each other.
A method according to claim 50, wherein arranging the optical systems (64a-d) is performed so that the lenses (64a-d) in a thermally induced deformation along an optical length (1024) of the optical channel and along a direction (146) each optical channel (6a-d; 16N) perpendicular to the optical length (1024) of the optical channel from the deformation in the direction (146) perpendicular to the optical length (1024) of an adjacent optical channel (16a-d; 16N) is unaffected ,
A method according to any one of claims 48 to 51 comprising the step of:
Arranging partition structures (1016b, 1016C) between the optical channels (16a-d; 16N), the partition structures from an at least partially
opaque material are formed so that a stray light rejection between the optical channels (16a-d; 16N) is obtained.