description

The present invention relates to a multi-channel imaging device and to an apparatus having a multi-channel imaging device. The present invention also relates to a portable device having a multi-aperture imaging device.

Conventional cameras transmit the entire field of view in one channel and are limited in their miniaturization. In mobile devices such as smartphones, two cameras are used that are oriented in and against the direction of the normal to the surface of the display.

Accordingly, a concept would be desirable which enables miniaturized devices for capturing an entire field of view while ensuring high image quality.

The object of the present invention is therefore to create a multi-aperture imaging device which enables a high level of image information with, at the same time, a small installation space for the multi-aperture imaging device.

This object is achieved by the subject matter of the independent claims.

A core idea of ​​the present invention is to have recognized that the above object can be achieved in that a high level of image information can be obtained by recording the entire field of view in different wavelength ranges, which means a small number of recording channels and thus small sizes and low costs enables.

According to an embodiment, a multi-aperture imaging device comprises an image sensor; an array of optical channels arranged next to one another, each optical channel comprising an optical system for imaging at least a partial field of view of an overall field of view onto an image sensor area of ​​the image sensor. The multi-aperture imaging device has a beam deflecting device for deflecting a beam path

of the optical channels, the beam deflecting device having a first beam deflecting region which is effective for a first wavelength range of electromagnetic radiation passing through the optical channel; and has a second beam deflecting region which is effective for a second wavelength region different from the first wavelength region of the electromagnetic radiation passing through the optical channel. The advantage of this is that images in different wavelength ranges can be recorded with the same camera or the same channels.

According to one embodiment, the multi-aperture imaging device is designed to capture a first image of the entire field of view using the first beam deflection area with the image sensor, so that the first image is based on the first wavelength range; and to acquire a second image of the entire field of face using the second beam deflection region with the image sensor, so that the second image is based on the second wavelength range.

According to one embodiment, the multi-aperture imaging device is designed to determine a depth map for the first image using the second image. This enables depth information to be obtained with regard to the entire field of view.

According to an exemplary embodiment, the first beam deflecting area is arranged on a first side of the beam deflecting device and the second beam deflecting area is arranged on a second side arranged opposite the first side, and the beam deflecting device is designed so that for capturing a first image of the entire field of view the first side is arranged facing the image sensor, and for capturing a second recording of the overall field of view, the second side is arranged facing the image sensor.

According to one embodiment, a first side of the beam deflecting device has a coating different from a second, opposite side, in order to be effective in the first or second wavelength range.

According to one embodiment, the beam deflecting device is designed to reflect the first wavelength range when it is effective in the first wavelength range and to at least partially absorb different wavelength ranges therefrom. beer and / or wherein the beam deflection device is designed to reflect the second wavelength range when it is effective in the second wavelength range and to at least partially absorb different wavelength ranges therefrom. This enables a reduction or avoidance of stray light in the recordings and thus a high image quality.

According to one embodiment, the overall field of view is a first overall field of view, and the multi-aperture imaging device has a first direction of view for capturing the first overall field of view and a second direction of view to a second overall field of view. The multi-aperture imaging device is designed to capture a third image of the second overall field of view using the first beam deflection area with the image sensor, so that the third image is based on the first wavelength range; and to capture a fourth image of the second overall field of view using the second beam deflection area with the image sensor, so that the fourth image is based on the second wavelength range. Both, possibly

According to one embodiment, the first overall field of view and the second overall field of view are arranged along different main directions of the multi-aperture imaging device, and the beam deflection areas directs the beam path alternately in the direction of the first overall field of view and the second overall field of view and alternately with the first beam deflecting area and the second beam deflecting area. This can be an implemented or theoretical consideration of the sequence of movements. Embodiments provide in particular that a shortest path and therefore a shortest actuation time is implemented to change a position or position of the beam deflecting device,

According to one embodiment, the beam deflection device is designed to have an angle of incidence of 45 ° ± 10 ° of the first beam deflection area with respect to the image sensor to obtain a first image of the entire field of view and to have an angle of incidence of 45 ° ± 10 ° to obtain a second image of the entire field of view of the second beam deflection area with respect to the image sensor. This angle of incidence enables the beam path to be deflected by around 90 ° and a slight deflection

Size of the multi-aperture imaging device, since the small thickness of the multi-aperture imaging device can be used to advantage.

According to one embodiment, the multi-aperture imaging device is designed to capture the entire field of view through at least two partial fields of view and to capture at least one of the partial fields of view through at least one first optical channel and one second optical channel. This enables occlusion effects to be avoided or reduced.

According to one embodiment, the multi-aperture imaging device is designed to segment the entire field of view into exactly two partial facial fields and to capture exactly one of the partial fields of view through a first optical channel and a second optical channel. This enables the reduction or avoidance of the occlusion and, at the same time, a small number of optical channels, which enables a small overall size and / or low cost.

According to one embodiment, the first optical channel and the second optical channel are spaced apart by at least one further optical channel in the array. This enables occlusion effects to be avoided or reduced. In particular with a symmetrical arrangement of the optical channels receiving the partial field of view around a further optical channel, occlusion effects can be reduced or avoided. For example, a first partial field of view is recorded by channels to the left and right of the channel, which records a second partial field of view, in particular when the total field of view is divided into exactly two partial fields of view along a vertical direction or perpendicular to a direction along which the optical channels - channels be arranged in the array of optical channels,

According to one embodiment, the beam deflecting device is formed as an array of facets, each optical channel being assigned to a facet, and each of the facets having the first beam deflecting area and the second beam deflecting area. This enables a facet-specific or even channel-specific setting of a divergence in the deflected optical channels, so that the set portion of divergence does not have to be set in the optical channels or the optics themselves.

According to one embodiment, the facets of the array of facets are formed as double-sided reflective mirrors that are plane-parallel on both sides. This enables a simple design of the facets.

According to one embodiment, the image sensor areas are designed for image generation in the first wavelength range and for image generation in the second wavelength range. This enables a space-saving design of the image sensor.

According to one embodiment, pixels of the image sensor areas are designed for image generation in the first wavelength range and at least partially for image generation in the second wavelength range. This can be done, for example, by arranging appropriate filters and / or by integrating or substituting appropriately configured photocells in groups of photocells, for example a Bayer pattern.

According to one embodiment, the first wavelength range comprises a visible spectrum and the second wavelength range comprises an infrared spectrum, in particular a near infrared spectrum. This enables the multi-aperture imaging device to be configured in such a way that additional image information can be obtained by means of the infrared spectrum.

According to one exemplary embodiment, the multi-aperture imaging device furthermore has an illumination device which is designed to emit a temporal or spatial illumination pattern with a third wavelength range which at least partially corresponds to the second wavelength range. This enables targeted illumination of the entire field of view with light of the second wavelength range, so that the arrangement of further illumination sources for this wavelength range can be dispensed with.

According to one exemplary embodiment, the multi-aperture imaging device is designed to capture the entire field of view at least stereoscopically. This enables an additional increase in the image information obtained.

According to an exemplary embodiment, the beam deflecting device is designed to block or attenuate the second wavelength range with the first beam deflection area and to block or attenuate the first wavelength range with the second beam deflection area. This enables an isolation of the wavelength ranges at

the deflection, so that only light for use in the desired recording hits the image sensor.

According to one embodiment, a device comprises a multi-aperture imaging device according to the invention and is designed to generate a depth map of the overall field of view.

According to one embodiment, the device does not have an additional infrared camera.

According to one exemplary embodiment, the device is designed to record the entire field of view from one perspective and to provide no stereoscopic recording of the entire field of view. This embodiment is particularly advantageous with the generation of depth information based on the different wavelength ranges, which enable additional imaging modules for stereoscopic purposes to be saved.

Further advantageous embodiments are the subject of the dependent patent claims.

Preferred exemplary embodiments of the present invention are explained below with reference to the accompanying drawings. Show it:

1 shows a schematic perspective view of a device according to an exemplary embodiment;

2 shows a schematic view of a main side of a device according to a further exemplary embodiment;

3a shows a beam deflecting device and a state of diaphragms in a first operating state according to an exemplary embodiment;

3b shows the beam deflecting device and the diaphragms in a second operating state;

4a shows a schematic view of the beam deflecting device according to an exemplary embodiment, which comprises a plurality of beam deflecting regions;

FIG. 4b shows a schematic view of the beam deflecting device in accordance with a configuration alternative to FIG. 4a and in accordance with an exemplary embodiment; FIG.

4c-h show an advantageous embodiment of a beam deflecting device of an imaging device according to an exemplary embodiment.

5a shows a schematic perspective view of an imaging device according to an embodiment;

5b shows a schematic perspective view of a multi-aperture imaging device according to an exemplary embodiment, which has an illumination device which is designed to emit a temporal or spatial illumination pattern;

5c shows a schematic side sectional view of a modified imaging device, in which the beam deflecting device can be switched rotationally between a first position of the first operating state and a second position;

6a shows a schematic view of an overall field of view which comprises four overlapping partial fields of view;

FIG. 6b shows a division of the overall field of view changed from FIG. 6a, in which a partial field of view is recorded twice and partial fields of view are arranged next to one another along a first direction; FIG.

FIG. 6c shows a division of the overall field of view changed from FIG. 6a, in which a partial field of view is recorded twice and partial fields of view are arranged next to one another along a second direction; FIG.

7a shows a schematic perspective view of a device which comprises two multi-aperture imaging devices for stereoscopic recording of an overall field of view, according to an exemplary embodiment;

Figure 7b. a schematic perspective view of a device comprising two multi-aperture imaging devices, according to an embodiment,

which is designed to create the depth information instead of a stereoscopic image from the image in one of the wavelength ranges;

7c shows a schematic perspective view of a preferred embodiment of a multi-aperture imaging device according to an exemplary embodiment, which has a single viewing direction;

8 shows a schematic structure comprising a first multi-aperture imaging device and a second multi-aperture imaging device with a common image sensor;

9a-d show schematic views of a multi-aperture imaging device according to an embodiment that uses different wavelength ranges; and

10 shows a schematic graph of a sensitivity of an image sensor area of ​​the image sensor of the multi-aperture imaging device over the wavelengths of a first and second wavelength range according to an exemplary embodiment.

Before exemplary embodiments of the present invention are explained in more detail below with reference to the drawings, it is pointed out that identical, functionally identical or identically acting elements, objects and / or structures in the different figures are provided with the same reference symbols, so that the Description of these elements shown in different exemplary embodiments is interchangeable or can be applied to one another.

The following exemplary embodiments relate to the use of different wavelength ranges for imaging on an image sensor. The wavelength refers to electromagnetic radiation, especially light. An example of different wavelength ranges is, for example, the use of visible light, for example in a wavelength range from approx. 380 nm to approx. 650 nm / or an infrared spectrum with wavelengths of more than 700 nm, e.g. from approx.

1,000 nm to approx. 1,000 μm, in particular a near infrared spectrum with wavelengths in a range from approx. 700 nm or 780 nm up to approx. 3 μm. The first and second wavelength ranges have wavelengths that are at least partially different from one anotheron. According to one exemplary embodiment, the wavelength ranges do not have any overlaps. According to an alternative exemplary embodiment, the wavelength ranges have an overlap which, however, is only partial, so that there are wavelengths in both ranges which enable a distinction.

Exemplary embodiments explained below relate to beam deflecting areas of a beam deflecting device. A beam deflecting area can be a surface area or an area of ​​an object that is configured to deflect a beam path at least in a specific wavelength range. This can be a sequence of at least one applied layer, for example dielectric but also electrically conductive layers, which provide or set a reflectivity. It can be an electrically passive or an active property.

In the exemplary embodiments described below, reference is made to the main pages and secondary pages of a device. In the exemplary embodiments described herein, a main side of a device can be understood as a side of a housing or of the device that has a large or a largest dimension compared to other sides. Although this is not intended to have a restrictive effect, for example a first main side can denote a front side and a second main side a back side. Pages or areas that connect the main pages to one another can be understood as secondary pages.

Although the exemplary embodiments described below relate to portable devices, the aspects presented can easily be transferred to other mobile or immobile devices. It goes without saying that the portable devices described can be installed in other devices, for example in vehicles. Furthermore, the housing of a device can be designed in such a way that it is not portable. The exemplary embodiments described below are therefore not intended to be restricted to portable devices, but can relate to any implementation of a device.

1 shows a schematic perspective view of a portable device 10 according to an exemplary embodiment. The portable device 10 comprises a housing 12 with a first transparent area 14a and a second transparent area 14b. For example, the housing 12 can be formed from an opaque plastic, a metal or the like. The transparent areas 14a and / or 14b can be made in one piece with

the housing 12 or be formed in several pieces. The transparent areas 14a and / or 14b can be cutouts in the housing 12, for example. Alternatively, a transparent material can be arranged in a region of the cutouts or the transparent regions 14a and / or 14b. Transparent materials of the transparent areas 14a and / or 14b can be transparent at least in one wavelength range of electromagnetic radiation for which an imaging device, in particular a multi-aperture imaging device 16 or an image sensor thereof, is sensitive. This means that the transparent areas 14a and / or 14b can be partially or completely opaque in different wavelength ranges. For example, the imaging device 16 can be designed

The imaging device or multi-aperture imaging device 16 is arranged in an interior of the housing 12. The imaging device 16 comprises a beam deflecting device 18 and an image capturing device 19. The image capturing device 19 can comprise two or more optical channels, each of which has one or more optics for changing (e.g. bundling, focusing or scattering) a beam path of the imaging device 16 and one Have image sensor. With regard to different optical channels, optics can be disjoint or undivided or channel-specific. Alternatively, however, it is also possible for the optics to have elements which act together for two, more or all of the optical channels, for example a common collective lens, a common filter or the like combined with a channel-specific lens.

For example, the image acquisition device 19 can have one or more image sensors, the associated beam paths of which are directed through one or more optical channels onto the beam deflection device 18 and are deflected by the latter. As described in connection with FIG. 6a, the at least two optical channels can be deflected in such a way that they cover overlapping partial fields of view (partial object areas) of an overall field of vision (total object area). The imaging device 16 can be referred to as a multi-aperture imaging device. Each image sensor area of ​​the image sensor can be assigned to an optical channel. A structural gap can be arranged between adjacent image sensor areas, or the image sensor areas can act as different image sensors or parts

be implemented by this, but it is alternatively or additionally also possible that neighboring image sensor areas directly adjoin one another and are separated from one another by reading out the image sensor.

The portable device 10 has a first operating state and a second operating state. The operating state can be correlated with a pitch, position or orientation of the beam deflection device 18. This can relate to which wavelength range is deflected by the beam deflection device 16 in that sides with different effectiveness are used for the deflection. Alternatively or additionally, two different operating states can be related to the direction in which the beam path is deflected. In the exemplary multi-aperture imaging device 16, for example, there could be 4 operating states, two for two different viewing directions and two for the different wavelength ranges. One reason for this is that the beam deflecting device 16 has a first beam deflecting area which is effective for the first wavelength range of electromagnetic radiation running through the optical channel; and has a second beam deflecting region which is effective for the second wavelength region, different from the first wavelength region, of the electromagnetic radiation passing through the optical channels.

With regard to the viewing directions, in the first operating state the beam deflecting device 18 can deflect the beam path 22 of the imaging device 16 such that it runs through the first transparent area 14a, as indicated by the beam path 22a. In the second operating state, the beam deflecting device 18 can be designed to deflect the beam path 22 of the imaging device 16 so that it runs through the second transparent area 14b, as is indicated by the beam path 22b. This can also be understood to mean that the beam deflection device 18 directs the beam path 22 through one of the transparent regions 14a and / or 14b at a point in time and based on the operating state. Based on the operating status, a position of a field of view (object area),

The first beam deflection area effective for the first wavelength range and the second beam deflection area effective for the second wavelength range can be used alternately to deflect the beam paths of the optical channels or the beam path 22. This makes it possible to direct that part of the spectrum in the direction of the image sensor for which the beam deflection area is effective. For example, he can

Beam deflecting range have a bandpass functionality and deflect, i.e. reflect, those wavelength ranges for which the bandpass functionality is designed, while other wavelength ranges are suppressed, filtered out or at least strongly attenuated, for example by at least 20 dB, at least 40 dB or at least 60 dB.

The beam deflecting areas can be arranged on the same side of the beam deflecting device 18, which offers advantages in the case of beam deflecting devices that can be moved in a translatory manner. As an alternative or in addition, different beam deflecting areas can also be arranged on different sides of the beam deflecting device 18, which, based on a rotational movement of the beam deflecting device 18, can alternately face the image sensor. An angle of attack can be arbitrary. However, it is advantageous when using two possibly opposing viewing directions of the multi-aperture imaging device 16 to select an angle of approximately 45 °, so that a rotational movement of 90 ° is sufficient to change the viewing direction. In contrast, if there is only one viewing direction, a further degree of freedom can be selected.

By alternately turning to different beam deflecting areas, the overall field of view of the respective direction of view can be captured with different wavelength areas, in that the multi-aperture imaging device is designed to capture a first image of the overall field of view using the first beam deflecting area with the image sensor, so that the first recording is based on the first wavelength range; and to acquire a second image of the entire field of face using the second beam deflection region with the image sensor, so that the second image is based on the second wavelength range. For example, a wavelength range that is not visible to the human eye can be used to obtain additional image information, such as depth maps.

The portable device 10 may include a first bezel 24a and a second bezel 24b. The screen 24a is arranged in an area of ​​the transparent area 14a and is designed to optically at least partially close the transparent area 14a in a closed state of the screen 24a. According to one embodiment, the screen 24a is designed to close the transparent area 14a completely or at least to 50%, 90% or at least 99% of the surface of the transparent area 14a in the closed state. The screen 24b is designed to close the transparent area 14b in the same or a similar manner as is described for the screen 24a in connection with the transparent area 14a. By doing

In the first operating state, in which the beam deflecting device 18 deflects the beam path 22 to the beam path 22a, the screen 24b can optically at least partially close the transparent area 14b, so that a small amount of false light or possibly not into the interior of the housing through the transparent area 14b 12 entry. This enables a slight influence on the recording of the field of view in the first operating state through the false light entering through the diaphragm 14b. In the second operating state, in which, for example, the beam path 22b emerges from the housing 12, the screen 24a can optically at least partially close the transparent area 14a. To put it simply, the screens 24a and / or 24b can be designed in such a way that they close off transparent areas 14a and 14b in such a way that they that due to this false light from undesired directions (in which, for example, the recorded field of view is not arranged) enters or does not enter to a small extent. The diaphragms 24a and 24b can be formed continuously and each be arranged with respect to all optical channels of the imaging device 16. This means that the diaphragms 24a and 24b can be used by all optical channels of the multi-aperture imaging device based on the respective operating state. According to one embodiment, no individual round diaphragms are arranged for each optical channel, but instead a diaphragm 24a or 24b, which is used by all optical channels. The diaphragms 24a and / or 24b can follow a polygonal course, for example be rectangular, oval, round or elliptical in shape.

Switching between the first and the second operating state can include, for example, a movement of the beam deflecting device 18 based on a translational movement 26 and / or based on a rotary movement 28.

The diaphragms 24a and / or 24b can be designed, for example, as a mechanical diaphragm. Alternatively, the diaphragms 24a and / or 24b can be designed as electrochromic diaphragms. This enables a small number of mechanically moving parts. Furthermore, a configuration of the diaphragms 24a and / or 24b as electrochromic diaphragms enables the transparent areas 14a and / or 14b to be opened and / or closed noiselessly as well as a configuration that can be easily integrated into the optics of the portable device 10. For example, the panels 24a and / or 24b can be designed in such a way that a user can hardly or not perceive them in a closed state, since there are few optical differences to the housing 12.

The housing 12 can be formed flat. For example, main pages 13a and / or 13b can be arranged in space in an x ​​/ y plane or a plane parallel to this. Secondary sides or secondary surfaces 15a and / or 15b between the main sides 13a and 13b can be arranged obliquely or perpendicularly thereto in the room, wherein the main sides 13a and / or 13b and / or the secondary sides 15a and / or 15b can be curved or flat. An extension of the housing 12 along a first housing direction z between the main sides 13a and 13b, for example parallel or antiparallel to a surface normal of a display of the portable device 10, can be small if it is combined with further dimensions of the housing 12 along further extensions, ie along a Extension direction of the main side 13a and / or 13b is compared. The secondary sides 15a and 15b can be parallel or anti-parallel to the surface normal of a display. The main sides 13a and / or 13b can be arranged perpendicular to a surface normal to a display of the portable device 10 in space. For example, an expansion of the housing along the x direction and / or the y direction can be at least three times, at least five times or at least seven times an expansion of the housing 12 along the first expansion z. The extension of the housing z can be understood in a simplifying manner, but without a restrictive effect, as the thickness or depth of the housing 12. The main sides 13a and / or 13b can be arranged perpendicular to a surface normal to a display of the portable device 10 in space. For example, an expansion of the housing along the x-direction and / or the y-direction can be at least three times, at least five times or at least seven times an expansion of the housing 12 along the first expansion z. The extension of the housing z can be understood in a simplifying manner, but without restricting effect, as the thickness or depth of the housing 12. The main sides 13a and / or 13b can be arranged perpendicular to a surface normal to a display of the portable device 10 in space. For example, an expansion of the housing along the x-direction and / or the y-direction can be at least three times, at least five times or at least seven times an expansion of the housing 12 along the first expansion z. The extension of the housing z can be understood in a simplifying manner, but without a restrictive effect, as the thickness or depth of the housing 12. at least five times or at least seven times an extension of the housing 12 along the first extension z. The extension of the housing z can be understood in a simplifying manner, but without a restrictive effect, as the thickness or depth of the housing 12. at least five times or at least seven times an extension of the housing 12 along the first extension z. The extension of the housing z can be understood in a simplifying manner, but without a restrictive effect, as the thickness or depth of the housing 12.

FIG. 2 shows a schematic view of a main side of a portable device 20 according to an exemplary embodiment. The portable device may include device 10. The portable device 20 may include a display 33, such as a screen or display. For example, the device 20 can be a portable communication device, such as a mobile phone (smartphone), a tablet computer, a mobile music player, a monitor or visual display device, which the imaging device 16 has. The transparent area 14a and / or the transparent area 14b can be arranged in an area of ​​the housing 12 in which the display 33 is arranged. This means that the screen 24a and / or 24b can be arranged in a region of the display 33. For example, the transparent area 14a and / or 14b and / or the screen 24a or 24b can be covered by the display 33. In an area of ​​the display 33 in which the screen 24a and / or 24b is arranged, information from the display can be displayed at least temporarily. The presentation of the information can be any operation of the portable device 20. For example, a viewfinder function can be displayed on the display 33, in which a field of view can be displayed that is generated by the imaging device inside the The presentation of the information can be any operation of the portable device 20. For example, a viewfinder function can be displayed on the display 33, in which a field of view can be displayed that is generated by the imaging device inside the The presentation of the information can be any operation of the portable device 20. For example, a viewfinder function can be displayed on the display 33, in which a field of view can be displayed that is generated by the imaging device inside theHousing 12 is scanned or detected. Alternatively or additionally, images that have already been captured or any other information can be displayed. In simple terms, the transparent area 14a and / or the screen 24a can be covered by the display 33, so that the transparent area 14a and / or the screen 24a is barely or imperceptible during operation of the portable device 20.

The transparent areas 14a and 14b can each be arranged in at least one main side 13a of the housing 12 and / or in an opposite main side. In simple terms, the housing 12 can have a transparent area at the front and a transparent area at the rear. In this regard, it should be noted that the terms front and back can be replaced by other terms, such as left and right, top and bottom or the same, without restricting the exemplary embodiments described herein. According to further exemplary embodiments, the transparent regions 14a and / or 14b can be arranged in a secondary side. An arrangement of the transparent areas can be arbitrary and / or dependent on directions in which the beam paths of the optical channels can be deflected,

In the area of ​​the transparent area 14a or the screen 24a, the display 33 can be configured, for example, to be temporarily deactivated while an image is being captured with the imaging device or to increase the transparency of the display 33 from the housing 12. Alternatively, the display 33 can also remain active in this area, for example when the display 33 emits no or hardly any electromagnetic radiation in a relevant wavelength range into the interior of the portable device 20 or the housing 12 or towards the imaging device 16.

3a shows the beam deflecting device 18 and a state of the multi-aperture imaging device which is associated, for example, with an operating state of the first diaphragm 24a and the second diaphragm 24b. The beam deflecting device 18 deflects, for example, the beam path 22 with a beam deflecting area 18A only shown in FIG. 3b in such a way that it runs as a beam path 22a through the transparent area 14a. The screen 24b can temporarily at least partially close the transparent area 14b so that stray light penetrates through the transparent area 14b to a small extent or no extent into the interior of the housing of the portable device.

3b shows the beam deflecting device 18, the diaphragm 24a and the diaphragm 24b in a second operating state, the beam deflecting device 18, for example, under execution the rotational movement 28 by 90 ° has a different viewing direction. However, the beam deflecting device now deflects the beam path with a beam deflecting area 18B, which is effective for the second wavelength range, so that an overall field of view arranged in the viewing direction of the beam path 22b can be detected in the area of ​​the second wavelength range.

In the event of a rotation of the beam deflecting device by a further 90 ° and thus 180 ° compared to the original state, the first viewing direction shown in FIG. 3a would be assumed again, but under the influence of the beam deflecting region 18B. Although only one overall field of view can be recorded, for example by only providing the viewing direction 22a or 22b at any desired angle, a higher number of overall fields of view, for example 2, 3 or more, can thus also be recorded.

The beam deflecting device 18 can deflect the beam path 22 such that it runs as a beam path 22b through the transparent area 14b, while the diaphragm 24a optically at least partially closes the transparent area 14a. In the second operating state, the diaphragm 24b can have an at least partially or completely open state. The open state can relate to a transparency of the diaphragm. For example, an electrochromic shutter can be designated as open or closed depending on an activation state without mechanical components being moved. A diaphragm 24b designed as an electrochromic diaphragm can be partially or completely transparent at least temporarily during the second operating state for a wavelength range to be recorded by the imaging device. In the first operating state, as shown in FIG. 3a, the diaphragm 24b can be partially or completely non-transparent or opaque for this wavelength range. Switching between the first operating state according to FIG. 3a and the second operating state according to FIG. 3b can be based on the rotational movement 28 of the deflection device 18 and / or based on a translational movement, as described in connection with FIGS. 4a and 4b is, and are obtained or at least include one of these movements.

4a shows a schematic view of the beam deflecting device 18, which comprises a plurality of beam deflecting elements 32a-h. For example, the imaging device can comprise a plurality or a plurality of optical channels, for example two, four or a greater number. For example, if the imaging device has four optical channelson, the beam deflecting device 18 can comprise a number of beam deflecting elements 32a-h according to a number of the optical channels multiplied by a number of operating states between which the beam deflecting device 18 or the portable device can be switched. For example, the beam deflecting elements 32a and 32e can be assigned to a first optical channel, the beam deflecting element 32a deflecting the beam path of the first optical channel in the first operating state and the beam deflecting element 32e the beam path of the first optical channel in the first operating state. In the same way, the beam deflecting elements 32b and 32f, 32c and 32g or 32d and 32h can be assigned to further optical channels.

The beam deflecting device can be translationally movable along the translational movement direction 26 and / or can be moved back and forth between a first position and a second position of the beam deflecting device 18 with respect to the optical channels of the imaging device in order to switch between the first operating state and the second To change operating status. A distance 34 over which the beam deflecting device 18 is moved between the first position and the second position can correspond to at least a distance between four optical channels of the imaging device. The beam deflecting device 18 can have the beam deflecting elements 32a-h sorted in blocks. For example, the beam deflecting elements 32a-d can be designed, in order to deflect the beam paths of the imaging device in a first viewing direction to a first field of view, wherein each optical channel can be assigned to a partial field of view of the total field of view. The beam deflecting elements 32e-h can be designed to deflect the beam paths of the imaging device in a second viewing direction to a second field of view, wherein each optical channel can be assigned to a partial field of view of the total field of view. According to further exemplary embodiments, it is possible for beam paths from at least two optical channels to be deflected by a beam deflecting element, so that a number of beam deflecting elements of the beam deflecting device 18 can be smaller. wherein each optical channel can be assigned to a partial field of view of the total field of view. The beam deflecting elements 32e-h can be designed to deflect the beam paths of the imaging device in a second viewing direction to a second field of view, wherein each optical channel can be assigned to a partial field of view of the total field of view. According to further exemplary embodiments, it is possible for beam paths from at least two optical channels to be deflected by a beam deflecting element, so that a number of beam deflecting elements of the beam deflecting device 18 can be smaller. wherein each optical channel can be assigned to a partial field of view of the total field of view. The beam deflecting elements 32e-h can be designed to deflect the beam paths of the imaging device in a second viewing direction to a second field of view, wherein each optical channel can be assigned to a partial field of view of the total field of view. According to further exemplary embodiments, it is possible for beam paths from at least two optical channels to be deflected by a beam deflecting element, so that a number of beam deflecting elements of the beam deflecting device 18 can be smaller. wherein each optical channel can be assigned to a partial field of view of the total field of view. According to further exemplary embodiments, it is possible for beam paths from at least two optical channels to be deflected by a beam deflecting element, so that a number of beam deflecting elements of the beam deflecting device 18 can be smaller. wherein each optical channel can be assigned to a partial field of view of the total field of view. According to further exemplary embodiments, it is possible for beam paths from at least two optical channels to be deflected by a beam deflecting element, so that a number of beam deflecting elements of the beam deflecting device 18 can be smaller.

The beam deflecting elements 32a-h can be, for example, regions of the beam deflecting device 18 that are curved differently from one another or planar facets of a facet mirror. For example, the beam deflecting device 18 can be understood as an array of facets and / or deflecting elements 32a-h inclined differently from one another, so that beam paths from optical channels striking the beam deflecting device 18 into different partial fields of view of the firstth operating state and beam paths that strike deflection elements 32e-h and are deflected by them are deflected into different partial fields of view of a field of view of the second operating state.

FIG. 4b shows a schematic view of the beam deflecting device 18 according to a configuration which is different from the configuration according to FIG. 4a. While the configuration according to FIG. 4a can be understood as sorting the beam deflecting elements 32a-h in blocks based on an operating state, the configuration according to FIG Channels of the imaging device are understood. The beam deflecting elements 32a and 32e assigned to the first optical channel can be arranged adjacent to one another. Analogously, the beam deflecting elements 32b and 32f, 32c and 32g or 32d and 32h, which can be assigned to the optical channels 2, 3 or 4, can be arranged adjacent to one another. For example, if the optical channels of the imaging device have a sufficiently large distance from one another, a distance 34 'over which the beam deflecting device 18 is moved in order to be moved back and forth between the first position and the second position can be smaller than the distance 34, for example a quarter or a half thereof. This enables an additionally reduced design of the imaging device and / or the portable device.

The beam deflecting elements can also provide different types of beam deflecting areas, so that a first optical channel is deflected, for example, by deflecting either with the beam deflecting element 32a in the first wavelength range or by deflecting with the beam deflecting element 32e in the second wavelength range will.

The rotational movement can be combined with the translational movement. For example, it is conceivable that a translational movement switches between the wavelength ranges, that is, the various beam deflecting elements 32a-h are arranged on a common side of the beam deflecting device 18, with a double-sided reflective design enabling the viewing direction to be switched or the other way around.

Advantageous configurations of the beam deflecting device 18 are described with reference to FIGS. 4c-h. The designs show a number of advantages that can be used individually or inany combination can be carried out with one another, but should not have a restrictive effect.

FIG. 4c shows a schematic side sectional view of a beam deflecting element 32 as it can be used for a beam deflecting device described herein, for example the beam deflecting device 18 of FIG. The beam deflecting element 32 can have a polygonal cross-section. Although a triangular cross-section is shown, it can be any other polygon. As an alternative or in addition, the cross section can also have at least one curved surface, wherein, in particular in the case of reflective surfaces, an at least partially planar design can be advantageous in order to avoid imaging errors. With respect to wavelengths, different effective beam deflection areas can be arranged on different and opposite main sides 35a and 35b.

The beam deflecting element 32 has, for example, a first side 35a, a second side 35b and a third side 35c. At least two sides, for example the sides 35a and 35b, are designed to be reflective, so that the beam deflecting element 32 is designed to be reflective on both sides. The sides 35a and 35b can be main sides of the beam deflecting element 32, that is to say sides whose area is larger than the side 35c.

In other words, the beam deflecting element 32 can be wedge-shaped and reflective on both sides. Opposite the surface 35c, that is to say between the surfaces 35a and 35b, a further surface can be arranged which, however, is considerably smaller than the surface 35c. In other words, in such a case, the wedge formed by the surfaces 35a, 35b and 35c does not run to an arbitrary point, but is provided with a surface on the pointed side and is therefore truncated.

4d shows a schematic side sectional view of the beam deflecting element 32, in which a suspension or a displacement axis 37 of the beam deflecting element 32 is described. The displacement axis 37, about which the beam deflecting element 32 can be moved in a rotary and / or translational manner in the beam deflection device 18, can be displaced eccentrically with respect to a centroid 43 of the cross section. The centroid can alternatively also be a point which describes half the dimension of the beam deflecting element 32 along a thickness direction 45 and along a direction 47 perpendicular thereto.

The displacement axis can, for example, remain unchanged along a thickness direction 45 and have any offset in a direction perpendicular thereto. Alternatively, an offset along the thickness direction 45 is also conceivable. The shift can take place, for example, in such a way that when the beam deflecting element 32 rotates about the displacement axis 37, a higher adjustment path is obtained than with a rotation about the centroid 43 the edge between the sides 35a and 35b moved during a rotation will increase with the same rotation angle compared to a rotation around the centroid 43. The beam deflecting element 32 is preferably arranged in such a way that the edge, i.e. the pointed side of the wedge-shaped cross section, between the sides 35a and 35b facing the image sensor. A respective other side 35a or 35b can thus deflect the beam path of the optical channels by small rotational movements. It becomes clear here that the rotation can be carried out in such a way that the space requirement of the beam deflecting device along the thickness direction 45 is small, since a movement of the beam deflecting element 32 so that a main side is perpendicular to the image sensor is not necessary.

The side 35c can also be referred to as the secondary side or the rear side. Several jet deflecting elements can be connected to one another in such a way that a connecting element is arranged on the side 35c or runs through the cross section of the jet deflecting elements, i.e. is arranged in the interior of the jet deflecting elements, for example in the area of ​​the displacement axis 37 be arranged so that it does not protrude or only to a small extent, ie at most 50%, at most 30% or at most 10%, beyond the beam deflecting element 32 along the direction 45, so that the holding element does not extend the overall structure along the direction 45 increased or determined. The extension in the thickness direction 45 can alternatively be determined by the lenses of the optical channels, ie

The beam deflecting element 32 can be formed from glass, ceramic, glass ceramic, plastic, metal or a combination of these materials and / or other materials.

In other words, the beam deflecting element 32 can be arranged in such a way that the tip, that is to say the edge between the main sides 35a and 35b, points towards the image sensor. The beam deflecting elements can be held in such a way that they only take place on the rear side or in the interior of the beam deflecting elements, ie the main sides are not covered. Acommon holding or connecting element can extend over the rear side 35c. The axis of rotation of the beam deflecting element 32 can be arranged eccentrically.

4e shows a schematic perspective view of a multi-aperture imaging device 40 which comprises an image sensor 36 and a single-line array 38 of optical channels 42a-d arranged next to one another. The beam deflecting device 18 comprises a number of beam deflecting elements 32a-d, which can correspond to the number of optical channels. Alternatively, a smaller number of beam deflecting elements can be arranged, for example if at least one beam deflecting element is used by two optical channels. Alternatively, a higher number can also be arranged, for example if the deflection direction of the beam deflection device 18 is switched over by a translatory movement, as is described in connection with FIGS. 4a and 4b. Each beam window element 32a-d can be assigned to an optical channel 42a-d.

4c and 4d. Alternatively, at least two, more or all of the beam deflecting elements 32a-d can be formed in one piece with one another.

4f shows a schematic side sectional view of the beam deflecting element 32, the cross section of which is formed as a free-form surface. For example, the side 35c can have a recess 49 which enables a holding element to be attached, wherein the recess 49 can also be formed as a protruding element, for example as a tongue of a tongue and groove system. The cross section also has a fourth side 35d, which has a smaller surface area than the main sides 35a and 35b and connects the same to one another.

4g shows a schematic sectional side view of a first beam deflecting element 32a and a second beam deflecting element 32b located behind it in the direction of representation. The recesses 49a and 49b can be arranged in such a way that they are essentially congruent, so that an arrangement of a connecting element in the recesses is made possible.

4h shows a schematic perspective view of the beam deflecting device 18, which comprises, for example, four beam deflecting elements 32a-d which are connected to a connecting element 51. The connecting element can be used to be translationally and / or rotationally movable by an actuator. The connecting element 51 can be designed in one piece and over a direction of extent, for example the y-direction in Fig. 4e,run on or in the beam deflection elements 32a-d. Alternatively, the connecting element 51 can also only be connected to at least one side of the beam deflecting device 18, for example if the beam deflecting elements 32a-d are formed in one piece. Alternatively, a connection to an actuator and / or a connection of the beam deflecting elements 32a-d can also take place in any other way, for example by means of gluing, wringing or soldering.

5a shows a schematic perspective view of the imaging device 16. The imaging device 16 comprises the beam deflecting device 18, an image sensor 36 and a single-line array 38 of optical channels 42a-d arranged next to one another. Each optical channel 42a-d can have optics which are designed to optically influence beam paths 22-1 to 22-4 of the imaging device 16. The optics can be channel-specific or have common components for groups of two or more optical channels.

The image sensor 36 can include image sensor areas 44a-d, wherein the beam paths 22-1 to 22-4 of the optical channels 22a-d can each strike an image sensor area 44a-d. In simple terms, each image sensor area 44a-d can be assigned an optical channel 22a-d and / or a beam path 22-1 to 22-4. The beam deflecting device 18 can be designed to deflect the beam paths 22-1 to 22-4 in different directions and / or to deflect different wavelengths based on mutually different operating states of the portable device and / or on mutually different positions of the beam deflecting device 18 as described, for example, in connection with FIGS. 1, 2, 3a, 3b, 4a-h. That means,

The image sensor areas 44a-d can each be formed, for example, from a chip which comprises a corresponding pixel array, wherein the image sensor areas can be mounted on a common substrate or a common circuit board. Alternatively, it would of course also be possible that the image sensor areas 44a-d are each formed from a part of a common pixel array that extends continuously over the image sensor areas 44a-d, the common pixel array being formed on a single chip, for example . For example, only the pixel values ​​of the common pixel array are then read out in the image sensor areas 44a-d. Various mixtures of these alternatives are of course also possible, such as the presence of oneChips for two or more channels and a further chip for in turn other channels or the like. In the case of a plurality of chips of the image sensor 36, these can, for example, be mounted on one or more circuit boards, such as, for example, all together or in groups or the like.

The single-row array 38 can have a carrier 39 on which optics 41a-d of the optical channels are arranged. The carrier 39 can be passed by the optical beam paths 22-1 to 22-4 used for imaging in the individual optical channels. The optical channels of the multi-aperture imaging device can traverse the carrier 39 between the beam deflecting device 18 and an image sensor 36. The carrier 39 can hold a relative position between the optics 41a-d in a stable manner. The carrier 39 can be made transparent and, for example, comprise a glass material and / or a polymer material. The optics 41a-d can be arranged on at least one surface of the carrier 39. This enables a small dimension of the carrier 39 and therefore of the single-line array 38 along a direction parallel to the image sensor 36 and perpendicular to the line extension direction 56, since the optics 41a-d do not need to be framed in a peripheral area thereof. According to exemplary embodiments, the carrier 39 is not or only insignificantly, ie at most 20%, at most 10% or at most 5%, larger than a corresponding dimension along the direction parallel to a main side of the image sensor 36 and perpendicular to the line extension direction 56 -solution of optics 41a-d.

The beam deflecting device can be designed such that, in the first position and in the second stiffening, it deflects the beam path 22-1 to 22-4 of each optical channel 42a-d in a mutually different direction. This means that the deflected beam paths 22-1 to 22-4 can have an angle to one another, as is described in connection with FIG. 6a. The optical channels 16a-d can be arranged in at least one line along a line extension direction 56. The array 38 can be formed as a multi-row array comprising at least two rows or as a single-row array comprising (precisely) one row of optical channels. The optical channels can be directed by the beam deflecting device 18 based on a set viewing direction towards variable fields of view.become. The different angles of the optical channels can be obtained based on the optics of the optical channels and / or based on a mutually different deflection of the optical channels at the beam deflector 18.

The imaging device 16 can comprise an actuator 48a, which is, for example, part of an optical image stabilizer 46a and / or can be used to switch the position or position of the beam deflecting device 18. The optical image stabilizer 46 can be designed to enable optical image stabilization of an image captured by the image sensor 36. For this purpose, the actuator 48a can be designed to generate a rotational movement 52 of the jet turning device 18. The rotational movement 52 can take place about an axis of rotation 54, wherein the axis of rotation 54 of the beam deflection device 18 can be arranged in a central region of the beam deflection device 18 or away from it. The rotational movement 52 can correspond to the rotational movement 28 or the translational movement 26 for switching the beam deflecting device between a first and a second position or operating state can be superimposed. If the beam deflecting device 18 is translationally movable, the translational movement 26 can be arranged in space parallel to a line extension direction 56 of the single-line array 38. The line extension direction 56 can relate to a direction along which the optical channels 42a-d are arranged next to one another. Based on the rotational movement 52, an optical image stabilization can be obtained along a first image axis 58, possibly perpendicular to the line extension direction 56. Thus, the translational movement 26 can be arranged in space parallel to a line extension direction 56 of the single-line array 38. The line extension direction 56 can relate to a direction along which the optical channels 42a-d are arranged next to one another. Based on the rotational movement 52, an optical image stabilization can be obtained along a first image axis 58, possibly perpendicular to the line extension direction 56. Thus, the translational movement 26 can be arranged in space parallel to a line extension direction 56 of the single-line array 38. The line extension direction 56 can relate to a direction along which the optical channels 42a-d are arranged next to one another. Based on the rotational movement 52, an optical image stabilization can be obtained along a first image axis 58, possibly perpendicular to the line extension direction 56.

The optical image stabilizer 46 can alternatively or additionally comprise an actuator 48b which is designed to move the single-row array 38 in a translatory manner along the row extension direction 56. Based on the translational movement of the single-line array 38 along the line extension direction 56, optical image stabilization can be obtained along a second image axis 62, possibly parallel to the line extension direction 56 or parallel to the movement direction of the single-line array 38. The actuators 48a and 48b can be formed, for example, as a piezoelectric actuator, pneumatic actuator, hydraulic actuator, DC motor, stepper motor, thermal actuator, electrostatic actuator, electrostrictive actuator and / or magnetostrictive actuator. The actuators 48a and 48b can be formed identically or differently from one another. Alternatively, an actuator can also be arranged which is designed to move the beam deflecting device 18 in a rotary manner and to move the single-line array 38 in a translatory manner. For example, the axis of rotation 54 can be parallel to the direction of line extension 56. The rotational movement52 about the axis of rotation 54 can result in a small installation space requirement of the imaging device 16 along a direction parallel to the image axis 58, so that the portable device, which includes the imaging device 16 inside a housing, can also have a small size. In simple terms, the portable device can have a flat housing.

The translational movement 26 can be executed, for example, parallel or essentially parallel to an extension of a main side 13a and / or 13b of the device 10, so that there is an additional installation space that may be required for switching the beam deflection device between operating states the line extension direction 56 can be arranged and / or the provision of installation space along a thickness direction of the device can be dispensed with. The actuators 48a and / or 48b can be arranged along the line extension direction and / or perpendicular thereto, parallel to an extension direction of main sides of the housing of the device. In simplified terms, this can be described as that actuators for switching between operating states and / or actuators of the optical image stabilizer can be arranged next to, in front of and behind an extension between the image sensor, the single-line array 38 and the beam deflecting device 18, an arrangement above and / or below being dispensed with is to keep an overall height of the imaging device 16 low. This means that actuators for switching the operating state and / or that of the optical image stabilizer can be arranged in a plane in which the image sensor 36, the single-line array 38 and the beam deflecting device 18 are arranged. in order to keep a structural height of the imaging device 16 low. This means that actuators for switching the operating state and / or that of the optical image stabilizer can be arranged in a plane in which the image sensor 36, the single-line array 38 and the beam deflecting device 18 are arranged. in order to keep a structural height of the imaging device 16 low. This means that actuators for switching the operating state and / or that of the optical image stabilizer can be arranged in a plane in which the image sensor 36, the single-line array 38 and the beam deflecting device 18 are arranged.

According to further exemplary embodiments, the actuator 48b and / or other actuators can be designed to change a distance between the image sensor 36 and the single-line array 38 or the optics of the optical channels. For this purpose, the actuator 48b can be designed, for example, to move the single-line array 38 and / or the image sensor 36 relative to one another along a beam path of the beam paths 22-1 to 22-4 or perpendicular to the line extension direction 56 in order to achieve a focus of the To change the image of the field of view and / or to obtain an autofocus function.

The imaging device 16 can have a focus device which is designed to change the focus of the imaging device. The focus device can be designed to provide a relative movement between the single-line array 38 and the image sensor 36. The focus device can be designed to detect the relative movement while executing a movement of the

Execute beam deflection device 18. For example, the actuator 48b or another actuator can be designed to keep a distance between the single-row array 38 and the beam deflecting device 18 at least essentially constant or at least essentially, possibly exactly constant, even if no additional actuator is used , ie to move the beam deflecting device 18 to the same extent as the single-row array 38. In cameras which do not have a beam deflecting device, an implementation of a focus function can lead to an increased dimension (thickness) of the device.

Based on the beam deflection device, this can be done without an additional dimension along a dimension parallel to a main side of the image sensor 36 and perpendicular to the line extension direction 56 (e.g. a thickness) of the multi-aperture imaging device, since an installation space that enables the movement can be arranged perpendicular thereto. Based on a constant distance between the single-row array 38 and the beam deflection device 18, a beam deflection can be maintained in a set (possibly optimal) state. In simple terms, the imaging device 16 can have a focus device for changing a focus. The focus device can be designed in order to provide a relative movement (focusing movement) between at least one optical system 41a-d of the optical channels of the multi-aperture imaging device 16 and the image sensor 36. The focus device can have an actuator for providing the relative movement, for example the actuator 48b and / or 48a. The beam deflecting device 18 can be moved simultaneously with the focusing movement by appropriate structural design or use, possibly using a further actuator. This means that a distance between the single-row array 38 and the beam deflecting device remains unchanged and / or that the beam deflecting device 18 is moved simultaneously or with a time delay to the same or comparable extent as the focusing movement,

The imaging device 16 comprises a control device 53 which is designed to receive image information from the image sensor 36. For this purpose, an image of the entire field of view is evaluated, which is evaluated by deflecting the beam paths 22-1 to 22-4 of the optical channels 42a to 42d with the first beam deflection area, and a corresponding, ie, matching image is evaluated, which is evaluated by deflecting the beam paths 22- 1 to 22-4 of the optical channels 42a to 42d with the

second beam deflection area is obtained, an order of the first and second images is arbitrary.

The control device 53 can generate two overall images of the captured overall field of view, for example using methods for image combination (stitching), with a first overall image based on the first wavelength range and a second overall image on the second wavelength range.

The control device can be designed to determine a depth map for the first exposure using the second exposure, for example based on a wavelength range that is not visible to humans, for example an infrared range, in particular a near infrared range (NIR). For this purpose, the control device can be designed, for example, to evaluate a pattern that is visible in the second wavelength range. For example, a predefined pattern, for example a point pattern in the NIR wavelength range, can be emitted in the direction of the overall field of view and a distortion of the pattern can be evaluated in the second recording or image. The distortion can be correlated with depth information. The control device 53 can be designed to provide the depth map by evaluating the depth information.

The illumination source can be designed to emit the temporal and / or spatial illumination pattern with a third wavelength range that completely or partially encompasses the second wavelength range, so that the third wavelength range at least partially corresponds to the second wavelength range. This means that a partial reflection of the wavelengths of the emitted pattern is a sufficient source for the second wavelength range arriving at the image sensor and wavelength shifts or partial reflections, for example based on absorptions, are also included. The second wavelength range and the third wavelength range may also be congruent.

As described in connection with FIG. 1, the deflected beam paths of the optical channels can run through a transparent area of ​​a housing of the device, wherein a screen can be arranged in the transparent area. In at least one operating state of the device, a device in a region of the trans-Aperture arranged in the parent area optically at least partially close it in such a way that the opening is effective for two, a plurality or all of the optical channels, ie has the at least partially closed state. In another operating state, the diaphragm can have an open state for the two, the plurality or for all optical channels. This means that the diaphragms can be effective for at least two optical channels of the multi-aperture imaging device. In the first operating state, the screen 24b can optically at least partially close the transparent area 14b for the two, the plurality or all of the optical channels. In the second operating state, the screen 24a can optically at least partially close the transparent area 14a for the two, the plurality or all of the optical channels.

5b shows a schematic perspective view of the multi-aperture imaging device 16 according to an exemplary embodiment in which the array 38 has, for example, two optical channels that include optics 41a-b, any higher number being possible, for example three, four , five or more. In each case one of the optical channels 41a and 41b is designed to capture a partial field of view 64a or 64b of an overall field of view 60. The partial fields of view 64a and 64b overlap with one another and together form the overall field of view 60.

The multi-aperture imaging device 16 comprises an illumination device 55 which is designed to emit a temporal or spatial illumination pattern 55a, in particular in the direction of the overall field of view 60. The illumination pattern 55a can comprise a third wavelength range which at least partially overlaps or corresponds to the second wavelength range so that when the beam paths are deflected using the second beam deflection region, the pattern distorted in the overall field of view hits the image sensor and can be evaluated by the control device 53.

5c shows a schematic sectional side view of a modified imaging device 16 ′, in which the beam deflecting device 18 can be moved between a first position Pos1 of the first operating state and a second position Pos2 of the second operating state based on a rotary movement 52 ′ about the axis of rotation 54. In the first operating state, the imaging device 16 ′ can have a first viewing direction 57a. In the second operating state, the imaging device 16 ′ can have a first viewing direction 57b. Main sides 59a and 59b of the beam deflector18 can be formed reflective as a mirror and / or as facet elements. During a switchover between the operating states, the beam deflection device 18 can be switchable between a central position 61, so that a distance between parallel planes 63a and 63b, which is a minimum dimension of the imaging device 16 'along a normal direction of the planes 63a and 63b can be described by the dimensions of the image sensor 36, the array 38, however, is not influenced by a movement of the beam deflecting device 18. The rotational movement 52 can be superimposed on the rotational movement 28. To put it simply, a superposition of switching and optical image stabilization can be implemented.

Actuators of the multi-aperture imaging device can be arranged in such a way that they are at least partially arranged between two planes 63a and 63b, which are spanned by the sides of a cuboid. The sides of the cuboid can be aligned parallel to one another and parallel to the line extension direction of the array and part of the beam path of the optical channels between the image sensor and the beam deflecting device. The volume of the cuboid is minimal and still includes the image sensor, the array and the beam deflection device as well as their operational movements.

A thickness direction of the multi-aperture imaging device can be arranged normal to the planes 63a and / or 63b. The actuators can have a dimension or extension parallel to the thickness direction. A proportion of at most 50%, at most 30% or at most 10% of the dimension can, starting from an area between planes 63a and 63b, protrude beyond planes 63a and / or 63b or protrude from the area the level 63a and / or 63b out. According to exemplary embodiments, the actuators do not protrude beyond the levels 63a and / or 63b. This has the advantage that an extension of the multi-aperture imaging device along the thickness direction is not increased by the actuators.

A volume of the multi-aperture imaging device can have a small or minimal installation space between the planes 63a and 63b. A construction space of the multi-aperture imaging device can be large or arbitrarily large along the lateral sides or directions of extent of the planes 63a and / or 63b. The volume of the virtual cuboid is influenced, for example, by an arrangement of the image sensor 36, the array 38 and the beam deflection device, the arrangement of these components according to the method described herein.In the exemplary embodiments, the installation space of these components along the direction perpendicular to the planes and consequently the spacing of the planes 63a and 63b from one another becomes small or minimal. Compared to other arrangements of the components, the volume and / or the spacing of other sides of the virtual cuboid can be increased.

6a shows a schematic view of an overall field of view 60 which comprises four overlapping partial fields of view 64a-d. The partial fields of view 64a-d are arranged, for example, along two directions H and V in the object region, which can for example, but not restrictively, designate a horizontal direction and a vertical direction. Any other directional arrangement is possible. Referring to FIG. 5a, for example, the beam path 22-1 to the partial field of view 64a, the beam path 22-2 to the partial field of view 64b, the beam path 22-3 to the partial field of view 64c and / or the beam path 22- 4 can be directed towards the partial field of view 64d. Although an assignment between beam paths 22-1 to 22-4 to the partial fields of view 64a-d is arbitrary, it becomes clear that that, starting from the beam deflecting device 18, the beam paths 22-1 to 22-4 are directed in different directions from one another. Although the total field of view 60 in the exemplary embodiment described is captured by four optical channels that capture the partial fields of view 64a-d, the total field of view 60 can also be captured by any other number of partial fields of view greater than 1, i.e. at least 2, at least 3, at least five, at least seven or more.

FIG. 6b shows a likewise possible division of the overall field of view 60, which is changed from FIG. 6a and is captured, for example, by only two partial fields of view 64a and 64b. The partial fields of view 64a and 64b can be arranged, for example, along the direction V or, as shown in FIG. 6c, along the direction H and overlap one another in order to enable effective image merging. The partial fields of view are only shown with different sizes for better distinguishability, even if this can mean a corresponding optional implementation in this way.

An assignment of the partial fields of view 64a and 64b to the optical channels and a relative alignment of the array 14 can in principle be arbitrary. A direction along which the partial fields of view are arranged, for example V in FIG. 6 b or H in FIG. 6 c, can be arranged as desired in relation to the line extension direction 56 of the array 14. An arrangement is advantageous such that the line extension direction 56 and the direction along which the partial fields of view are arranged at least within a tolerance range of ± 25 °,± 15 ° or ± 5 ° are arranged perpendicular to one another, preferably perpendicular to one another. Thus, in FIG. 6b, the line extension direction 56 is arranged, for example, parallel to the direction H arranged perpendicular to V. FIG. In FIG. 6c, the line extension direction 56 is also rotated in accordance with the arrangement of the partial visual fields 64a and 64b rotated with respect to FIG. 6b, so that the line extension direction 56 is parallel to V or, within the specified tolerance range, perpendicular to H. The optical channels 42a c and the image sensor regions 44a-c could thus overlap in the plane of representation in FIG. 6c or be congruent within the tolerance range and are shown offset from one another for the sake of representation.

Multi-aperture imaging devices in accordance with exemplary embodiments can be designed to capture the entire field of view 60 through at least two partial fields of view 64a-b. At least one of the partial facial fields can be recorded differently than single-channel recorded partial visual fields, for example partial visual field 64b or the partial visual fields according to the explanations for FIG. 6a, by at least one first optical channel 42a and a second optical channel 42c. For example, the entire field of view can be segmented into exactly two partial fields of view 64a and 64b. Exactly one of the partial fields of view, for example the partial field of view 64a, can be captured by two optical channels 42a and 42c. Other partial fields of view can be recorded using one channel.

Multi-aperture imaging devices according to exemplary embodiments provide for this purpose the use of exactly two optical channels in order to image the two partial fields of view 64a and 64b in the respective wavelength range or in both wavelength ranges. There is the possibility that coverings or occlusion effects may occur in the overlap area with such a configuration, which means that instead of a double detection of a field of view arranged behind an object, only one viewing angle is detected. To reduce or avoid such effects, some exemplary embodiments provide for at least one of the partial facial fields 64a and / or 64b to be recorded with a further optical channel 42a-c, so that at least this channel 42a-c is recorded multiple times, in particular twice.

As shown in FIGS. 6b and 6c, optical channels 42a and 42c and / or image sensor areas 44a and 44c can be used for multiple detection of a partial facial area. des 64 can be arranged symmetrically around an optical channel 42b for capturing the other partial field of view, spaced apart from one another in array 14 by at least one optical channel 42b directed towards another partial field of view and / or an enlarged or maximum distance from one another within the array to allow for a degree of disparity.

7a shows a schematic perspective view of a device 70i, which comprises a first multi-aperture imaging device 16a and a second multi-aperture imaging device 16b, and is designed to capture the entire field of view 60 stereoscopically with the multi-aperture imaging devices. The overall field of view 60 is arranged, for example, on a main page 13b facing away from main page 13a. For example, the multi-aperture imaging devices 16a and 16b can capture the entire field of view 60 through transparent areas 14a and 14c, respectively, with apertures 24a and 24c arranged in the main side 13b being at least partially transparent. Panels 24b and 24d arranged in the main side 13a can optically at least partially close off transparent areas 14b and 14d, so that an amount of false light from a side facing the main side 13a, which can falsify the recordings of the multi-aperture imaging devices 16a and / or 16b, is at least reduced. Although the multi-aperture imaging devices 16a and 16b are shown spatially spaced apart from one another, the multi-aperture imaging devices 16a and 16b can also be arranged spatially adjacent or combined. For example, the single-line arrays of the imaging devices 16a and 16b can be arranged next to one another or parallel to one another. The single-line arrays can form rows to one another, with each multi-aperture imaging device 16a and 16b having a single-line array.

The transparent areas 14a-d can additionally be equipped with a switchable screen 24a-d, which covers the optical structure in the event that it is not used. The screen 24a-d can comprise a mechanically moved part. The movement of the mechanically moved part can take place using an actuator, as described, for example, for the actuators 48a and 48b. The diaphragm can alternatively or additionally be electrically controllable and comprise an electrochromic layer or an electrochromic layer sequence.

According to an embodiment preferred in FIG. 7b, a device 70 2 is designed similarly to device 70 1 , but designed so that the depth information is created instead of a stereoscopic recording from the recording in one of the wavelength ranges, for example via the evaluation a pattern distortion in a non-visible wavelength range. According to this preferred embodiment, the device 70 is designed and configured, for example, with only a single imaging device 18 in order to record the entire field of view from one perspective, namely that of the imaging device 16, and not to capture a stereoscopic image of the overall field of view.

The device 70 can also be designed according to the preferred embodiment to provide or generate a depth map of the overall field of view, for example by evaluating a pattern distortion in one of the detected wavelength ranges, for example by the control device 53 or a computing device of the device 70 set up for this purpose or the imaging device 16.

The device 70 can be implemented without an additional infrared camera supplementing or expanding the imaging device 16, since such a functionality is already implemented in the imaging device 16, possibly with the inclusion of the lighting device 55.

According to one in Fig. 7c shown another preferred embodiment of the Abbil plication device 16 is a device 70 3 is formed to face the devices 70 1 and 70 2 have only one viewing direction, so that sponding entspre-to an arrangement of a viewing window in other directions including the already optional panels can be dispensed with.

By evaluating the two wavelength ranges, the devices 70 2 and 70 3 can also be designed to create a depth map of the overall field of view.

8 shows a schematic structure comprising a first multi-aperture imaging device 16a and a second multi-aperture imaging device 16b, as it can be arranged, for example, in the imaging system 70 1 . The multi-aperture imaging devices 16a and 16b can be formed entirely or partially as a common multi-aperture imaging device. The single line arrays 38a and 38b form a common line. The image sensors 36a and 36b can be on a common substrate or on a common circuit carrier such as a common circuit board or a common

Flexboard must be mounted. Alternatively, the image sensors 36a and 36b can also comprise substrates that are different from one another. Various mixtures of these alternatives are of course also possible, such as multi-aperture imaging devices comprising a common image sensor, a common array and / or a common beam deflection device 18 as well as further multi-aperture imaging devices which have separate components. The advantage of a common image sensor, a common single-line array and / or a common beam deflection device is that a movement of a respective component can be obtained with great precision by controlling a small number of actuators and synchronization between actuators is reduced or can be avoided. Furthermore, high thermal stability can be obtained. As an alternative or in addition, further multi-aperture imaging devices can also have a common array, a common image sensor and / or a common beam deflection device. By arranging at least one further group of imaging optical channels, any number of which can be implemented, the multi-aperture imaging device can be designed to capture the entire field of view at least stereoscopically.

It has already been pointed out above that the beam paths or optical axes, starting from the beam deflecting device, can be directed in mutually different directions. This can be achieved in that the beam paths are deflected at the beam deflecting device and / or by the optics in a manner deviating from parallelism to one another. The beam paths or optical axes can deviate from a parallelism before or without beam deflection. This fact is described in the following by the fact that the channels can be provided with a kind of advance divergence. With this advance divergence of the optical axes, it would be possible, for example, that not all facet inclinations of facets of the beam deflection device differ from one another, but that some groups of channels, for example, have facets with the same inclination or are directed onto them. The latter can then be formed in one piece or continuously merging into one another, quasi as a facet which is assigned to this group of channels which are adjacent in the direction of line extension. The divergence of the optical axes of these channels could then originate from the divergence of these optical axes, as is achieved by a lateral offset between optical centers of the optics of the optical channels and image sensor areas of the channels. The advance divergence could be limited to one level, for example. The optical axes could, for example, run in a common plane before or without beam deflection, but divergent in this plane, and the The latter can then be formed in one piece or continuously merging into one another, quasi as a facet which is assigned to this group of channels which are adjacent in the direction of line extension. The divergence of the optical axes of these channels could then originate from the divergence of these optical axes, as is achieved by a lateral offset between optical centers of the optics of the optical channels and image sensor areas of the channels. The advance divergence could be limited to one level, for example. The optical axes could, for example, run in a common plane before or without beam deflection, but divergent in this plane, and the The latter can then be formed in one piece or continuously merging into one another, quasi as a facet which is assigned to this group of channels which are adjacent in the direction of line extension. The divergence of the optical axes of these channels could then originate from the divergence of these optical axes, as is achieved by a lateral offset between optical centers of the optics of the optical channels and image sensor areas of the channels. The advance divergence could be limited to one level, for example. The optical axes could, for example, run in a common plane before or without beam deflection, but divergent in this plane, and the which is assigned to this group of adjacent channels in the direction of line extension. The divergence of the optical axes of these channels could then originate from the divergence of these optical axes, as is achieved by a lateral offset between optical centers of the optics of the optical channels and image sensor areas of the channels. The advance divergence could be limited to one level, for example. The optical axes could, for example, run in a common plane before or without beam deflection, but divergent in this plane, and the which is assigned to this group of adjacent channels in the direction of line extension. The divergence of the optical axes of these channels could then originate from the divergence of these optical axes, as is achieved by a lateral offset between optical centers of the optics of the optical channels and image sensor areas of the channels. The advance divergence could be limited to one level, for example. The optical axes could, for example, run in a common plane before or without beam deflection, but divergent in this plane, and the The advance divergence could be limited to one level, for example. The optical axes could, for example, run in a common plane before or without beam deflection, but divergent in this plane, and the The advance divergence could be limited to one level, for example. The optical axes could, for example, run in a common plane before or without beam deflection, but divergent in this plane, and theFacets only cause an additional divergence in the other transverse plane, that is, they are all inclined parallel to the direction of line extension and against each other only differently to the aforementioned common plane of the optical axes, whereby here again several facets can have the same inclination or one Group of channels could be assigned jointly, the optical axes of which already differ, for example, in the aforementioned common plane of the optical axes in pairs before or without beam deflection. To simplify matters, the optics can enable a (preliminary) divergence of the beam paths along a first (image) direction and the beam deflection device a divergence of the beam paths along a second (image) direction.

The mentioned possible pre-divergence can be achieved, for example, in that the optical centers of the optics lie on a straight line along the line stretching direction, while the centers of the image sensor areas are projected from the projection of the optical centers along the normal of the plane of the image sensor areas onto points on a Straight lines in the image sensor plane are arranged differently, for example at points that deviate from the points on the aforementioned straight line in the image sensor plane individually for each channel along the line extension direction and / or along the direction perpendicular to both the line extension direction and the image sensor normal. Alternatively, advance divergence can be achieved by placing the centers of the image sensors on a straight line along the direction of extension of the line. while the centers of the optics are arranged deviating from the projection of the optical centers of the image sensors along the normal of the plane of the optical centers of the optics to points on a straight line in the optic center plane, such as at points that are separated from the points on the aforementioned straight line in of the optics center level, channel-specific! deviate along the line extension direction and / or along the direction perpendicular to both the line extension direction and the normal of the optical center plane. It is preferred if the aforementioned channel-specific deviation from the respective projection runs only in the direction of extension of the lines, that is to say the optical axes are only located in a common plane with a previous divergence. Both optical centers and image sensor area centers then each lie on a straight line parallel to the direction of extension of the drawing, but with different intermediate distances. On the other hand, a lateral offset between the lenses and image sensors in a perpendicular lateral direction to the direction of extension of the lines led to an increase in the overall height. A pure in-plane offset in the direction of extension does not change the overall height, but it does resultpossibly fewer facets and / or the facets only have a tilt in one angular orientation, which simplifies the structure. For example, neighboring optical

Channels running in the common plane, each cross-eyed against one another, that is to say provided with an advance divergence, have optical axes. A facet can be arranged with respect to a group of optical channels, only inclined in one direction and parallel to the direction of line extension.

Furthermore, it could be provided that some optical channels are assigned to the same partial field of view, such as for the purpose of super resolution or to increase the resolution with which the corresponding partial field of view is scanned through these channels. The optical channels within such a group then run parallel, for example before beam deflection, and would be deflected by a facet onto a partial field of view. Advantageously, pixel images of the image sensor of a channel of a group would be in intermediate positions between images of the pixels of the image sensor of another channel of this group.

For example, without super resolution purposes, but only for stereoscopic purposes, an embodiment would be conceivable in which a group of directly adjacent channels in the direction of line extension completely cover the entire field of view with their partial fields of view, and another group of channels directly adjacent to one another the entire field of view in turn cover completely.

The above embodiments can therefore be implemented in the form of a multi-aperture imaging device and / or a device comprising such a multi-aperture imaging device, specifically with a single-line channel arrangement, with each channel transmitting a partial field of view of an overall field of view and the partial fields of view partially overlapping. A structure with several such multi-aperture imaging devices for stereo, trio, quattro, etc. structures for 3D image recording is possible. The plurality of modules can be designed as a coherent line. The connected line could use identical actuators and a common beam deflecting element. One or more reinforcing substrates that may be present in the beam path can extend over the entire line, forming a stereo, trio, Quattro construction can extend. Superresolution methods can be used, with several channels depicting the same partial image areas. The optical axes can also run divergent without a beam deflection device, so that fewer facets on the beam deflectionsteering unit are required. The facets then advantageously have only one helical component. The image sensor can be in one piece, have only one contiguous pixel matrix or several interrupted ones. The image sensor can be composed of many partial sensors, which are arranged next to one another on a printed circuit board, for example. An autofocus drive can be designed in such a way that the beam deflecting element is moved synchronously with the optics or is stationary.

In principle, any number of sub-modules comprising image sensor (s), imaging optics (s) and mirror array (s) can be arranged. Sub-modules can also be set up as a system. The sub-modules or systems can be installed in a housing such as a smartphone. The systems can be arranged in one or more rows and / or rows and at any point. For example, two imaging devices 16 can be arranged in the housing 12 in order to enable a stereoscopic detection of a field of view.

According to further exemplary embodiments, the device 70 comprises further multi-aperture imaging devices 16, so that the overall field of view 60 can be scanned with more than two multi-aperture imaging devices. This enables a number of partially overlapping channels, which take up the entire field due to their viewing directions, which are adapted for each channel. For a stereoscopic or a higher order detection of the overall field of view, at least one further arrangement of channels according to the exemplary embodiments described herein and / or the described arrangement of channels can be arranged, which can be designed as exactly one line or as separate modules. This means that the single-line array can be arranged in multiple lines with another line, wherein the further row of optical channels can be assigned to a further multi-aperture imaging device. The optical channels of the further row can also each receive overlapping partial areas and together cover the entire field of view. This makes it possible to obtain a stereo, trio, quattro, etc. structure of array cameras, which consist of channels that partially overlap and, within their subgroups, cover the entire field of view.

In other words, multi-aperture cameras with a linear channel arrangement can comprise a plurality of optical channels which are arranged next to one another and each transmit parts of the overall field of view. According to exemplary embodiments, a mirror (beam deflection device) can advantageously be arranged in front of the imaging lenses, which mirror can be used for beam deflection and for reducing the overall height of the device

can contribute. In combination with a mirror adapted for each channel, such as a facet mirror, where the facets can be planar or arbitrarily curved or provided with a free-form surface, it can be advantageous to design the imaging optics of the channels essentially identically, whereas the viewing directions of the channels are influenced or specified by the individual facets of the mirror array. In combination with a planar (flat) mirror, the imaging optics of the channels can be designed or shaped differently, so that different viewing directions result. The deflecting mirror (beam deflecting device) can be rotatably mounted, the axis of rotation being able to run perpendicular to the optical channels, ie parallel to the line extension direction of the channels. The deflecting mirror can be reflective on both sides, with metallic or dielectric layers or layer sequences being able to be arranged in order to obtain reflectivity. A rotation or translational displacement of the mirror can take place in an analog or bistable manner or repeatedly in a stable manner. It can be understood as stable when a force has to be applied to move along a foreseen direction, and if the force falls below this limit, the beam deflecting device may stop or move backwards.

The analog rotation (rotational movement 52) ​​can be used for a one-dimensional adaptation of the image position, which can be understood as optical image stabilization. For example, a movement of only a few degrees can be sufficient, for example ≤ 15 °, 10 ° or 1 °. The bistable or multiple stable rotation of the mirror can be used to switch the viewing direction of the camera. For example, you can switch between the viewing directions in front of, next to and behind the display. Analog and bistable / multiply stable movements or positions can be combined, ie superimposed. For example, through the exemplary embodiments described herein, solutions in portable devices, such as smartphones, that use two cameras with different viewing directions forwards and backwards, can be replaced by a structure that comprises only one imaging device. The structure can distinguish itself from known solutions, for example, in that the viewing window in the housing for the cameras is arranged in the same position, facing forwards and backwards, ie opposite in the upper or lower housing cover. Areas of these housing covers which are arranged for the beam passage can be transparent and, in the case of the use of visible light, can consist of glass and / or polymers or comprise these. The structure can distinguish itself from known solutions, for example, in that the viewing window in the housing for the cameras is arranged in the same position, facing forwards and backwards, ie opposite in the upper or lower housing cover. Areas of these housing covers that are arranged for the beam passage can be transparent and, in the case of the use of visible light, can consist of glass and / or polymers or comprise these. The structure can distinguish itself from known solutions, for example, in that the viewing window in the housing for the cameras is arranged in the same position, facing forwards and backwards, ie opposite in the upper or lower housing cover. Areas of these housing covers that are arranged for the beam passage can be transparent and, in the case of the use of visible light, can consist of glass and / or polymers or comprise these.

Although the previously described exemplary embodiments are described in such a way that the device has a first and a second operating state, according to further exemplary embodiments, further operating states for detecting further, ie at least a third field of view, can be arranged.

In the following, particularly advantageous configurations of multi-aperture imaging devices are described with reference to FIGS. 9a-d, which can be used alone or as part of a device according to the invention, for example device 70 1 , 70 2 and / or 70 3 .

The side sectional views shown relate, for example, to the respective facets of a faceted beam deflection device. The beam deflecting device can be formed, for example, as an array of facets. A facet can be assigned to each optical channel, and each facet can deflect one or more optical channels. Each of the facets can have a corresponding first beam deflecting area and a second beam deflecting area. As shown in FIGS. 4c-4f, the facets of the array of facets can be formed as mirrors reflective on both sides. The in Fig. 4c-4f can enable a low overall height, especially when using only one viewing direction or when combining a rotary movement with a translational movement to switch between the four positions of the beam deflecting direction used for recording two viewing directions and the use of two wavelength ranges. For this purpose, the beam deflecting device can be moved so that the front edge of the facet is moved slightly up and down for alternately deflecting with different sides, without the surface normal of the sides 35a and 35b being parallel to a surface normal of the image sensor.

In return, a simple and / or small structural size along the line extension direction of the array can be obtained in that the beam deflecting device is rotatably supported by 90 ° or more, for example approximately 180 ° or even 360 °. For example, the four mentioned positions or positions can be obtained by a purely rotational movement so that additional facets and / or a translational movement can be dispensed with. This also enables a simple design of the facets as plane-parallel mirrors, for example as a single plane-parallel mirror with adjustment of the divergence of the beam paths by means of the optics and / or as mutually inclined or tilted plane-parallel facets that completely or partially adjust the divergence.

9a shows a schematic side sectional view of a multi-aperture imaging device 90 according to an embodiment, in which opposite sides 18A and 18B are designed to deflect a beam path 22 so that on sides 18A and

18B there is a filtering with respect to the reflected wavelength. The beam deflection device is shown in a first position in which the side 18A faces the image sensor 36.

The beam deflecting device 18A has a first beam deflecting area which is formed, for example, on the side 18A and which is effective for a first wavelength range of electromagnetic radiation passing through the optical channel, for example the visible wavelength range. The beam deflecting device has a second beam deflecting area 18B which, for example, for a second wavelength range different from the first wavelength range, such as ultraviolet (UV) infrared (IR) or near infrared (NIR), the electromagnetic Radiation is effective.

The wavelength ranges can be disjoint, but can also partially overlap, as long as they are at least partially different and thus enable different image information to be obtained.

This enables recordings of different wavelength ranges to be obtained by means of the image sensor 36, so that, for example, the second recording can be used to create a depth map for the first recording, in particular in combination with a coded (N) IR pattern that is transmitted by the device 90 is sent out.

In Fig. 9a the beam deflecting device 18 is shown in a first position. The beam deflecting device can be designed to obtain an angle of incidence α 1 of the first beam deflecting region 18A with respect to the

Image sensor of 45 ° within a tolerance range of ± 10 ° ± 5 ° or ± 2 °. For example, the side 18A completely provides the corresponding first beam deflection area and the side 18B completely provides the corresponding second beam deflection area, so that the terms are used synonymously here. However, the beam deflection areas can also only cover part of the side,

In Fig. 9b, the beam deflection device 18 is shown in a second position in which the side 18B faces the image sensor, so that the side 18B is effective, for example around NIR Redirect light. For example, the beam deflecting device 18 can be rotated by 180 ° with respect to the first position. The beam deflecting area 18A can be arranged on a first side of the beam deflecting device 18 and the second beam deflecting area 18B on a second side arranged opposite the first side. The beam deflection device 18 can be designed as a whole or in the individual beam deflection elements so that the first side is arranged facing the image sensor for capturing a first exposure of the entire field of view, and the second side is arranged facing the image sensor for capturing a second exposure of the entire field of view. A rotary and / or translational movement can be used to change the sides facing the image sensor.

A plane-parallel configuration of the beam deflecting device or the facet thereof enables the facet or beam deflecting device 18 to have an angle of incidence α 2 in order to obtain a second image of the overall field of view, for example using the second wavelength rangeof the second beam deflection area 18B with respect to the image sensor of 45 ° within a tolerance range of ± 10 °, ± 5 ° or ± 2 °. The tolerance ranges can, for example, compensate for the fact that beam deflection elements include an angle of incidence slightly different from 45 °, which results from an inclination or tilting of different facets of the beam deflection device 18 with respect to one another, so that the individual facets are obtained in an average of around 45 ° or deflection areas differ from this due to the individual inclination.

The beam deflecting regions 18A and 18B can be obtained by coatings which are configured differently from one another and which are either reflective or non-reflective in the first or second wavelength range.

Embodiments provide that a corresponding coating with one or more layers is provided on the sides of the beam deflecting device 18 in order to produce the beam deflecting regions 18A and 18B. These layers can have, for example, one or more dielectric layers which, with regard to their layer thickness, can be adapted to the angle of incidence of the beam deflecting device.

Since, depending on the selected operating mode or the wave length range currently desired for the recording, portions of wavelength ranges, in particular of the respective other wavelength range, can strike the beam deflecting device 18,some exemplary embodiments have a range for the absorption of certain wavelengths, for example a volume absorber or the like. The area can be covered by the coating so that, for example, some wavelengths are first reflected and non-reflected, for example transmitted, wavelength ranges are absorbed. For example, when the first wavelength range is recorded, the corresponding wavelengths can be reflected by the coating, while other wavelengths, for example at least undesired parts of the second wavelength range, are for example transmitted by these layers, that is to say let through. The absorption area behind the coating can absorb these components, in order to avoid or at least reduce a negative influence on the imaging in the multi-aperture imaging device. A complementary device for absorbing undesired parts of the first wavelength range, which is effective when the second beam deflection area 18B is used for beam deflection, can be arranged on the second side.

9c shows the beam deflecting device 18 is shown in an optional third position in which the side 18A again faces the image sensor, but the inclination is selected so that the beam paths are deflected in the direction of a second overall field of view, e.g. first overall field of view from FIGS. 9a and 9b.

9d shows the beam deflecting device in an optional fourth position in which side 18B again faces the image sensor, so that side 18B is effective, for example, to deflect from the second overall field of view in the direction of image sensor 36.

Due to the additional positions according to FIGS. 9c and 9d for capturing the second total field of view, a recording of the second total field of view can be captured using the first beam deflection area 18A with the image sensor, so that this recording is based on the first wavelength range. In addition, the second overall field of view can be imaged with a further recording, specifically using the beam deflection area 18B with the image sensor, so that this recording is based on the second wavelength range.

The two overall fields of view can be arranged along different main directions of the multi-aperture imaging device, for example along opposite directions, that is, along approximately 180 ° different directions. When executing a progressive rotary movement, the beam deflecting regions can, for example, along

in a sequence analogous to the sequence of FIGS. 9a-d, the beam path alternating in the direction of the first overall field of view and the second overall field of view and alternating with the first beam deflecting area 18A and the second beam deflecting area

Deflect 18B. This can be a possible but not absolutely necessary sequence of movements. Rather, for example, the direction of rotation can always be selected that enables the shortest and / or fastest change of position, so that it is possible to switch between the positions in any order, especially in the case of a third overall field of view being captured along a third direction and / or with an arrangement of the total fields of view at an angle of not equal to 180 °.

The angles in FIGS. 9a-9d can be approached in any order, approximately 45 ° each.

Instead of or in combination with the rotary displacement described, a translational displacement of the beam deflecting device can also be implemented.

To obtain images, image information or images with different wavelength information, pixels of the image sensor can be designed to be effective for both wavelength ranges and / or cells with different sensitivity can be arranged spatially adjacent so that at least the Image sensor area is sensitive for both wavelength ranges.

For example, the image sensor areas can be designed for image generation in the first wavelength range and for image generation in the second wavelength range. For example, CMOS pixels can be sensitive in the visual and NIR range at the same time, the overlying color filter array (“CFA” - typically in Bayer arrangement in the visual) can be (red, green, blue or magenta) depending on the color , cyan, yellow / yellow) but also contain “filter pixels”, of which only some also transmit the NIR and also only partially, but that is sufficient. Alternatively or additionally, in a cell arrangement, for example in the extended Bayer pattern, individual cells can be replaced or implemented by cells that are only sensitive to the NIR.

For example, pixels of the image sensor areas can be designed for image generation in the first wavelength range and for image generation in the second wavelength range.

The invention thus relates to a beam deflecting device in facetVISION architecture with different configurations of the mirror front and mirror rear sides, with facetVISION relating to the multi-aperture imaging devices described herein.

A key idea is to design the deflection mirror in such a way that it has different functionalities on the front and back.

This applies in particular to the reflectivity, in particular spectral reflectivity (i.e. depending on the incident wavelengths), in particular the 1st side reflects the visual spectral range (visual - VIS), but not the near infrared (NIR) and the The 2nd side reflects NIR under the desired beam deflection, but not VIS, all of this, for example, through differently designed dielectric layer systems on the 1st and 2nd mirror sides.

This enables

• The same camera can "simultaneously" or very quickly one behind the other - only through

Mirror switching, can be used as a VIS or NIR camera.

• Mirror no longer necessarily has a wedge shape, but is a simple plane-parallel plate. 180 ° rotation used to switch between VIS / NIR mirrors. Any negative installation space implications in the area of ​​rotation of the mirror can be cured by opening and closing cover glasses at the location of the windows (passage openings of the device).

• The camera can only be designed with a one-sided viewing direction ("world" or "selfie"), mirror switching (180 °) then only serves to change the recorded spectral range. But can still allow front and back lines of sight. Then, for example, in 90 ° rotation steps of the mirror: World-VIS, Selfie-NIR, World-NIR, Selfie-VIS.

• Of course, combination with field of view division and image stitching (for example 2 channels).

• Also possible as a dual camera design to generate a disparity-based depth map for image stitching (for example 4 channels). However, this is not necessary (and thus channel-saving and thus considerably cost-saving), because:

• Can the above arrangement now combine with structured or coded lighting (à la Kinect) in the NIR (the camera now also sees in a mirror position in the

NIR) and can generate a depth map from it, which is necessary for image stitching of the VIS image. All of this only with two camera channels divided into two fields of view, the special mirror and only with the addition of the NIR point pattern projector, without an additional NIR camera.

• The goal of reducing from 4 to 2 channels achieved, even without adding an additional NIR camera (would be a 3rd optical channel), only an additional NIR projector is required

• Cost reduction while maintaining the height advantage, only through alternative generation of the depth map, which is partly integrated into the system itself

10 shows a schematic graph of a sensitivity E of an image sensor area of ​​the image sensor of the multi-aperture imaging device over the wavelengths λ of wavelength areas 66 and 68, for example the sensitivity of one or more of the image sensor areas 44a-d. The image sensor areas can be designed for image generation in the first wavelength range 66 and for image generation in the second wavelength range 68. The first wavelength range 66 is arranged, for example, between a first lower wavelength λ 1 and a first upper wavelength λ 2 , with λ 1 <λ z . The second wavelength range 68 is, for example, between a second lower wavelength λ 3and a second upper wavelength λ 4 , with λ 3 <λ 4 . Although FIG. 10 is shown in such a way that the second wavelength range 68 has larger wavelengths than the first wavelength range 66, it is also possible that the second wavelength range 68 has smaller wavelengths than the first wavelength range 66 can overlap with one another, but can also be spaced apart from one another by an intermediate region 72.

The image sensor area can be designed to generate image data at least in the wavelength ranges 66 and 68; does not generate any image data or image signals because it is insensitive to these wavelengths.

The beam deflection can take place selectively for the wavelength ranges 66 and 68, so that a respective attenuation or filtering out of wavelengths takes place outside the respective wavelength range for which the beam deflection range is currently effective, whereby it is sufficient that at least the wavelengths are suppressed or attenuated which are arranged in the complementary wavelength range. This means that, for example, a wavelength range for which the image sensor is insensitive can also be deflected by the beam deflection area 18A and / or 18B. In simple terms, the image sensor area can also be designed for imaging outside of the wavelength areas 66 and 68.

For example, the image sensor area can have a multiplicity of image points, ie, pixels (picture element). Each pixel can be formed from at least one, preferably a plurality of imaging, ie photosensitive, sensor cells. These can be arranged freely or according to a pattern, for example a Bayer pattern. A sensitivity of the image sensor area for the second wavelength range 68 can be obtained, for example, in that a first subset of pixels is sensitive for the first wavelength range 66 and a second subset of other pixels is sensitive for the second wavelength range 68. A pixel of the first subset can, depending on the desired resolution of the first and / or second recording, be arranged interlaced with one another and alternately, ie, 1: 1, or in a different ratio. Alternatively or additionally, it is possible for one, several or all of the sensor cells of a pixel to be sensitive to the first and second wavelength ranges 66 and 68. Alternatively or additionally, it is also possible to change the pattern of the sensor cells for the first wavelength range 66 in such a way that sensitive sensor cells are added for the second wavelength range 68 and / or replace sensor cells from the pattern. Pixels of the image sensor areas can thus be designed for generating images in the first wavelength range 66 and / or at least partially for generating images in the second wavelength range 68. to change the pattern of the sensor cells for the first wavelength range 66 such that sensitive sensor cells are added for the second wavelength range 68 and / or substitute sensor cells from the pattern. Pixels of the image sensor areas can thus be designed for generating images in the first wavelength range 66 and / or at least partially for generating images in the second wavelength range 68. to change the pattern of the sensor cells for the first wavelength range 66 such that sensitive sensor cells are added for the second wavelength range 68 and / or replace sensor cells from the pattern. Pixels of the image sensor areas can thus be designed for generating images in the first wavelength range 66 and / or at least partially for generating images in the second wavelength range 68.

Although some aspects have been described in connection with a device, it goes without saying that these aspects also represent a description of the corresponding method, so that a block or a component of a device can also be used as a corresponding method step or as a feature of a method step understand is. Analogously to this, aspects that were described in connection with or as a method step also represent a description of a corresponding block or details or features of a corresponding device.

The above-described exemplary embodiments are merely illustrative of the principles of the present invention. It is understood that modifications and variations of the arrangements and details described herein will entrust other persons skilled in the art.

will shine. It is therefore intended that the invention be limited only by the scope of protection of the following patent claims and not by the specific details presented herein on the basis of the description and the explanation of the exemplary embodiments.
Claims

1. Multi-aperture imaging device with:

an image sensor (36);

an array (38) of juxtaposed optical channels (42a-d), each optical channel (42a-d) having optics for mapping at least a partial field of view (64a-d) of an overall field of view (60) onto an image sensor area (46a) d) the image sensor (36) comprises,

a beam deflecting device (18) for deflecting a beam path of the optical channels (42a-d),

wherein the beam deflecting device (18) has a first beam deflecting area (18A) which is effective for a first wavelength range (66) of electromagnetic radiation running through the optical channel (42a-d); and has a second beam deflecting region (18B) which is effective for a second wavelength region (68) of the electromagnetic radiation passing through the optical channels (42a-d) different from the first wavelength region (66).

2. Multi-aperture imaging device according to claim 1, which is designed to capture a first image of the entire field of view (60) using the first beam deflection region (18A) with the image sensor (36), so that the first image is based on the first wavelength range (66) ; and to acquire a second image of the entire field of view (60) using the second beam deflection region (18B) with the image sensor (36), so that the second image is based on the second wavelength range (68).

3. Multi-aperture imaging device according to claim 2, which is designed to determine a depth map for the first image using the second image.

4. Multi-aperture imaging device according to one of the preceding claims, in which the first beam deflecting region (18A) on a first side of the beam deflecting device (18) and the second beam deflecting region (18B) on a second, the first

Side arranged opposite side, and the beam deflection device (18) is designed such that the first side is arranged facing the image sensor (36) for capturing a first exposure of the entire field of view (60), and for capturing a second exposure of the total field of view (60), the second side is arranged facing the image sensor (36).

5. Multi-aperture imaging device according to one of the preceding claims, in which a first side of the beam deflecting device (18) has a coating different from a second, opposite side in order to be effective in the first or second wavelength range (66, 68).

6. Multi-aperture imaging device according to one of the preceding claims, in which the beam deflecting device (18) is designed to reflect the first wavelength range (66) when it is effective in the first wavelength range (66) and to at least partially absorb and / or absorb different wavelength ranges therefrom the beam deflecting device (18) is designed to reflect the second wavelength range (68) when it is effective in the second wavelength range (68) and to at least partially absorb different wavelength ranges therefrom.

7. Multi-aperture imaging device according to one of the preceding claims, in which the overall field of view (60) is a first overall field of view and which has a first direction of view for capturing the first overall field of view and a second direction of view to a second overall field of view;

wherein the multi-aperture imaging device is designed to capture a third image of the second overall field of view using the first beam deflection region (18A) with the image sensor (36), so that the third image is based on the first wavelength range (66); and to capture a fourth image of the second overall field of view using the second beam deflection region (18B) with the image sensor (36), so that the fourth image is based on the second wavelength range (68).

8. Multi-aperture imaging device according to one of the preceding claims, in which the first overall field of view and the second overall field of view are arranged along different main directions of the multi-aperture imaging device, and the beam deflection areas (18A-B) alternate the beam path in the direction of the deflects the first overall field of view and the second overall field of view and alternately with the first beam deflection area (18A) and the second beam deflection area (18B).

9. Multi-aperture imaging device according to one of the preceding claims, in which the beam deflecting device (18) is designed to achieve an angle of incidence (α 1 ) of 45 ° ± 10 ° of the first beam deflection area ( 60) to obtain a first exposure of the entire field of view (60). 18A) with respect to the image sensor (36) and in order to have a setting angle (α 2 ) of 45 ° ± 10 ° of the second beam deflection area (18B) with respect to the image sensor (36) to obtain a second image of the entire field of view (60) .

10. Multi-aperture imaging device according to one of the preceding claims, which is designed to capture the entire field of view (60) through at least two partial fields of view (64a-d) and to cover at least one of the partial fields of view (64a-b) through at least one first optical channel ( 42a) and a second optical channel (42c).

11. Multi-aperture imaging device according to claim 10, which is designed to segment the entire field of view into exactly two partial fields of view (64a-b) and to divide exactly one of the partial fields of view (64a) through a first optical channel (42a) and a second optical channel ( 42c).

12. Multi-aperture imaging device according to claim 10 or 11, in which the first optical channel! (42a) and the second optical kana! (42c) are spaced apart by at least one further optical channel (42b) in the array (14).

13. Multi-aperture imaging device according to one of the preceding claims, in which the beam deflecting device (18) is formed as an array of facets (32), each optical channel (42a-d) being assigned to a facet (32), and each of the facets being assigned to the first beam deflecting region (18A) and the second beam deflection region (18B).

14. Multi-aperture imaging device according to claim 13, in which the facets (32) of the array of facets are formed as double-sided reflective plane-parallel mirrors.

15. Multi-aperture imaging device according to one of the preceding claims, in which the image sensor areas (46a-d) are designed for image generation in the first wavelength range (66) and for image generation in the second wavelength range (68).

16. Multi-aperture imaging device according to claim 15, in which the pixels of the image sensor areas (46a-d) are designed for image generation in the first wavelength range (66) and at least partially for image generation in the second wavelength range (68).

17. Multi-aperture imaging device according to one of the preceding claims, in which the first wavelength range (66) comprises a visible spectrum and in which the second wavelength range (68) comprises an infrared spectrum, in particular a near (infrared spectrum).

18. Multi-aperture imaging device according to one of the preceding claims, further comprising an illumination device (55) which is designed to emit a temporal or spatial illumination pattern (55a) with a third wavelength range which is at least partially the second wavelength range (68 ) is equivalent to.

19. Multi-aperture imaging device according to one of the preceding claims, which is designed to capture the entire field of view (60) at least stereoscopically.

20. Multi-aperture imaging device according to one of the preceding claims, in which the beam deflection device (18) is designed to block or attenuate the second wavelength range (68) with the first beam deflection area (18A), and to use the second beam deflection area ( 18B) to block or attenuate the first wavelength range (66).

21. Device with a multi-aperture imaging device according to one of the preceding claims, which is designed to generate a depth map of the entire field of view (60).

22. The device according to claim 21, which does not have an additional infrared camera.

23. The device according to claim 21 or 22, which is designed to record the entire field of view (60) from one perspective and which does not provide a stereoscopic recording of the entire field of view (60).