US20100225755A1 - Compound eye camera module and method of producing the same - Google Patents
Compound eye camera module and method of producing the same Download PDFInfo
- Publication number
- US20100225755A1 US20100225755A1 US12/159,288 US15928807A US2010225755A1 US 20100225755 A1 US20100225755 A1 US 20100225755A1 US 15928807 A US15928807 A US 15928807A US 2010225755 A1 US2010225755 A1 US 2010225755A1
- Authority
- US
- United States
- Prior art keywords
- lens
- optical axis
- light shielding
- shielding block
- respect
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 150000001875 compounds Chemical class 0.000 title claims abstract description 48
- 238000000034 method Methods 0.000 title claims description 15
- 230000003287 optical effect Effects 0.000 claims abstract description 166
- 238000003384 imaging method Methods 0.000 claims abstract description 140
- 238000006073 displacement reaction Methods 0.000 claims description 22
- 239000011159 matrix material Substances 0.000 claims description 9
- 230000003595 spectral effect Effects 0.000 description 13
- 239000000758 substrate Substances 0.000 description 11
- 230000000694 effects Effects 0.000 description 6
- 238000004519 manufacturing process Methods 0.000 description 6
- 238000005259 measurement Methods 0.000 description 6
- 239000000463 material Substances 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 239000000853 adhesive Substances 0.000 description 3
- 230000001070 adhesive effect Effects 0.000 description 3
- 230000002035 prolonged effect Effects 0.000 description 3
- 239000003086 colorant Substances 0.000 description 2
- 230000007423 decrease Effects 0.000 description 2
- 239000011521 glass Substances 0.000 description 2
- 238000000465 moulding Methods 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000007747 plating Methods 0.000 description 1
- 239000011347 resin Substances 0.000 description 1
- 229920005989 resin Polymers 0.000 description 1
- 238000007788 roughening Methods 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 238000004381 surface treatment Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/57—Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/55—Optical parts specially adapted for electronic image sensors; Mounting thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/40—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled
- H04N25/41—Extracting pixel data from a plurality of image sensors simultaneously picking up an image, e.g. for increasing the field of view by combining the outputs of a plurality of sensors
Definitions
- the present invention relates to a small and thin camera module, and a method of producing the camera module.
- the present invention relates to a compound eye camera module that captures an image with a plurality of photographing optical lenses, and a method of producing the camera module.
- an imaging apparatus such as a digital video and a digital camera
- a subject image is formed on an imaging element such as a CCD or a CMOS through a lens, whereby a subject is converted into two-dimensional image information.
- a camera module to be mounted on such an imaging apparatus is required to be small and thin.
- a lens array 100 including three lenses 100 a, 100 b, and 100 c and an imaging element 105 are placed so as to oppose each other.
- An optical filter array 102 having a green spectral filter 102 a, a red spectral filter 102 b, and a blue spectral filter 102 c is provided on a surface of the lens array 100 on a subject side so that the green spectral filter 102 a, the red spectral filter 102 b, and the blue spectral filter 102 c correspond to the three lenses 100 a, 100 b, and 100 c, respectively.
- An optical filter array 103 having a green spectral filter 103 a, a red spectral filter 103 b, and a blue spectral filter 103 c is provided also on a surface of the imaging element 105 on the lens array 100 side so that the green spectral filter 103 a, the red spectral filter 103 b, and the blue spectral filter 103 c correspond to the three lenses 100 a, 100 b, and 100 c, respectively.
- a diaphragm member 107 having apertures (openings) at positions matched with optical axes of the lenses 100 a, 100 b, and 100 c is placed.
- the lenses 100 a, 100 b, and 100 c form subject images respectively on corresponding imaging regions on the imaging element 105 .
- the wavelengths of light to be received by the lenses 100 a, 100 b, and 100 c, respectively, are limited, so that they can form subject images on the imaging element 105 although they are single lenses. Thus, a camera module can be made thinner.
- the optical filter array 102 in order to prevent light having passed through a lens from being incident upon an imaging region not corresponding to the lens on the imaging element 105 , the optical filter array 102 is provided between the diaphragm member 107 and the lens array 100 , and furthermore, the optical filter array 103 is provided between the lens array 100 and the imaging element 105 . Since a required optical length must be maintained between the lens array 100 and the imaging element 105 , even if the optical filter array 103 is provided therebetween, the thickness of a lens module does not increase. However, when the optical filter array 102 is provided between the diaphragm member 107 and the lens array 100 , the thickness of a camera module increases by the thickness of the optical filter array 102 . More specifically, the camera module in FIG. 13 has a problem that thinning is insufficient.
- a compound eye camera module solving the above problem is described in Patent Document 2, and will be described with reference to FIG. 14 .
- a diaphragm member 111 , a lens array 112 , a light shielding block 113 , an optical filter array 114 , and an imaging element 116 are placed in this order from a subject side.
- the lens array 112 has a plurality of lenses.
- the diaphragm member 111 has apertures (openings) at positions matched with optical axes of the respective lenses of the lens array 112 .
- the optical filter array 114 includes a plurality of optical filters having spectral characteristics that vary depending upon the region corresponding to each lens of the lens array 112 , and covers a light receiving plane of the imaging element 116 .
- the light shielding block 113 includes light shielding walls 113 a at boundaries between adjacent lenses of the lens array 112 , i.e., at positions matched with the boundaries between the adjacent optical filters of the optical filter array 114 .
- the imaging element 116 is mounted on a semiconductor substrate 115 .
- a driving circuit 117 and a signal processing circuit 118 further are mounted.
- the camera module According to the camera module, light having passed through a lens is prevented from being incident upon a filter of the optical filter array 114 not corresponding to the lens by the light shielding walls 113 a of the light shielding block 113 .
- the optical filter array 102 between the diaphragm member 107 and the lens array 100 which used to be required in the camera modules in FIG. 13 , is not required. This enables the camera module to be thinned further.
- Patent Document 1 JP 2001-78217 A
- Patent Document 2 JP 2003-143459 A
- the camera module in FIG. 14 has a problem in that the light shielding walls 113 a of the light shielding block 113 may cover required imaging regions of the imaging element 116 due to the variation in assembly of the light shielding block 113 with respect to the lens array 112 in a direction parallel to a plane normal to an optical axis. Furthermore, if the imaging regions on the imaging element 116 are enlarged considering the variation, the number of pixels not used for actual imaging increases, enlarging the imaging element 116 and increasing a cost.
- the present invention solves the above conventional problems, and its object is to provide a thin compound eye camera module that is small and entails low cost because of the small number of pixels of an imaging element to be wasted, and a method of producing the camera module.
- a compound eye camera module of the present invention includes: a lens module integrally having a plurality of lenses arranged on a single plane; a plurality of imaging regions; an optical filter array placed between the lens module and the plurality of imaging regions and having a plurality of optical filters, each transmitting light in a particular wavelength band; and a light shielding block placed between the lens module and the plurality of imaging regions and having light shielding walls forming a plurality of openings independent from each other.
- the plurality of lenses, the plurality of imaging regions, the plurality of optical filters, and the plurality of openings correspond to each other in a one-to-one relationship.
- a first sliding surface is provided on the light shielding block. Furthermore, a second sliding surface sliding on the first sliding surface is provided on the lens module so that the lens module is capable of rotating with respect to the light shielding block with an axis normal to the plurality of imaging regions as a rotation center axis.
- a method of producing a compound eye camera module of the present invention is a method of producing a compound eye camera module including a lens module integrally having a plurality of lenses arranged on a single plane, a plurality of imaging regions, an optical filter array placed between the lens module and the plurality of imaging regions and having a plurality of optical filters, each transmitting light in a particular wavelength band, and a light shielding block placed between the lens module and the plurality of imaging regions and having light shielding walls forming a plurality of openings independent from each other, the plurality of lenses, the plurality of imaging regions, the plurality of optical filters, and the plurality of openings corresponding to each other in a one-to-one relationship.
- the above production method is characterized by rotating the lens module with respect to the light shielding block with an axis normal to the plurality of imaging regions as a rotation center axis; and then, fixing the lens module and the light shielding block to each other.
- a light shielding block provided with light shielding walls is used in order to prevent light from being incident upon an imaging region from a lens not corresponding to the imaging region, so that a thin camera module can be realized.
- a light shielding block has a first sliding surface
- a lens module has a second sliding surface that slides on the first sliding surface.
- the lens module is rotated with respect to the light shielding block with an axis normal to a plurality of imaging regions as a rotation center axis, and then, the lens module and the light shielding block are fixed to each other. Consequently, an image forming region of a lens does not extend off the imaging region, and it is not necessary to use a large imaging element having a number of unnecessary pixels, either.
- the camera module can be miniaturized and its cost can be reduced.
- a thin, small, and low-cost compound eye camera module can be provided.
- FIG. 1 is an exploded perspective view of a compound eye camera module according to Embodiment 1 of the present invention.
- FIG. 2 is a perspective view of an upper barrel seen from an imaging element side in the compound eye camera module according to Embodiment 1 of the present invention.
- FIG. 3 is a perspective view of a light shielding block seen from a subject side in the compound eye camera module according to Embodiment 1 of the present invention.
- FIG. 4 is a plan view showing the arrangement of lenses of a lens array with respect to imaging regions of the imaging element before being positioned in a direction parallel to a plane normal to an optical axis in the compound eye camera module according to Embodiment 1 of the present invention.
- FIG. 5 is a plan view showing the arrangement of lenses of a lens array with respect to the imaging regions of the imaging element after being positioned in a direction parallel to a plane normal to an optical axis in the compound eye camera module according to Embodiment 1 of the present invention.
- FIG. 6 is an exploded perspective view of a compound eye camera module according to Embodiment 2 of the present invention.
- FIG. 7 is a perspective view of an upper barrel seen from a subject side in the compound eye camera module according to Embodiment 2 of the present invention.
- FIG. 8 is a perspective view of a light shielding block seen from the subject side in the compound eye camera module according to Embodiment 2 of the present invention.
- FIG. 9 is a plan view of the compound eye camera module according to Embodiment 2 of the present invention.
- FIG. 10 is a perspective view of the compound eye camera module according to Embodiment 2 of the present invention seen from the subject side.
- FIG. 11A is a plan view showing a positional relationship between optical axes of a plurality of lenses and a plurality of imaging regions before rotation adjustment of a lens module with respect to a light shielding block in a compound eye camera module according to Embodiment 3 of the present invention.
- FIG. 11B is a plan view showing a positional relationship between the optical axes of the plurality of lenses and the plurality of imaging regions after the rotation adjustment of the lens module with respect to the light shielding block in the compound eye camera module according to Embodiment 3 of the present invention.
- FIG. 12A is a side view illustrating the principle of measuring a distance to a subject using the compound eye camera module according to the present invention.
- FIG. 12B is a plan view illustrating the principle of measuring a distance to a subject using the compound eye camera module according to the present invention.
- FIG. 13 is a cross-sectional view of an imaging system of a conventional camera module.
- FIG. 14 is an exploded perspective view of an imaging system of another conventional camera module.
- the first sliding surface includes at least a part of a cylindrical surface with the rotation center axis as a center axis
- the second sliding surface includes at least a part of a cylindrical surface
- the above compound eye camera module of the present invention further includes a mechanism limiting an angle of the rotation of the lens module with respect to the light shielding block. According to this configuration, the rotation adjustment range of the lens module with respect to the light shielding block becomes small, so that the productivity can be enhanced, whereby a lower-cost compound eye camera module can be realized.
- the lens module and the light shielding block are fixed to each other with the mechanism. According to this configuration, it is not necessary to newly design and provide components, shapes, and the like for fixing the lens module and the light shielding block to each other. Furthermore, a method of fixing the lens module and the light shielding block to each other can be simplified, which enhances assembly workability. Thus, a lower-cost compound eye camera module can be realized.
- pixels in the plurality of imaging regions are arranged in a matrix in a first direction and a second direction orthogonal to each other, and the lens module has at least first to fourth lenses arranged in a lattice point shape.
- a direction connecting an optical axis of the first lens to an optical axis of the third lens and a direction connecting an optical axis of the second lens to an optical axis of the fourth lens are substantially parallel to the first direction
- a direction connecting the optical axis of the first lens to the optical axis of the second lens and a direction connecting the optical axis of the third lens to the optical axis of the fourth lens are substantially parallel to the second direction.
- a displacement amount of the optical axis of the third lens in the second direction with respect to the optical axis of the first lens and a displacement amount of the optical axis of the fourth lens in the second direction with respect to the optical axis of the second lens is no greater than an arrangement pitch of the pixels in the second direction.
- pixels in the plurality of imaging regions are arranged in a matrix in a first direction and a second direction orthogonal to each other, and the lens module has at least first and second lenses.
- a direction connecting an optical axis of the first lens to an optical axis of the second lens is substantially parallel to the first direction.
- a displacement amount of the optical axis of the second lens in the second direction with respect to the optical axis of the first lens is no greater than an arrangement pitch of the pixels in the second direction.
- the camera module further includes a mechanism limiting an angle of the rotation of the lens module with respect to the light shielding block. Then, it is preferred that the lens module is rotated with respect to the light shielding block in a range of the limited angle. According to this configuration, the rotation adjustment range of the lens module with respect to the light shielding block becomes small, so that the productivity can be enhanced, whereby a lower-cost compound eye camera module can be provided.
- the lens module and the light shielding block are fixed to each other with the mechanism. According to this configuration, it is not necessary to newly design and provide components, shapes, and the like for fixing the lens module and the light shielding block to each other. Furthermore, a method of fixing the lens module and the light shielding block to each other can be simplified, which enhances assembly workability. Thus, a lower-cost compound eye camera module can be provided.
- pixels in the plurality of imaging regions are arranged in a matrix in a first direction and a second direction orthogonal to each other, and the lens module has at least first to fourth lenses arranged in a lattice point shape.
- the lens module is rotated with respect to the light shielding block so that a direction connecting an optical axis of the first lens to an optical axis of the third lens and a direction connecting an optical axis of the second lens to an optical axis of the fourth lens are substantially parallel to the first direction, and a direction connecting the optical axis of the first lens to the optical axis of the second lens and a direction connecting the optical axis of the third lens to the optical axis of the fourth lens are substantially parallel to the second direction, and one or both of a displacement amount of the optical axis of the third lens in the second direction with respect to the optical axis of the first lens and a displacement amount of the optical axis of the fourth lens in the second direction with respect to the optical axis of the second lens is no greater than an arrangement pitch of the pixels in the second direction.
- pixels in the plurality of imaging regions are arranged in a matrix in a first direction and a second direction orthogonal to each other, and the lens module has at least first and second lenses.
- the lens module is rotated with respect to the light shielding block so that a direction connecting an optical axis of the first lens to an optical axis of the second lens is substantially parallel to the first direction, and a displacement amount of the optical axis of the second lens in the second direction with respect to the optical axis of the first lens is no greater than an arrangement pitch of the pixels in the second direction.
- FIG. 1 is an exploded perspective view of a compound eye camera module of Embodiment 1.
- reference numeral 1 denotes a lens array
- 2 denotes an optical filter array
- 3 denotes a substrate
- 4 denotes an imaging element
- 5 denotes an upper barrel
- 6 denotes a light shielding block (lower barrel)
- 7 denotes a lens module.
- a Z-axis passes through substantially the center of an effective pixel region of the imaging element 4 and is normal to the effective pixel region.
- An X-axis is orthogonal to the Z-axis and parallel to light shielding walls 61 a, 61 c (described later) of the light shielding block 6
- a Y-axis is orthogonal to the Z-axis and parallel to light shielding walls 61 b, 61 d (described later) of the light shielding block 6 .
- the lens array 1 integrally has four single lenses 1 a to 1 d arranged in a lattice point shape on the same plane parallel to an XY-plane. Respective optical axes of the four lenses 1 a to 1 d are parallel to the Z-axis and arranged at four apexes of a virtual rectangle parallel to the XY-plane.
- the lenses 1 a to 1 d are designed respectively so as to satisfy the optical specifications such as MTF required with respect to light in a red, blue, or green wavelength band among three primary colors of light.
- the lenses 1 a, 1 b, 1 c, and 1 d are designed optimally for light in red, green, green, and blue wavelength bands, respectively.
- the lenses 1 a to 1 d are formed integrally using a material such as glass or plastic.
- the respective lenses 1 a to 1 d allow light from a subject (not shown) to pass through the optical filter array 2 to form images on the imaging element 4 .
- the optical filter array 2 is placed between the lens array 1 and the imaging element 4 .
- the optical filter array 2 also has four optical filters 2 a to 2 d arranged on the same plane parallel to the XY-plane in the same way as in the lens array 1 .
- the four optical filters 2 a to 2 d respectively transmit light in only a red, green, or blue wavelength band. Specifically, the optical filter 2 a transmits light in a red wavelength band, the optical filter 2 b transmits light in a green wavelength band, the optical filter 2 c transmits light in a green wavelength band, and the optical filter 2 d transmits light in a blue wavelength band. In the case where it is necessary to cut infrared rays, such characteristics may be provided to the optical filters 2 a to 2 d.
- the four optical filters 2 a to 2 d are arranged respectively on the corresponding optical axes of the four lenses 1 a to 1 d.
- the imaging element 4 is an imaging sensor such as a CCD, and has a number of pixels arranged two-dimensionally in a checkered pattern.
- the effective pixel region of the imaging element 4 is divided substantially equally into four imaging regions 4 a to 4 d.
- the four imaging regions 4 a to 4 d are arranged respectively on the corresponding optical axes of the four lenses 1 a to 1 d.
- subject images formed of only a red, green, or blue wavelength component are formed independently on the four imaging regions 4 a to 4 d.
- only light in a red wavelength band in the light from a subject having passed through the lens 1 a, passes through the optical filter 2 a to form a subject image formed of only a red wavelength component on the imaging region 4 a.
- Each pixel constituting the imaging regions 4 a to 4 d of the imaging element 4 photoelectrically converts the incident light from the subject, and outputs an electric signal (not shown) in accordance with the intensity of the light.
- the electric signal output from the imaging element 4 is subjected to various signal processings and video processing. For example, a parallax amount between two images captured by the imaging regions 4 b, 4 c, upon which light in a green wavelength band is incident, is obtained, and based on the obtained parallax amount, a parallax amount among four images respectively captured by the four imaging regions 4 a to 4 d is obtained. Then, images of three colors: red, green, and blue are combined considering the above parallax amounts, whereby one color image can be created. Alternatively, the distance to the subject also can be measured using the principle of triangulation, comparing the two images captured by the imaging regions 4 b, 4 c with each other. These processings can be performed using a digital signal processor (a DSP, not shown) or the like.
- a digital signal processor a DSP, not shown
- the upper barrel 5 has a concave portion 51 on a lower surface thereof, which holds and fixes the lens array 1 , as shown in FIG. 2 .
- the lens array 1 is fitted in the concave portion 51 to be positioned with respect to the upper barrel 5 .
- four apertures (openings) 5 a to 5 d are formed at positions through which the respective optical axes of the four lenses 1 a to 1 d of the held lens array 1 pass.
- the upper barrel 5 is made of a material that does not transmit light, and prevents unnecessary ambient light from being incident upon the lenses 1 a to 1 d from portions other than the apertures 5 a to 5 d.
- the lens array 1 and the upper barrel 5 holding it constitute the lens module 7 .
- the light shielding block 6 includes light shielding walls 61 a to 61 d arranged in a cross shape so as to form four openings 6 a to 6 d independent from each other, and an outer barrel portion 62 holding the light shielding walls 61 a to 61 d.
- the light shielding walls 61 a to 61 d extend radially with respect to the Z-axis that is a center axis of the light shielding block 6 .
- the light shielding walls 61 a, 61 c are placed along an XZ-plane, and the light shielding walls 61 b, 61 d are placed along a YZ-plane.
- the four openings 6 a to 6 d are arranged respectively on the corresponding optical axes of the four lenses 1 a to 1 d.
- the light shielding walls 61 a to 61 d divide the effective pixel region of the imaging element 4 into four imaging regions 4 a to 4 d.
- the size of the openings 6 a to 6 d seen from a direction parallel to the Z-axis is substantially the same as or larger than the imaging regions 4 a to 4 d.
- Light from the subject having passed through the lenses 1 a to 1 d respectively pass through the openings 6 a to 6 d to form images on the imaging regions 4 a to 4 d, respectively.
- the light shielding walls 61 a to 61 d prevent the light having passed through one of the lenses 1 a to 1 d from being incident upon an imaging region not corresponding to the lens.
- the light shielding wall 61 a blocking the light in a green wavelength band is provided along a boundary between the imaging regions 4 a and 4 b.
- the outer barrel portion 62 surrounding the openings 6 a to 6 d prevents ambient light, not passing through the lens array 1 and the optical filter array 2 , from being incident upon the imaging regions 4 a to 4 d.
- the light shielding block 6 is made of a material that does not transmit light in the same way as in the upper barrel 5 .
- the light shielding walls 61 a to 61 d and side surfaces of the outer barrel portion 62 , exposed to the openings 6 a to 6 d, are subjected to various surface treatments (for example, roughening, plating, blackening, etc.) so that the reflection of light is minimized.
- a concave portion 63 holding and fixing the optical filter array 2 is provided on a surface of the light shielding block 6 on the lens array 1 side.
- the optical filter array 2 is fitted in the concave portion 63 to be positioned with respect to the light shielding block 6 .
- the optical filters 2 a to 2 d are arranged respectively in the openings 6 a to 6 d.
- the imaging element 4 is positioned and fixed with respect to the substrate 3 .
- the imaging element 4 is connected electrically to the substrate 3 via wire bonding or the like, and further is connected to an electronic component such as a DSP that processes the electric signal from the imaging element 4 .
- the electronic component such as a DSP may be mounted on the substrate 3 .
- the substrate 3 performs functions as electrical connection and a reference plane of each component during assembly.
- the light shielding block 6 with the optical filter array 2 fixed thereto is positioned with respect to the imaging element 4 and fixed onto the substrate 3 in such a manner that the Z-axis that is a center axis of the light shielding block 6 passes through substantially the center of the effective pixel region of the imaging element 4 , and the light shielding walls 61 a to 61 d of the light shielding block 6 are matched with checkered arrangement directions of many pixels constituting the imaging element 4 .
- a light-receiving plane of the imaging element 4 becomes normal to the Z-axis
- one arrangement direction for example, a lateral arrangement direction
- the other arrangement direction for example, a vertical arrangement direction
- the effective pixel region of the imaging element 4 is divided substantially equally into the four imaging regions 4 a to 4 d corresponding to the four openings 6 a to 6 d.
- the lens module 7 with the lens array 1 fixed to the upper barrel 5 is fitted to the light shielding block 6 .
- tip end surfaces of legs 53 a to 53 d at four corners of the upper barrel 5 come into contact with the substrate 3 .
- the lens array 1 becomes parallel to the XY-plane, and is positioned in the Z-axis direction.
- the lens module 7 including the lens array 1 needs to be positioned exactly with respect to the imaging element 4 and the light shielding block 6 . More specifically, a center axis 55 (which is parallel to each optical axis of the four lenses 1 a to 1 d of the lens array 1 , and passes through the center of the virtual rectangle with each optical axis position as an apex) of the upper barrel 5 shown in FIG. 2 needs to be substantially matched with the Z-axis in the XY-plane. In addition, as shown in FIG.
- a long side 12 a and a short side 12 b of the virtual rectangle with optical axis positions 11 a to 11 d of the four lenses 1 a to 1 d as apexes need to be substantially parallel to the X-axis and the Y-axis, respectively.
- shaded regions 14 a to 14 d among image-forming regions 13 a to 13 d of the lenses 1 a to 1 d extend off the imaging regions 4 a to 4 d. That is, pixels required for capturing the subject whose images are formed by the lenses 1 a to 1 d cannot be ensured.
- reference numeral 41 denotes pixels constituting the imaging element 4 .
- first sliding surfaces 66 , 67 , 68 , and 69 which are parts of a virtual cylindrical surface 65 c having a radius r 1 with the Z-axis that is the center axis of the light shielding block 6 as a center axis, are provided on outer peripheral walls at four corners of the light shielding block 6 positioned and fixed to the substrate 3 .
- first sliding surfaces 66 , 67 , 68 , and 69 which are parts of a virtual cylindrical surface 65 c having a radius r 1 with the Z-axis that is the center axis of the light shielding block 6 as a center axis, are provided on outer peripheral walls at four corners of the light shielding block 6 positioned and fixed to the substrate 3 .
- second sliding surfaces 56 , 57 , 58 , and 59 which are parts of a virtual cylindrical surface 55 c having a radius r 2 with the center axis 55 of the upper barrel 5 as a center axis, are provided on inner wall surfaces of the legs 53 a to 53 d at four corners of the upper barrel 5 of the lens module 7 .
- the radius r 2 is set to be slightly larger than the radius r 1 so that a minimum required gap, allowing the second sliding surfaces 56 , 57 , 58 , and 59 of the upper barrel 5 on a rotation side to slide on the first sliding surfaces 66 , 67 , 68 , and 69 of the light shielding block 6 on a fixed side, is formed between the first sliding surfaces 66 , 67 , 68 , and 69 and the second sliding surfaces 56 , 57 , 58 , and 59 .
- the Z-axis that is the center axis of the light shielding block 6 is substantially matched with the center axis 55 of the upper barrel 5 .
- the long side 12 a and the short side 12 b of the virtual rectangle with the optical axis positions 11 a to 11 d of the four lenses 1 a to 1 d as apexes, shown in FIG. 4 are rendered parallel to the X-axis and the Y-axis, respectively.
- the rotation adjustment of the lens module 7 can be performed, for example, as follows.
- a parallel light source as a subject is set on the Z-axis, and subject images are formed on the imaging regions 4 a to 4 d via the lenses 1 a
- the optical axis positions 11 a to 11 d of the lenses 1 a to 1 d are calculated from positions of spots captured in the imaging regions 4 a to 4 d, respectively. Then, as shown in FIG. 5 , the lens module 7 is rotated in the XY-plane so that the long side 12 a and the short side 12 b of the virtual rectangle with the optical axis positions 11 a to 11 d as apexes become parallel to the X-axis and the Y-axis, respectively. Consequently, the subject images can be captured in the respective imaging regions 4 a to 4 d without being lost, while the image-forming regions 13 a to 13 d of the lenses 1 a to 1 d do not extend off the imaging regions 4 a to 4 d.
- the second sliding surfaces 56 , 57 , 58 , and 59 slide while being substantially in contact with the first sliding surfaces 66 , 67 , 68 , and 69 during rotation adjustment.
- the center axis 55 of the upper barrel 5 hardly is displaced from the Z-axis in the XY-plane. Consequently, during the rotation adjustment of the lens module 7 , the relative positional relationships of the respective optical axis positions 11 a to 11 d with respect to the respective imaging regions 4 a to 4 d are substantially the same at all times.
- a plane including the tip end surfaces of the legs 53 a to 53 d at four corners of the upper barrel 5 is parallel to a plane on which the four lenses 1 a to 1 d are arranged. Then, during the rotation adjustment of the lens module 7 , the tip end surfaces of the legs 53 a to 53 d at four corners slide while being in contact with the substrate 3 at all times. Thus, even if the lens module 7 is rotated, the spot shapes formed respectively by the lenses 1 a to 1 d on the imaging regions 4 a to 4 d do not change. This facilitates a rotation adjustment operation, and a photographed image is not changed by the rotation position.
- the light shielding block 6 having the light shielding walls 61 a to 61 d is used, so that it is not necessary to provide two layers of the optical filter arrays for conducting color separation.
- the thickness of a camera module can be reduced.
- the light shielding block 6 includes the first sliding surfaces 66 , 67 , 68 , and 69
- the upper barrel 5 includes the second sliding surfaces 56 , 57 , 58 , and 59 , so that the center axis (Z-axis) of the light shielding block 6 can be matched substantially with the center axis 55 of the upper barrel 5 .
- the lens module 7 by adjusting the lens module 7 with respect to the light shielding block 6 and the imaging element 4 by rotation, the long side 12 a and the short side 12 b of the virtual rectangle with the optical axis positions 11 a to 11 d of the lenses 1 a to 1 d as apexes can be rendered parallel to the X-axis and the Y-axis, respectively.
- the image-forming regions 13 a to 13 d of the lenses 1 a to 1 d do not extend off the imaging regions 4 a to 4 d, and it is not necessary to use a large imaging element having a number of unnecessary pixels.
- the camera module can be miniaturized, and the cost thereof can be reduced.
- the case using a parallel light source as a subject during rotation adjustment of the lens module 7 has been illustrated.
- the subject during rotation adjustment is not limited thereto in the present invention, and for example, the optical axis positions 11 a to 11 d may be obtained using various kinds of charts.
- the rotation adjustment is performed with the light shielding block 6 and the imaging element 4 being on a fixed side and the lens module 7 being on a rotation side.
- the present invention is not limited thereto, and even if the fixed side and the rotation side are reversed compared with the above, the relative position therebetween can be changed, and the same effects as those in the above can be obtained.
- the optical system which separates light from a subject to light in four (red, green, green, and blue) wavelength bands
- the optical system of the present invention is not limited thereto, and for example, an optical system that separates light to light in two near-infrared wavelength bands and light in two green wavelength bands may be used, or a combination of light in the other wavelength bands may be used.
- the above effects of the present embodiment can be obtained irrespective of a wavelength band to be selected.
- the lens array of the present invention is not limited thereto.
- the number of the lenses to be provided in the lens array may be two or more without being limited to four.
- the arrangement of two or more lenses is not limited to a lattice point arrangement.
- the lens module 7 includes the lens array 1 and the upper barrel 5 holding the lens array 1 , and the second sliding surfaces 56 , 57 , 58 , and 59 are formed on the upper barrel 5
- the lens module 7 of the present invention is not limited thereto.
- the lens module 7 may be formed of a member including the lens array having the lenses 1 a to 1 d and the second sliding surfaces 56 , 57 , 58 , and 59 , and a diaphragm member having the apertures 5 a to 5 d.
- first sliding surfaces 66 , 67 , 68 , and 69 are formed discontinuously only at four corners of the light shielding block 6
- first sliding surfaces of the present invention are not limited thereto and may be, for example, a cylindrical surface extending over the entire periphery of the light shielding block 6
- second sliding surfaces 56 , 57 , 58 , and 59 are formed discontinuously on the legs 53 a to 53 d at four corners of the upper barrel 5
- the second sliding surfaces of the present invention are not limited thereto and may be, for example, a cylindrical surface extending over the entire periphery.
- first sliding surfaces and the second sliding surfaces respectively include four discontinuous surfaces
- first sliding surfaces and the second sliding surfaces of the present invention are not limited thereto.
- the first sliding surfaces and/or the second sliding surfaces may include two, three, or at least five discontinuous surfaces, as long as the second sliding surfaces can be slid on the first sliding surfaces to rotate the lens module 7 with respect to the light shielding block 6 .
- first sliding surfaces and the second sliding surfaces are along a cylindrical surface
- first sliding surfaces and the second sliding surfaces of the present invention are not limited thereto.
- first sliding surfaces and the second sliding surfaces may be those along the surface of a rotator such as a circular conical surface or a spherical surface.
- first sliding surface and the second sliding surface are in a plane-contact with each other
- the present invention is not limited thereto.
- one of the first sliding surface and the second sliding surface may be a plane having a predetermined area
- the other may be a spherical surface that is in a point-contact with the plane having a predetermined area or a cylindrical surface that is in a line-contact with the plane having a predetermined area.
- the second sliding surfaces 56 , 57 , 58 , and 59 along the virtual cylindrical surface having the radius r 2 of the lens module 7 are placed on an outer side of the first sliding surfaces 66 , 67 , 68 , and 69 along the virtual cylindrical surface having the radius r 1 of the light shielding block 6
- the second sliding surfaces of the lens module 7 may be placed on an inner side of the first sliding surfaces of the light shielding block 6 instead.
- r 1 >r 2 is satisfied, and it is preferred that the difference therebetween is smaller in the same way as in the above embodiment.
- the lens module 7 is adjusted with respect to the light shielding block 6 by rotation so that the respective directions of the long side 12 a and the short side 12 b of the virtual rectangle with the optical axis positions 11 a to 11 d of the lenses 1 a to 1 d as apexes are parallel to the checkered arrangement directions (i.e., the Y-axis and the X-axis) of a number of pixels constituting the imaging element 4 .
- the rotation adjustment of the present invention is not limited thereto.
- the lens module 7 may be adjusted with respect to the light shielding block 6 by rotation so that the respective directions of the long side 12 a and the short side 12 b are inclined at a slight angle with respect to the checkered arrangement directions (i.e., the Y-axis and the X-axis) of a number of pixels of the imaging element 4 .
- a high-resolution image can be obtained by pixel shifting.
- FIG. 6 is an exploded perspective view of a compound eye camera module of Embodiment 2.
- the same members as those in FIG. 1 are denoted with the same reference numerals as those therein, and the description thereof will be omitted.
- the basic configuration of the camera module of the present embodiment is substantially the same as that of Embodiment 1.
- the present embodiment is different from Embodiment 1 in the shapes of an upper barrel 500 and a light shielding block 600 .
- FIG. 7 is a perspective view of the upper barrel 500 seen from a subject side.
- the upper barrel 500 in the present embodiment is different from the upper barrel 5 in Embodiment 1 in that grooves 501 , 502 are provided on two opposed side surfaces.
- FIG. 8 is a perspective view of the light shielding block 600 seen from the subject side.
- the light shielding block 600 in the present embodiment is different from the light shielding block 6 in Embodiment 1 in that protruding walls 601 , 602 formed of the opposed two side surfaces extending to the subject side are provided.
- the walls 601 , 602 are fitted in the grooves 501 , 502 .
- the grooves 501 , 502 are larger than the walls 601 , 602 , so that the upper barrel 500 can be rotated in the XY-plane with respect to the light shielding block 600 .
- the rotatable range thereof is limited to a range in which the walls 601 , 602 are not in contact with the grooves 501 , 502 . That is, the walls 601 , 602 and the grooves 501 , 502 function as a mechanism (stopper) of limiting the angle of a rotation of the lens module 7 including the upper barrel 500 with respect to the light shielding block 600 .
- the inclination amounts of the long side 12 a and the short side 12 b of the virtual rectangle with the optical axis positions 11 a to 11 d of the four lenses 1 a to 1 d as apexes shown in FIG. 4 , with respect to the X-axis and the Y-axis, can be decreased.
- the adjustment amount in the rotation adjustment step of the lens module 7 conducted later, can be reduced. Consequently, the time of the rotation adjustment step of the lens module 7 can be shortened, and the productivity of the camera module can be enhanced.
- Gaps 901 , 902 are provided between the grooves 501 , 502 and the walls 601 , 602 to such a degree that the lens module 7 can be adjusted by rotation.
- the upper barrel 500 and the light shielding block 600 can be fixed to each other by applying an adhesive to the gaps 901 , 902 .
- a rotation restriction mechanism (stopper) of the lens module 7 with respect to the light shielding block 600 a method of fixing them can be simplified, which enhances assembly workability.
- a compound eye camera module can be realized at a lower cost.
- the side surfaces of the grooves 501 , 502 , and/or the walls 601 , 602 may be inclined so that the gaps between the grooves 501 , 502 and the walls 601 , 602 increase toward a subject in the Z-axis direction. Consequently, an adhesive can be injected into the gaps 901 , 902 precisely, and the contact area of the adhesive increases, so that the light shielding block 600 and the lens module 7 can be fixed to each other more strongly.
- the rotation restriction mechanism of the present invention is not limited thereto. Any mechanism capable of allowing the rotation of the lens module 7 in the XY-plane with respect to the light shielding block 600 and restricting the rotation angle in a predetermined range, such as a combination of an arc-shaped groove (or hole) and a pin inserted therein, can be used. Even in this case, the same effects as those in the above can be obtained.
- the lens array 1 having a plurality of lenses can be obtained integrally, for example, by molding a lens material (e.g., resin or glass) with a mold.
- the optical axis positions of a plurality of lenses on the obtained lens array may be displaced from desired positions due to the production error of the mold, the molding error, etc.
- FIG. 11A there is a case in which a quadrangle with the optical axis positions 11 a to 11 d of the four lenses 1 a to 1 d (not shown) arranged in a lattice point shape as apexes may not exactly be a rectangle.
- FIG. 12A is a side view seen in a direction normal to a plane including the optical axes 11 a, 11 c of the two lenses 1 a, 1 c
- FIG. 12B is a plan view seen in a direction parallel to the optical axes 11 a, 11 c of the two lenses 1 a, 1 c.
- Reference numerals 15 a, 15 c denote positions where the optical axes 11 a, 11 c cross the imaging regions of the imaging element 4 .
- a subject 200 on the optical axis 11 c is formed as subject images 201 a, 201 c on the imaging regions of the imaging element 4 by the lenses 1 a, 1 c. Since the optical axes 11 a, 11 c of the lenses 1 a, 1 c are different from each other, when the distances from the lenses 1 a, 1 c to the subject 200 change, the position of the subject image 201 a moves on a straight line 202 connecting an intersection point 15 a to an intersection point 15 c on the imaging element 4 . This phenomenon is called a “parallax”.
- the displacement amount (hereinafter, referred to as a “parallax amount”) of the subject image 201 a from the intersection point 15 a is S
- the distance between the optical axes 11 a and 11 c is d
- a subject distance (distance from the lens 1 c to the subject 200 ) is A
- an image-forming distance is f
- the displacement amount (i.e., a parallax amount) S of the position of the subject image 201 a in the image to be compared, with respect to the position of the subject image 201 c in the reference image is obtained.
- the parallax amount S it is necessary to search for the subject image 201 a corresponding to the subject image 201 c in the reference image, in the image to be compared (this is referred to as “stereo matching”). In the case of performing the stereo matching, if the direction of the straight line 202 shown in FIG.
- the subject image 201 a cannot be specified exactly in the image to be compared, and the subject distance cannot be obtained exactly.
- a great amount of time is required for searching for the subject image 201 a in the image to be compared, and consequently, a calculation time is prolonged.
- the stereo matching is performed between two captured images obtained from the two upper imaging regions 4 a, 4 c to measure a subject distance and the stereo matching is performed between two captured images obtained from the two lower imaging regions 4 b, 4 d to measure a subject distance.
- lid are not parallel to the lateral arrangement direction (i.e., the X-axis) of the pixels 41 , the measurement precision of the subject distance decreases as described above and a calculation time is prolonged.
- the lens module 7 is adjusted with respect to the light shielding blocks 6 , 600 by rotation so that the degree of parallelization of the straight lines 12 a 1 and 12 a 2 with respect to the X-axis is optimized.
- a displacement amount Dy 1 of the optical axis 11 a in the Y-axis direction with respect to the optical axis 11 c and a displacement amount Dy 2 of the optical axis 11 b in the Y-axis direction with respect to the optical axis 11 d is set to be no greater than an arrangement pitch of the pixels 41 in the Y-axis direction.
- the present invention is not limited thereto.
- the stereo matching is performed between two captured images obtained from the two right imaging regions 4 a, 4 b, and the stereo matching is performed between two captured images obtained from the two left imaging regions 4 c, 4 d.
- the lens module 7 is adjusted by rotation with respect to the light shielding blocks 6 , 600 so that one (preferably, both) of a displacement amount Dx 1 of the optical axis 11 b in the X-axis direction with respect to the optical axis 11 a and a displacement amount Dx 2 of the optical axis lid in the X-axis direction with respect to the optical axis 11 c is no greater than the arrangement pitch of the pixels 41 in the X-axis direction.
- a subject distance may be measured using only two captured images obtained from the two upper imaging regions 4 a, 4 c.
- the displacement amount Dy 1 is set to be no greater than the arrangement pitch of the pixels 41 in the Y-axis direction.
- a subject distance may be measured using only two captured images obtained from the two lower imaging regions 4 b, 4 d.
- the displacement amount Dy 2 is set to be no greater than the arrangement pitch of the pixels 41 in the Y-axis direction.
- a subject distance may be measured using only two captured images obtained from the two right imaging regions 4 a, 4 b.
- the displacement amount Dx 1 is set to be no greater than the arrangement pitch of the pixels 41 in the X-axis direction.
- a subject distance may be measured using only two captured images obtained from the two left imaging regions 4 c, 4 d.
- the displacement amount Dx 2 is set to be no greater than the arrangement pitch of the pixels 41 in the X-axis direction.
- the lens array has four lenses.
- the effects similar to those in the above can be obtained by setting the direction connecting the optical axes of two lenses to be substantially parallel to the X-axis or the Y-axis as described above.
- the lens array has at least five lenses
- the same effects as those in the above can be obtained by placing two or four lenses among the at least five lenses with respect to the imaging element 4 so that the above conditions are satisfied.
- the stereo matching is performed between two captured images obtained from light in the same wavelength band.
- the stereo matching can be performed, even between two captured images obtained from light in different wavelength bands, and a subject distance can be measured.
- the field of the compound eye camera module of the present invention is not particularly limited, and the present invention can be preferably used for, for example, a small and thin mobile telephone having a camera function, a digital still camera, a security camera, a vehicle-mounted camera, and the like.
Abstract
Description
- The present invention relates to a small and thin camera module, and a method of producing the camera module. In particular, the present invention relates to a compound eye camera module that captures an image with a plurality of photographing optical lenses, and a method of producing the camera module.
- In an imaging apparatus such as a digital video and a digital camera, a subject image is formed on an imaging element such as a CCD or a CMOS through a lens, whereby a subject is converted into two-dimensional image information. A camera module to be mounted on such an imaging apparatus is required to be small and thin.
- In order to realize a small and thin camera module, a compound eye camera module has been proposed.
- One example of the compound eye camera module is described in
Patent Document 1, and will be described with reference toFIG. 13 . Alens array 100 including threelenses imaging element 105 are placed so as to oppose each other. Anoptical filter array 102 having a greenspectral filter 102 a, a redspectral filter 102 b, and a bluespectral filter 102 c is provided on a surface of thelens array 100 on a subject side so that the greenspectral filter 102 a, the redspectral filter 102 b, and the bluespectral filter 102 c correspond to the threelenses optical filter array 103 having a greenspectral filter 103 a, a redspectral filter 103 b, and a bluespectral filter 103 c is provided also on a surface of theimaging element 105 on thelens array 100 side so that the greenspectral filter 103 a, the redspectral filter 103 b, and the bluespectral filter 103 c correspond to the threelenses optical filter array 102, adiaphragm member 107 having apertures (openings) at positions matched with optical axes of thelenses lenses imaging element 105. The wavelengths of light to be received by thelenses imaging element 105 although they are single lenses. Thus, a camera module can be made thinner. - However, in the camera module, in order to prevent light having passed through a lens from being incident upon an imaging region not corresponding to the lens on the
imaging element 105, theoptical filter array 102 is provided between thediaphragm member 107 and thelens array 100, and furthermore, theoptical filter array 103 is provided between thelens array 100 and theimaging element 105. Since a required optical length must be maintained between thelens array 100 and theimaging element 105, even if theoptical filter array 103 is provided therebetween, the thickness of a lens module does not increase. However, when theoptical filter array 102 is provided between thediaphragm member 107 and thelens array 100, the thickness of a camera module increases by the thickness of theoptical filter array 102. More specifically, the camera module inFIG. 13 has a problem that thinning is insufficient. - A compound eye camera module solving the above problem is described in
Patent Document 2, and will be described with reference toFIG. 14 . Adiaphragm member 111, alens array 112, alight shielding block 113, anoptical filter array 114, and animaging element 116 are placed in this order from a subject side. Thelens array 112 has a plurality of lenses. Thediaphragm member 111 has apertures (openings) at positions matched with optical axes of the respective lenses of thelens array 112. Theoptical filter array 114 includes a plurality of optical filters having spectral characteristics that vary depending upon the region corresponding to each lens of thelens array 112, and covers a light receiving plane of theimaging element 116. Thelight shielding block 113 includeslight shielding walls 113 a at boundaries between adjacent lenses of thelens array 112, i.e., at positions matched with the boundaries between the adjacent optical filters of theoptical filter array 114. Theimaging element 116 is mounted on asemiconductor substrate 115. On thesemiconductor substrate 115, adriving circuit 117 and asignal processing circuit 118 further are mounted. - According to the camera module, light having passed through a lens is prevented from being incident upon a filter of the
optical filter array 114 not corresponding to the lens by thelight shielding walls 113 a of thelight shielding block 113. Thus, theoptical filter array 102 between thediaphragm member 107 and thelens array 100, which used to be required in the camera modules inFIG. 13 , is not required. This enables the camera module to be thinned further. - Patent Document 1: JP 2001-78217 A
- Patent Document 2: JP 2003-143459 A
- However, the camera module in
FIG. 14 has a problem in that thelight shielding walls 113 a of thelight shielding block 113 may cover required imaging regions of theimaging element 116 due to the variation in assembly of thelight shielding block 113 with respect to thelens array 112 in a direction parallel to a plane normal to an optical axis. Furthermore, if the imaging regions on theimaging element 116 are enlarged considering the variation, the number of pixels not used for actual imaging increases, enlarging theimaging element 116 and increasing a cost. - The present invention solves the above conventional problems, and its object is to provide a thin compound eye camera module that is small and entails low cost because of the small number of pixels of an imaging element to be wasted, and a method of producing the camera module.
- A compound eye camera module of the present invention includes: a lens module integrally having a plurality of lenses arranged on a single plane; a plurality of imaging regions; an optical filter array placed between the lens module and the plurality of imaging regions and having a plurality of optical filters, each transmitting light in a particular wavelength band; and a light shielding block placed between the lens module and the plurality of imaging regions and having light shielding walls forming a plurality of openings independent from each other. The plurality of lenses, the plurality of imaging regions, the plurality of optical filters, and the plurality of openings correspond to each other in a one-to-one relationship.
- A first sliding surface is provided on the light shielding block. Furthermore, a second sliding surface sliding on the first sliding surface is provided on the lens module so that the lens module is capable of rotating with respect to the light shielding block with an axis normal to the plurality of imaging regions as a rotation center axis.
- Next, a method of producing a compound eye camera module of the present invention is a method of producing a compound eye camera module including a lens module integrally having a plurality of lenses arranged on a single plane, a plurality of imaging regions, an optical filter array placed between the lens module and the plurality of imaging regions and having a plurality of optical filters, each transmitting light in a particular wavelength band, and a light shielding block placed between the lens module and the plurality of imaging regions and having light shielding walls forming a plurality of openings independent from each other, the plurality of lenses, the plurality of imaging regions, the plurality of optical filters, and the plurality of openings corresponding to each other in a one-to-one relationship.
- The above production method is characterized by rotating the lens module with respect to the light shielding block with an axis normal to the plurality of imaging regions as a rotation center axis; and then, fixing the lens module and the light shielding block to each other.
- According to the present invention, a light shielding block provided with light shielding walls is used in order to prevent light from being incident upon an imaging region from a lens not corresponding to the imaging region, so that a thin camera module can be realized.
- Furthermore, in a camera module of the present invention, a light shielding block has a first sliding surface, and a lens module has a second sliding surface that slides on the first sliding surface. Furthermore, according to a production method of the present invention, the lens module is rotated with respect to the light shielding block with an axis normal to a plurality of imaging regions as a rotation center axis, and then, the lens module and the light shielding block are fixed to each other. Consequently, an image forming region of a lens does not extend off the imaging region, and it is not necessary to use a large imaging element having a number of unnecessary pixels, either. Thus, the camera module can be miniaturized and its cost can be reduced.
- Accordingly, a thin, small, and low-cost compound eye camera module can be provided.
-
FIG. 1 is an exploded perspective view of a compound eye camera module according toEmbodiment 1 of the present invention. -
FIG. 2 is a perspective view of an upper barrel seen from an imaging element side in the compound eye camera module according toEmbodiment 1 of the present invention. -
FIG. 3 is a perspective view of a light shielding block seen from a subject side in the compound eye camera module according toEmbodiment 1 of the present invention. -
FIG. 4 is a plan view showing the arrangement of lenses of a lens array with respect to imaging regions of the imaging element before being positioned in a direction parallel to a plane normal to an optical axis in the compound eye camera module according toEmbodiment 1 of the present invention. -
FIG. 5 is a plan view showing the arrangement of lenses of a lens array with respect to the imaging regions of the imaging element after being positioned in a direction parallel to a plane normal to an optical axis in the compound eye camera module according toEmbodiment 1 of the present invention. -
FIG. 6 is an exploded perspective view of a compound eye camera module according toEmbodiment 2 of the present invention. -
FIG. 7 is a perspective view of an upper barrel seen from a subject side in the compound eye camera module according toEmbodiment 2 of the present invention. -
FIG. 8 is a perspective view of a light shielding block seen from the subject side in the compound eye camera module according toEmbodiment 2 of the present invention. -
FIG. 9 is a plan view of the compound eye camera module according toEmbodiment 2 of the present invention. -
FIG. 10 is a perspective view of the compound eye camera module according toEmbodiment 2 of the present invention seen from the subject side. -
FIG. 11A is a plan view showing a positional relationship between optical axes of a plurality of lenses and a plurality of imaging regions before rotation adjustment of a lens module with respect to a light shielding block in a compound eye camera module according toEmbodiment 3 of the present invention. -
FIG. 11B is a plan view showing a positional relationship between the optical axes of the plurality of lenses and the plurality of imaging regions after the rotation adjustment of the lens module with respect to the light shielding block in the compound eye camera module according toEmbodiment 3 of the present invention. -
FIG. 12A is a side view illustrating the principle of measuring a distance to a subject using the compound eye camera module according to the present invention. -
FIG. 12B is a plan view illustrating the principle of measuring a distance to a subject using the compound eye camera module according to the present invention. -
FIG. 13 is a cross-sectional view of an imaging system of a conventional camera module. -
FIG. 14 is an exploded perspective view of an imaging system of another conventional camera module. - In the above compound eye camera module of the present invention, it is preferred that the first sliding surface includes at least a part of a cylindrical surface with the rotation center axis as a center axis, and the second sliding surface includes at least a part of a cylindrical surface. According to this configuration, a mechanism for rotating the lens module with respect to the light shielding block can be realized easily.
- It is preferred that the above compound eye camera module of the present invention further includes a mechanism limiting an angle of the rotation of the lens module with respect to the light shielding block. According to this configuration, the rotation adjustment range of the lens module with respect to the light shielding block becomes small, so that the productivity can be enhanced, whereby a lower-cost compound eye camera module can be realized.
- In this case, it is preferred that the lens module and the light shielding block are fixed to each other with the mechanism. According to this configuration, it is not necessary to newly design and provide components, shapes, and the like for fixing the lens module and the light shielding block to each other. Furthermore, a method of fixing the lens module and the light shielding block to each other can be simplified, which enhances assembly workability. Thus, a lower-cost compound eye camera module can be realized.
- In the above compound eye camera module of the present invention, it is preferred that pixels in the plurality of imaging regions are arranged in a matrix in a first direction and a second direction orthogonal to each other, and the lens module has at least first to fourth lenses arranged in a lattice point shape. In this case, it is preferred that a direction connecting an optical axis of the first lens to an optical axis of the third lens and a direction connecting an optical axis of the second lens to an optical axis of the fourth lens are substantially parallel to the first direction, and a direction connecting the optical axis of the first lens to the optical axis of the second lens and a direction connecting the optical axis of the third lens to the optical axis of the fourth lens are substantially parallel to the second direction. Then, it is preferred that one or both of a displacement amount of the optical axis of the third lens in the second direction with respect to the optical axis of the first lens and a displacement amount of the optical axis of the fourth lens in the second direction with respect to the optical axis of the second lens is no greater than an arrangement pitch of the pixels in the second direction. According to this configuration, the distance to a subject can be measured with high precision in a short period of time using the principle of triangulation, with the first and third lenses placed substantially in the first direction and/or the second and fourth lenses placed substantially in the first direction.
- Alternatively, in the above compound eye camera module of the present invention, it is preferred that pixels in the plurality of imaging regions are arranged in a matrix in a first direction and a second direction orthogonal to each other, and the lens module has at least first and second lenses. In this case, it is preferred that a direction connecting an optical axis of the first lens to an optical axis of the second lens is substantially parallel to the first direction. Then, it is preferred that a displacement amount of the optical axis of the second lens in the second direction with respect to the optical axis of the first lens is no greater than an arrangement pitch of the pixels in the second direction. According to this configuration, the distance to a subject can be measured with high precision in a short period of time using the principle of triangulation, with the first and second lenses placed substantially in the first direction.
- Next, in the above production method of the present invention, it is preferred that the camera module further includes a mechanism limiting an angle of the rotation of the lens module with respect to the light shielding block. Then, it is preferred that the lens module is rotated with respect to the light shielding block in a range of the limited angle. According to this configuration, the rotation adjustment range of the lens module with respect to the light shielding block becomes small, so that the productivity can be enhanced, whereby a lower-cost compound eye camera module can be provided.
- In this case, it is preferred that the lens module and the light shielding block are fixed to each other with the mechanism. According to this configuration, it is not necessary to newly design and provide components, shapes, and the like for fixing the lens module and the light shielding block to each other. Furthermore, a method of fixing the lens module and the light shielding block to each other can be simplified, which enhances assembly workability. Thus, a lower-cost compound eye camera module can be provided.
- In the above production method of the present invention, it is preferred that pixels in the plurality of imaging regions are arranged in a matrix in a first direction and a second direction orthogonal to each other, and the lens module has at least first to fourth lenses arranged in a lattice point shape. In this case, it is preferred that the lens module is rotated with respect to the light shielding block so that a direction connecting an optical axis of the first lens to an optical axis of the third lens and a direction connecting an optical axis of the second lens to an optical axis of the fourth lens are substantially parallel to the first direction, and a direction connecting the optical axis of the first lens to the optical axis of the second lens and a direction connecting the optical axis of the third lens to the optical axis of the fourth lens are substantially parallel to the second direction, and one or both of a displacement amount of the optical axis of the third lens in the second direction with respect to the optical axis of the first lens and a displacement amount of the optical axis of the fourth lens in the second direction with respect to the optical axis of the second lens is no greater than an arrangement pitch of the pixels in the second direction. According to this configuration, the distance to a subject can be measured with high precision in a short period of time using the principle of triangulation, with the first and third lenses placed substantially in the first direction and/or the second and fourth lenses placed substantially in the first direction.
- Alternatively, in the above production method of the present invention, it is preferred that pixels in the plurality of imaging regions are arranged in a matrix in a first direction and a second direction orthogonal to each other, and the lens module has at least first and second lenses. In this case, it is preferred that the lens module is rotated with respect to the light shielding block so that a direction connecting an optical axis of the first lens to an optical axis of the second lens is substantially parallel to the first direction, and a displacement amount of the optical axis of the second lens in the second direction with respect to the optical axis of the first lens is no greater than an arrangement pitch of the pixels in the second direction. According to this configuration, the distance to a subject can be measured with high precision in a short period of time using the principle of triangulation, with the first and second lenses placed substantially in the first direction.
- Hereinafter,
Embodiment 1 of the present invention will be described with reference to the drawings. -
FIG. 1 is an exploded perspective view of a compound eye camera module ofEmbodiment 1. InFIG. 1 ,reference numeral 1 denotes a lens array, 2 denotes an optical filter array, 3 denotes a substrate, 4 denotes an imaging element, 5 denotes an upper barrel, 6 denotes a light shielding block (lower barrel), and 7 denotes a lens module. For convenience of the description, an XYZ rectangular coordinate system as shown is assumed. Herein, a Z-axis passes through substantially the center of an effective pixel region of theimaging element 4 and is normal to the effective pixel region. An X-axis is orthogonal to the Z-axis and parallel tolight shielding walls light shielding block 6, and a Y-axis is orthogonal to the Z-axis and parallel tolight shielding walls light shielding block 6. - The
lens array 1 integrally has foursingle lenses 1 a to 1 d arranged in a lattice point shape on the same plane parallel to an XY-plane. Respective optical axes of the fourlenses 1 a to 1 d are parallel to the Z-axis and arranged at four apexes of a virtual rectangle parallel to the XY-plane. Thelenses 1 a to 1 d are designed respectively so as to satisfy the optical specifications such as MTF required with respect to light in a red, blue, or green wavelength band among three primary colors of light. Specifically, thelenses lenses 1 a to 1 d are formed integrally using a material such as glass or plastic. Therespective lenses 1 a to 1 d allow light from a subject (not shown) to pass through theoptical filter array 2 to form images on theimaging element 4. - The
optical filter array 2 is placed between thelens array 1 and theimaging element 4. Theoptical filter array 2 also has fouroptical filters 2 a to 2 d arranged on the same plane parallel to the XY-plane in the same way as in thelens array 1. The fouroptical filters 2 a to 2 d respectively transmit light in only a red, green, or blue wavelength band. Specifically, theoptical filter 2 a transmits light in a red wavelength band, theoptical filter 2 b transmits light in a green wavelength band, theoptical filter 2 c transmits light in a green wavelength band, and theoptical filter 2 d transmits light in a blue wavelength band. In the case where it is necessary to cut infrared rays, such characteristics may be provided to theoptical filters 2 a to 2 d. The fouroptical filters 2 a to 2 d are arranged respectively on the corresponding optical axes of the fourlenses 1 a to 1 d. - The
imaging element 4 is an imaging sensor such as a CCD, and has a number of pixels arranged two-dimensionally in a checkered pattern. The effective pixel region of theimaging element 4 is divided substantially equally into fourimaging regions 4 a to 4 d. The fourimaging regions 4 a to 4 d are arranged respectively on the corresponding optical axes of the fourlenses 1 a to 1 d. Thus, subject images formed of only a red, green, or blue wavelength component are formed independently on the fourimaging regions 4 a to 4 d. Specifically, only light in a red wavelength band in the light from a subject, having passed through thelens 1 a, passes through theoptical filter 2 a to form a subject image formed of only a red wavelength component on theimaging region 4 a. Similarly, only light in a green wavelength band in the light from the subject, having passed through thelens 1 b, passes through theoptical filter 2 b to form a subject image formed of only a green wavelength component on theimaging region 4 b. Only light in a green wavelength band in the light from the subject, having passed through thelens 1 c, passes through theoptical filter 2 c to form a subject image formed of only a green wavelength component on theimaging region 4 c. Only light in a blue wavelength band in the light from the subject, having passed through thelens 1 d, passes through theoptical filter 2 d to form a subject image formed of only a blue wavelength component on theimaging region 4 d. - Each pixel constituting the
imaging regions 4 a to 4 d of theimaging element 4 photoelectrically converts the incident light from the subject, and outputs an electric signal (not shown) in accordance with the intensity of the light. - The electric signal output from the
imaging element 4 is subjected to various signal processings and video processing. For example, a parallax amount between two images captured by theimaging regions imaging regions 4 a to 4 d is obtained. Then, images of three colors: red, green, and blue are combined considering the above parallax amounts, whereby one color image can be created. Alternatively, the distance to the subject also can be measured using the principle of triangulation, comparing the two images captured by theimaging regions - The
upper barrel 5 has aconcave portion 51 on a lower surface thereof, which holds and fixes thelens array 1, as shown inFIG. 2 . Thelens array 1 is fitted in theconcave portion 51 to be positioned with respect to theupper barrel 5. Furthermore, four apertures (openings) 5 a to 5 d are formed at positions through which the respective optical axes of the fourlenses 1 a to 1 d of the heldlens array 1 pass. Theupper barrel 5 is made of a material that does not transmit light, and prevents unnecessary ambient light from being incident upon thelenses 1 a to 1 d from portions other than theapertures 5 a to 5 d. - The
lens array 1 and theupper barrel 5 holding it constitute thelens module 7. - As shown in
FIG. 3 , thelight shielding block 6 includeslight shielding walls 61 a to 61 d arranged in a cross shape so as to form fouropenings 6 a to 6 d independent from each other, and anouter barrel portion 62 holding thelight shielding walls 61 a to 61 d. Thelight shielding walls 61 a to 61 d extend radially with respect to the Z-axis that is a center axis of thelight shielding block 6. Thelight shielding walls light shielding walls openings 6 a to 6 d are arranged respectively on the corresponding optical axes of the fourlenses 1 a to 1 d. Thelight shielding walls 61 a to 61 d divide the effective pixel region of theimaging element 4 into fourimaging regions 4 a to 4 d. The size of theopenings 6 a to 6 d seen from a direction parallel to the Z-axis is substantially the same as or larger than theimaging regions 4 a to 4 d. Light from the subject having passed through thelenses 1 a to 1 d respectively pass through theopenings 6 a to 6 d to form images on theimaging regions 4 a to 4 d, respectively. Thelight shielding walls 61 a to 61 d prevent the light having passed through one of thelenses 1 a to 1 d from being incident upon an imaging region not corresponding to the lens. For example, in order for light in a green wavelength band having been incident upon thelens 1 b diagonally and passed through theoptical filter 2 b not be incident upon theimaging region 4 a upon which only light in a red wavelength band is supposed to be incident originally, thelight shielding wall 61 a blocking the light in a green wavelength band is provided along a boundary between theimaging regions outer barrel portion 62 surrounding theopenings 6 a to 6 d prevents ambient light, not passing through thelens array 1 and theoptical filter array 2, from being incident upon theimaging regions 4 a to 4 d. Thus, owing to thelight shielding block 6, unnecessary light is not incident upon therespective imaging regions 4 a to 4 d, and the occurrence of stray light and the like can be prevented. In order to allow this function to be exhibited effectively, thelight shielding block 6 is made of a material that does not transmit light in the same way as in theupper barrel 5. Furthermore, it is preferred that thelight shielding walls 61 a to 61 d and side surfaces of theouter barrel portion 62, exposed to theopenings 6 a to 6 d, are subjected to various surface treatments (for example, roughening, plating, blackening, etc.) so that the reflection of light is minimized. - A
concave portion 63 holding and fixing theoptical filter array 2 is provided on a surface of thelight shielding block 6 on thelens array 1 side. Theoptical filter array 2 is fitted in theconcave portion 63 to be positioned with respect to thelight shielding block 6. Theoptical filters 2 a to 2 d are arranged respectively in theopenings 6 a to 6 d. - Next, a method of assembling a camera module of the present embodiment will be described.
- The
imaging element 4 is positioned and fixed with respect to thesubstrate 3. Theimaging element 4 is connected electrically to thesubstrate 3 via wire bonding or the like, and further is connected to an electronic component such as a DSP that processes the electric signal from theimaging element 4. The electronic component such as a DSP may be mounted on thesubstrate 3. Thesubstrate 3 performs functions as electrical connection and a reference plane of each component during assembly. - Next, the
light shielding block 6 with theoptical filter array 2 fixed thereto is positioned with respect to theimaging element 4 and fixed onto thesubstrate 3 in such a manner that the Z-axis that is a center axis of thelight shielding block 6 passes through substantially the center of the effective pixel region of theimaging element 4, and thelight shielding walls 61 a to 61 d of thelight shielding block 6 are matched with checkered arrangement directions of many pixels constituting theimaging element 4. Thus, a light-receiving plane of theimaging element 4 becomes normal to the Z-axis, one arrangement direction (for example, a lateral arrangement direction) of the number of pixels arranged in a matrix constituting theimaging element 4 becomes parallel to the X-axis, and the other arrangement direction (for example, a vertical arrangement direction) becomes parallel to the Y-axis. Furthermore, the effective pixel region of theimaging element 4 is divided substantially equally into the fourimaging regions 4 a to 4 d corresponding to the fouropenings 6 a to 6 d. - Next, the
lens module 7 with thelens array 1 fixed to theupper barrel 5 is fitted to thelight shielding block 6. At this time, tip end surfaces oflegs 53 a to 53 d at four corners of theupper barrel 5 come into contact with thesubstrate 3. Thus, thelens array 1 becomes parallel to the XY-plane, and is positioned in the Z-axis direction. - Furthermore, in the direction parallel to the XY-plane, the
lens module 7 including thelens array 1 needs to be positioned exactly with respect to theimaging element 4 and thelight shielding block 6. More specifically, a center axis 55 (which is parallel to each optical axis of the fourlenses 1 a to 1 d of thelens array 1, and passes through the center of the virtual rectangle with each optical axis position as an apex) of theupper barrel 5 shown inFIG. 2 needs to be substantially matched with the Z-axis in the XY-plane. In addition, as shown inFIG. 4 , along side 12 a and ashort side 12 b of the virtual rectangle with optical axis positions 11 a to 11 d of the fourlenses 1 a to 1 d as apexes need to be substantially parallel to the X-axis and the Y-axis, respectively. This is because, if thelong side 12 a and theshort side 12 b are not parallel to the X-axis and the Y-axis, respectively,shaded regions 14 a to 14 d among image-formingregions 13 a to 13 d of thelenses 1 a to 1 d extend off theimaging regions 4 a to 4 d. That is, pixels required for capturing the subject whose images are formed by thelenses 1 a to 1 d cannot be ensured. InFIG. 4 ,reference numeral 41 denotes pixels constituting theimaging element 4. - The present embodiment realizes the above as follows. As shown in
FIG. 3 , first slidingsurfaces cylindrical surface 65 c having a radius r1 with the Z-axis that is the center axis of thelight shielding block 6 as a center axis, are provided on outer peripheral walls at four corners of thelight shielding block 6 positioned and fixed to thesubstrate 3. On the other hand, as shown inFIG. 2 , second slidingsurfaces cylindrical surface 55 c having a radius r2 with thecenter axis 55 of theupper barrel 5 as a center axis, are provided on inner wall surfaces of thelegs 53 a to 53 d at four corners of theupper barrel 5 of thelens module 7. The radius r2 is set to be slightly larger than the radius r1 so that a minimum required gap, allowing the second slidingsurfaces upper barrel 5 on a rotation side to slide on the first slidingsurfaces light shielding block 6 on a fixed side, is formed between the first slidingsurfaces surfaces - When the
lens module 7 is fitted to thelight shielding block 6 so that the second slidingsurfaces upper barrel 5 are opposed respectively to the first slidingsurfaces light shielding block 6, the Z-axis that is the center axis of thelight shielding block 6 is substantially matched with thecenter axis 55 of theupper barrel 5. Then, by adjusting thelens module 7 with respect to thelight shielding block 6 in the XY-plane by rotation, thelong side 12 a and theshort side 12 b of the virtual rectangle with the optical axis positions 11 a to 11 d of the fourlenses 1 a to 1 d as apexes, shown inFIG. 4 , are rendered parallel to the X-axis and the Y-axis, respectively. - The rotation adjustment of the
lens module 7 can be performed, for example, as follows. A parallel light source as a subject is set on the Z-axis, and subject images are formed on theimaging regions 4 a to 4 d via thelenses 1 a - to 1 d and the
optical filters 2 a to 2 d. The optical axis positions 11 a to 11 d of thelenses 1 a to 1 d are calculated from positions of spots captured in theimaging regions 4 a to 4 d, respectively. Then, as shown inFIG. 5 , thelens module 7 is rotated in the XY-plane so that thelong side 12 a and theshort side 12 b of the virtual rectangle with the optical axis positions 11 a to 11 d as apexes become parallel to the X-axis and the Y-axis, respectively. Consequently, the subject images can be captured in therespective imaging regions 4 a to 4 d without being lost, while the image-formingregions 13 a to 13 d of thelenses 1 a to 1 d do not extend off theimaging regions 4 a to 4 d. - Since the difference between the radius r1 and the radius r2 is small, the second sliding
surfaces surfaces center axis 55 of theupper barrel 5 hardly is displaced from the Z-axis in the XY-plane. Consequently, during the rotation adjustment of thelens module 7, the relative positional relationships of the respective optical axis positions 11 a to 11 d with respect to therespective imaging regions 4 a to 4 d are substantially the same at all times. - A plane including the tip end surfaces of the
legs 53 a to 53 d at four corners of theupper barrel 5 is parallel to a plane on which the fourlenses 1 a to 1 d are arranged. Then, during the rotation adjustment of thelens module 7, the tip end surfaces of thelegs 53 a to 53 d at four corners slide while being in contact with thesubstrate 3 at all times. Thus, even if thelens module 7 is rotated, the spot shapes formed respectively by thelenses 1 a to 1 d on theimaging regions 4 a to 4 d do not change. This facilitates a rotation adjustment operation, and a photographed image is not changed by the rotation position. - As described above, according to the present embodiment, in order to prevent light from a lens not corresponding to an imaging region from being incident upon the imaging region, the
light shielding block 6 having thelight shielding walls 61 a to 61 d is used, so that it is not necessary to provide two layers of the optical filter arrays for conducting color separation. Thus, the thickness of a camera module can be reduced. - Furthermore, the
light shielding block 6 includes the first slidingsurfaces upper barrel 5 includes the second slidingsurfaces light shielding block 6 can be matched substantially with thecenter axis 55 of theupper barrel 5. Furthermore, by adjusting thelens module 7 with respect to thelight shielding block 6 and theimaging element 4 by rotation, thelong side 12 a and theshort side 12 b of the virtual rectangle with the optical axis positions 11 a to 11 d of thelenses 1 a to 1 d as apexes can be rendered parallel to the X-axis and the Y-axis, respectively. Consequently, the image-formingregions 13 a to 13 d of thelenses 1 a to 1 d do not extend off theimaging regions 4 a to 4 d, and it is not necessary to use a large imaging element having a number of unnecessary pixels. Thus, the camera module can be miniaturized, and the cost thereof can be reduced. - The above embodiment is an example, and the present invention is not limited thereto.
- For example, in the above embodiment, the case using a parallel light source as a subject during rotation adjustment of the
lens module 7 has been illustrated. However, the subject during rotation adjustment is not limited thereto in the present invention, and for example, the optical axis positions 11 a to 11 d may be obtained using various kinds of charts. - Furthermore, in the above embodiment, the rotation adjustment is performed with the
light shielding block 6 and theimaging element 4 being on a fixed side and thelens module 7 being on a rotation side. However, the present invention is not limited thereto, and even if the fixed side and the rotation side are reversed compared with the above, the relative position therebetween can be changed, and the same effects as those in the above can be obtained. - Furthermore, in the above embodiment, although the optical system is illustrated, which separates light from a subject to light in four (red, green, green, and blue) wavelength bands, the optical system of the present invention is not limited thereto, and for example, an optical system that separates light to light in two near-infrared wavelength bands and light in two green wavelength bands may be used, or a combination of light in the other wavelength bands may be used. The above effects of the present embodiment can be obtained irrespective of a wavelength band to be selected.
- Furthermore, in the above embodiment, although the example in which the
lens array 1 includes the fourlenses 1 a to 1 d has been illustrated, the lens array of the present invention is not limited thereto. The number of the lenses to be provided in the lens array may be two or more without being limited to four. Furthermore, the arrangement of two or more lenses is not limited to a lattice point arrangement. - Furthermore, in the above embodiment, although the example in which the
lens module 7 includes thelens array 1 and theupper barrel 5 holding thelens array 1, and the second slidingsurfaces upper barrel 5 has been illustrated, thelens module 7 of the present invention is not limited thereto. For example, thelens module 7 may be formed of a member including the lens array having thelenses 1 a to 1 d and the second slidingsurfaces apertures 5 a to 5 d. - Furthermore, in the above embodiment, although the first sliding
surfaces light shielding block 6, the first sliding surfaces of the present invention are not limited thereto and may be, for example, a cylindrical surface extending over the entire periphery of thelight shielding block 6. Similarly, in the above embodiment, although the second slidingsurfaces legs 53 a to 53 d at four corners of theupper barrel 5, the second sliding surfaces of the present invention are not limited thereto and may be, for example, a cylindrical surface extending over the entire periphery. - Furthermore, in the above embodiment, although the first sliding surfaces and the second sliding surfaces respectively include four discontinuous surfaces, the first sliding surfaces and the second sliding surfaces of the present invention are not limited thereto. The first sliding surfaces and/or the second sliding surfaces may include two, three, or at least five discontinuous surfaces, as long as the second sliding surfaces can be slid on the first sliding surfaces to rotate the
lens module 7 with respect to thelight shielding block 6. - Furthermore, in the above embodiment, although both the first sliding surfaces and the second sliding surfaces are along a cylindrical surface, the first sliding surfaces and the second sliding surfaces of the present invention are not limited thereto. For example, the first sliding surfaces and the second sliding surfaces may be those along the surface of a rotator such as a circular conical surface or a spherical surface.
- Furthermore, in the present embodiment, although the example in which the first sliding surface and the second sliding surface are in a plane-contact with each other has been described, the present invention is not limited thereto. For example, one of the first sliding surface and the second sliding surface may be a plane having a predetermined area, and the other may be a spherical surface that is in a point-contact with the plane having a predetermined area or a cylindrical surface that is in a line-contact with the plane having a predetermined area.
- Furthermore, in the above embodiment, although the example has been described in which the second sliding
surfaces lens module 7 are placed on an outer side of the first slidingsurfaces light shielding block 6, the second sliding surfaces of thelens module 7 may be placed on an inner side of the first sliding surfaces of thelight shielding block 6 instead. In this case, r1>r2 is satisfied, and it is preferred that the difference therebetween is smaller in the same way as in the above embodiment. - Furthermore, in the above embodiment, the case has been described in which the
lens module 7 is adjusted with respect to thelight shielding block 6 by rotation so that the respective directions of thelong side 12 a and theshort side 12 b of the virtual rectangle with the optical axis positions 11 a to 11 d of thelenses 1 a to 1 d as apexes are parallel to the checkered arrangement directions (i.e., the Y-axis and the X-axis) of a number of pixels constituting theimaging element 4. However, the rotation adjustment of the present invention is not limited thereto. For example, thelens module 7 may be adjusted with respect to thelight shielding block 6 by rotation so that the respective directions of thelong side 12 a and theshort side 12 b are inclined at a slight angle with respect to the checkered arrangement directions (i.e., the Y-axis and the X-axis) of a number of pixels of theimaging element 4. In this case, a high-resolution image can be obtained by pixel shifting. - Hereinafter,
Embodiment 2 of the present invention will be described with reference to the drawings. -
FIG. 6 is an exploded perspective view of a compound eye camera module ofEmbodiment 2. InFIG. 6 , the same members as those inFIG. 1 are denoted with the same reference numerals as those therein, and the description thereof will be omitted. - The basic configuration of the camera module of the present embodiment is substantially the same as that of
Embodiment 1. The present embodiment is different fromEmbodiment 1 in the shapes of anupper barrel 500 and alight shielding block 600. -
FIG. 7 is a perspective view of theupper barrel 500 seen from a subject side. Theupper barrel 500 in the present embodiment is different from theupper barrel 5 inEmbodiment 1 in thatgrooves -
FIG. 8 is a perspective view of thelight shielding block 600 seen from the subject side. Thelight shielding block 600 in the present embodiment is different from thelight shielding block 6 inEmbodiment 1 in that protrudingwalls - When the
upper barrel 500 is fitted to thelight shielding block 600, as shown inFIGS. 9 and 10 , thewalls grooves grooves walls upper barrel 500 can be rotated in the XY-plane with respect to thelight shielding block 600. The rotatable range thereof is limited to a range in which thewalls grooves walls grooves lens module 7 including theupper barrel 500 with respect to thelight shielding block 600. - In the present embodiment, merely by fitting the
upper barrel 500 to thelight shielding block 600 so that thewalls grooves long side 12 a and theshort side 12 b of the virtual rectangle with the optical axis positions 11 a to 11 d of the fourlenses 1 a to 1 d as apexes shown inFIG. 4 , with respect to the X-axis and the Y-axis, can be decreased. Thus, the adjustment amount in the rotation adjustment step of thelens module 7, conducted later, can be reduced. Consequently, the time of the rotation adjustment step of thelens module 7 can be shortened, and the productivity of the camera module can be enhanced. -
Gaps grooves walls lens module 7 can be adjusted by rotation. Thus, after the rotation adjustment step of thelens module 7, theupper barrel 500 and thelight shielding block 600 can be fixed to each other by applying an adhesive to thegaps lens module 7 and thelight shielding block 600 to each other, using a rotation restriction mechanism (stopper) of thelens module 7 with respect to thelight shielding block 600, a method of fixing them can be simplified, which enhances assembly workability. Furthermore, it is not necessary to newly design and provide components, shapes, and the like for fixing thelight shielding block 600 and thelens module 7 to each other. Thus, a compound eye camera module can be realized at a lower cost. - The side surfaces of the
grooves walls grooves walls gaps light shielding block 600 and thelens module 7 can be fixed to each other more strongly. - In the above embodiment, although the combination of the
grooves walls lens module 7 with respect to thelight shielding block 600, the rotation restriction mechanism of the present invention is not limited thereto. Any mechanism capable of allowing the rotation of thelens module 7 in the XY-plane with respect to thelight shielding block 600 and restricting the rotation angle in a predetermined range, such as a combination of an arc-shaped groove (or hole) and a pin inserted therein, can be used. Even in this case, the same effects as those in the above can be obtained. - The
lens array 1 having a plurality of lenses can be obtained integrally, for example, by molding a lens material (e.g., resin or glass) with a mold. In such a case, the optical axis positions of a plurality of lenses on the obtained lens array may be displaced from desired positions due to the production error of the mold, the molding error, etc. For example, as shown inFIG. 11A , there is a case in which a quadrangle with the optical axis positions 11 a to 11 d of the fourlenses 1 a to 1 d (not shown) arranged in a lattice point shape as apexes may not exactly be a rectangle. In such a case, even if thelens module 7 is adjusted by rotation with respect to the light shielding blocks 6, 600 so that the image-formingregions 13 a to 13 d of thelenses 1 a to 1 d do not extend off theimaging regions 4 a to 4 d, for example, in the case where the distance to a subject is measured with a camera module, using the principle of triangulation, there arise problems in that the measurement precision decreases and the calculation time is prolonged. - The principle of measuring a distance with a camera module will be described with reference to
FIGS. 12A and 12B .FIG. 12A is a side view seen in a direction normal to a plane including theoptical axes lenses FIG. 12B is a plan view seen in a direction parallel to theoptical axes lenses Reference numerals optical axes imaging element 4. A subject 200 on theoptical axis 11 c is formed assubject images imaging element 4 by thelenses optical axes lenses lenses subject image 201 a moves on astraight line 202 connecting anintersection point 15 a to anintersection point 15 c on theimaging element 4. This phenomenon is called a “parallax”. Assuming that the displacement amount (hereinafter, referred to as a “parallax amount”) of thesubject image 201 a from theintersection point 15 a is S, the distance between theoptical axes lens 1 c to the subject 200) is A, and an image-forming distance is f, a relationship: A/d=f/S is satisfied. Thus, if the parallax amount S is obtained, the subject distance A can be obtained. Specifically, assuming that the captured image obtained via thelens 1 c is a reference image, and the captured image obtained via thelens 1 a is an image to be compared, the displacement amount (i.e., a parallax amount) S of the position of thesubject image 201 a in the image to be compared, with respect to the position of thesubject image 201 c in the reference image is obtained. In order to obtain the parallax amount S, it is necessary to search for thesubject image 201 a corresponding to thesubject image 201 c in the reference image, in the image to be compared (this is referred to as “stereo matching”). In the case of performing the stereo matching, if the direction of thestraight line 202 shown inFIG. 12B is not matched with the arrangement direction of pixels in theimaging element 4, thesubject image 201 a cannot be specified exactly in the image to be compared, and the subject distance cannot be obtained exactly. Alternatively, a great amount of time is required for searching for thesubject image 201 a in the image to be compared, and consequently, a calculation time is prolonged. - The case will be considered in which, using the camera module having four lenses arranged in a lattice point shape as shown in
FIG. 11A , the stereo matching is performed between two captured images obtained from the twoupper imaging regions lower imaging regions straight line 12 a 1 connecting theoptical axes straight line 12 a 2 connecting theoptical axes 11 b, lid are not parallel to the lateral arrangement direction (i.e., the X-axis) of thepixels 41, the measurement precision of the subject distance decreases as described above and a calculation time is prolonged. - The
lens module 7 is adjusted with respect to the light shielding blocks 6, 600 by rotation so that the degree of parallelization of thestraight lines FIG. 11B , it is preferred that one (more preferably both) of a displacement amount Dy1 of theoptical axis 11 a in the Y-axis direction with respect to theoptical axis 11 c and a displacement amount Dy2 of theoptical axis 11 b in the Y-axis direction with respect to theoptical axis 11 d is set to be no greater than an arrangement pitch of thepixels 41 in the Y-axis direction. Thus, the measurement precision and calculation time without any practical problems in the measurement of a subject distance are obtained. - In the above description, although the case has been described where the stereo matching is performed between two captured images obtained from the two
upper imaging regions lower imaging regions - For example, it also is possible that the stereo matching is performed between two captured images obtained from the two
right imaging regions left imaging regions lens module 7 is adjusted by rotation with respect to the light shielding blocks 6, 600 so that one (preferably, both) of a displacement amount Dx1 of theoptical axis 11 b in the X-axis direction with respect to theoptical axis 11 a and a displacement amount Dx2 of the optical axis lid in the X-axis direction with respect to theoptical axis 11 c is no greater than the arrangement pitch of thepixels 41 in the X-axis direction. - Alternatively, a subject distance may be measured using only two captured images obtained from the two
upper imaging regions pixels 41 in the Y-axis direction. Similarly, a subject distance may be measured using only two captured images obtained from the twolower imaging regions pixels 41 in the Y-axis direction. Furthermore, a subject distance may be measured using only two captured images obtained from the tworight imaging regions pixels 41 in the X-axis direction. Similarly, a subject distance may be measured using only two captured images obtained from the twoleft imaging regions pixels 41 in the X-axis direction. - In the above embodiment, the case where the lens array has four lenses has been described. In the case where the lens array has only two lenses, the effects similar to those in the above can be obtained by setting the direction connecting the optical axes of two lenses to be substantially parallel to the X-axis or the Y-axis as described above.
- Furthermore, in the case where the lens array has at least five lenses, the same effects as those in the above can be obtained by placing two or four lenses among the at least five lenses with respect to the
imaging element 4 so that the above conditions are satisfied. In order to enhance the measurement precision of a subject distance, it is preferred to select lenses to be used for measuring a distance so that a distance d between optical axes of the lenses increases. - In order to enhance the measurement precision and calculation speed, it is preferred that the stereo matching is performed between two captured images obtained from light in the same wavelength band. However, the stereo matching can be performed, even between two captured images obtained from light in different wavelength bands, and a subject distance can be measured.
- Any of the embodiments described above strictly is intended to clarify the technical contents of the present invention. The present invention should not be interpreted by being limited to such specific examples, and can be carried out by being variously modified within the scope of the spirit of the present invention and the claims and should be interpreted broadly.
- The field of the compound eye camera module of the present invention is not particularly limited, and the present invention can be preferably used for, for example, a small and thin mobile telephone having a camera function, a digital still camera, a security camera, a vehicle-mounted camera, and the like.
Claims (11)
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2006-012819 | 2006-01-20 | ||
JP2006012819 | 2006-01-20 | ||
PCT/JP2007/050351 WO2007083579A1 (en) | 2006-01-20 | 2007-01-12 | Compound eye camera module and method of producing the same |
Publications (2)
Publication Number | Publication Date |
---|---|
US20100225755A1 true US20100225755A1 (en) | 2010-09-09 |
US8194169B2 US8194169B2 (en) | 2012-06-05 |
Family
ID=38287532
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/159,288 Active 2029-10-22 US8194169B2 (en) | 2006-01-20 | 2007-01-12 | Compound eye camera module and method of producing the same |
Country Status (4)
Country | Link |
---|---|
US (1) | US8194169B2 (en) |
JP (1) | JP4147273B2 (en) |
CN (1) | CN101371568B (en) |
WO (1) | WO2007083579A1 (en) |
Cited By (42)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20130033578A1 (en) * | 2010-02-19 | 2013-02-07 | Andrew Augustine Wajs | Processing multi-aperture image data |
US20140118834A1 (en) * | 2011-06-01 | 2014-05-01 | Naoyuki Inoue | Compound-Eye Unit |
WO2015058153A1 (en) * | 2013-10-18 | 2015-04-23 | The Lightco Inc. | Methods and apparatus for implementing and/or using a camera device |
US20150215505A1 (en) * | 2014-01-27 | 2015-07-30 | Himax Technologies Limited | Image-capturing assembly and array lens units thereof |
US20150229909A1 (en) * | 2012-10-24 | 2015-08-13 | Olympus Corporation | Image pickup element and image pickup apparatus |
US9197816B2 (en) | 2013-10-18 | 2015-11-24 | The Lightco Inc. | Zoom related methods and apparatus |
US9270876B2 (en) | 2013-01-05 | 2016-02-23 | The Lightco Inc. | Methods and apparatus for using multiple optical chains in parallel with multiple different exposure times |
US9423588B2 (en) | 2013-10-18 | 2016-08-23 | The Lightco Inc. | Methods and apparatus for supporting zoom operations |
US9426365B2 (en) | 2013-11-01 | 2016-08-23 | The Lightco Inc. | Image stabilization related methods and apparatus |
US9462170B2 (en) | 2014-02-21 | 2016-10-04 | The Lightco Inc. | Lighting methods and apparatus |
US9467627B2 (en) | 2013-10-26 | 2016-10-11 | The Lightco Inc. | Methods and apparatus for use with multiple optical chains |
US9544503B2 (en) | 2014-12-30 | 2017-01-10 | Light Labs Inc. | Exposure control methods and apparatus |
US9554031B2 (en) | 2013-12-31 | 2017-01-24 | Light Labs Inc. | Camera focusing related methods and apparatus |
US9721344B2 (en) | 2015-02-26 | 2017-08-01 | Dual Aperture International Co., Ltd. | Multi-aperture depth map using partial blurring |
US9736365B2 (en) | 2013-10-26 | 2017-08-15 | Light Labs Inc. | Zoom related methods and apparatus |
US9749549B2 (en) | 2015-10-06 | 2017-08-29 | Light Labs Inc. | Methods and apparatus for facilitating selective blurring of one or more image portions |
US9824427B2 (en) | 2015-04-15 | 2017-11-21 | Light Labs Inc. | Methods and apparatus for generating a sharp image |
US9857584B2 (en) | 2015-04-17 | 2018-01-02 | Light Labs Inc. | Camera device methods, apparatus and components |
US20180035046A1 (en) * | 2016-07-29 | 2018-02-01 | Xin Yuan | Block-based lensless compressive image acquisition |
US9912865B2 (en) | 2014-10-17 | 2018-03-06 | Light Labs Inc. | Methods and apparatus for supporting burst modes of camera operation |
US9930233B2 (en) | 2015-04-22 | 2018-03-27 | Light Labs Inc. | Filter mounting methods and apparatus and related camera apparatus |
US20180095275A1 (en) * | 2015-03-30 | 2018-04-05 | Nikon Corporation | Image-capturing device, multi-lens camera, and method for manufacturing image-capturing device |
US9948832B2 (en) | 2016-06-22 | 2018-04-17 | Light Labs Inc. | Methods and apparatus for synchronized image capture in a device including optical chains with different orientations |
US9967535B2 (en) | 2015-04-17 | 2018-05-08 | Light Labs Inc. | Methods and apparatus for reducing noise in images |
US9979878B2 (en) | 2014-02-21 | 2018-05-22 | Light Labs Inc. | Intuitive camera user interface methods and apparatus |
US9998638B2 (en) | 2014-12-17 | 2018-06-12 | Light Labs Inc. | Methods and apparatus for implementing and using camera devices |
US10003738B2 (en) | 2015-12-18 | 2018-06-19 | Light Labs Inc. | Methods and apparatus for detecting and/or indicating a blocked sensor or camera module |
US10075651B2 (en) | 2015-04-17 | 2018-09-11 | Light Labs Inc. | Methods and apparatus for capturing images using multiple camera modules in an efficient manner |
US10091447B2 (en) | 2015-04-17 | 2018-10-02 | Light Labs Inc. | Methods and apparatus for synchronizing readout of multiple image sensors |
US10110794B2 (en) | 2014-07-09 | 2018-10-23 | Light Labs Inc. | Camera device including multiple optical chains and related methods |
US10110788B2 (en) * | 2016-02-03 | 2018-10-23 | Tdk Taiwan Corp. | Camera device |
US10129483B2 (en) | 2015-06-23 | 2018-11-13 | Light Labs Inc. | Methods and apparatus for implementing zoom using one or more moveable camera modules |
US20180328717A1 (en) * | 2017-05-09 | 2018-11-15 | Google Inc. | Sensor combination |
US10191356B2 (en) | 2014-07-04 | 2019-01-29 | Light Labs Inc. | Methods and apparatus relating to detection and/or indicating a dirty lens condition |
US10225445B2 (en) | 2015-12-18 | 2019-03-05 | Light Labs Inc. | Methods and apparatus for providing a camera lens or viewing point indicator |
US10306218B2 (en) | 2016-03-22 | 2019-05-28 | Light Labs Inc. | Camera calibration apparatus and methods |
US10365480B2 (en) | 2015-08-27 | 2019-07-30 | Light Labs Inc. | Methods and apparatus for implementing and/or using camera devices with one or more light redirection devices |
US10462377B2 (en) | 2016-07-29 | 2019-10-29 | Nokia Of America Corporation | Single-aperture multi-sensor lensless compressive image acquisition |
US10491806B2 (en) | 2015-08-03 | 2019-11-26 | Light Labs Inc. | Camera device control related methods and apparatus |
US10582186B1 (en) * | 2014-06-11 | 2020-03-03 | Amazon Technologies, Inc. | Approaches for identifying misaligned cameras |
US11126066B2 (en) * | 2019-09-04 | 2021-09-21 | Chicony Electronics Co., Ltd. | Digital imaging device |
CN114236853A (en) * | 2022-01-26 | 2022-03-25 | 中煤科工开采研究院有限公司 | Split type mining AR glasses fixing device and using method thereof |
Families Citing this family (69)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20100259655A1 (en) * | 2007-11-01 | 2010-10-14 | Konica Minolta Holdings, Inc. | Imaging device |
US20100053414A1 (en) * | 2008-01-11 | 2010-03-04 | Satoshi Tamaki | Compound eye camera module |
US8902321B2 (en) | 2008-05-20 | 2014-12-02 | Pelican Imaging Corporation | Capturing and processing of images using monolithic camera array with heterogeneous imagers |
US8866920B2 (en) | 2008-05-20 | 2014-10-21 | Pelican Imaging Corporation | Capturing and processing of images using monolithic camera array with heterogeneous imagers |
US11792538B2 (en) | 2008-05-20 | 2023-10-17 | Adeia Imaging Llc | Capturing and processing of images including occlusions focused on an image sensor by a lens stack array |
EP2502115A4 (en) | 2009-11-20 | 2013-11-06 | Pelican Imaging Corp | Capturing and processing of images using monolithic camera array with heterogeneous imagers |
KR101824672B1 (en) | 2010-05-12 | 2018-02-05 | 포토네이션 케이맨 리미티드 | Architectures for imager arrays and array cameras |
US8878950B2 (en) | 2010-12-14 | 2014-11-04 | Pelican Imaging Corporation | Systems and methods for synthesizing high resolution images using super-resolution processes |
JP2012182309A (en) * | 2011-03-01 | 2012-09-20 | Seiko Instruments Inc | Optical device |
JP2014519741A (en) | 2011-05-11 | 2014-08-14 | ペリカン イメージング コーポレイション | System and method for transmitting and receiving array camera image data |
US20130265459A1 (en) | 2011-06-28 | 2013-10-10 | Pelican Imaging Corporation | Optical arrangements for use with an array camera |
EP2726930A4 (en) | 2011-06-28 | 2015-03-04 | Pelican Imaging Corp | Optical arrangements for use with an array camera |
WO2013043761A1 (en) | 2011-09-19 | 2013-03-28 | Pelican Imaging Corporation | Determining depth from multiple views of a scene that include aliasing using hypothesized fusion |
EP2761534B1 (en) | 2011-09-28 | 2020-11-18 | FotoNation Limited | Systems for encoding light field image files |
KR101490066B1 (en) * | 2011-10-31 | 2015-02-11 | 코니카 미놀타 가부시키가이샤 | Lens unit manufacturing method, lens array, and lens unit |
KR101826718B1 (en) * | 2011-12-22 | 2018-02-08 | 엘지이노텍 주식회사 | imaging device |
US9412206B2 (en) | 2012-02-21 | 2016-08-09 | Pelican Imaging Corporation | Systems and methods for the manipulation of captured light field image data |
US9210392B2 (en) | 2012-05-01 | 2015-12-08 | Pelican Imaging Coporation | Camera modules patterned with pi filter groups |
WO2014005123A1 (en) | 2012-06-28 | 2014-01-03 | Pelican Imaging Corporation | Systems and methods for detecting defective camera arrays, optic arrays, and sensors |
US20140002674A1 (en) | 2012-06-30 | 2014-01-02 | Pelican Imaging Corporation | Systems and Methods for Manufacturing Camera Modules Using Active Alignment of Lens Stack Arrays and Sensors |
CN107346061B (en) | 2012-08-21 | 2020-04-24 | 快图有限公司 | System and method for parallax detection and correction in images captured using an array camera |
WO2014032020A2 (en) | 2012-08-23 | 2014-02-27 | Pelican Imaging Corporation | Feature based high resolution motion estimation from low resolution images captured using an array source |
US9214013B2 (en) | 2012-09-14 | 2015-12-15 | Pelican Imaging Corporation | Systems and methods for correcting user identified artifacts in light field images |
CN104685860A (en) | 2012-09-28 | 2015-06-03 | 派力肯影像公司 | Generating images from light fields utilizing virtual viewpoints |
US9143711B2 (en) | 2012-11-13 | 2015-09-22 | Pelican Imaging Corporation | Systems and methods for array camera focal plane control |
CN103076709B (en) * | 2013-01-16 | 2016-06-29 | 瑞声声学科技(深圳)有限公司 | Array camera |
US9462164B2 (en) | 2013-02-21 | 2016-10-04 | Pelican Imaging Corporation | Systems and methods for generating compressed light field representation data using captured light fields, array geometry, and parallax information |
US9253380B2 (en) | 2013-02-24 | 2016-02-02 | Pelican Imaging Corporation | Thin form factor computational array cameras and modular array cameras |
US9638883B1 (en) | 2013-03-04 | 2017-05-02 | Fotonation Cayman Limited | Passive alignment of array camera modules constructed from lens stack arrays and sensors based upon alignment information obtained during manufacture of array camera modules using an active alignment process |
US9774789B2 (en) | 2013-03-08 | 2017-09-26 | Fotonation Cayman Limited | Systems and methods for high dynamic range imaging using array cameras |
US8866912B2 (en) | 2013-03-10 | 2014-10-21 | Pelican Imaging Corporation | System and methods for calibration of an array camera using a single captured image |
US9521416B1 (en) | 2013-03-11 | 2016-12-13 | Kip Peli P1 Lp | Systems and methods for image data compression |
US9106784B2 (en) | 2013-03-13 | 2015-08-11 | Pelican Imaging Corporation | Systems and methods for controlling aliasing in images captured by an array camera for use in super-resolution processing |
US9888194B2 (en) | 2013-03-13 | 2018-02-06 | Fotonation Cayman Limited | Array camera architecture implementing quantum film image sensors |
WO2014165244A1 (en) | 2013-03-13 | 2014-10-09 | Pelican Imaging Corporation | Systems and methods for synthesizing images from image data captured by an array camera using restricted depth of field depth maps in which depth estimation precision varies |
WO2014164550A2 (en) | 2013-03-13 | 2014-10-09 | Pelican Imaging Corporation | System and methods for calibration of an array camera |
WO2014153098A1 (en) | 2013-03-14 | 2014-09-25 | Pelican Imaging Corporation | Photmetric normalization in array cameras |
US9578259B2 (en) | 2013-03-14 | 2017-02-21 | Fotonation Cayman Limited | Systems and methods for reducing motion blur in images or video in ultra low light with array cameras |
US9633442B2 (en) | 2013-03-15 | 2017-04-25 | Fotonation Cayman Limited | Array cameras including an array camera module augmented with a separate camera |
US9445003B1 (en) | 2013-03-15 | 2016-09-13 | Pelican Imaging Corporation | Systems and methods for synthesizing high resolution images using image deconvolution based on motion and depth information |
US9497429B2 (en) | 2013-03-15 | 2016-11-15 | Pelican Imaging Corporation | Extended color processing on pelican array cameras |
WO2014145856A1 (en) | 2013-03-15 | 2014-09-18 | Pelican Imaging Corporation | Systems and methods for stereo imaging with camera arrays |
US9497370B2 (en) | 2013-03-15 | 2016-11-15 | Pelican Imaging Corporation | Array camera architecture implementing quantum dot color filters |
US10122993B2 (en) | 2013-03-15 | 2018-11-06 | Fotonation Limited | Autofocus system for a conventional camera that uses depth information from an array camera |
WO2015048694A2 (en) | 2013-09-27 | 2015-04-02 | Pelican Imaging Corporation | Systems and methods for depth-assisted perspective distortion correction |
WO2015070105A1 (en) | 2013-11-07 | 2015-05-14 | Pelican Imaging Corporation | Methods of manufacturing array camera modules incorporating independently aligned lens stacks |
US10119808B2 (en) | 2013-11-18 | 2018-11-06 | Fotonation Limited | Systems and methods for estimating depth from projected texture using camera arrays |
EP3075140B1 (en) | 2013-11-26 | 2018-06-13 | FotoNation Cayman Limited | Array camera configurations incorporating multiple constituent array cameras |
US10089740B2 (en) | 2014-03-07 | 2018-10-02 | Fotonation Limited | System and methods for depth regularization and semiautomatic interactive matting using RGB-D images |
US9247117B2 (en) | 2014-04-07 | 2016-01-26 | Pelican Imaging Corporation | Systems and methods for correcting for warpage of a sensor array in an array camera module by introducing warpage into a focal plane of a lens stack array |
US9521319B2 (en) | 2014-06-18 | 2016-12-13 | Pelican Imaging Corporation | Array cameras and array camera modules including spectral filters disposed outside of a constituent image sensor |
JP6627083B2 (en) * | 2014-08-22 | 2020-01-08 | パナソニックIpマネジメント株式会社 | Image acquisition device and image forming system |
CN113256730B (en) | 2014-09-29 | 2023-09-05 | 快图有限公司 | System and method for dynamic calibration of an array camera |
US9942474B2 (en) | 2015-04-17 | 2018-04-10 | Fotonation Cayman Limited | Systems and methods for performing high speed video capture and depth estimation using array cameras |
US10482618B2 (en) | 2017-08-21 | 2019-11-19 | Fotonation Limited | Systems and methods for hybrid depth regularization |
KR102012717B1 (en) * | 2018-10-25 | 2019-08-21 | 전자부품연구원 | Image conversion device and system for generating 360 VR image in real time |
US10880475B2 (en) | 2018-10-25 | 2020-12-29 | Korea Electronics Technology Institute | Video conversion apparatus and system for generating 360-degree virtual reality video in real time |
CN209167632U (en) * | 2018-11-27 | 2019-07-26 | 瑞声光学科技(常州)有限公司 | A kind of lens module |
CN110351473A (en) * | 2019-08-13 | 2019-10-18 | 宁波为森智能传感技术有限公司 | Fatigue driving monitoring apparatus |
MX2022003020A (en) | 2019-09-17 | 2022-06-14 | Boston Polarimetrics Inc | Systems and methods for surface modeling using polarization cues. |
EP4042366A4 (en) | 2019-10-07 | 2023-11-15 | Boston Polarimetrics, Inc. | Systems and methods for augmentation of sensor systems and imaging systems with polarization |
KR20230116068A (en) | 2019-11-30 | 2023-08-03 | 보스턴 폴라리메트릭스, 인크. | System and method for segmenting transparent objects using polarization signals |
CN115552486A (en) | 2020-01-29 | 2022-12-30 | 因思创新有限责任公司 | System and method for characterizing an object pose detection and measurement system |
KR20220133973A (en) | 2020-01-30 | 2022-10-05 | 인트린식 이노베이션 엘엘씨 | Systems and methods for synthesizing data to train statistical models for different imaging modalities, including polarized images |
WO2021243088A1 (en) | 2020-05-27 | 2021-12-02 | Boston Polarimetrics, Inc. | Multi-aperture polarization optical systems using beam splitters |
US11290658B1 (en) | 2021-04-15 | 2022-03-29 | Boston Polarimetrics, Inc. | Systems and methods for camera exposure control |
US11954886B2 (en) | 2021-04-15 | 2024-04-09 | Intrinsic Innovation Llc | Systems and methods for six-degree of freedom pose estimation of deformable objects |
US11689813B2 (en) | 2021-07-01 | 2023-06-27 | Intrinsic Innovation Llc | Systems and methods for high dynamic range imaging using crossed polarizers |
JP7315988B1 (en) | 2022-01-13 | 2023-07-27 | 誠一 杉田 | Moving body travel control system |
Citations (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4307940A (en) * | 1979-05-28 | 1981-12-29 | Oce-Helioprint As | Lens turret |
US5818637A (en) * | 1996-02-26 | 1998-10-06 | Hoover; Rex A. | Computerized video microscopy system |
US6072620A (en) * | 1995-11-01 | 2000-06-06 | Matsushita Electric Industrial Co., Ltd. | Output efficiency control device, projection-type display apparatus, infrared sensor, and non-contact thermometer |
US20020122124A1 (en) * | 2000-10-25 | 2002-09-05 | Yasuo Suda | Image sensing apparatus and its control method, control program, and storage medium |
US20030048378A1 (en) * | 2001-09-11 | 2003-03-13 | Samsung Electro-Mechanics Co., Ltd. | Imaging device module package |
US20030086013A1 (en) * | 2001-11-02 | 2003-05-08 | Michiharu Aratani | Compound eye image-taking system and apparatus with the same |
US6804460B1 (en) * | 2003-09-30 | 2004-10-12 | Arc Design, Inc. | Lens turret with back focal length adjustment |
US6833873B1 (en) * | 1999-06-30 | 2004-12-21 | Canon Kabushiki Kaisha | Image pickup apparatus |
US20060023444A1 (en) * | 2004-07-30 | 2006-02-02 | Fiskars Brands, Inc. | Lighting head mechanism and filter |
US20060054782A1 (en) * | 2004-08-25 | 2006-03-16 | Olsen Richard I | Apparatus for multiple camera devices and method of operating same |
US7411733B2 (en) * | 2005-10-17 | 2008-08-12 | Funai Electric Co., Ltd. | Compound-eye imaging device |
US7453056B2 (en) * | 2006-06-08 | 2008-11-18 | Funai Electric Co., Ltd. | Compound-eye imaging device |
US7525081B2 (en) * | 2005-12-27 | 2009-04-28 | Funai Electric Co., Ltd. | Compound-eye imaging device having a light shielding block with a stack of multiple flat unit plates |
US7865076B2 (en) * | 2006-04-21 | 2011-01-04 | Panasonic Corporation | Compound eye-camera module |
Family Cites Families (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3547869B2 (en) | 1995-11-07 | 2004-07-28 | コニカミノルタホールディングス株式会社 | Imaging device |
JP3397754B2 (en) | 1999-06-30 | 2003-04-21 | キヤノン株式会社 | Imaging device |
JP2002171430A (en) | 2000-11-30 | 2002-06-14 | Canon Inc | Compound eye imaging system, imaging device and electronic apparatus |
JP2005109092A (en) | 2003-09-30 | 2005-04-21 | Konica Minolta Opto Inc | Solid state imaging device and imaging apparatus having same |
JP2005134835A (en) * | 2003-10-31 | 2005-05-26 | Olympus Corp | Imaging apparatus and imaging device equipped with imaging apparatus |
JP2006080597A (en) | 2004-09-07 | 2006-03-23 | Canon Inc | Image pickup module and method of manufacturing the same |
JP2006246193A (en) | 2005-03-04 | 2006-09-14 | Matsushita Electric Ind Co Ltd | Image pickup device |
JP2009164654A (en) | 2006-04-24 | 2009-07-23 | Panasonic Corp | Compound eye camera module |
-
2007
- 2007-01-12 US US12/159,288 patent/US8194169B2/en active Active
- 2007-01-12 CN CN2007800025971A patent/CN101371568B/en active Active
- 2007-01-12 JP JP2007554873A patent/JP4147273B2/en not_active Expired - Fee Related
- 2007-01-12 WO PCT/JP2007/050351 patent/WO2007083579A1/en active Application Filing
Patent Citations (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4307940A (en) * | 1979-05-28 | 1981-12-29 | Oce-Helioprint As | Lens turret |
US6072620A (en) * | 1995-11-01 | 2000-06-06 | Matsushita Electric Industrial Co., Ltd. | Output efficiency control device, projection-type display apparatus, infrared sensor, and non-contact thermometer |
US5818637A (en) * | 1996-02-26 | 1998-10-06 | Hoover; Rex A. | Computerized video microscopy system |
US6833873B1 (en) * | 1999-06-30 | 2004-12-21 | Canon Kabushiki Kaisha | Image pickup apparatus |
US20020122124A1 (en) * | 2000-10-25 | 2002-09-05 | Yasuo Suda | Image sensing apparatus and its control method, control program, and storage medium |
US20030048378A1 (en) * | 2001-09-11 | 2003-03-13 | Samsung Electro-Mechanics Co., Ltd. | Imaging device module package |
US20030086013A1 (en) * | 2001-11-02 | 2003-05-08 | Michiharu Aratani | Compound eye image-taking system and apparatus with the same |
US6804460B1 (en) * | 2003-09-30 | 2004-10-12 | Arc Design, Inc. | Lens turret with back focal length adjustment |
US20060023444A1 (en) * | 2004-07-30 | 2006-02-02 | Fiskars Brands, Inc. | Lighting head mechanism and filter |
US20060054782A1 (en) * | 2004-08-25 | 2006-03-16 | Olsen Richard I | Apparatus for multiple camera devices and method of operating same |
US7411733B2 (en) * | 2005-10-17 | 2008-08-12 | Funai Electric Co., Ltd. | Compound-eye imaging device |
US7525081B2 (en) * | 2005-12-27 | 2009-04-28 | Funai Electric Co., Ltd. | Compound-eye imaging device having a light shielding block with a stack of multiple flat unit plates |
US7865076B2 (en) * | 2006-04-21 | 2011-01-04 | Panasonic Corporation | Compound eye-camera module |
US7453056B2 (en) * | 2006-06-08 | 2008-11-18 | Funai Electric Co., Ltd. | Compound-eye imaging device |
Cited By (69)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20130033578A1 (en) * | 2010-02-19 | 2013-02-07 | Andrew Augustine Wajs | Processing multi-aperture image data |
US9495751B2 (en) * | 2010-02-19 | 2016-11-15 | Dual Aperture International Co. Ltd. | Processing multi-aperture image data |
US20140118834A1 (en) * | 2011-06-01 | 2014-05-01 | Naoyuki Inoue | Compound-Eye Unit |
US20150229909A1 (en) * | 2012-10-24 | 2015-08-13 | Olympus Corporation | Image pickup element and image pickup apparatus |
US9554116B2 (en) * | 2012-10-24 | 2017-01-24 | Olympus Corporation | Image pickup element and image pickup apparatus |
US9671595B2 (en) | 2013-01-05 | 2017-06-06 | Light Labs Inc. | Methods and apparatus for using multiple optical chains in paralell |
US9568713B2 (en) | 2013-01-05 | 2017-02-14 | Light Labs Inc. | Methods and apparatus for using multiple optical chains in parallel to support separate color-capture |
US9690079B2 (en) | 2013-01-05 | 2017-06-27 | Light Labs Inc. | Camera methods and apparatus using optical chain modules which alter the direction of received light |
US9270876B2 (en) | 2013-01-05 | 2016-02-23 | The Lightco Inc. | Methods and apparatus for using multiple optical chains in parallel with multiple different exposure times |
US9282228B2 (en) | 2013-01-05 | 2016-03-08 | The Lightco Inc. | Camera methods and apparatus using optical chain modules which alter the direction of received light |
US9547160B2 (en) | 2013-01-05 | 2017-01-17 | Light Labs Inc. | Methods and apparatus for capturing and/or processing images |
US9749511B2 (en) | 2013-10-18 | 2017-08-29 | Light Labs Inc. | Methods and apparatus relating to a camera including multiple optical chains |
US9197816B2 (en) | 2013-10-18 | 2015-11-24 | The Lightco Inc. | Zoom related methods and apparatus |
US9851527B2 (en) | 2013-10-18 | 2017-12-26 | Light Labs Inc. | Methods and apparatus for capturing and/or combining images |
US10120159B2 (en) | 2013-10-18 | 2018-11-06 | Light Labs Inc. | Methods and apparatus for supporting zoom operations |
US9423588B2 (en) | 2013-10-18 | 2016-08-23 | The Lightco Inc. | Methods and apparatus for supporting zoom operations |
US9544501B2 (en) | 2013-10-18 | 2017-01-10 | Light Labs Inc. | Methods and apparatus for implementing and/or using a camera device |
US9374514B2 (en) | 2013-10-18 | 2016-06-21 | The Lightco Inc. | Methods and apparatus relating to a camera including multiple optical chains |
US9549127B2 (en) | 2013-10-18 | 2017-01-17 | Light Labs Inc. | Image capture control methods and apparatus |
US9325906B2 (en) | 2013-10-18 | 2016-04-26 | The Lightco Inc. | Methods and apparatus relating to a thin camera device |
US9451171B2 (en) | 2013-10-18 | 2016-09-20 | The Lightco Inc. | Zoom related methods and apparatus |
US9551854B2 (en) | 2013-10-18 | 2017-01-24 | Light Labs Inc. | Methods and apparatus for controlling sensors to capture images in a synchronized manner |
US10509208B2 (en) * | 2013-10-18 | 2019-12-17 | Light Labs Inc. | Methods and apparatus for implementing and/or using a camera device |
US9557519B2 (en) | 2013-10-18 | 2017-01-31 | Light Labs Inc. | Methods and apparatus for implementing a camera device supporting a number of different focal lengths |
US9557520B2 (en) | 2013-10-18 | 2017-01-31 | Light Labs Inc. | Synchronized image capture methods and apparatus |
US9563033B2 (en) | 2013-10-18 | 2017-02-07 | Light Labs Inc. | Methods and apparatus for capturing images and/or for using captured images |
WO2015058153A1 (en) * | 2013-10-18 | 2015-04-23 | The Lightco Inc. | Methods and apparatus for implementing and/or using a camera device |
US9578252B2 (en) | 2013-10-18 | 2017-02-21 | Light Labs Inc. | Methods and apparatus for capturing images using optical chains and/or for using captured images |
US9736365B2 (en) | 2013-10-26 | 2017-08-15 | Light Labs Inc. | Zoom related methods and apparatus |
US9467627B2 (en) | 2013-10-26 | 2016-10-11 | The Lightco Inc. | Methods and apparatus for use with multiple optical chains |
US9426365B2 (en) | 2013-11-01 | 2016-08-23 | The Lightco Inc. | Image stabilization related methods and apparatus |
US9686471B2 (en) | 2013-11-01 | 2017-06-20 | Light Labs Inc. | Methods and apparatus relating to image stabilization |
US9554031B2 (en) | 2013-12-31 | 2017-01-24 | Light Labs Inc. | Camera focusing related methods and apparatus |
US20150215505A1 (en) * | 2014-01-27 | 2015-07-30 | Himax Technologies Limited | Image-capturing assembly and array lens units thereof |
US9955053B2 (en) * | 2014-01-27 | 2018-04-24 | Himax Technologies Limited | Image-capturing assembly and array lens units thereof |
US9462170B2 (en) | 2014-02-21 | 2016-10-04 | The Lightco Inc. | Lighting methods and apparatus |
US9979878B2 (en) | 2014-02-21 | 2018-05-22 | Light Labs Inc. | Intuitive camera user interface methods and apparatus |
US10582186B1 (en) * | 2014-06-11 | 2020-03-03 | Amazon Technologies, Inc. | Approaches for identifying misaligned cameras |
US10191356B2 (en) | 2014-07-04 | 2019-01-29 | Light Labs Inc. | Methods and apparatus relating to detection and/or indicating a dirty lens condition |
US10110794B2 (en) | 2014-07-09 | 2018-10-23 | Light Labs Inc. | Camera device including multiple optical chains and related methods |
US9912865B2 (en) | 2014-10-17 | 2018-03-06 | Light Labs Inc. | Methods and apparatus for supporting burst modes of camera operation |
US9912864B2 (en) | 2014-10-17 | 2018-03-06 | Light Labs Inc. | Methods and apparatus for using a camera device to support multiple modes of operation |
US9998638B2 (en) | 2014-12-17 | 2018-06-12 | Light Labs Inc. | Methods and apparatus for implementing and using camera devices |
US9544503B2 (en) | 2014-12-30 | 2017-01-10 | Light Labs Inc. | Exposure control methods and apparatus |
US9721357B2 (en) | 2015-02-26 | 2017-08-01 | Dual Aperture International Co. Ltd. | Multi-aperture depth map using blur kernels and edges |
US9721344B2 (en) | 2015-02-26 | 2017-08-01 | Dual Aperture International Co., Ltd. | Multi-aperture depth map using partial blurring |
US20180095275A1 (en) * | 2015-03-30 | 2018-04-05 | Nikon Corporation | Image-capturing device, multi-lens camera, and method for manufacturing image-capturing device |
US9824427B2 (en) | 2015-04-15 | 2017-11-21 | Light Labs Inc. | Methods and apparatus for generating a sharp image |
US9967535B2 (en) | 2015-04-17 | 2018-05-08 | Light Labs Inc. | Methods and apparatus for reducing noise in images |
US10075651B2 (en) | 2015-04-17 | 2018-09-11 | Light Labs Inc. | Methods and apparatus for capturing images using multiple camera modules in an efficient manner |
US10091447B2 (en) | 2015-04-17 | 2018-10-02 | Light Labs Inc. | Methods and apparatus for synchronizing readout of multiple image sensors |
US9857584B2 (en) | 2015-04-17 | 2018-01-02 | Light Labs Inc. | Camera device methods, apparatus and components |
US9930233B2 (en) | 2015-04-22 | 2018-03-27 | Light Labs Inc. | Filter mounting methods and apparatus and related camera apparatus |
US10129483B2 (en) | 2015-06-23 | 2018-11-13 | Light Labs Inc. | Methods and apparatus for implementing zoom using one or more moveable camera modules |
US10491806B2 (en) | 2015-08-03 | 2019-11-26 | Light Labs Inc. | Camera device control related methods and apparatus |
US10365480B2 (en) | 2015-08-27 | 2019-07-30 | Light Labs Inc. | Methods and apparatus for implementing and/or using camera devices with one or more light redirection devices |
US9749549B2 (en) | 2015-10-06 | 2017-08-29 | Light Labs Inc. | Methods and apparatus for facilitating selective blurring of one or more image portions |
US10003738B2 (en) | 2015-12-18 | 2018-06-19 | Light Labs Inc. | Methods and apparatus for detecting and/or indicating a blocked sensor or camera module |
US10225445B2 (en) | 2015-12-18 | 2019-03-05 | Light Labs Inc. | Methods and apparatus for providing a camera lens or viewing point indicator |
US10110788B2 (en) * | 2016-02-03 | 2018-10-23 | Tdk Taiwan Corp. | Camera device |
US10306218B2 (en) | 2016-03-22 | 2019-05-28 | Light Labs Inc. | Camera calibration apparatus and methods |
US9948832B2 (en) | 2016-06-22 | 2018-04-17 | Light Labs Inc. | Methods and apparatus for synchronized image capture in a device including optical chains with different orientations |
US20180035046A1 (en) * | 2016-07-29 | 2018-02-01 | Xin Yuan | Block-based lensless compressive image acquisition |
US10462377B2 (en) | 2016-07-29 | 2019-10-29 | Nokia Of America Corporation | Single-aperture multi-sensor lensless compressive image acquisition |
CN109644232A (en) * | 2016-07-29 | 2019-04-16 | 诺基亚美国公司 | Sectional type is obtained without lens compression image |
US10502548B2 (en) * | 2017-05-09 | 2019-12-10 | Google Llc | Sensor combination |
US20180328717A1 (en) * | 2017-05-09 | 2018-11-15 | Google Inc. | Sensor combination |
US11126066B2 (en) * | 2019-09-04 | 2021-09-21 | Chicony Electronics Co., Ltd. | Digital imaging device |
CN114236853A (en) * | 2022-01-26 | 2022-03-25 | 中煤科工开采研究院有限公司 | Split type mining AR glasses fixing device and using method thereof |
Also Published As
Publication number | Publication date |
---|---|
JP4147273B2 (en) | 2008-09-10 |
CN101371568B (en) | 2010-06-30 |
WO2007083579A1 (en) | 2007-07-26 |
US8194169B2 (en) | 2012-06-05 |
JPWO2007083579A1 (en) | 2009-06-11 |
CN101371568A (en) | 2009-02-18 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8194169B2 (en) | Compound eye camera module and method of producing the same | |
JP4374078B2 (en) | Compound eye camera module | |
US7865076B2 (en) | Compound eye-camera module | |
KR101823195B1 (en) | Lens assembly and camera module including the same | |
US20160252734A1 (en) | Lens array modules and wafer-level techniques for fabricating the same | |
US20070097249A1 (en) | Camera module | |
US20160006913A1 (en) | Optical imaging apparatus, in particular for computational imaging, having further functionality | |
JP2011176715A (en) | Back-illuminated image sensor and imaging apparatus | |
JP2009164654A (en) | Compound eye camera module | |
US20140240559A1 (en) | Solid state imaging device, portable information terminal, and solid state imaging system | |
TW201605236A (en) | Compound-eye imaging device | |
TWI584643B (en) | Camera devices and systems based on a single imaging sensor and methods for manufacturing the same | |
JP4248586B2 (en) | IMAGING DEVICE, MANUFACTURING METHOD THEREOF, AND PORTABLE INFORMATION TERMINAL AND IMAGING DEVICE WITH THE IMAGING DEVICE | |
US9077977B2 (en) | Image sensor and imaging apparatus with sensitivity versus incident angle ranges for 2D and 3D imaging | |
US20210368080A1 (en) | Multi-cameras with shared camera apertures | |
JP2009201008A (en) | Compound-eye imaging apparatus | |
CN107895135B (en) | Iris scanning camera module and portable electronic device comprising same | |
US20190068930A1 (en) | Imaging device and imaging system | |
KR101912285B1 (en) | Iris scan camera module and mobile device including the same | |
JP2018041810A (en) | Image pick-up device and imaging apparatus | |
JP2005031460A (en) | Compound eye optical system | |
CN109756656B (en) | Handheld electronic equipment and camera device thereof | |
JP2009180976A (en) | Compound-eye camera module | |
US11829053B2 (en) | Optical unit, optical apparatus, imaging apparatus, and imaging system | |
JP4020259B2 (en) | Three-plate solid-state imaging device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: MATSUSHITA ELECTRIC INDUSTRIAL CO., LTD., JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:TAMAKI, SATOSHI;IMADA, KATSUMI;SUENAGA, TATSUTOSHI;REEL/FRAME:021330/0769 Effective date: 20080530 |
|
AS | Assignment |
Owner name: PANASONIC CORPORATION, JAPAN Free format text: CHANGE OF NAME;ASSIGNOR:MATSUSHITA ELECTRIC INDUSTRIAL CO., LTD.;REEL/FRAME:021832/0215 Effective date: 20081001 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
FEPP | Fee payment procedure |
Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
AS | Assignment |
Owner name: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA, CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:PANASONIC CORPORATION;REEL/FRAME:033033/0163 Effective date: 20140527 Owner name: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AME Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:PANASONIC CORPORATION;REEL/FRAME:033033/0163 Effective date: 20140527 |
|
FPAY | Fee payment |
Year of fee payment: 4 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 8 |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 12TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1553); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 12 |