US20070052947A1 - Three-dimensional imaging processing module incorporating stacked layers containing microelectronic circuits - Google Patents
Three-dimensional imaging processing module incorporating stacked layers containing microelectronic circuits Download PDFInfo
- Publication number
- US20070052947A1 US20070052947A1 US10/806,037 US80603704A US2007052947A1 US 20070052947 A1 US20070052947 A1 US 20070052947A1 US 80603704 A US80603704 A US 80603704A US 2007052947 A1 US2007052947 A1 US 2007052947A1
- Authority
- US
- United States
- Prior art keywords
- photon detector
- detector array
- detector module
- integrated circuit
- array
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000012545 processing Methods 0.000 title claims abstract description 27
- 238000003384 imaging method Methods 0.000 title abstract description 11
- 238000004377 microelectronic Methods 0.000 title abstract 2
- 229910000530 Gallium indium arsenide Inorganic materials 0.000 claims description 3
- 239000000853 adhesive Substances 0.000 claims description 2
- 230000001070 adhesive effect Effects 0.000 claims description 2
- 238000001514 detection method Methods 0.000 claims description 2
- 230000004044 response Effects 0.000 claims description 2
- 238000006243 chemical reaction Methods 0.000 claims 1
- 238000007493 shaping process Methods 0.000 abstract description 7
- 238000002592 echocardiography Methods 0.000 description 7
- 238000010586 diagram Methods 0.000 description 4
- 230000035945 sensitivity Effects 0.000 description 4
- 238000000034 method Methods 0.000 description 3
- 239000000463 material Substances 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000006467 substitution reaction Methods 0.000 description 2
- XUIMIQQOPSSXEZ-UHFFFAOYSA-N Silicon Chemical compound [Si] XUIMIQQOPSSXEZ-UHFFFAOYSA-N 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 230000003321 amplification Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 230000001934 delay Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 229910052738 indium Inorganic materials 0.000 description 1
- APFVFJFRJDLVQX-UHFFFAOYSA-N indium atom Chemical compound [In] APFVFJFRJDLVQX-UHFFFAOYSA-N 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 238000004806 packaging method and process Methods 0.000 description 1
- 230000003071 parasitic effect Effects 0.000 description 1
- 238000012805 post-processing Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000002310 reflectometry Methods 0.000 description 1
- 238000012827 research and development Methods 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 229910052710 silicon Inorganic materials 0.000 description 1
- 239000010703 silicon Substances 0.000 description 1
- 230000003595 spectral effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
- G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
- G01S7/483—Details of pulse systems
- G01S7/486—Receivers
- G01S7/487—Extracting wanted echo signals, e.g. pulse detection
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
- G01S17/88—Lidar systems specially adapted for specific applications
- G01S17/89—Lidar systems specially adapted for specific applications for mapping or imaging
- G01S17/894—3D imaging with simultaneous measurement of time-of-flight at a 2D array of receiver pixels, e.g. time-of-flight cameras or flash lidar
Definitions
- the instant invention relates generally to the field of LADAR (laser-radar) imaging technology. Specifically, the instant invention relates to a device which allows three-dimensional laser imaging of partially obscured or camouflaged targets with very high range resolution and sensitivity.
- LADAR laser-radar
- Current LADAR imaging typically comprises scanning a target with a laser and detecting the reflected photons, also referred to as a laser echo, with a photon detector such as a focal plane array.
- the time required for return of the laser echo from the target to the photon detector is calculated to determine the target range.
- the detector output signal is electronically processed to allow the definition of surface features on a three-dimensional object.
- imaging capability is valuable in situations where, for instance, a vehicle is camouflaged or obscured by foliage or in an urban environment when an imaging sensor can acquire only a limited or angular view of a target.
- existing LADAR imaging systems include a laser source, appropriate optics in conjunction with a detector array, processing circuitry suitable for processing the detector array output into a usable form and post-processing circuitry and software capable of taking the processed detector array output and converting it into a usable format such as an image on an electronic display.
- one or more laser pulses are directed toward a desired target.
- the laser echoes from the target surface are received and imaged upon the detectors in a detector array using appropriate optics. Because the time of flight of the returning laser echoes will vary based on the distance between the detector array plane and the surface features from which the echoes are received, a three-dimensional image can be calculated based upon the relative echo delays.
- conventional passive visible sensors such as CCD video sensors
- CCD video sensors provide easily interpreted information to an observer.
- these types of sensors are undesirable where accurate scene information in a complex video environment (i.e., camouflaged or partially obscured targets) is an important factor in the observer's decision-making.
- the instant invention addresses the aforementioned problems in prior art devices by providing a reliable, high speed, high circuit density LADAR detector system and device capable of providing range resolution and sensitivity at a centimeter level.
- One aspect of the present invention includes a photon source, such as a laser, beam shaping optics, a two-dimensional photo-detector array comprised of multiple photo-detector pixels, an optical lens for collecting reflected photons (laser echo) upon the detector array, a processing module comprised of stacked layers of readout electronics integrated circuit chips (ROIC), wherein each ROIC-containing layer has one or more channels, each channel containing circuitry for processing the detector array signals.
- ROIC readout electronics integrated circuit chips
- external support circuitry is provided for the generating of a three-dimensional image on an electronic display from the output of the processing module.
- the enhanced imaging capability provided by the claimed invention is achieved, in part, by the use of stacked layers containing the ROIC circuitry, which increases detector output processing circuit density while minimizing circuit lead length and associated capacitance.
- the result of the stacked layers of ROIC circuitry is the ability to integrate a large (e.g., 128 ⁇ 128 or larger) detector array with associated dedicated detector readout circuitry (amplifier, threshold detector, sampling circuitry, digital to analog converter (DAC) and first in, first out, (FIFO) register range bins all within a very small module.
- the resultant module permits the circuit speeds and densities required to resolve small, three-dimensional target features based on one or more laser echoes sensed by each detector pixel on the detector array while simultaneously providing dedicated processing channels for each detector on the detector array.
- the multilayer ROIC processing module is preferably comprised of a stack of layers containing thinned, integrated circuit chips, each layer including one or more receiver channels.
- Each channel comprises circuitry which detects the laser echo time from T 0 (the start of a laser pulse or a user-assigned T 0 point) to the time of laser echo return, based on the receipt of photons that are reflected from the imaged target surfaces.
- Laser echo time of flight information is pre-processed, and then converted to a digital bit stored in a FIFO register comprising a set of range bins on the ROIC.
- a high bit in a range bin may, for instance, be designated as indicating the time of arrival of a laser echo, based on its location within the set of range bins.
- the range bin data is multiplexed off of the ROIC module to external circuitry which, in turn, interprets the data and converts it to a usable form, such as a 3-D point cloud for representation as an electronic image on a display.
- FIG. 1 is a block diagram of the present invention.
- FIG. 2 is a perspective view of the individual layers and stacked configuration of the present invention
- FIG. 3 is a cross section the processing module of the present invention showing an exemplar T-connect.
- FIG. 4 is a circuit block diagram of the integrated circuit of the present invention.
- FIG. 1 shows a block diagram of the present invention.
- a photon source such as a laser 1 , generates a beam 5 , which is directed toward a scene or target 7 , through beam-shaping optics 10 .
- laser 1 is a 1064 nm, mechanically aligned, 300 micro-Joule, seed YAG laser capable of producing a pulse width of 500 picoseconds.
- a beam amplifier is provided (not shown), such as a master oscillator power amplifier wherein a seed beam is fed into the amplifier.
- the seed beam passes through a Faraday rotator and enters a four-pass, thermally controlled amplifier which includes two pumped YAG diodes.
- beam-shaping optics 10 is a beam-shaping holographic lens suitable for projecting a rectangular beam area on a target. It has been determined that a rectangular beam area optimizes the ability of a detector array to receive and process reflected photons in its field of view.
- Beam 5 is preferably amplified to generate a detectable photon reflection off of a target having 10% reflectivity at 100 meters.
- Collection optics 20 are provided, preferably a 75-mm, F1.4 lens with an appropriate spectral filter for optimization of the laser pulse wavelength. Collection optics 20 are oriented so as to receive photons that are reflected from the imaged target 7 , (i.e., the collective obscuration, subject and ground) and focus them upon the invention's detector array as is discussed below.
- beam 5 may optionally be pre-aligned with the invention's detector array by passing beam 5 through Risley prisms (not shown) to steer and rotate beam 5 for “bore sighting” to the invention's detector array. It has been determined that placing beam-shaping optics 10 in close proximity and aligned with collection optics 20 minimizes parallax error with respect to the two optical subassemblies.
- a detector assembly 30 comprising a sensor array or detector array 40 and a multilayer processing readout electronics module 50 .
- Detector array 40 is generally a focal plane array of individual photo-detectors suitable for detecting reflected photons from a target and generating a signal in response thereto.
- an InGaAs detector array is used.
- Irvine Sensors Corp. the assignee herein, has demonstrated a 128 ⁇ 128 InGaAs detector array with 40-micron active detectors on 50-micron centers in the disclosed invention, wherein a 128 ⁇ 8 set of detectors on the array were accessed.
- processing module 50 includes a stack of two or more layers 60 , each layer containing one or more readout electronics circuits 70 , preferably in the form of integrated circuit chips, for the processing of signals received from detector array 40 .
- Each readout electronic circuit 70 includes one or more channels 75 comprised of electronic circuitry for the processing of electronic signals from detector array 40 .
- Individual layers 60 are formed so that appropriate input, output, power and ground paths of read out electronic circuits 70 are routed using metalized traces 73 to one or more edges of each layer 60 to form one or more access leads 80 .
- Layers 60 are bonded together using an appropriate adhesive 62 as is known in the art and processed (e.g., ground or lapped) so as to expose access leads 80 .
- Layers 60 may optionally be thinned using techniques that are well known in the field of semiconductor processing and packaging. Thinned active layers may be embedded silicon cap chips for ease of handling.
- Suitable conductive interconnect pads 90 are formed on one or more lateral surfaces of processing module 50 to form one or more “T-connects” 85 to allow the electrical interconnection of access leads 80 to detector array 40 as well as to external image processing electronics.
- FIG. 3 illustrates a detailed cross section of an exemplar T-connect 85 between a bump bond on a detector array 40 and a metalized access lead 80 .
- the T-connect structures conveniently allow the interconnection of the high-density stack of layers to detector array 40 and external circuitry contained outside of the processing module.
- the preferred embodiment provides interconnect pads 90 formed on one or more processor module lateral surfaces so as to allow the bump bonding of detector array 40 , such as by indium bump bonding. After bump bonding of detector array 40 , the volume occupied by perpendicularly disposed detector array 40 upon processor module 50 is minimized yet the detector-to-readout circuitry lead length is optimized to increase speed while reducing parasitic capacitance. Such an interconnection orientation takes full advantage of the high circuit density of the processing module while providing very short circuit paths necessary for high-speed laser range resolution.
- external electronic circuitry 100 for receiving and processing the output of processor module 50 may be connected through the use of wirebonding to interconnect pads 90 formed on the accessible surfaces of processing module 50 .
- beam 5 expands outward from beam-shaping optics 10 and is imaged upon the desired target.
- Photons from the pulsed beam which are not absorbed by the target or specularly reflected, return to collection optics 20 from the various target surfaces. Because the distance between the target surfaces and collection optics varies, so will the time the reflected photons are received by the detector assembly. Note that each individual detector in the detector array may witness multiple signal returns from photon reflections off of scene surfaces at different distances from the detector array.
- Beam 5 is swept across the target area in a scan to attain 256 vertical samples.
- the laser is pulsed at 94 Hz to attain 256 horizontal samples while the channel data records in the 1024 FIFO range bins.
- the 256 ⁇ 256 ⁇ 1024 data is recorded as a frame and multiple frames registered and coalesced into a 3-D point cloud for display as a 3-D image for classification of target objects.
- each channel 75 can function as a dedicated detector signal input circuit and includes circuitry that receives a T 0 trigger signal (initial laser pulse trigger) to provide the FIFO register with a reference for the time of the laser echo's arrival at detector array 40 .
- the preferred laser pulse is short relative to the capture interval (e.g. ⁇ 500 picoseconds vs. 500 nanoseconds) and multiple returns can be detected by a single detector pixel.
- Each channel 75 is preferably comprised of an analog section that operates with a very high bandwidth. Each channel further comprises a digital section operating at up to 2 GHz during the time the FIFO register is filling with data. A digital to analog converter is included in channel 75 as well as circuitry to allow a user to adjust a comparator's threshold. Each ROIC can contain multiple channels (e.g., 128 channels) that may be multiplexed to a single output for image processing by external circuitry 100 .
- Received laser echoes are integrated and filtered by the channel during a capture interval.
- the integrated signals are then amplified and differentiated. This converts the signals back into pulses with amplified signal strength great enough to allow detection by the comparator.
- the comparator detects whether the pulses are above or below a programmable predetermined threshold. In a preferred embodiment, the comparator's output is sampled at a 2 GHz rate, resulting in a one bit, analog to digital converted signal.
- each channel 75 includes a 1024 deep, FIFO register which stores the history of the comparator's output from T 0 to T 0 plus approximately 500 nanoseconds.
- a high bit in the FIFO register may be defined as representing the arrival time of a laser echo with respect to the T 0 signal, as determined by the bit's location in the register.
- each stage of the register bin represents 500 picoseconds of time history, which in turn, equates to 7.5 cm of range history.
- the timing of the T 0 trigger signal can be varied to allow longer return times for laser echoes returning from more distant targets.
- the ROIC begins to read (MUX) the data out to external circuitry 100 using conventional frame and line signals at a 20 MHz rate.
- the MUX data may be processed using appropriate external circuitry so as to create a 3-D point cloud defined by the target and further processed to create a 3-D electronic image.
Abstract
Description
- This application is related to U.S. Provisional patent application Ser. No. 60,462,677, filed on Mar. 28, 2003, which is incorporated herein by reference and to which priority is claimed pursuant to 35 USC 119.
- N/A
- 1. Field of the Invention
- The instant invention relates generally to the field of LADAR (laser-radar) imaging technology. Specifically, the instant invention relates to a device which allows three-dimensional laser imaging of partially obscured or camouflaged targets with very high range resolution and sensitivity.
- Current LADAR imaging typically comprises scanning a target with a laser and detecting the reflected photons, also referred to as a laser echo, with a photon detector such as a focal plane array. The time required for return of the laser echo from the target to the photon detector is calculated to determine the target range. The detector output signal is electronically processed to allow the definition of surface features on a three-dimensional object. Such imaging capability is valuable in situations where, for instance, a vehicle is camouflaged or obscured by foliage or in an urban environment when an imaging sensor can acquire only a limited or angular view of a target.
- 2. Description of the Related Art
- In general, existing LADAR imaging systems include a laser source, appropriate optics in conjunction with a detector array, processing circuitry suitable for processing the detector array output into a usable form and post-processing circuitry and software capable of taking the processed detector array output and converting it into a usable format such as an image on an electronic display.
- In the operation of such systems, one or more laser pulses are directed toward a desired target. The laser echoes from the target surface are received and imaged upon the detectors in a detector array using appropriate optics. Because the time of flight of the returning laser echoes will vary based on the distance between the detector array plane and the surface features from which the echoes are received, a three-dimensional image can be calculated based upon the relative echo delays.
- Note that a laser echo delay of one nanosecond suggests a target surface variation of about 15 centimeters and that a laser echo delay of only 500 picoseconds translates into a target surface variation of about eight centimeters. As is evident from these short time periods, very high detector signal processing and timing circuit speeds are desirable in order to resolve target surface feature variations at a centimeter-level depth resolution. Unfortunately, existing LADAR imaging systems lack the necessary circuit speed and capacity to achieve very high (i.e., centimeter) range resolution and sensitivity.
- Alternatively, conventional passive visible sensors, such as CCD video sensors, provide easily interpreted information to an observer. Nonetheless, these types of sensors are undesirable where accurate scene information in a complex video environment (i.e., camouflaged or partially obscured targets) is an important factor in the observer's decision-making.
- Accordingly, a need exists for a LADAR imaging system that has the circuitry speed and density required to achieve range resolution and sensitivity necessary to define small target surface variations based on picosecond time of flight differences in laser echoes.
- The instant invention addresses the aforementioned problems in prior art devices by providing a reliable, high speed, high circuit density LADAR detector system and device capable of providing range resolution and sensitivity at a centimeter level.
- One aspect of the present invention includes a photon source, such as a laser, beam shaping optics, a two-dimensional photo-detector array comprised of multiple photo-detector pixels, an optical lens for collecting reflected photons (laser echo) upon the detector array, a processing module comprised of stacked layers of readout electronics integrated circuit chips (ROIC), wherein each ROIC-containing layer has one or more channels, each channel containing circuitry for processing the detector array signals. In another aspect of the invention, external support circuitry is provided for the generating of a three-dimensional image on an electronic display from the output of the processing module.
- The enhanced imaging capability provided by the claimed invention is achieved, in part, by the use of stacked layers containing the ROIC circuitry, which increases detector output processing circuit density while minimizing circuit lead length and associated capacitance. The result of the stacked layers of ROIC circuitry is the ability to integrate a large (e.g., 128×128 or larger) detector array with associated dedicated detector readout circuitry (amplifier, threshold detector, sampling circuitry, digital to analog converter (DAC) and first in, first out, (FIFO) register range bins all within a very small module.
- The resultant module permits the circuit speeds and densities required to resolve small, three-dimensional target features based on one or more laser echoes sensed by each detector pixel on the detector array while simultaneously providing dedicated processing channels for each detector on the detector array.
- The multilayer ROIC processing module is preferably comprised of a stack of layers containing thinned, integrated circuit chips, each layer including one or more receiver channels. Each channel comprises circuitry which detects the laser echo time from T0 (the start of a laser pulse or a user-assigned T0 point) to the time of laser echo return, based on the receipt of photons that are reflected from the imaged target surfaces. Laser echo time of flight information is pre-processed, and then converted to a digital bit stored in a FIFO register comprising a set of range bins on the ROIC. A high bit in a range bin may, for instance, be designated as indicating the time of arrival of a laser echo, based on its location within the set of range bins. The range bin data is multiplexed off of the ROIC module to external circuitry which, in turn, interprets the data and converts it to a usable form, such as a 3-D point cloud for representation as an electronic image on a display.
- While the claimed apparatus and method has or will be described for the sake of grammatical fluidity with functional explanations, it is to be expressly understood that the claims, unless expressly formulated under 35 USC 112, are not to be construed as necessarily limited in any way by the construction of “means” or “steps” limitations, but are to be accorded the full scope of the meaning and equivalents of the definition provided by the claims under the judicial doctrine of equivalents, and in the case where the claims are expressly formulated under 35 USC 112 are to be accorded full statutory equivalents under 35 USC 112.
-
FIG. 1 is a block diagram of the present invention. -
FIG. 2 is a perspective view of the individual layers and stacked configuration of the present invention -
FIG. 3 is a cross section the processing module of the present invention showing an exemplar T-connect. -
FIG. 4 is a circuit block diagram of the integrated circuit of the present invention. - The invention and its various embodiments can now be better understood by turning to the following detailed description of the preferred embodiments which are presented as illustrated examples of the invention defined in the claims. It is expressly understood that the invention as defined by the claims may be broader than the illustrated embodiments described below.
- Turning now to the figures wherein like numerals designate like elements among the several views,
FIG. 1 shows a block diagram of the present invention. - A photon source, such as a
laser 1, generates a beam 5, which is directed toward a scene ortarget 7, through beam-shaping optics 10. - In a preferred embodiment,
laser 1 is a 1064 nm, mechanically aligned, 300 micro-Joule, seed YAG laser capable of producing a pulse width of 500 picoseconds. In the preferred embodiment, a beam amplifier is provided (not shown), such as a master oscillator power amplifier wherein a seed beam is fed into the amplifier. In this preferred embodiment, the seed beam passes through a Faraday rotator and enters a four-pass, thermally controlled amplifier which includes two pumped YAG diodes. - In the preferred embodiment, beam-
shaping optics 10 is a beam-shaping holographic lens suitable for projecting a rectangular beam area on a target. It has been determined that a rectangular beam area optimizes the ability of a detector array to receive and process reflected photons in its field of view. - Beam 5 is preferably amplified to generate a detectable photon reflection off of a target having 10% reflectivity at 100 meters.
-
Collection optics 20 are provided, preferably a 75-mm, F1.4 lens with an appropriate spectral filter for optimization of the laser pulse wavelength.Collection optics 20 are oriented so as to receive photons that are reflected from theimaged target 7, (i.e., the collective obscuration, subject and ground) and focus them upon the invention's detector array as is discussed below. - After beam amplification, beam 5 may optionally be pre-aligned with the invention's detector array by passing beam 5 through Risley prisms (not shown) to steer and rotate beam 5 for “bore sighting” to the invention's detector array. It has been determined that placing beam-
shaping optics 10 in close proximity and aligned withcollection optics 20 minimizes parallax error with respect to the two optical subassemblies. - Further included is a
detector assembly 30 comprising a sensor array or detector array 40 and a multilayer processingreadout electronics module 50. - Detector array 40 is generally a focal plane array of individual photo-detectors suitable for detecting reflected photons from a target and generating a signal in response thereto. In the preferred embodiment, an InGaAs detector array is used. Irvine Sensors Corp., the assignee herein, has demonstrated a 128×128 InGaAs detector array with 40-micron active detectors on 50-micron centers in the disclosed invention, wherein a 128×8 set of detectors on the array were accessed.
- Turning now to
FIGS. 2 and 3 ,processing module 50 includes a stack of two ormore layers 60, each layer containing one or morereadout electronics circuits 70, preferably in the form of integrated circuit chips, for the processing of signals received from detector array 40. Each readoutelectronic circuit 70 includes one ormore channels 75 comprised of electronic circuitry for the processing of electronic signals from detector array 40. -
Individual layers 60 are formed so that appropriate input, output, power and ground paths of read outelectronic circuits 70 are routed using metalized traces 73 to one or more edges of eachlayer 60 to form one or more access leads 80. -
Layers 60 are bonded together using an appropriate adhesive 62 as is known in the art and processed (e.g., ground or lapped) so as to expose access leads 80.Layers 60 may optionally be thinned using techniques that are well known in the field of semiconductor processing and packaging. Thinned active layers may be embedded silicon cap chips for ease of handling. - Suitable
conductive interconnect pads 90 are formed on one or more lateral surfaces ofprocessing module 50 to form one or more “T-connects” 85 to allow the electrical interconnection of access leads 80 to detector array 40 as well as to external image processing electronics. -
FIG. 3 illustrates a detailed cross section of an exemplar T-connect 85 between a bump bond on a detector array 40 and a metalizedaccess lead 80. The T-connect structures conveniently allow the interconnection of the high-density stack of layers to detector array 40 and external circuitry contained outside of the processing module. - The preferred embodiment provides
interconnect pads 90 formed on one or more processor module lateral surfaces so as to allow the bump bonding of detector array 40, such as by indium bump bonding. After bump bonding of detector array 40, the volume occupied by perpendicularly disposed detector array 40 uponprocessor module 50 is minimized yet the detector-to-readout circuitry lead length is optimized to increase speed while reducing parasitic capacitance. Such an interconnection orientation takes full advantage of the high circuit density of the processing module while providing very short circuit paths necessary for high-speed laser range resolution. - Referring back to
FIG. 1 , externalelectronic circuitry 100 for receiving and processing the output ofprocessor module 50 may be connected through the use of wirebonding to interconnectpads 90 formed on the accessible surfaces ofprocessing module 50. - In system operation, beam 5 expands outward from beam-shaping
optics 10 and is imaged upon the desired target. Photons from the pulsed beam which are not absorbed by the target or specularly reflected, return tocollection optics 20 from the various target surfaces. Because the distance between the target surfaces and collection optics varies, so will the time the reflected photons are received by the detector assembly. Note that each individual detector in the detector array may witness multiple signal returns from photon reflections off of scene surfaces at different distances from the detector array. - Beam 5 is swept across the target area in a scan to attain 256 vertical samples. The laser is pulsed at 94 Hz to attain 256 horizontal samples while the channel data records in the 1024 FIFO range bins. The 256×256×1024 data is recorded as a frame and multiple frames registered and coalesced into a 3-D point cloud for display as a 3-D image for classification of target objects. The time of flight for the reflected photons emitted from
laser 1 to their return to the surface of detector array 40 will vary depending upon the distance of the target surfaces based upon the speed of light (c=3×108 n/s) and the physical characteristics of the associated light conducting medium. - An exemplar block diagram of a preferred embodiment of a channel on the ROIC chip is shown in
FIG. 4 . As illustrated inFIGS. 1 and 4 , eachchannel 75 can function as a dedicated detector signal input circuit and includes circuitry that receives a T0 trigger signal (initial laser pulse trigger) to provide the FIFO register with a reference for the time of the laser echo's arrival at detector array 40. The preferred laser pulse is short relative to the capture interval (e.g. −500 picoseconds vs. 500 nanoseconds) and multiple returns can be detected by a single detector pixel. - Each
channel 75 is preferably comprised of an analog section that operates with a very high bandwidth. Each channel further comprises a digital section operating at up to 2 GHz during the time the FIFO register is filling with data. A digital to analog converter is included inchannel 75 as well as circuitry to allow a user to adjust a comparator's threshold. Each ROIC can contain multiple channels (e.g., 128 channels) that may be multiplexed to a single output for image processing byexternal circuitry 100. - Received laser echoes are integrated and filtered by the channel during a capture interval. The integrated signals are then amplified and differentiated. This converts the signals back into pulses with amplified signal strength great enough to allow detection by the comparator. The comparator detects whether the pulses are above or below a programmable predetermined threshold. In a preferred embodiment, the comparator's output is sampled at a 2 GHz rate, resulting in a one bit, analog to digital converted signal.
- In a preferred embodiment, each
channel 75 includes a 1024 deep, FIFO register which stores the history of the comparator's output from T0 to T0 plus approximately 500 nanoseconds. A high bit in the FIFO register may be defined as representing the arrival time of a laser echo with respect to the T0 signal, as determined by the bit's location in the register. With the FIFO clocking at 2 GHz, each stage of the register bin represents 500 picoseconds of time history, which in turn, equates to 7.5 cm of range history. The timing of the T0 trigger signal can be varied to allow longer return times for laser echoes returning from more distant targets. After the 1024 stages of FIFO are filled, the ROIC begins to read (MUX) the data out toexternal circuitry 100 using conventional frame and line signals at a 20 MHz rate. The MUX data may be processed using appropriate external circuitry so as to create a 3-D point cloud defined by the target and further processed to create a 3-D electronic image. - Many alterations and modifications may be made by those having ordinary skill in the art without departing from the spirit and scope of the invention. Therefore, it must be understood that the illustrated embodiment has been set forth only for the purposes of example and that it should not be taken as limiting the invention as defined by the following claims. For example, notwithstanding the fact that the elements of a claim are set forth below in a certain combination, it must be expressly understood that the invention includes other combinations of fewer, more or different elements, which are disclosed in above even when not initially claimed in such combinations.
- The words used in this specification to describe the invention and its various embodiments are to be understood not only in the sense of their commonly defined meanings, but to include by special definition in this specification structure, material or acts beyond the scope of the commonly defined meanings. Thus if an element can be understood in the context of this specification as including more than one meaning, then its use in a claim must be understood as being generic to all possible meanings supported by the specification and by the word itself.
- The definitions of the words or elements of the following claims are, therefore, defined in this specification to include not only the combination of elements which are literally set forth, but all equivalent structure, material or acts for performing substantially the same function in substantially the same way to obtain substantially the same result. In this sense it is therefore contemplated that an equivalent substitution of two or more elements may be made for any one of the elements in the claims below or that a single element may be substituted for two or more elements in a claim. Although elements may be described above as acting in certain combinations and even initially claimed as such, it is to be expressly understood that one or more elements from a claimed combination can in some cases be excised from the combination and that the claimed combination may be directed to a subcombination or variation of a subcombination.
- Insubstantial changes from the claimed subject matter as viewed by a person with ordinary skill in the art, now known or later devised, are expressly contemplated as being equivalently within the scope of the claims. Therefore, obvious substitutions now or later known to one with ordinary skill in the art are defined to be within the scope of the defined elements.
- The claims are thus to be understood to include what is specifically illustrated and described above, what is conceptually equivalent, what can be obviously substituted and also what essentially incorporates the essential idea of the invention.
Claims (14)
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US10/806,037 US7180579B1 (en) | 2003-03-28 | 2004-03-22 | Three-dimensional imaging processing module incorporating stacked layers containing microelectronic circuits |
US11/706,724 US7436494B1 (en) | 2003-03-28 | 2007-02-15 | Three-dimensional ladar module with alignment reference insert circuitry |
US12/287,691 US8198576B2 (en) | 2003-03-28 | 2008-10-10 | Three-dimensional LADAR module with alignment reference insert circuitry comprising high density interconnect structure |
US12/607,253 USRE43722E1 (en) | 2003-03-28 | 2009-10-28 | Three-dimensional ladar module with alignment reference insert circuitry |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US46267703P | 2003-03-28 | 2003-03-28 | |
US10/806,037 US7180579B1 (en) | 2003-03-28 | 2004-03-22 | Three-dimensional imaging processing module incorporating stacked layers containing microelectronic circuits |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/706,724 Continuation-In-Part US7436494B1 (en) | 2003-03-28 | 2007-02-15 | Three-dimensional ladar module with alignment reference insert circuitry |
Publications (2)
Publication Number | Publication Date |
---|---|
US7180579B1 US7180579B1 (en) | 2007-02-20 |
US20070052947A1 true US20070052947A1 (en) | 2007-03-08 |
Family
ID=37745001
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/806,037 Expired - Fee Related US7180579B1 (en) | 2003-03-28 | 2004-03-22 | Three-dimensional imaging processing module incorporating stacked layers containing microelectronic circuits |
Country Status (1)
Country | Link |
---|---|
US (1) | US7180579B1 (en) |
Cited By (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20080278715A1 (en) * | 2007-05-11 | 2008-11-13 | Rosemount Aerospace Inc. | Scanning ladar with adjustable operational parameters |
US8208131B2 (en) | 2010-07-01 | 2012-06-26 | Schilling Bradley W | Digital registration of 3D laser radar data based on manually selected fiducials |
US20140211194A1 (en) * | 2013-01-27 | 2014-07-31 | Quanergy Systems, Inc. | Cost-effective lidar sensor for multi-signal detection, weak signal detection and signal disambiguation and method of using same |
US9753351B2 (en) | 2014-06-30 | 2017-09-05 | Quanergy Systems, Inc. | Planar beam forming and steering optical phased array chip and method of using same |
US9869753B2 (en) | 2014-08-15 | 2018-01-16 | Quanergy Systems, Inc. | Three-dimensional-mapping two-dimensional-scanning lidar based on one-dimensional-steering optical phased arrays and method of using same |
US10126412B2 (en) | 2013-08-19 | 2018-11-13 | Quanergy Systems, Inc. | Optical phased array lidar system and method of using same |
US10132928B2 (en) | 2013-05-09 | 2018-11-20 | Quanergy Systems, Inc. | Solid state optical phased array lidar and method of using same |
US10267918B2 (en) | 2017-03-28 | 2019-04-23 | Luminar Technologies, Inc. | Lidar detector having a plurality of time to digital converters integrated onto a detector chip |
US10545240B2 (en) | 2017-03-28 | 2020-01-28 | Luminar Technologies, Inc. | LIDAR transmitter and detector system using pulse encoding to reduce range ambiguity |
US10557940B2 (en) | 2015-11-30 | 2020-02-11 | Luminar Technologies, Inc. | Lidar system |
US10613201B2 (en) | 2014-10-20 | 2020-04-07 | Quanergy Systems, Inc. | Three-dimensional lidar sensor based on two-dimensional scanning of one-dimensional optical emitter and method of using same |
US10641876B2 (en) | 2017-04-06 | 2020-05-05 | Quanergy Systems, Inc. | Apparatus and method for mitigating LiDAR interference through pulse coding and frequency shifting |
Families Citing this family (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8279420B2 (en) * | 2009-08-06 | 2012-10-02 | ISC8 Inc. | Phase sensing and scanning time of flight LADAR using atmospheric absorption bands |
US8125367B2 (en) * | 2009-08-06 | 2012-02-28 | Irvine Sensors Corp. | AM chirp LADAR readout circuit and module |
US20110084212A1 (en) * | 2009-09-22 | 2011-04-14 | Irvine Sensors Corporation | Multi-layer photon counting electronic module |
US20110285981A1 (en) * | 2010-05-18 | 2011-11-24 | Irvine Sensors Corporation | Sensor Element and System Comprising Wide Field-of-View 3-D Imaging LIDAR |
US10451518B2 (en) * | 2016-05-10 | 2019-10-22 | Rd2, Llc | All fiber temperature and air density sensor |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US644968A (en) * | 1899-06-26 | 1900-03-06 | Holman Crawford | Wheel. |
US4659931A (en) * | 1985-05-08 | 1987-04-21 | Grumman Aerospace Corporation | High density multi-layered integrated circuit package |
US5214274A (en) * | 1992-07-24 | 1993-05-25 | President And Fellows Of Harvard College | Image sensor array with threshold voltage detectors and charged storage capacitors |
US5262837A (en) * | 1992-10-21 | 1993-11-16 | Norm Pacific Automation Corp. | Laser range finder |
US5682229A (en) * | 1995-04-14 | 1997-10-28 | Schwartz Electro-Optics, Inc. | Laser range camera |
US5875158A (en) * | 1995-01-25 | 1999-02-23 | Discovision Associates | Servo control system for information storage device |
US5953110A (en) * | 1998-04-23 | 1999-09-14 | H.N. Burns Engineering Corporation | Multichannel laser radar |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3913901B2 (en) | 1998-06-04 | 2007-05-09 | 本田技研工業株式会社 | Camera internal parameter determination device |
-
2004
- 2004-03-22 US US10/806,037 patent/US7180579B1/en not_active Expired - Fee Related
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US644968A (en) * | 1899-06-26 | 1900-03-06 | Holman Crawford | Wheel. |
US4659931A (en) * | 1985-05-08 | 1987-04-21 | Grumman Aerospace Corporation | High density multi-layered integrated circuit package |
US5214274A (en) * | 1992-07-24 | 1993-05-25 | President And Fellows Of Harvard College | Image sensor array with threshold voltage detectors and charged storage capacitors |
US5262837A (en) * | 1992-10-21 | 1993-11-16 | Norm Pacific Automation Corp. | Laser range finder |
US5875158A (en) * | 1995-01-25 | 1999-02-23 | Discovision Associates | Servo control system for information storage device |
US5682229A (en) * | 1995-04-14 | 1997-10-28 | Schwartz Electro-Optics, Inc. | Laser range camera |
US5953110A (en) * | 1998-04-23 | 1999-09-14 | H.N. Burns Engineering Corporation | Multichannel laser radar |
Cited By (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7697125B2 (en) * | 2007-05-11 | 2010-04-13 | Rosemount Aerospace Inc. | Scanning ladar with adjustable operational parameters |
US20080278715A1 (en) * | 2007-05-11 | 2008-11-13 | Rosemount Aerospace Inc. | Scanning ladar with adjustable operational parameters |
US8208131B2 (en) | 2010-07-01 | 2012-06-26 | Schilling Bradley W | Digital registration of 3D laser radar data based on manually selected fiducials |
US20140211194A1 (en) * | 2013-01-27 | 2014-07-31 | Quanergy Systems, Inc. | Cost-effective lidar sensor for multi-signal detection, weak signal detection and signal disambiguation and method of using same |
US11209546B1 (en) | 2013-05-09 | 2021-12-28 | Quanergy Systems, Inc. | Solid state optical phased array lidar and method of using same |
US10132928B2 (en) | 2013-05-09 | 2018-11-20 | Quanergy Systems, Inc. | Solid state optical phased array lidar and method of using same |
US10126412B2 (en) | 2013-08-19 | 2018-11-13 | Quanergy Systems, Inc. | Optical phased array lidar system and method of using same |
US9753351B2 (en) | 2014-06-30 | 2017-09-05 | Quanergy Systems, Inc. | Planar beam forming and steering optical phased array chip and method of using same |
US9964833B2 (en) | 2014-06-30 | 2018-05-08 | Quanergy Systems, Inc. | Planar beam forming and steering optical phased array chip and method of using same |
US10180493B2 (en) | 2014-08-15 | 2019-01-15 | Quanergy Systems, Inc. | Three-dimensional-mapping two-dimensional-scanning LIDAR based on one-dimensional-steering optical phased arrays and method of using same |
US9869753B2 (en) | 2014-08-15 | 2018-01-16 | Quanergy Systems, Inc. | Three-dimensional-mapping two-dimensional-scanning lidar based on one-dimensional-steering optical phased arrays and method of using same |
US10613201B2 (en) | 2014-10-20 | 2020-04-07 | Quanergy Systems, Inc. | Three-dimensional lidar sensor based on two-dimensional scanning of one-dimensional optical emitter and method of using same |
US10557940B2 (en) | 2015-11-30 | 2020-02-11 | Luminar Technologies, Inc. | Lidar system |
US10267918B2 (en) | 2017-03-28 | 2019-04-23 | Luminar Technologies, Inc. | Lidar detector having a plurality of time to digital converters integrated onto a detector chip |
US10545240B2 (en) | 2017-03-28 | 2020-01-28 | Luminar Technologies, Inc. | LIDAR transmitter and detector system using pulse encoding to reduce range ambiguity |
US10641876B2 (en) | 2017-04-06 | 2020-05-05 | Quanergy Systems, Inc. | Apparatus and method for mitigating LiDAR interference through pulse coding and frequency shifting |
Also Published As
Publication number | Publication date |
---|---|
US7180579B1 (en) | 2007-02-20 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7436494B1 (en) | Three-dimensional ladar module with alignment reference insert circuitry | |
US7180579B1 (en) | Three-dimensional imaging processing module incorporating stacked layers containing microelectronic circuits | |
US8198576B2 (en) | Three-dimensional LADAR module with alignment reference insert circuitry comprising high density interconnect structure | |
US6414746B1 (en) | 3-D imaging multiple target laser radar | |
US11027726B2 (en) | Automotive auxiliary LADAR sensor | |
US10908266B2 (en) | Time of flight distance sensor | |
US20130250273A1 (en) | Threshold Detection Method and Device for LIDAR Time of Flight System Using Differentiated Gaussian Signal | |
EP3625589B1 (en) | System and method for determining a distance to an object | |
US6448572B1 (en) | Ranging three-dimensional laser imager and method | |
US9261357B2 (en) | Dimensioning system | |
US5446529A (en) | 3D imaging underwater laser radar | |
US20140293263A1 (en) | LIDAR Comprising Polyhedron Transmission and Receiving Scanning Element | |
US20130250272A1 (en) | Threshold Detection Method, Module and Readout Integrated Circuit Layer for LIDAR Time of Flight System Using Differentiated Gaussian Signal | |
EP3550329A1 (en) | System and method for determining a distance to an object | |
Aull et al. | Three-dimensional imaging with arrays of Geiger-mode avalanche photodiodes | |
Hao et al. | Development of pulsed‐laser three‐dimensional imaging flash lidar using APD arrays | |
US11280885B2 (en) | LADAR receiver | |
US20040188596A1 (en) | Three-dimensional imaging device incorporating stacked layers containing microelectronic circuits | |
US10444330B2 (en) | LADAR receiver with enhanced signal to noise ratio and method | |
EP1637903A1 (en) | Three-dimensional imaging processing module incorporating stacked layers containing microelectronic circuits | |
US20220179050A1 (en) | Integrated transmitter and receiver module for lidar system | |
JP2006098190A (en) | Photon detector module and imaging device | |
US10154207B2 (en) | Event-triggered imaging pixels | |
US11965989B2 (en) | Copackaging photodetector and readout circuit for improved LiDAR detection | |
Stettner et al. | Staring underwater laser radar (SULAR) 3D imaging |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: IRVINE SENSORS CORPORATION, CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:LUDWIG, DAVID E.;KENNEDY, JOHN V;KRUTZIK, CHRISTIAN;REEL/FRAME:016762/0738;SIGNING DATES FROM 20050620 TO 20050628 |
|
FEPP | Fee payment procedure |
Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
AS | Assignment |
Owner name: LONGVIEW FUND, L.P.,CALIFORNIA Free format text: SECURITY INTEREST;ASSIGNOR:IRVINE SENSORS CORP.;REEL/FRAME:018746/0842 Effective date: 20061229 Owner name: ALPHA CAPITAL ANSTALT,LIECHTENSTEIN Free format text: SECURITY INTEREST;ASSIGNOR:IRVINE SENSORS CORP.;REEL/FRAME:018746/0842 Effective date: 20061229 Owner name: ALPHA CAPITAL ANSTALT, LIECHTENSTEIN Free format text: SECURITY INTEREST;ASSIGNOR:IRVINE SENSORS CORP.;REEL/FRAME:018746/0842 Effective date: 20061229 Owner name: LONGVIEW FUND, L.P., CALIFORNIA Free format text: SECURITY INTEREST;ASSIGNOR:IRVINE SENSORS CORP.;REEL/FRAME:018746/0842 Effective date: 20061229 |
|
FEPP | Fee payment procedure |
Free format text: PAYER NUMBER DE-ASSIGNED (ORIGINAL EVENT CODE: RMPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
FEPP | Fee payment procedure |
Free format text: PAT HOLDER NO LONGER CLAIMS SMALL ENTITY STATUS, ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: STOL); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
AS | Assignment |
Owner name: IRVINE SENSORS CORPORATION, CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:LUDWIG, DAVID;KRUTZIK, CHRISTIAN;KENNEDY, JOHN;REEL/FRAME:022137/0054;SIGNING DATES FROM 20090115 TO 20090116 Owner name: IRVINE SENSORS CORPORATION, CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:KLEINHANS, WILLIAM;LIU, TINA;REEL/FRAME:022138/0094 Effective date: 20081029 |
|
AS | Assignment |
Owner name: APROLASE DEVELOPMENT CO., LLC, DELAWARE Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:IRVINE SENSORS CORPORATION;REEL/FRAME:022632/0035 Effective date: 20090316 |
|
FPAY | Fee payment |
Year of fee payment: 4 |
|
AS | Assignment |
Owner name: IRVINE SENSORS CORPORATION, CALIFORNIA Free format text: RELEASE BY SECURED PARTY;ASSIGNORS:LONGVIEW FUND, L.P.;ALPHA CAPITAL ANSTALT;REEL/FRAME:026632/0405 Effective date: 20090227 |
|
REMI | Maintenance fee reminder mailed | ||
LAPS | Lapse for failure to pay maintenance fees | ||
STCH | Information on status: patent discontinuation |
Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362 |
|
FP | Lapsed due to failure to pay maintenance fee |
Effective date: 20150220 |
|
AS | Assignment |
Owner name: AI-CORE TECHNOLOGIES, LLC, TEXAS Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:INTELLECTUAL VENTURES ASSETS 190 LLC;REEL/FRAME:065227/0107 Effective date: 20231005 |
|
AS | Assignment |
Owner name: LONGHORN AUTOMOTIVE GROUP LLC, TEXAS Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:AI-CORE TECHNOLOGIES, LLC;REEL/FRAME:066911/0261 Effective date: 20231006 |