US20090250632A1 - Method and Arrangement for Collimated Microscopic Imaging - Google Patents
Method and Arrangement for Collimated Microscopic Imaging Download PDFInfo
- Publication number
- US20090250632A1 US20090250632A1 US12/444,290 US44429007A US2009250632A1 US 20090250632 A1 US20090250632 A1 US 20090250632A1 US 44429007 A US44429007 A US 44429007A US 2009250632 A1 US2009250632 A1 US 2009250632A1
- Authority
- US
- United States
- Prior art keywords
- illumination
- sample
- fluorescence
- arrangement according
- partial regions
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 238000000034 method Methods 0.000 title claims abstract description 38
- 238000003384 imaging method Methods 0.000 title claims abstract description 18
- 238000005286 illumination Methods 0.000 claims abstract description 61
- 238000001514 detection method Methods 0.000 claims abstract description 32
- 230000036961 partial effect Effects 0.000 claims abstract description 25
- 230000002829 reductive effect Effects 0.000 claims abstract description 7
- 230000003595 spectral effect Effects 0.000 claims abstract 4
- 238000009826 distribution Methods 0.000 claims description 58
- 210000001747 pupil Anatomy 0.000 claims description 23
- 230000003993 interaction Effects 0.000 claims description 13
- 230000003287 optical effect Effects 0.000 claims description 13
- 230000000670 limiting effect Effects 0.000 claims description 8
- 238000013519 translation Methods 0.000 claims description 5
- 230000005283 ground state Effects 0.000 claims description 4
- 230000002441 reversible effect Effects 0.000 claims description 4
- 230000000737 periodic effect Effects 0.000 claims description 3
- 230000005484 gravity Effects 0.000 claims description 2
- 230000002427 irreversible effect Effects 0.000 claims description 2
- 230000010287 polarization Effects 0.000 claims description 2
- 230000001360 synchronised effect Effects 0.000 claims description 2
- 239000000126 substance Substances 0.000 claims 2
- 238000012634 optical imaging Methods 0.000 claims 1
- 238000000926 separation method Methods 0.000 abstract 2
- 230000005284 excitation Effects 0.000 description 40
- 239000000975 dye Substances 0.000 description 18
- 238000010586 diagram Methods 0.000 description 5
- 230000006978 adaptation Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 238000013461 design Methods 0.000 description 3
- 230000010354 integration Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 108090000623 proteins and genes Proteins 0.000 description 3
- 102000004169 proteins and genes Human genes 0.000 description 3
- XKRFYHLGVUSROY-UHFFFAOYSA-N Argon Chemical compound [Ar] XKRFYHLGVUSROY-UHFFFAOYSA-N 0.000 description 2
- 101100453960 Drosophila melanogaster klar gene Proteins 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 230000001427 coherent effect Effects 0.000 description 2
- 238000010226 confocal imaging Methods 0.000 description 2
- 230000007423 decrease Effects 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 230000007935 neutral effect Effects 0.000 description 2
- 229920006395 saturated elastomer Polymers 0.000 description 2
- 238000007493 shaping process Methods 0.000 description 2
- 229910052786 argon Inorganic materials 0.000 description 1
- 239000011324 bead Substances 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 238000011157 data evaluation Methods 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 235000012489 doughnuts Nutrition 0.000 description 1
- 230000005281 excited state Effects 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 238000001917 fluorescence detection Methods 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 238000007654 immersion Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000010363 phase shift Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000000979 retarding effect Effects 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 230000002269 spontaneous effect Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/16—Microscopes adapted for ultraviolet illumination ; Fluorescence microscopes
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
- G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
- G01N21/64—Fluorescence; Phosphorescence
- G01N21/645—Specially adapted constructive features of fluorimeters
- G01N21/6456—Spatial resolved fluorescence measurements; Imaging
- G01N21/6458—Fluorescence microscopy
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/0004—Microscopes specially adapted for specific applications
- G02B21/002—Scanning microscopes
- G02B21/0024—Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
- G02B21/0032—Optical details of illumination, e.g. light-sources, pinholes, beam splitters, slits, fibers
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/0004—Microscopes specially adapted for specific applications
- G02B21/002—Scanning microscopes
- G02B21/0024—Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
- G02B21/0052—Optical details of the image generation
- G02B21/0072—Optical details of the image generation details concerning resolution or correction, including general design of CSOM objectives
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/0004—Microscopes specially adapted for specific applications
- G02B21/002—Scanning microscopes
- G02B21/0024—Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
- G02B21/0052—Optical details of the image generation
- G02B21/0076—Optical details of the image generation arrangements using fluorescence or luminescence
Definitions
- the present invention relates to methods and arrangements for microscopic imaging with structured illumination. Increased spatial resolution is achieved by means of nonlinear interactions between samples, which is known from the prior art. By means of the method and the corresponding arrangements of this invention, this sample interaction is made use of for imaging in such a way that confocal imaging is possible with a resolution that goes beyond the diffraction boundary in all spatial directions with parallel data acquisition.
- the intention is to achieve a fluorescing region which is smaller than that which can be achieved by diffraction-limited excitation.
- FIG. 1 The basic principle is illustrated in FIG. 1 with the steps and schematically depicted spatial distributions which are used or which result.
- the arrangements known from the prior art are based on point scanning methods in which light distributions with zero settings in the center (doughnut modes, as they are called) which are preferred for depopulation, switching and de-excitation are applied.
- the laser beam is scanned over the sample and the steps shown in FIG. 1 are carried out sequentially in every spatial point.
- Previous arrangements according to the first method e.g., Klar et al, PNAS 97 (2000), 8206-8210) and third method (Hoffmann et al., PNAS 102 (2005), 17565-17569), all of which function according to the scheme mentioned above, have been described.
- a decisive disadvantage of this arrangement is the sequential data acquisition. Owing to the fact that the increased spatial resolution results in reduced excitation volumes, the fluorescence emission is reduced so that the pixel integration time must generally be longer (with a fivefold increase in resolution only laterally, the expected fluorescence emission is about twenty-five times lower, e.g., with a homogeneous dye distribution over the extent of diffraction-limited excitation). Further, some known switchable dyes such as Dronpa can be switched only with limited light power so as to afford many switching cycles (Habuchi et al., PNAS 102 (2005) 9511-9516). In this case, the third method mentioned above requires a considerably longer exposure time per pixel for switching off than that required for fluorescence excitation alone.
- a method and an arrangement in which a high-resolution image is achieved directly (without image processing) with parallel data acquisition is described in the following.
- the extrafocal background can be eliminated by variable confocal detection.
- This method and arrangement prevent the above-mentioned disadvantages of the multi-spot arrangement according to the prior art.
- an optimal parallelization maximum density of the simultaneously excited regions of the sample
- a relatively simple technical implementation are made possible by the invention.
- FIG. 1 is a diagram schematically illustrating sequential steps of known point scanning methods
- FIG. 2 is a diagram illustrating the switching beam distribution
- FIG. 3 illustrates the camera pixels and light distribution, object point allocation in the scanning steps, the resulting line image, and the resulting two-dimensional image after a Y-scanning step
- FIG. 4 shows the lateral (X/X) and axial (optical axis Z) light distribution in the object plane
- FIG. 5 schematically shows the axial light distribution which would occur without axially structured switching light, together with the axial structuring of the switching light;
- FIG. 7 schematically shows a modified line scanning arrangement
- FIG. 8 illustrates a phase mask for lateral structuring
- FIG. 9( a ) illustrates an achromatic color splitter which results from the pupil light distributions in FIG. 8 ;
- FIG. 9( b ) illustrates the achromatic color splitter located in the beam in a conjugate pupil plane
- FIG. 10( a ) shows the distribution without a mask (corresponds to excitation distribution);
- FIG. 10( b ) shows the distribution with a mask according to FIG. 8( b );
- FIG. 10( c ) shows the distribution with a mask according to FIG. 8( a );
- FIG. 10(d) shows incoherent overlapping results in the distribution shown
- FIG. 11( a ) is a graph illustrating intensity versus time showing switching on and off
- FIG. 11( b ) is a graph illustrating intensity versus time showing switching off
- FIG. 12 is a schematic view showing a preferred illumination unit for a laser scanning microscope for use with Dronpa;
- FIG. 13 shows the integration of an illumination unit according to the invention in a line-scanning microscope
- FIGS. 14( a )-( c ) illustrate adjustment gratings for masks
- FIG. 15 shows the intensity distribution of the illumination in the object plane using the phase mask from FIG. 8( a ).
- FIG. 16 shows a molecule population in the excited state with saturated switching off
- FIG. 17 illustrates an embodiment example of the illumination
- FIG. 18( a ) illustrates an intensity structure
- FIG. 18( b ) illustrates an axial structuring of the illumination light in the object plane.
- An arrangement which meets the demands mentioned above is based on a line-shaped excitation and confocal detection by means of a line camera behind a slit diaphragm.
- a de-excitation/depopulation/switching (always referred to hereinafter, by way of example, as switching) is realized in such a way that only a series of spots along a line can emit fluorescent light.
- the distance between these spots is at least as great as (but advantageously no greater than) the diffraction-limited resolution of the optical system.
- a possibility for generating an illumination of this kind (which is simultaneously also axially structured) consists in the diffraction of coherent light at a periodic structure and interference of the diffraction orders in the object plane, as is described in the application DE102004034962A1 which is hereby incorporated in the present disclosure. This results in diffraction-limited light distributions on the camera line which are separated from one another, impinge on corresponding pixels and are detected separately at the latter (see FIG. 2 ).
- FIG. 2 shows, from top to bottom, the switching beam distribution in the object plane, the excitation distribution in the object plane, the superposition of excitation and switching light in the object plane, the camera pixels, and the light distribution in the camera plane.
- X represents the zeroth diffraction order referring to the diagram and description in FIG. 9 a ) and FIG. 11 .
- XX is the +/ ⁇ first diffraction order according to the diagram and description in FIG. 9 a ) and FIG. 11 .
- a highly resolved image is now obtained by scanning the object along line (x) and perpendicular to line (y).
- This scanning can be carried out by moving the illumination distributions, e.g., by means of a galvanometer scanner and/or by moving the object.
- the illumination beam and the detection beam must pass over the same beam deflection elements in order to obtain a stationary light distribution on the detector (descanned detection).
- the object is simply moved (object scanning), the light distributions are stationary in every case.
- FIG. 3 shows, one below the other, the camera pixels and light distribution, object point allocation in scanning steps 1 to 10 , the resulting line image, and the resulting two-dimensional image after a Y-scanning step.
- the PSF can correspond to the diffraction-limited PSF (structured switching light only in lateral direction).
- FIG. 4 shows the lateral (X/X) and axial (optical axis Z) light distribution in the object plane.
- an axial resolution enhancement can also be achieved ( FIG. 5 ) by means of additional structuring of the switching light in axial direction.
- FIG. 5 shows schematically the axial light distribution which would occur without axially structured switching light, together with the axial structuring of the switching light.
- the switching light distribution results, e.g., from the use of an optical element from FIG. 8 b ) or FIG. 8 c ) in an arrangement according to FIG. 12 (including the associated descriptions).
- the light distribution actually obtained in this case is shown at the bottom in FIG. 5 .
- a distribution such as that in FIG. 4 , bottom, or FIG. 5 , bottom, can be useful. Therefore, it is advisable to be able to implement both scenarios in one device.
- An option for the use of increased parallelism while simultaneously preserving a certain confocality of the imaging is to image a plurality of separate lines on the sample and to carry out detection by means of an area detector.
- a confocal detection can be achieved by selectively reading out the pixels associated with the lines.
- the confocality can be adjusted by also taking into account adjacent pixels. For example, by reading out the two pixel rows adjacent to the line and summing the corresponding associated pixel elements, the effective “slit diaphragm” can be increased by a factor of 3 with a corresponding decrease in confocality.
- the same elements in the vicinity of the pupil as those shown in FIGS.
- the light must be split into n partial beams impinging in the pupil at different angles by means of an element arranged in front of the main color splitter.
- An element, mentioned above, placed in front of the main color splitter can be a suitably shaped diffractive element (or a combination of a plurality of elements) with corresponding imaging or an arrangement for the geometric splitting and beam deflection of the partial beams.
- a preferred arrangement uses a modified line-scanning system as shown in FIG. 7 and, for example, in DE 10257237A1 and EP1617271 A2 which are hereby incorporated in the present disclosure.
- the AchroGate achromatic color splitter is replaced by one permitting a structuring of the switching light in the object plane—this can be a suitable achromatic design or a dichroic beamsplitter.
- the illumination unit is replaced by one which enables the required nonlinear sample interactions and the structuring of the switching light.
- the illumination and the data acquisition are adapted in such a way that the exposure of the sample and the detection with the suitable sequence of switching/excitation/detection/switching on (see FIG. 1 ) is carried out within a suitable period of time.
- the data evaluation is adapted so that a correlation of pixels to object points is carried out as shown schematically in FIG. 3 .
- a preferred way to generate a lateral structuring is made possible by means of a phase mask according to FIG. 8 a ) which should be imaged in the vicinity of the pupil of the objective.
- the mask is divided in the middle, the right half and the left half producing different phase shifts in the light passing through.
- a sine-shaped modulation of the line in the intermediate space of the double line (to produce a modulation of the excitation in the intermediate space of the double line, see FIG. 2 , top) is generated by the interference of the two line distributions at the edge of the pupil.
- the lines must have a spacing equal to 2 ⁇ 3 of the diameter of the pupil radius. It is important that the components of the light which generate the double line and those which generate the modulated center line overlap incoherently in the sample. This can be ensured by delaying the arrival of the corresponding light components in the object by a time greater than the coherence length.
- a suitable phase grating can be used in the vicinity of a conjugate image plane in front of the mask in order to obtain the distribution of the light on the phase mask shown in FIG. 8 a ).
- the center line then corresponds to the zeroth diffraction order, and the two lines at the edge of the pupil correspond to the first diffraction order of the corresponding grating.
- the optimal position of the light distributions in the object plane relative to one another is ensured at the same time through the use of diffraction orders of a grating.
- FIG. 8 b another partial beam of the switching light is modified with a phase mask according to FIG. 8 b ) located in the vicinity of a plane conjugate to the objective pupil.
- Masks 8 b ) and 8 c ) have a central region symmetric to the optical axis and to an axis perpendicular to the optical axis which produces a different phase delay of the passing light compared to the outer regions to the right and left sides.
- a phase delay of ⁇ of an outer portion of the line-shaped pupil illumination relative to an inner portion of the line-shaped pupil illumination is carried out.
- the optimal radius of the phase jump is 1/ ⁇ square root over (2) ⁇ of the pupil radius of the objective. In practice, a somewhat smaller radius is often optimal.
- a phase plate such as that shown in FIG. 8 c ) is suitable for optimizing the radius. Adaptation of the radius can be carried out by translation.
- FIG. 9 a shows an achromatic color splitter which results from the pupil light distributions in FIG. 8 and which is also compatible with the distributions for excitation and switching on (lines).
- This achromatic color splitter is located in the beam in a conjugate pupil plane as is shown in FIG. 9 b ).
- the fluorescent light emitted by the sample fills the pupil and therefore passes the splitter (except at the reflecting strips).
- the outer mirror surfaces (X) are used for transmitting the +/ ⁇ first diffraction order of S 1 in FIG. 11
- the inner mirror surface (XX) is used to transmit the zeroth diffraction order of S 1 in FIG. 12 and the beam paths S 2 , S 3 .
- the mirror surfaces do not all lie in the same focal plane.
- the defocusing due to the magnification of the outer mirror surfaces (which are not in the focus) compared to the inner mirror surface must be taken into account.
- FIG. 9 shows experimental results (sections through the light distributions in the sample) with the corresponding masks with an oil-immersion objective having a numerical aperture (NA) of 1.4 at 488 nm.
- FIG. 10 a shows the distribution without a mask (corresponds to excitation distribution)
- FIG. 10 b shows the distribution with a mask according to FIG. 8 b
- FIG. 10 c shows the distribution with a mask according to FIG. 8 a ) (only the center portion).
- an incoherent overlapping results in the distribution shown in FIG. 10 d ) which shows a minimum which is surrounded in the y- and z-directions. This minimum extends to about 170 nm (y) and 400 nm (z), which corresponds roughly to the inverse of the diffraction-limited limiting frequencies (lateral: ⁇ /(2 ⁇ NA) ⁇ 170 nm, axial:
- the point pattern of intensity minima occurring in the focus in the sample caused by a corresponding nonlinear sample interaction is a point pattern of excitable regions (GSD/switching) or of regions in which there is still significant excitation (STED). These regions are appreciably smaller after suitable exposure optimized for the dye (wavelength, intensity, exposure time) than a diffraction-limited light distribution and therefore allow a scanning of the sample with increased resolution.
- the adjustment of the illumination is carried out based on knowledge of the dye and can be optimized at the device based on the resolution of test structures (e.g., beads).
- variable optical system which makes it possible to adapt the periods of the pattern to the periods of the detector elements is advantageously provided in the illumination beam path or detection beam path.
- the position of the imaged spots i.e., their center of gravity
- the excitation and switching on are carried out with diffraction-limited light distributions which are generated without a mask.
- these are lines which have the most homogeneous possible intensity curve along the line and extend in a diffraction-limited manner perpendicular to the line.
- the excitation is carried out either before the switching/de-excitation (STED) or after the dye has been switched off (GSD/switching) by the switching light in a structured manner. Only in the case of switching is it generally necessary to subsequently reverse the switching off by a switch-on laser, because the other processes spontaneously revert to the initial state of the dye (see also FIG. 1 with respect to the timing).
- the time sequence can be achieved by retarding the corresponding partial beams.
- the time sequence must be achieved by means of fast switches (preferably AOTFs).
- the optimal parameters for excitation and switching on are determined beforehand from knowledge of the dye characteristics.
- the aim is to reverse the switching off as completely as possible; optimized excitation and simultaneous detection of the emitted fluorescence signal is carried out by maximizing the signal-to-noise ratio.
- Different boundary conditions must be taken into account for the different interaction mechanisms:
- a suitable candidate for switching is the Dronpa protein (Habuchi et al., PNAS 102 (2005) 9511-9516).
- the switching off and the excitation are carried out with a wavelength in the range of about 450 nm to 520 nm.
- Switching on can be carried out in the range of 350 nm to 420 nm.
- the mutual switching on and off is shown in FIG. 11 a ).
- a detailed view of switching off is represented in FIG. 11 b ). This illustrates the long exposure times of about 5 ms for achieving a sufficient switching off. While the exposure time can be shortened by increasing the intensity, this would reduce the number of possible switching cycles compared to FIG. 11 a ) in which about 100 switching cycles are shown.
- FIG. 12 shows a schematic view of a preferred illumination unit for a laser scanning microscope for use with Dronpa.
- S 1 represents the beam path for generating the switching light distribution (see FIGS. 2 , 7 and 5 ).
- the dye is switched on in this case either before switching off or after excitation.
- S 2 is the excitation beam path
- S 3 is another beam path for switching on a switched off dye, if necessary. Accordingly, S 1 (switching off) is carried out first, followed by S 2 (excitation) and S 3 (switching on) either at the very start or at the very end, wherein detection is carried out at S 2 .
- the wavelength 477 nm at S 2 can also be replaced with another excitation wavelength (e.g., 488 nm).
- STED and GSD can be realized by means of S 1 and S 2 , STED can be realized by S 2 followed by S 1 , and detection can be realized in S 1 , GSD by S 1 followed by S 2 , and detection in S 2 .
- S 1 after the beam shaping (e.g., by means of a Powel lens) and after passing through a splitter DC in the zeroth diffraction order of a grating followed by the mask 7 a ) (phase jump), the two laterally limiting outer lines of the switching beam are generated in the sample and the structuring of the center line is generated by means of the +/ ⁇ first diffraction order.
- the mask 7 b ) or c ) (after reflection at the splitter DC and separate beam path until after the mask 7 c )) generates the limiting lines of the switching beam in axial direction by means of the phase jump described above.
- Slightly different wavelengths in this case, 488 nm, 477 nm can be used for the beam paths through 7 a ) and 7 c ), but they must both lie within the range of the response behavior of the respective dye.
- FIG. 13 The integration of an illumination unit according to the invention in a line-scanning microscope is shown in FIG. 13 . It contains the above-mentioned adjusting plate in the detection beam path for positioning the spot on the row of detectors.
- An additional zoom in the system serves to adjust the imaging of the illuminated line in the object on the row detectors. Accordingly, a selected portion of the line can be imaged on the row detectors.
- the definitive correlation of the illumination spot and camera pixels must be ensured in every case by the interaction of the two zooms.
- additional lasers are connected and the design of the dichroic splitter DC is provided for a plurality of colors (or as a neutral splitter). Further, it may be necessary (depending upon the wavelength difference) to change masks (although simultaneous operation would not then be possible).
- a simple adaptation consists in changing the grating constant so that the diffraction orders occur at the same location in the pupil. This can be achieved by a translation of a grating as is shown in FIG. 14 a ). With moderate wavelength changes (on the order of 5%), the masks can also be used simultaneously with a plurality of wavelengths.
- FIG. 14 b shows a preferred form of adapting by changing the effective gap ratio at the grating while maintaining the same grating constant. Adapting the radius of the phase jump of the mask in FIG. 8 b ) is particularly critical for optimal structuring in axial direction.
- a precision optimization of this radius e.g., based on the recording of PSF, with the objective to be used is possible with a mask design such as that shown in FIG. 12 c ).
- the effective radius of the phase edge can be adapted by translation of the mask.
- FIG. 15 shows the intensity distribution of the illumination in the object plane using the phase mask from FIG. 8 a ).
- the quantity n of excited molecules decreases exponentially with the illumination intensity and the exposure duration.
- FIG. 16 shows the resulting molecule population in the excited stated with saturated switching off, which provides a measurement for the PSF.
- FIG. 17 An embodiment example of the illumination is shown in FIG. 17 . Side views of the beam path are shown at left and at the top.
- a light bundle which is adapted to a Powell lens and has a Gaussian intensity profile is provided by fiber coupling.
- the light bundle has two wavelengths, 477 nm and 488 nm.
- the Powell lens (divergence 30°) generates a line-shaped illumination with a homogeneous intensity distribution along the line in the focal plane of the following achromatic objective with a focal distance of 10 mm. This plane is conjugate to the object plane of the microscope.
- a first color splitter splits the two homogenized laser lines.
- a light path, advantageously that with 488 nm, has a line grating with 55 l/mm which generates the zeroth and ⁇ first diffraction orders in a determined intensity ratio of 8:1.
- phase element which is located in a plane conjugate to the microscope pupil.
- the phase element is described in FIG. 8 a ).
- this phase element causes an intensity structure according to FIG. 18 a ).
- the grating is advantageously formed as a phase grating.
- the grating has a variable groove depth as is shown in FIG. 14 b ). Since the illumination of the grating is line-shaped, the efficiency of the diffraction orders can be adjusted by lateral displacement of the grating.
- the second light path only has the same 2f imaging as the first, but without a grating.
- the phase procedure in the pupil of the second light path is implemented by a phase mask according to FIG. 8 c ).
- This enables an axial structuring of the illumination light in the object plane ( FIG. 18 b )).
- the lateral extension of the masks is about 12 ⁇ 12 mm 2 .
- the diffraction orders in the first light path are at ⁇ 4 mm, 0 mm and 4 mm.
- the two light paths are recombined after these procedures.
- the illumination pupil is adapted to the pupil of the microscope by means of relay optics.
- the interface is the main color splitter.
- the imaging scale of the relay optics is 4.35.
- the variability of the relay optics serves for precision adjustment of the imaging scale.
- the beam combiner is followed by a neutral splitter which serves to couple in the light for fluorescence excitation (477 nm) and also the light for erasing the structure impressed in the object (405 nm).
Abstract
A method and arrangement for collimated microscopic imaging, including a first illumination of a sample in at least one region for exciting fluorescence, and a spatially resolving detection of the sample light by detector elements, the detection being associated with the region, wherein by means of a second illumination a sub-division of the region into separate fluorescent partial regions occurs, which are associated with the detector elements. The separation of the partial regions is carried out by the spatial separation of the fluorescent regions by means of intermediate regions having reduced fluorescence or no fluorescence, and/or by means of different spectral properties of the fluorescence from the partial regions.
Description
- The present application is a U.S. National Stage application of International PCT Application No. PCT/EP2007/008556 filed on Oct. 2, 2007, which claims benefit of German Application No. DE 10 2006 047 912.2 filed on Oct. 6, 2006, the contents of each are incorporated by reference in their entirety.
- The present invention relates to methods and arrangements for microscopic imaging with structured illumination. Increased spatial resolution is achieved by means of nonlinear interactions between samples, which is known from the prior art. By means of the method and the corresponding arrangements of this invention, this sample interaction is made use of for imaging in such a way that confocal imaging is possible with a resolution that goes beyond the diffraction boundary in all spatial directions with parallel data acquisition.
- The prior art discloses various nonlinear sample interactions which can lead to enhanced spatial resolution when suitably implemented, specifically:
- 1. De-excitation of the excited level through stimulated emission (Stimulated Emission Deletion—STED), Klar and Hell, Opt. Lett. 24 (1999), 954-956
2. Depopulation of the ground state by triplet occupation (Ground State Depletion—GSD), Hell and Kroug, Appl. Phys. B 60 (1995). 495-497
3. Reversible or irreversible dye switching between a fluorescing state, a non-fluorescing state, a reduced fluorescing state, or a fluorescing state characterized by other features (such as a different emission wavelength), Hell, Jakobs and Kastrup, Appl. Phys. A 77 (2003), 859-860. - The basic idea behind the method of the invention is that the dye is either
- a) brought to a non-fluorescing or slightly fluorescing state in a spatially limited region so that a subsequent excitation can lead to fluorescence only, or predominantly, in a limited region (second and third method), or
- b) is de-excited in a spatially limited region following excitation so that fluorescence is carried out only from a limited region (first method).
- In both cases, the intention is to achieve a fluorescing region which is smaller than that which can be achieved by diffraction-limited excitation.
- The basic principle is illustrated in
FIG. 1 with the steps and schematically depicted spatial distributions which are used or which result. The arrangements known from the prior art are based on point scanning methods in which light distributions with zero settings in the center (doughnut modes, as they are called) which are preferred for depopulation, switching and de-excitation are applied. The laser beam is scanned over the sample and the steps shown inFIG. 1 are carried out sequentially in every spatial point. Previous arrangements according to the first method (e.g., Klar et al, PNAS 97 (2000), 8206-8210) and third method (Hoffmann et al., PNAS 102 (2005), 17565-17569), all of which function according to the scheme mentioned above, have been described. A decisive disadvantage of this arrangement is the sequential data acquisition. Owing to the fact that the increased spatial resolution results in reduced excitation volumes, the fluorescence emission is reduced so that the pixel integration time must generally be longer (with a fivefold increase in resolution only laterally, the expected fluorescence emission is about twenty-five times lower, e.g., with a homogeneous dye distribution over the extent of diffraction-limited excitation). Further, some known switchable dyes such as Dronpa can be switched only with limited light power so as to afford many switching cycles (Habuchi et al., PNAS 102 (2005) 9511-9516). In this case, the third method mentioned above requires a considerably longer exposure time per pixel for switching off than that required for fluorescence excitation alone. - Therefore, it is clear that a parallel data acquisition is needed in order to arrive at acceptable image compilation times. In this connection, it must be taken into consideration that confocal imaging is required in order to avoid a loss of contrast and reduced resolution enhancement due to extrafocal fluorescence. A possibility offered by the prior art for parallelizing is simultaneous excitation with a plurality of spots, each of whose fluorescence characteristics are modified by a doughnut-shaped illumination. However, the doughnut-shaped illumination must lead to a nonlinear sample interaction, i.e., a saturation, in order to achieve increased resolution. This means that a relatively large area around the individual spot interacts with this light distribution, which only allows a low density of the spot and, therefore, meager parallelization. Further, a confocal detection in a multi-spot arrangement of this kind is cumbersome in technical respects.
- A method and an arrangement in which a high-resolution image is achieved directly (without image processing) with parallel data acquisition is described in the following. The extrafocal background can be eliminated by variable confocal detection. This method and arrangement prevent the above-mentioned disadvantages of the multi-spot arrangement according to the prior art. In particular, an optimal parallelization (maximum density of the simultaneously excited regions of the sample) and a relatively simple technical implementation are made possible by the invention.
- The present inventions will be described in greater detail, using examples with reference to the annexed drawings, in which:
-
FIG. 1 is a diagram schematically illustrating sequential steps of known point scanning methods; -
FIG. 2 is a diagram illustrating the switching beam distribution; -
FIG. 3 illustrates the camera pixels and light distribution, object point allocation in the scanning steps, the resulting line image, and the resulting two-dimensional image after a Y-scanning step; -
FIG. 4 shows the lateral (X/X) and axial (optical axis Z) light distribution in the object plane; -
FIG. 5 schematically shows the axial light distribution which would occur without axially structured switching light, together with the axial structuring of the switching light; -
FIG. 6 is a schematic optical diagram which shows splitting in only n=3 lines; -
FIG. 7 schematically shows a modified line scanning arrangement; -
FIG. 8 illustrates a phase mask for lateral structuring; -
FIG. 9( a) illustrates an achromatic color splitter which results from the pupil light distributions inFIG. 8 ; -
FIG. 9( b) illustrates the achromatic color splitter located in the beam in a conjugate pupil plane; -
FIG. 10( a) shows the distribution without a mask (corresponds to excitation distribution); -
FIG. 10( b) shows the distribution with a mask according toFIG. 8( b); -
FIG. 10( c) shows the distribution with a mask according toFIG. 8( a); -
FIG. 10(d) shows incoherent overlapping results in the distribution shown; -
FIG. 11( a) is a graph illustrating intensity versus time showing switching on and off, -
FIG. 11( b) is a graph illustrating intensity versus time showing switching off; -
FIG. 12 is a schematic view showing a preferred illumination unit for a laser scanning microscope for use with Dronpa; -
FIG. 13 shows the integration of an illumination unit according to the invention in a line-scanning microscope; -
FIGS. 14( a)-(c) illustrate adjustment gratings for masks; -
FIG. 15 shows the intensity distribution of the illumination in the object plane using the phase mask fromFIG. 8( a). -
FIG. 16 shows a molecule population in the excited state with saturated switching off; -
FIG. 17 illustrates an embodiment example of the illumination; -
FIG. 18( a) illustrates an intensity structure; and -
FIG. 18( b) illustrates an axial structuring of the illumination light in the object plane. - Basic Principles
- An arrangement which meets the demands mentioned above is based on a line-shaped excitation and confocal detection by means of a line camera behind a slit diaphragm. By means of a suitable exposure pattern in combination with the nonlinear sample interaction, a de-excitation/depopulation/switching (always referred to hereinafter, by way of example, as switching) is realized in such a way that only a series of spots along a line can emit fluorescent light. The distance between these spots is at least as great as (but advantageously no greater than) the diffraction-limited resolution of the optical system. A possibility for generating an illumination of this kind (which is simultaneously also axially structured) consists in the diffraction of coherent light at a periodic structure and interference of the diffraction orders in the object plane, as is described in the application DE102004034962A1 which is hereby incorporated in the present disclosure. This results in diffraction-limited light distributions on the camera line which are separated from one another, impinge on corresponding pixels and are detected separately at the latter (see
FIG. 2 ). -
FIG. 2 shows, from top to bottom, the switching beam distribution in the object plane, the excitation distribution in the object plane, the superposition of excitation and switching light in the object plane, the camera pixels, and the light distribution in the camera plane. In the switching beam distribution, X represents the zeroth diffraction order referring to the diagram and description inFIG. 9 a) andFIG. 11 . XX is the +/− first diffraction order according to the diagram and description inFIG. 9 a) andFIG. 11 . - A highly resolved image is now obtained by scanning the object along line (x) and perpendicular to line (y). This scanning can be carried out by moving the illumination distributions, e.g., by means of a galvanometer scanner and/or by moving the object. In the former case, the illumination beam and the detection beam must pass over the same beam deflection elements in order to obtain a stationary light distribution on the detector (descanned detection). In case the object is simply moved (object scanning), the light distributions are stationary in every case.
- The information about the correlation of pixel to measurement point on the sample is derived in a definitive manner from the scanning movement and the corresponding optics. This will be described more exactly: the image field raster observed by the detector is determined by the imaging of the camera pixels on the sample. For example, 512 pixels are imaged on the sample in such a way that every pixel detects an image surface of 1.5-times the diffraction-limited resolution (for an objective with an NA of 1.4, this corresponds at a
wavelength 488 nm to a field of 488 nm/(2*1.4)*1.5=260 nm edge length). Adjustment of the illumination pattern (switching light distribution) ensures that there is a unique correlation between the luminous spots in the sample and the camera pixels. By means of the relative movement of the object and illumination pattern, different sample points are imaged. For this purpose, the scanning movement and the detection of the spot size in the sample which is synchronized with the scanning movement must be adapted. Typically, scanning is carried out with one half of the spot diameter (Nyquist theorem). Thus when a fivefold increase in resolution (N=5) is achieved in the example given above by mean of the nonlinear sample interaction, a sample scanning must be carried out at a distance of 260 nm/(5*2)=26 nm. Therefore, N*2 scan/detection steps (10 in the example above) are needed to completely scan a line. Therefore, 512*2*N highly resolved data points are obtained from 512 pixels in x-direction (seeFIG. 3 ). -
FIG. 3 shows, one below the other, the camera pixels and light distribution, object point allocation inscanning steps 1 to 10, the resulting line image, and the resulting two-dimensional image after a Y-scanning step. - The discussion has so far been limited to one object plane. However, objects are always three-dimensional. This has several consequences. For one, aside from the fluorescence in the focus with increased resolution, fluorescence is also excited outside of the focus. This fluorescence interferes with the imaging described above and can make it impossible to correlate the pixels to high-resolution object points. A remedy is afforded by confocal detection which effectively suppresses extrafocal fluorescent light. In the case presently under consideration, this is realized by means of an (ideally) variable slit diaphragm in front of the camera parallel to the line. On the other hand, the three-dimensional point spread function (PSF) must be taken into consideration for imaging. This will depend upon the switching light distribution as well as on the excitation PSF and detection PSF. In axial direction, the PSF can correspond to the diffraction-limited PSF (structured switching light only in lateral direction).
FIG. 4 shows the lateral (X/X) and axial (optical axis Z) light distribution in the object plane. However, an axial resolution enhancement can also be achieved (FIG. 5 ) by means of additional structuring of the switching light in axial direction.FIG. 5 shows schematically the axial light distribution which would occur without axially structured switching light, together with the axial structuring of the switching light. The switching light distribution results, e.g., from the use of an optical element fromFIG. 8 b) orFIG. 8 c) in an arrangement according toFIG. 12 (including the associated descriptions). The light distribution actually obtained in this case is shown at the bottom inFIG. 5 . Depending upon the application, a distribution such as that inFIG. 4 , bottom, orFIG. 5 , bottom, can be useful. Therefore, it is advisable to be able to implement both scenarios in one device. - In principle, all of the above considerations can also be applied to a two-dimensionally structured switching beam distribution and detection with an area detector. In this case, the excitation and the switching on which may possibly be necessary are carried out with (far-field) area illumination. An arrangement of this kind would have the advantage of increased parallelism (e.g., 5122 points could be exposed simultaneously), but also has the disadvantage of non-confocal detection. The occurrence of extrafocal fluorescence can pose a severe problem depending on the sample (particularly with thick, strongly dyed samples).
- An option for the use of increased parallelism while simultaneously preserving a certain confocality of the imaging is to image a plurality of separate lines on the sample and to carry out detection by means of an area detector. When the lines on the area detector are sufficiently separated (e.g., by about 10 pixels), a confocal detection can be achieved by selectively reading out the pixels associated with the lines. The confocality can be adjusted by also taking into account adjacent pixels. For example, by reading out the two pixel rows adjacent to the line and summing the corresponding associated pixel elements, the effective “slit diaphragm” can be increased by a factor of 3 with a corresponding decrease in confocality. The same elements in the vicinity of the pupil as those shown in
FIGS. 8 and 9 can be used for an arrangement of this kind in the illumination beam path. However, the light must be split into n partial beams impinging in the pupil at different angles by means of an element arranged in front of the main color splitter. This results in n lines which are separated from one another in the object plane, every line being shaped in the same manner as shown inFIG. 4 andFIG. 5 . An element, mentioned above, placed in front of the main color splitter can be a suitably shaped diffractive element (or a combination of a plurality of elements) with corresponding imaging or an arrangement for the geometric splitting and beam deflection of the partial beams. An example of this is shown inFIG. 6 which shows splitting in only n=3 lines for the sake of clarity. - Preferred Arrangement
- A preferred arrangement uses a modified line-scanning system as shown in FIG. 7 and, for example, in DE 10257237A1 and EP1617271 A2 which are hereby incorporated in the present disclosure.
- The modifications involve the following aspects:
- The AchroGate achromatic color splitter is replaced by one permitting a structuring of the switching light in the object plane—this can be a suitable achromatic design or a dichroic beamsplitter.
- The illumination unit is replaced by one which enables the required nonlinear sample interactions and the structuring of the switching light.
- The illumination and the data acquisition are adapted in such a way that the exposure of the sample and the detection with the suitable sequence of switching/excitation/detection/switching on (see
FIG. 1 ) is carried out within a suitable period of time. - The data evaluation is adapted so that a correlation of pixels to object points is carried out as shown schematically in
FIG. 3 . - Structuring of the Switching Light
- A preferred way to generate a lateral structuring is made possible by means of a phase mask according to
FIG. 8 a) which should be imaged in the vicinity of the pupil of the objective. In this connection, reference is had to the beam path shown inFIG. 12 . The mask is divided in the middle, the right half and the left half producing different phase shifts in the light passing through. A double line—as is shown at the top in FIG. 2—is achieved by means of a phase jump of π for half of the center line. A sine-shaped modulation of the line in the intermediate space of the double line (to produce a modulation of the excitation in the intermediate space of the double line, seeFIG. 2 , top) is generated by the interference of the two line distributions at the edge of the pupil. To achieve a modulation of the line at ⅔ of the limiting frequency, for example, the lines must have a spacing equal to ⅔ of the diameter of the pupil radius. It is important that the components of the light which generate the double line and those which generate the modulated center line overlap incoherently in the sample. This can be ensured by delaying the arrival of the corresponding light components in the object by a time greater than the coherence length. However, it is preferable simply to adjust the polarization of the light components orthogonal to one another as is illustrated schematically by arrows inFIG. 8 . This can be accomplished, e.g., by means half-wave plates which selectively rotate the light in the outer area of the pupil (seeFIG. 8 ). A suitable phase grating can be used in the vicinity of a conjugate image plane in front of the mask in order to obtain the distribution of the light on the phase mask shown inFIG. 8 a). The center line then corresponds to the zeroth diffraction order, and the two lines at the edge of the pupil correspond to the first diffraction order of the corresponding grating. The optimal position of the light distributions in the object plane relative to one another is ensured at the same time through the use of diffraction orders of a grating. Because of the incoherence of the first diffraction orders relative to the zeroth diffraction order that is achieved by the steps described above, it is also ensured that the center line in the object plane can be modulated up to the limiting frequency of the imaging of incoherent light (which is twice as great compared to imaging with coherent light). Another consequence consists in that no structuring of the light is carried out in axial direction, in contrast to the arrangement described in DE102004034962 A1. - If an axial structuring of the switching light—as is shown schematically at the top of FIG. 5—is also desired, another partial beam of the switching light is modified with a phase mask according to
FIG. 8 b) located in the vicinity of a plane conjugate to the objective pupil. - Masks 8 b) and 8 c) have a central region symmetric to the optical axis and to an axis perpendicular to the optical axis which produces a different phase delay of the passing light compared to the outer regions to the right and left sides. A phase delay of π of an outer portion of the line-shaped pupil illumination relative to an inner portion of the line-shaped pupil illumination is carried out. In theory, the optimal radius of the phase jump is 1/√{square root over (2)} of the pupil radius of the objective. In practice, a somewhat smaller radius is often optimal. A phase plate such as that shown in
FIG. 8 c) is suitable for optimizing the radius. Adaptation of the radius can be carried out by translation. -
FIG. 9 a) shows an achromatic color splitter which results from the pupil light distributions inFIG. 8 and which is also compatible with the distributions for excitation and switching on (lines). This achromatic color splitter is located in the beam in a conjugate pupil plane as is shown inFIG. 9 b). The fluorescent light emitted by the sample fills the pupil and therefore passes the splitter (except at the reflecting strips). The outer mirror surfaces (X) are used for transmitting the +/− first diffraction order of S1 inFIG. 11 , the inner mirror surface (XX) is used to transmit the zeroth diffraction order of S1 inFIG. 12 and the beam paths S2, S3. It must be ensured, as the case may be, that the mirror surfaces do not all lie in the same focal plane. In case the Rayleigh range of the light focused in this plane is less than the focus deviation of the outer mirror surfaces, the defocusing due to the magnification of the outer mirror surfaces (which are not in the focus) compared to the inner mirror surface must be taken into account. -
FIG. 9 shows experimental results (sections through the light distributions in the sample) with the corresponding masks with an oil-immersion objective having a numerical aperture (NA) of 1.4 at 488 nm.FIG. 10 a) shows the distribution without a mask (corresponds to excitation distribution),FIG. 10 b) shows the distribution with a mask according toFIG. 8 b), andFIG. 10 c) shows the distribution with a mask according toFIG. 8 a) (only the center portion). Finally, an incoherent overlapping results in the distribution shown inFIG. 10 d) which shows a minimum which is surrounded in the y- and z-directions. This minimum extends to about 170 nm (y) and 400 nm (z), which corresponds roughly to the inverse of the diffraction-limited limiting frequencies (lateral: λ/(2·NA)≈170 nm, axial: -
λ/(n−√{square root over (n 2 −NA 2)})≈520 nm). - The point pattern of intensity minima occurring in the focus in the sample caused by a corresponding nonlinear sample interaction is a point pattern of excitable regions (GSD/switching) or of regions in which there is still significant excitation (STED). These regions are appreciably smaller after suitable exposure optimized for the dye (wavelength, intensity, exposure time) than a diffraction-limited light distribution and therefore allow a scanning of the sample with increased resolution. The adjustment of the illumination is carried out based on knowledge of the dye and can be optimized at the device based on the resolution of test structures (e.g., beads). Since this point pattern must be imaged exactly on the pixels of the line camera, a variable optical system (zoom) which makes it possible to adapt the periods of the pattern to the periods of the detector elements is advantageously provided in the illumination beam path or detection beam path. The position of the imaged spots (i.e., their center of gravity) can be centered within the pixels by means of another element such as a tiltable, thick glass plate in the illumination beam path or detection beam path (see, e.g., DE 102004034960A1).
- Excitation and Switching On
- The excitation and switching on are carried out with diffraction-limited light distributions which are generated without a mask. In the preferred embodiment example, these are lines which have the most homogeneous possible intensity curve along the line and extend in a diffraction-limited manner perpendicular to the line.
- The excitation is carried out either before the switching/de-excitation (STED) or after the dye has been switched off (GSD/switching) by the switching light in a structured manner. Only in the case of switching is it generally necessary to subsequently reverse the switching off by a switch-on laser, because the other processes spontaneously revert to the initial state of the dye (see also
FIG. 1 with respect to the timing). In case pulsed lasers are used (which is generally required in STED), the time sequence can be achieved by retarding the corresponding partial beams. When using continuously emitting (cw) lasers, the time sequence must be achieved by means of fast switches (preferably AOTFs). - The optimal parameters for excitation and switching on are determined beforehand from knowledge of the dye characteristics. For switching on, the aim is to reverse the switching off as completely as possible; optimized excitation and simultaneous detection of the emitted fluorescence signal is carried out by maximizing the signal-to-noise ratio. Different boundary conditions must be taken into account for the different interaction mechanisms:
-
- With STED, only the number of excited molecules remaining after excitation and subsequent de-excitation can contribute to fluorescence. For a detection of photons going beyond the one-time emission of these molecules, it is necessary to repeat the process (excitation—de-excitation—fluorescence detection).
- With GSD, excitation can be carried out and the resulting fluorescence detected only until the molecules spontaneously revert back from the triplet level. This is a comparatively short time period on the order of 1 μs.
- When switching dyes, the excitation wavelength and the switching wavelength are identical in some cases. If this switching happens to be the switching off of the dye (as with Dronpa), the detection of fluorescence photons must be prevented during the targeted switching with the switching light distribution or separated from the detection of the photons from the spatially limited region. Further, the fluorescence signal can be detected only until the dye is switched off even in the spatially limited region. Otherwise, there are no other restrictions provided the dye remains stable in the switched off state. Even when the excitation wavelength and the wavelength for switching on the molecule are identical (as is known, e.g., for the asFP585 protein, Hoffmann et al., PNAS 102 (2005), 17565-17569), this does not pose any problems provided the fluorescence excitation is more efficient than the switching process and the excitation outputs, switching outputs and exposure times are adapted in a corresponding manner.
- Generally, not all light-emitting molecules in a sample take part in the nonlinear sample interaction (STED/switching/GSD). This leads to a background signal which is not subjected to the nonlinear beam shaping and accordingly limits the high resolution that can be achieved. In case of long-lived states (i.e., approximately >1 μs) as in GSD and switching, the magnitude of the background relative to the signal of the molecules participating in the nonlinear sample interaction can be gauged by a further recording before switching on again (switching) or before the spontaneous relaxation into the ground state (GSD). This is because the unstructured excitation (S2,
FIG. 11 ), e.g., in photoswitches such as Dronpa, in addition to the fluorescence excitation also leads to the switching off of the Dropna molecules (similarly the excitation also leads to an occupation of the triplet state in GSD). Therefore, in further (unstructured) excitation and detection, only those molecules which are not subjected to the photoswitching process (or GSD) emit light. The procedure is similar with switchable molecules in which the fluorescence excitation leads to the switching on of the molecule (as in asFP, Hoffmann et al., PNAS 102 (2005), 17565-17569). However, the dye must initially be switched off in an unstructured manner in an additional step in this case and the fluorescence excited by unstructured illumination is then detected. - A suitable candidate for switching is the Dronpa protein (Habuchi et al., PNAS 102 (2005) 9511-9516). In this case, the switching off and the excitation are carried out with a wavelength in the range of about 450 nm to 520 nm. Switching on can be carried out in the range of 350 nm to 420 nm. This makes it possible to work, e.g., with the lines of the argon laser at 477 nm and 488 nm and to use a laser diode at 405 nm for switching on. The mutual switching on and off is shown in
FIG. 11 a). A detailed view of switching off is represented inFIG. 11 b). This illustrates the long exposure times of about 5 ms for achieving a sufficient switching off. While the exposure time can be shortened by increasing the intensity, this would reduce the number of possible switching cycles compared toFIG. 11 a) in which about 100 switching cycles are shown. -
FIG. 12 shows a schematic view of a preferred illumination unit for a laser scanning microscope for use with Dronpa. S1 represents the beam path for generating the switching light distribution (seeFIGS. 2 , 7 and 5). The dye is switched on in this case either before switching off or after excitation. S2 is the excitation beam path, S3 is another beam path for switching on a switched off dye, if necessary. Accordingly, S1 (switching off) is carried out first, followed by S2 (excitation) and S3 (switching on) either at the very start or at the very end, wherein detection is carried out at S2. The wavelength 477 nm at S2 can also be replaced with another excitation wavelength (e.g., 488 nm). - STED and GSD (see the introductory part of the specification) can be realized by means of S1 and S2, STED can be realized by S2 followed by S1, and detection can be realized in S1, GSD by S1 followed by S2, and detection in S2. In S1, after the beam shaping (e.g., by means of a Powel lens) and after passing through a splitter DC in the zeroth diffraction order of a grating followed by the
mask 7 a) (phase jump), the two laterally limiting outer lines of the switching beam are generated in the sample and the structuring of the center line is generated by means of the +/− first diffraction order. - The mask 7 b) or c) (after reflection at the splitter DC and separate beam path until after the
mask 7 c)) generates the limiting lines of the switching beam in axial direction by means of the phase jump described above. - Slightly different wavelengths (in this case, 488 nm, 477 nm) can be used for the beam paths through 7 a) and 7 c), but they must both lie within the range of the response behavior of the respective dye.
- The integration of an illumination unit according to the invention in a line-scanning microscope is shown in
FIG. 13 . It contains the above-mentioned adjusting plate in the detection beam path for positioning the spot on the row of detectors. An additional zoom in the system serves to adjust the imaging of the illuminated line in the object on the row detectors. Accordingly, a selected portion of the line can be imaged on the row detectors. The definitive correlation of the illumination spot and camera pixels must be ensured in every case by the interaction of the two zooms. - In order to achieve a flexible system for switching additional dyes (also simultaneously with Dronpa), additional lasers are connected and the design of the dichroic splitter DC is provided for a plurality of colors (or as a neutral splitter). Further, it may be necessary (depending upon the wavelength difference) to change masks (although simultaneous operation would not then be possible).
- A simple adaptation consists in changing the grating constant so that the diffraction orders occur at the same location in the pupil. This can be achieved by a translation of a grating as is shown in
FIG. 14 a). With moderate wavelength changes (on the order of 5%), the masks can also be used simultaneously with a plurality of wavelengths. - Also, when a wavelength is used, the use of different objectives, for example, creates the need for adjustment possibilities in the system. In this connection, a basic adaptation of the illumination to the different pupils of the objectives is carried out by means of the zoom system directly following the main color splitter (
FIG. 8 ). Another specific adaptation is the relative proportioning of the intensity in the diffraction orders, which can result from the different losses of the orders when changing objectives. Further, this makes it possible to adapt specifically to the object.FIG. 14 b) shows a preferred form of adapting by changing the effective gap ratio at the grating while maintaining the same grating constant. Adapting the radius of the phase jump of the mask inFIG. 8 b) is particularly critical for optimal structuring in axial direction. A precision optimization of this radius, e.g., based on the recording of PSF, with the objective to be used is possible with a mask design such as that shown inFIG. 12 c). The effective radius of the phase edge can be adapted by translation of the mask. - Simulation of the Intensity Distribution for Dronpa
-
FIG. 15 shows the intensity distribution of the illumination in the object plane using the phase mask fromFIG. 8 a). The quantity n of excited molecules decreases exponentially with the illumination intensity and the exposure duration. Using Dronpa as an example,FIG. 16 shows the resulting molecule population in the excited stated with saturated switching off, which provides a measurement for the PSF. - An Optical Embodiment Example
- An embodiment example of the illumination is shown in
FIG. 17 . Side views of the beam path are shown at left and at the top. - A light bundle which is adapted to a Powell lens and has a Gaussian intensity profile is provided by fiber coupling. The light bundle has two wavelengths, 477 nm and 488 nm. The Powell lens (divergence 30°) generates a line-shaped illumination with a homogeneous intensity distribution along the line in the focal plane of the following achromatic objective with a focal distance of 10 mm. This plane is conjugate to the object plane of the microscope. A first color splitter splits the two homogenized laser lines. A light path, advantageously that with 488 nm, has a line grating with 55 l/mm which generates the zeroth and ± first diffraction orders in a determined intensity ratio of 8:1. These laser lines are imaged by 2f-imaging with 150 mm focal distance onto a phase element which is located in a plane conjugate to the microscope pupil. The phase element is described in
FIG. 8 a). In the object plane, this phase element causes an intensity structure according toFIG. 18 a). The grating is advantageously formed as a phase grating. For precise adjustment of the intensity ratio between the zeroth and first diffraction order, the grating has a variable groove depth as is shown inFIG. 14 b). Since the illumination of the grating is line-shaped, the efficiency of the diffraction orders can be adjusted by lateral displacement of the grating. The second light path only has the same 2f imaging as the first, but without a grating. The phase procedure in the pupil of the second light path is implemented by a phase mask according toFIG. 8 c). This enables an axial structuring of the illumination light in the object plane (FIG. 18 b)). The lateral extension of the masks is about 12×12 mm2. The diffraction orders in the first light path are at −4 mm, 0 mm and 4 mm. The two light paths are recombined after these procedures. The illumination pupil is adapted to the pupil of the microscope by means of relay optics. The interface is the main color splitter. The imaging scale of the relay optics is 4.35. The variability of the relay optics serves for precision adjustment of the imaging scale. The beam combiner is followed by a neutral splitter which serves to couple in the light for fluorescence excitation (477 nm) and also the light for erasing the structure impressed in the object (405 nm). - While the invention has been illustrated and described in connection with currently preferred embodiments shown and described in detail, it is not intended to be limited to the details shown since various modifications and structural changes may be made without departing in any way from the spirit of the present invention. The embodiments were chosen and described in order to best explain the principles of the invention and practical application to thereby enable a person skilled in the art to best utilize the invention and various embodiments with various modifications as are suited to the particular use contemplated.
Claims (34)
1. A method for collimated microscopic imaging with a first illumination of a sample in at least one region for exciting fluorescence and a spatially resolving detection of the sample light by detector elements which is associated with the region, comprising separating said region by a second illumination into separate fluorescing partial regions which are associated with said detector elements, wherein said separating of said region into partial regions comprises spatially dividing said fluorescing regions by means of intermediate regions with reduced fluorescence or no fluorescence and/or by different spectral properties of the fluorescence from said partial regions.
2. The method according to claim 1 , wherein said second illumination is spatially structured or patterned.
3. The method according to claim 1 , wherein the different spectral properties are a fluorescence of different wavelength or a different spectral distribution.
4. The method according to claim 1 , wherein a reduction of the extent of the partial regions by de-excitation (depopulation) and/or switching the fluorescence state are/is carried out by said second illumination.
5. The method according to claim 1 , wherein the reduction of the extent of the partial regions is carried out by means of nonlinear interactions of said second illumination with at least one substance capable of fluorescing which is present in the sample, and wherein
a) a de-excitation of an excited level is carried out by stimulated emission (STED) and/or
b) a depopulation of a ground state is carried out by triplet occupation (GSD) and/or
c) the at least one substance capable of fluorescing is driven from a state with first fluorescence characteristics into a state with second fluorescence characteristics or reduced fluorescence by reversible or irreversible optical switching.
6. The method according to claim 1 , wherein a definitive correlation of the partial regions to the detector elements is carried out by optical imaging of the fluorescence emitted by the said partial regions onto the detector.
7. The method according to claim 1 , wherein the partial regions are associated with the detector elements in such a way that the center of gravity of the partial regions is imaged substantially in the center of the detector elements.
8. The method according to claim 1 , wherein the samples and patterns of the second illumination are moved relative to one another for recording an image with enhanced resolution, and different partial regions are accordingly scanned in the sample, and the fluorescent light emitted by these partial regions is detected.
9. The method according to claim 1 , further comprising measuring said second illumination of region A being carried out without a pattern, and detecting fluorescence excited by the first illumination in a spatially resolved manner.
10. The method according to claim 9 , wherein the image obtained by said measuring step is applied to the image recorded with enhanced resolution in order to achieve a reduction in the background signal in the image with enhanced resolution.
11. The method according to claim 1 , wherein said region extends in a line-shaped manner.
12. The method according to claim 11 , wherein the extension perpendicular to the line is diffraction-limited.
13. The method according to claim 1 , wherein the second illumination has a patterned light distribution which comprises a periodic pattern along the direction of the illumination line and at least two laterally and/or axially limiting outer lines.
14. The method according to claim 1 , wherein the fluorescent light which is excited outside the focus is suppressed by a variably adjustable slit diaphragm in front of the detector elements.
15. The method according to claim 1 , wherein said region is formed of a plurality of line-shaped sub-regions which are spatially separated from one another.
16. The method according to claim 1 , wherein the fluorescent light which is excited outside the focus is suppressed in an adjustable manner by a variable selection and a variable combination of detector elements.
17. Method for operating a fluorescence microscope, wherein a structured illumination of the sample is carried out, comprising a first detecting of luminescing sample points, spatially offsetting of the illumination distribution on the sample, a second detecting of luminescing sample points, and determining and storing the position of the detected sample points on a compiled sample image from the values of the spatial offset.
18. An arrangement for collimated microscopic imaging comprising at least two light sources for respectively at least a first illumination and second illumination of a sample, means for generating a patterned light distribution on said sample, at least one detector which is spatially resolving in at least one direction and has a plurality of detector elements, wherein fluorescence is excited by a patterned or spatially structured light distribution in at least N partial regions of said sample which are separated from one another, and wherein said partial regions are imaged on the detector in such a way that a definitive association of partial regions and detector elements is carried out.
19. The arrangement according to claim 18 , wherein said pattern is moved by moving a beam-deflecting element in the illumination beam path and/or the sample is moved by a scanning table, and wherein a detection of the fluorescent light emitted by the sample is carried out so as to be synchronized with said movement.
20. The arrangement according to claim 18 , wherein a patterned or spatially structured second illumination is superimposed with an unpatterned first illumination in the sample.
21. The arrangement according to claim 18 , wherein said association of partial regions and detector elements can be adjusted by means of an optical zoom and by tilting a transparent, plane-parallel plate inserted in the illumination beam path and/or detection beam path.
22. The arrangement according to claim 18 , wherein said illumination is line-shaped.
23. The arrangement according to claim 18 , wherein the pupil of the illumination beam path is completely filled in one spatial direction.
24. The arrangement according to claim 18 , wherein the patterned or spatially structured second illumination is split, wherein one part generates a line-shaped, periodically patterned light distribution in the samples and another part forms double lines which limit the periodic light distribution axially and/or laterally.
25. The arrangement according to claim 18 , further comprising phase masks are provided in the illumination beam path for generating the limiting double lines, which phase masks have a phase jump in their center and/or in a symmetrical edge area.
26. The arrangement according to claim 18 , further comprising an optical grating for at least partial splitting of the partial beams of the second illumination, wherein the splitting is carried out by the zeroth and +/− first diffraction order of the grating.
27. The arrangement according to claim 26 , wherein said optical grating is designed so as to be variable perpendicular to the structuring direction in frequency and/or in the magnitude of the phase jump so that the direction and/or the intensity of the diffraction orders can be adjusted by translation of the grating.
28. The arrangement according to claim 25 , wherein said phase masks are arranged after the zeroth diffraction order of the grating.
29. The arrangement according to claim 25 , wherein said phase masks have a phase jump in their center or in a symmetrical edge area.
30. The arrangement according to claim 25 , wherein said phase masks are designed so as to be variable in position and/or in the magnitude of the phase jump in a direction perpendicular to the line-shaped illumination so that different characteristics of the influencing of the light can be adjusted by translation of the phase masks.
31. The arrangement according to claim 18 , wherein the axially and laterally limiting double lines and the periodically patterned light distribution overlap one another incoherently in the sample.
32. The arrangement according to claim 18 , wherein the incoherence of the overlapping is affected by polarization orthogonal to one another or by different wavelengths or by a retardation of the overlapping partial beams.
33. The arrangement according to claim 18 , wherein the spatially resolving detector is a row detector in front of which is arranged a variable slit diaphragm.
34. The arrangement according to claim 18 , wherein an illumination is provided in parallel with a plurality of lines and detection by a spatially resolving, planar detector.
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE102006047912A DE102006047912A1 (en) | 2006-10-06 | 2006-10-06 | Method and device for parallelized microscopic imaging |
DE102006047912.2 | 2006-10-06 | ||
PCT/EP2007/008556 WO2008043460A1 (en) | 2006-10-06 | 2007-10-02 | Method and arrangement for collimated microscopic imaging |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/EP2007/008556 A-371-Of-International WO2008043460A1 (en) | 2006-10-06 | 2007-10-02 | Method and arrangement for collimated microscopic imaging |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/042,137 Continuation US8207510B2 (en) | 2006-10-06 | 2011-03-07 | Method and arrangement for collimated microscopic imaging |
Publications (1)
Publication Number | Publication Date |
---|---|
US20090250632A1 true US20090250632A1 (en) | 2009-10-08 |
Family
ID=38963139
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/444,290 Abandoned US20090250632A1 (en) | 2006-10-06 | 2007-10-02 | Method and Arrangement for Collimated Microscopic Imaging |
US13/042,137 Active US8207510B2 (en) | 2006-10-06 | 2011-03-07 | Method and arrangement for collimated microscopic imaging |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/042,137 Active US8207510B2 (en) | 2006-10-06 | 2011-03-07 | Method and arrangement for collimated microscopic imaging |
Country Status (5)
Country | Link |
---|---|
US (2) | US20090250632A1 (en) |
EP (1) | EP2102695B1 (en) |
JP (1) | JP2010506203A (en) |
DE (1) | DE102006047912A1 (en) |
WO (1) | WO2008043460A1 (en) |
Cited By (26)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2013114265A (en) * | 2011-11-28 | 2013-06-10 | Leica Microsystems Cms Gmbh | Microscope illumination system and method |
US8704196B2 (en) | 2008-11-03 | 2014-04-22 | Carl Zeiss Microscopy Gmbh | Combination microscopy |
US20140320957A1 (en) * | 2012-01-18 | 2014-10-30 | Nikon Corporation | Structured illuminating apparatus, structured illuminating microscopy apparatus, and structured illuminating method |
US20150053872A1 (en) * | 2008-10-21 | 2015-02-26 | Chemometec A/S | Apparatus and methods for analysing fluorescent particles |
US9024279B2 (en) | 2010-04-22 | 2015-05-05 | Max-Planck-Gesellschaft Zur Foerderung Der Wissenschaften E.V. | Determining the distribution of a substance by scanning with a measuring front |
US20150253559A1 (en) * | 2012-09-11 | 2015-09-10 | Carl Zeiss Microscopy Gmbh | Optical arrangement and light microscope |
US20160305883A1 (en) * | 2014-09-29 | 2016-10-20 | Howard Hughes Medical Institute | Non-linear structured illumination microscopy |
US20170038572A1 (en) * | 2013-12-09 | 2017-02-09 | Nikon Corporation | Optical apparatus, measuring apparatus, measuring method, screening apparatus, and screening method |
US10051240B2 (en) | 2010-06-14 | 2018-08-14 | Howard Hughes Medical Institute | Structured plane illumination microscopy |
US10393661B2 (en) | 2014-04-25 | 2019-08-27 | Nikon Corporation | Structured illumination microscopic device and structured illumination observation method |
US10509217B2 (en) | 2010-06-14 | 2019-12-17 | Howard Hughes Medical Institute | Bessel beam plane illumination microscope |
US10795144B2 (en) | 2014-12-06 | 2020-10-06 | Howard Hughes Medical Institute | Microscopy with structured plane illumination and point accumulation for imaging and nanoscale topography |
US10831012B2 (en) | 2018-06-29 | 2020-11-10 | Illumina, Inc. | Predicting structured illumination parameters |
CN112260053A (en) * | 2020-10-23 | 2021-01-22 | 长春理工大学 | High-efficiency stacked-array semiconductor laser |
US10901202B2 (en) | 2018-09-19 | 2021-01-26 | Illumina, Inc. | Structured illumination of a sample |
US10908088B2 (en) | 2016-05-30 | 2021-02-02 | The Trustees Of Columbia University In The City Of New York | SCAPE microscopy with phase modulating element and image reconstruction |
US10928322B2 (en) | 2018-01-24 | 2021-02-23 | Illumina, Inc. | Structured illumination microscopy with line scanning |
US10955652B2 (en) * | 2016-09-30 | 2021-03-23 | The Trustees Of Columbia University In The City Of New York | Three-dimensional imaging using swept, confocally aligned planar excitation with a Powell lens and/or deliberate misalignment |
US10955349B2 (en) * | 2016-11-02 | 2021-03-23 | Nikon Corporation | Fluorescence observation device |
US10996453B2 (en) | 2018-01-16 | 2021-05-04 | Illumina, Inc. | Pattern angle spatial selection structured illumination imaging |
US11150455B2 (en) | 2018-01-24 | 2021-10-19 | Illumina, Inc. | Reduced dimensionality structured illumination microscopy with patterned arrays of nanowells |
US11226475B2 (en) | 2018-01-16 | 2022-01-18 | Illumina, Inc. | Dual optical grating slide structured illumination imaging |
WO2022111602A1 (en) * | 2020-11-27 | 2022-06-02 | 浙江大学 | Super-resolution microscopic imaging method and apparatus based on shared-path parallel fluorescence emission difference |
US11585757B2 (en) | 2018-06-14 | 2023-02-21 | Illumina, Inc. | Device for luminescent imaging |
US11675175B2 (en) | 2018-01-16 | 2023-06-13 | Illumina, Inc. | Multi-arm structured illumination imaging |
US11953464B2 (en) | 2018-01-08 | 2024-04-09 | Illumina, Inc. | Semiconductor-based biosensors for base calling |
Families Citing this family (21)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102008024954A1 (en) * | 2008-05-23 | 2009-11-26 | Carl Zeiss Microlmaging Gmbh | Microscope with an optical arrangement for structuring the illumination light |
DE102008049886B4 (en) | 2008-09-30 | 2021-11-04 | Carl Zeiss Microscopy Gmbh | Device, in particular a microscope, for examining samples |
JP2012515930A (en) * | 2009-01-26 | 2012-07-12 | ザ ジェネラル ホスピタル コーポレーション | System, method and computer-accessible medium for providing a wide-field super-resolution microscope |
DE102009060793A1 (en) * | 2009-12-22 | 2011-07-28 | Carl Zeiss Microlmaging GmbH, 07745 | High-resolution microscope and method for two- or three-dimensional position determination of objects |
US9335181B2 (en) | 2010-11-10 | 2016-05-10 | Qualcomm Incorporated | Haptic based personal navigation |
DE102011013614A1 (en) * | 2011-03-08 | 2012-09-13 | Carl Zeiss Microimaging Gmbh | Laser scanning microscope and method of its operation |
DE102011100507B4 (en) * | 2011-04-29 | 2020-05-14 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Portable optical analyzer |
US9664614B2 (en) | 2011-07-11 | 2017-05-30 | University Of Limerick | Method for high resolution sum-frequency generation and infrared microscopy |
US20130250088A1 (en) * | 2012-03-22 | 2013-09-26 | Molecular Devices, Llc | Multi-color confocal microscope and imaging methods |
EP2898312B1 (en) * | 2012-09-24 | 2021-03-24 | Global Life Sciences Solutions USA LLC | Methods for resolving positions in fluorescence stochastic microscopy using three-dimensional structured illumination. |
US9897536B2 (en) | 2013-01-04 | 2018-02-20 | University Of Limerick | Differential infra red nanoscopy system and method |
DE102013100172A1 (en) * | 2013-01-09 | 2014-07-10 | MAX-PLANCK-Gesellschaft zur Förderung der Wissenschaften e.V. | A method for spatially high resolution imaging of a luminophor structure of a sample |
EP2801854B1 (en) * | 2013-05-10 | 2017-07-19 | Ruprecht-Karls-Universität Heidelberg | Method and apparatus for combination of localization microscopy and structured illumination microscopy |
DE102013227107A1 (en) * | 2013-09-03 | 2015-03-05 | Leica Microsystems Cms Gmbh | Microscope with an element for changing the shape of the illumination light focus |
DE102013015933A1 (en) * | 2013-09-19 | 2015-03-19 | Carl Zeiss Microscopy Gmbh | High-resolution scanning microscopy |
DE102013114860B3 (en) * | 2013-12-23 | 2015-05-28 | MAX-PLANCK-Gesellschaft zur Förderung der Wissenschaften e.V. | Method and device for determining the locations of individual molecules of a substance in a sample |
LU93117B1 (en) * | 2016-06-23 | 2018-01-24 | Leica Microsystems | Lighting device for a microscope |
DE102017011843A1 (en) | 2017-12-21 | 2019-06-27 | Horst Wochnowski | Initialization of chemical, physico-chemical, and / or physical reactions by means of a started and unfinished STED process with a local resolution below the classical optical resolution limit with applications from biochemistry |
CN109375358B (en) * | 2018-11-28 | 2020-07-24 | 南京理工大学 | Differential phase contrast quantitative phase microscopic imaging method based on optimal illumination mode design |
DE102019110160B4 (en) * | 2019-04-17 | 2023-07-27 | Leica Microsystems Cms Gmbh | Fluorescence microscope and method of imaging a sample |
DE102021005684A1 (en) | 2021-11-16 | 2023-05-17 | Jörn Volkher Wochnowski | STED method with hollow fiber optic cables |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20010045523A1 (en) * | 1994-07-15 | 2001-11-29 | Baer Stephen C. | Superresolution in microlithography and fluorescence microscopy |
US20020141052A1 (en) * | 2000-08-21 | 2002-10-03 | Olympus Optical Co., Ltd. | Optical device and a microscope |
US20040095576A1 (en) * | 2002-11-15 | 2004-05-20 | Carl Zeiss Jena Gmbh | Method and arrangement for deeply resolved optical detection of a sample |
Family Cites Families (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPS61163314A (en) * | 1985-01-04 | 1986-07-24 | ユナイテッド キングドム アトミック エナ↓−ヂイ オ↓−ソリテイ | Scan microscope |
JPH09280954A (en) * | 1996-04-17 | 1997-10-31 | Nikon Corp | Object inspecting instrument |
JP3616999B2 (en) * | 2001-12-04 | 2005-02-02 | レーザーテック株式会社 | Confocal microscope |
JP4086182B2 (en) * | 2002-10-09 | 2008-05-14 | オリンパス株式会社 | Spectroscope, confocal optical system using the same, and scanning optical microscope |
DE10257120B4 (en) * | 2002-12-05 | 2020-01-16 | Leica Microsystems Cms Gmbh | Scanning microscope for imaging an object |
JP2004239660A (en) * | 2003-02-04 | 2004-08-26 | Japan Science & Technology Agency | Microscope |
JP4635145B2 (en) * | 2004-03-17 | 2011-02-16 | レーザーテック株式会社 | Confocal microscope and film thickness measuring device |
JP2005266705A (en) * | 2004-03-22 | 2005-09-29 | Japan Science & Technology Agency | Super-resolution microscope |
DE102004034996A1 (en) * | 2004-07-16 | 2006-02-02 | Carl Zeiss Jena Gmbh | Scanning microscope with linear scan |
DE102004034991A1 (en) | 2004-07-16 | 2006-02-02 | Carl Zeiss Jena Gmbh | Zoom optics for a light scanning microscope |
DE102004034960A1 (en) | 2004-07-16 | 2006-02-02 | Carl Zeiss Jena Gmbh | Correction device for an optical arrangement and confocal microscope with such a device |
DE102004034962A1 (en) | 2004-07-16 | 2006-02-16 | Carl Zeiss Jena Gmbh | Microscope with increased resolution |
DE502006004676D1 (en) * | 2005-07-22 | 2009-10-08 | Zeiss Carl Microimaging Gmbh | RESOLUTION-INCREASED LUMINESCENCE MICROSCOPY |
-
2006
- 2006-10-06 DE DE102006047912A patent/DE102006047912A1/en not_active Ceased
-
2007
- 2007-10-02 US US12/444,290 patent/US20090250632A1/en not_active Abandoned
- 2007-10-02 EP EP20070818636 patent/EP2102695B1/en active Active
- 2007-10-02 WO PCT/EP2007/008556 patent/WO2008043460A1/en active Application Filing
- 2007-10-02 JP JP2009530795A patent/JP2010506203A/en active Pending
-
2011
- 2011-03-07 US US13/042,137 patent/US8207510B2/en active Active
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20010045523A1 (en) * | 1994-07-15 | 2001-11-29 | Baer Stephen C. | Superresolution in microlithography and fluorescence microscopy |
US20020141052A1 (en) * | 2000-08-21 | 2002-10-03 | Olympus Optical Co., Ltd. | Optical device and a microscope |
US20040095576A1 (en) * | 2002-11-15 | 2004-05-20 | Carl Zeiss Jena Gmbh | Method and arrangement for deeply resolved optical detection of a sample |
Cited By (41)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10254223B2 (en) | 2008-10-21 | 2019-04-09 | Chemometec A/S | Apparatus and methods for analysing fluorescent particles |
US9903819B2 (en) * | 2008-10-21 | 2018-02-27 | Chemometec A/S | Apparatus and methods for analysing fluorescent particles |
US20150053872A1 (en) * | 2008-10-21 | 2015-02-26 | Chemometec A/S | Apparatus and methods for analysing fluorescent particles |
US8704196B2 (en) | 2008-11-03 | 2014-04-22 | Carl Zeiss Microscopy Gmbh | Combination microscopy |
US9024279B2 (en) | 2010-04-22 | 2015-05-05 | Max-Planck-Gesellschaft Zur Foerderung Der Wissenschaften E.V. | Determining the distribution of a substance by scanning with a measuring front |
US10721441B2 (en) | 2010-06-14 | 2020-07-21 | Howard Hughes Medical Institute | Structured plane illumination microscopy |
US10509217B2 (en) | 2010-06-14 | 2019-12-17 | Howard Hughes Medical Institute | Bessel beam plane illumination microscope |
US10051240B2 (en) | 2010-06-14 | 2018-08-14 | Howard Hughes Medical Institute | Structured plane illumination microscopy |
JP2013114265A (en) * | 2011-11-28 | 2013-06-10 | Leica Microsystems Cms Gmbh | Microscope illumination system and method |
US10802259B2 (en) * | 2012-01-18 | 2020-10-13 | Nikon Corporation | Structured illuminating apparatus, structured illuminating microscopy apparatus, and structured illuminating method |
US20140320957A1 (en) * | 2012-01-18 | 2014-10-30 | Nikon Corporation | Structured illuminating apparatus, structured illuminating microscopy apparatus, and structured illuminating method |
US10222599B2 (en) * | 2012-01-18 | 2019-03-05 | Nikon Corporation | Structured illuminating apparatus, structured illuminating microscopy apparatus, and structured illuminating method |
US20190146201A1 (en) * | 2012-01-18 | 2019-05-16 | Nikon Corporation | Structured illuminating apparatus, structured illuminating microscopy apparatus, and structured illuminating method |
US10133046B2 (en) * | 2012-09-11 | 2018-11-20 | Carl Zeiss Microscopy Gmbh | Optical arrangement and light microscope |
US20150253559A1 (en) * | 2012-09-11 | 2015-09-10 | Carl Zeiss Microscopy Gmbh | Optical arrangement and light microscope |
DE102012017922B4 (en) | 2012-09-11 | 2024-03-14 | Carl Zeiss Microscopy Gmbh | Optical arrangement and light microscope |
US20170038572A1 (en) * | 2013-12-09 | 2017-02-09 | Nikon Corporation | Optical apparatus, measuring apparatus, measuring method, screening apparatus, and screening method |
US10656401B2 (en) * | 2013-12-09 | 2020-05-19 | Nikon Corporation | Optical apparatus, measuring apparatus, measuring method, screening apparatus, and screening method |
US10393661B2 (en) | 2014-04-25 | 2019-08-27 | Nikon Corporation | Structured illumination microscopic device and structured illumination observation method |
US20160305883A1 (en) * | 2014-09-29 | 2016-10-20 | Howard Hughes Medical Institute | Non-linear structured illumination microscopy |
US10247672B2 (en) * | 2014-09-29 | 2019-04-02 | Howard Hughes Medical Institute | Non-linear structured illumination microscopy |
US10795144B2 (en) | 2014-12-06 | 2020-10-06 | Howard Hughes Medical Institute | Microscopy with structured plane illumination and point accumulation for imaging and nanoscale topography |
US10908088B2 (en) | 2016-05-30 | 2021-02-02 | The Trustees Of Columbia University In The City Of New York | SCAPE microscopy with phase modulating element and image reconstruction |
US10955652B2 (en) * | 2016-09-30 | 2021-03-23 | The Trustees Of Columbia University In The City Of New York | Three-dimensional imaging using swept, confocally aligned planar excitation with a Powell lens and/or deliberate misalignment |
US10955349B2 (en) * | 2016-11-02 | 2021-03-23 | Nikon Corporation | Fluorescence observation device |
US11953464B2 (en) | 2018-01-08 | 2024-04-09 | Illumina, Inc. | Semiconductor-based biosensors for base calling |
US11226475B2 (en) | 2018-01-16 | 2022-01-18 | Illumina, Inc. | Dual optical grating slide structured illumination imaging |
US11675175B2 (en) | 2018-01-16 | 2023-06-13 | Illumina, Inc. | Multi-arm structured illumination imaging |
US10996453B2 (en) | 2018-01-16 | 2021-05-04 | Illumina, Inc. | Pattern angle spatial selection structured illumination imaging |
US11650156B2 (en) | 2018-01-24 | 2023-05-16 | Illumina, Inc. | Reduced dimensionality structured illumination microscopy with patterned arrays of nanowells |
US11150455B2 (en) | 2018-01-24 | 2021-10-19 | Illumina, Inc. | Reduced dimensionality structured illumination microscopy with patterned arrays of nanowells |
US11933728B2 (en) | 2018-01-24 | 2024-03-19 | Illumina, Inc. | Reduced dimensionality structured illumination microscopy with patterned arrays of nanowells |
US10928322B2 (en) | 2018-01-24 | 2021-02-23 | Illumina, Inc. | Structured illumination microscopy with line scanning |
US11585757B2 (en) | 2018-06-14 | 2023-02-21 | Illumina, Inc. | Device for luminescent imaging |
US11119302B2 (en) | 2018-06-29 | 2021-09-14 | Illumina, Inc. | Predicting structured illumination parameters |
US11525993B2 (en) | 2018-06-29 | 2022-12-13 | Illumina, Inc. | Predicting structured illumination parameters |
US10831012B2 (en) | 2018-06-29 | 2020-11-10 | Illumina, Inc. | Predicting structured illumination parameters |
US11604346B2 (en) | 2018-09-19 | 2023-03-14 | Illumina, Inc. | Structured illumination of a sample |
US10901202B2 (en) | 2018-09-19 | 2021-01-26 | Illumina, Inc. | Structured illumination of a sample |
CN112260053A (en) * | 2020-10-23 | 2021-01-22 | 长春理工大学 | High-efficiency stacked-array semiconductor laser |
WO2022111602A1 (en) * | 2020-11-27 | 2022-06-02 | 浙江大学 | Super-resolution microscopic imaging method and apparatus based on shared-path parallel fluorescence emission difference |
Also Published As
Publication number | Publication date |
---|---|
JP2010506203A (en) | 2010-02-25 |
DE102006047912A1 (en) | 2008-04-10 |
US20110215258A1 (en) | 2011-09-08 |
EP2102695B1 (en) | 2013-03-27 |
WO2008043460A1 (en) | 2008-04-17 |
EP2102695A1 (en) | 2009-09-23 |
US8207510B2 (en) | 2012-06-26 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8207510B2 (en) | Method and arrangement for collimated microscopic imaging | |
Vangindertael et al. | An introduction to optical super-resolution microscopy for the adventurous biologist | |
JP6039760B2 (en) | Apparatus and method for imaging a sample structure spatially with high resolution | |
EP3055674B1 (en) | Method of imaging a sample | |
JP5485352B2 (en) | Luminescence microscopy with increased resolution | |
JP4723806B2 (en) | Confocal microscope | |
US8705172B2 (en) | Microscopy method and microscope with enhanced resolution | |
US7679741B2 (en) | Method and microscope for high spatial resolution examination of samples | |
JP6346615B2 (en) | Optical microscope and microscope observation method | |
US7903247B2 (en) | Method and microscope for high spatial resolution examination of samples | |
US7709809B2 (en) | Microscope with higher resolution and method for increasing same | |
US20130010098A1 (en) | High-Resolution Microscope and Method for Determining the Two- or Three-Dimensional Positions of Objects | |
US20140118750A1 (en) | Method and Configuration for Depth Resolved Optical Detection of an Illuminated Specimen | |
CA2973361A1 (en) | Multichannel line scan sted microscopy, method and device | |
JP2007233370A (en) | Method and microscope for high spatial resolution examination of sample | |
JP7350936B2 (en) | High-throughput hyperspectral imaging system | |
US20140339439A1 (en) | Method for High-Resolution 3D Localization Microscopy | |
US9507137B2 (en) | Microscope with structured illumination using displaceable grid structures | |
JP2007506146A (en) | Confocal laser scanning microscope | |
WO2020087998A1 (en) | Lattice light sheet microscope and method for tiling lattice light sheet in lattice light sheet microscope | |
US20220382031A1 (en) | Random access projection microscopy | |
JP2022500704A (en) | Methods and equipment for scanning samples | |
EP4220269A1 (en) | Light imaging device | |
Wurm et al. | STED Nanoscopy |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: CARL ZEISS MICROIMAGING GMBH, GERMANY Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:KEMPE, MICHAEL;KRAMPERT, GERHARD;WALD, MATTHIAS;AND OTHERS;REEL/FRAME:022954/0963;SIGNING DATES FROM 20090403 TO 20090420 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |