EP1278452A1 - Non-invasive measurement of blood components using retinal imaging - Google Patents

Non-invasive measurement of blood components using retinal imaging

Info

Publication number
EP1278452A1
EP1278452A1 EP00926006A EP00926006A EP1278452A1 EP 1278452 A1 EP1278452 A1 EP 1278452A1 EP 00926006 A EP00926006 A EP 00926006A EP 00926006 A EP00926006 A EP 00926006A EP 1278452 A1 EP1278452 A1 EP 1278452A1
Authority
EP
European Patent Office
Prior art keywords
light
fundus
wavelengths
image
eye
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP00926006A
Other languages
German (de)
French (fr)
Other versions
EP1278452A4 (en
Inventor
Mark J. Rice
Robert H. Sweat, Jr.
James M. Rioux
William T. Williams
Wilson Routt
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fovioptics Inc
Original Assignee
Fovioptics Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fovioptics Inc filed Critical Fovioptics Inc
Publication of EP1278452A1 publication Critical patent/EP1278452A1/en
Publication of EP1278452A4 publication Critical patent/EP1278452A4/en
Withdrawn legal-status Critical Current

Links

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/14Arrangements specially adapted for eye photography
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/12Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for looking at the eye fundus, e.g. ophthalmoscopes
    • A61B3/1241Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for looking at the eye fundus, e.g. ophthalmoscopes specially adapted for observation of ocular blood flow, e.g. by fluorescein angiography
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/145Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue
    • A61B5/14532Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue for measuring glucose, e.g. by tissue impedance measurement
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/145Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue
    • A61B5/14546Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue for measuring analytes not otherwise provided for, e.g. ions, cytochromes
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/145Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue
    • A61B5/1455Measuring characteristics of blood in vivo, e.g. gas concentration, pH value; Measuring characteristics of body fluids or tissues, e.g. interstitial fluid, cerebral tissue using optical sensors, e.g. spectral photometrical oximeters
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/0002Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network
    • A61B5/0004Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network characterised by the type of physiological signal transmitted
    • A61B5/0013Medical image data

Definitions

  • Fig. 9 is a graph of the intensity of light at 550 nm reflected from the retina showing the effect of single pulse illumination at 470 nm.
  • Fig. 1 illustrates a blood analysis 5 apparatus of the invention in conjunction with the eye of the patient, shown illustratively at 10 in Fig. 1.
  • the blood analysis apparatus includes an optics system 11 comprised of lenses for projecting illuminating light onto the fundus, generally although not necessarily directly through the pupil, and for receiving the light reflected from the fundus passed out through the pupil, and for focusing that
  • Fig. 3 illustrates a hand-held camera and illumination unit 25 for the analysis system of the invention in which the optic system 11 is mounted
  • Fig. 4 illustrates the output viewing system 14 at the back end of the hand-held unit 25 to enable the operator to review the image being obtained of the retina on a real-time basis.
  • a disposable transparent plastic e.g. polyethylene, polystyrene, polypropylene, etc.
  • Eye infections are particularly common in newborns and a cover would assist in the prevention of these infections.

Abstract

Illuminating light (12) of selected wavelengths in the visible or infrared range is projected through the pupil of the eye (10) onto the fundus. The light reflected back, out through the pupil is detected (22), and analyzed, preferably using the area of the optic disk for analyzing the retinal vessels overlying the optic disk. Specific wavelengths of illuminating light may be chosen for each blood component to be analyzed depending on the spectral characteristics of the substance being analyzed. The reflected image from the retina may be used to measure non-photo-reactive blood components such as hemoglobin, and photo-reactive components such as bilirubin. For the measurement of photo-reactive components, images may be taken before, and after, or during, illumination of the eye with light at wavelengths which will affect the photo-reactive analyte, enabling measurements of the concentration of the analyte.

Description

NON-INVASIVE MEASUREMENT OF BLOOD COMPONENTS
USING RETINAL IMAGING
FIELD OF THE INVENTION
This invention pertains to the field of non-invasive in vivo measurement of blood components such as glucose, hemoglobin, and bilirubin.
BACKGROUND OF THE INVENTION
The measurement of the concentration of blood components such as hemoglobin and glucose has required the drawing of a blood sample for in vitro analysis. The need to draw blood for analysis is undesirable for several reasons, including discomfort to the patient, the time required of medical personnel to draw and handle the samples, and the potential risk of spread of disease through punctures of the skin. Repeated drawing of blood samples is especially undesirable in infants. Many diabetics must test their blood up to six times a day to monitor their blood glucose levels. It would thus be desirable to be able to obtain fast and reliable estimates of the concentration of blood components in blood, such as hemoglobin and glucose, through a simple and non-invasive technique. Prior efforts have involved an examination of blood in the skin or extremities, such as fingers and ear lobes, or in observable surface blood vessels, but these efforts have had limited practical success due to the presence of tissue components that interfere with accurate reading of only the concentration of blood components.
There are approximately four million newborns in the United States alone each year. About 50% of newborns are clinically jaundiced from elevated bilirubin levels. If the serum bilirubin reaches very high levels during the post-natal period, kernicterus, neural damage resulting from sustained high levels of serum bilirubin, may occur. Frequent monitoring of serum bilirubin is critical to the care of these infants. Of the newborns that have recognizable jaundice during the first 5 days of life, 1.7 million receive at least one blood test for bilirubin. Of those tested, about 700,000 undergo phototherapy treatment; these infants receive an estimated two to three additional blood tests. Presently, blood is drawn through the heel of the neonate, resulting in occasional infections and other complications. Other drawbacks to this process are its high cost and the delay in lab results reaching the physician. Recently introduced non-invasive devices for measuring bilirubin do not provide the accuracy level required to diagnose or treat elevated serum bilirubin levels, rendering them virtually useless in practice.
SUMMARY OF THE INVENTION
The present invention combines the accuracy of in vitro laboratory testing of blood components and the advantages of rapidly-repeatable non-invasive technology. The invention utilizes a hand-held or stationary instrument for retinal imaging that allows non-invasive measurement of certain blood components in the retinal blood vessels. Illuminating light of selected wavelengths in the visible or infrared range is projected into the eye onto the fundus, and the light reflected back and out (e.g., through the pupil) is detected and analyzed, preferably using the area of the optic disk for analyzing the retinal vessels overlaying the optic disk for most blood components to be measured. Specific wavelengths of illuminating light may be chosen for each blood component to be analyzed depending on the spectral characteristics of the particular substance being analyzed. The reflected image from the retina is utilized to measure blood components, such as hemoglobin, glucose and bilirubin.
The utilization of the retina as a site for obtaining blood component data has several advantages, including the ease of visualizing the data because of the natural window provided by the eye. The reflected light from the fundus at visually significant wavelengths is much less scattered than light reflected from the skin or mucous membranes since the eye is naturally immune to scatter. The retina creates a uniform background for imaging, and the optical devices and techniques required for obtaining retinal images have been extensively developed and studied because of the need for ophthalmologists to image the retina for diagnosis of disease states. In addition, the blood flow to the retina is very even and repeatable even across a number of disease states. For example, although patients in shock have reduced blood flow to the skin and mucous membranes, allowing false data to be obtained with current technology that examines the skin and mucous membranes, the body maintains even blood flow to the retina except in states of extremely low blood pressure. Furthermore, in the present invention, there is no physical contact required between the device and the skin or mucous membranes, thereby eliminating the potential for transmission of infectious agents associated with devices that require patient contact. The device may be rested upon the orbit of the patient for ease of use and, if desired, a disposable plastic cover may be used to further minimize the risk of transmission of infectious agents. Such a cover may be transparent and fully cover the device, or not, depending upon requirements of the imaging system and the need to prevent incidental contact with the device. In accordance with the invention, a hand-held or stationary instrument for retinal imaging may be used to obtain non-invasive measurement of photoreactive analytes, an example of which is serum bilirubin. Illuminating light of selected wavelengths in the visible range is projected into the eye onto the fundus. Specific wavelengths of illuminating light are chosen so that serum bilirubin can be measured. Analysis of the reflected image from the fundus is utilized to measure bilirubin. Although measurement of the reflected light from the vessels overlying the optic disk is preferred, in accordance with the invention, it is also typically possible to obtain bilirubin measurements from light reflected from the fundus generally. During disease states when the serum bilirubin levels are above normal (e.g. , newborn jaundice), bilirubin is extruded from the choroid into the nerve layer of the retina. During newborn jaundice, this nerve layer stains yellow from the elevated bilirubin levels. This yellow color is directly proportional to the elevated serum bilirubin levels and changes rapidly with changes in serum bilirubin. The bilirubin molecule exhibits peak absorption of light at 470 nm. However, when exposed to light at or near this wavelength, the molecule breaks down into optically inactive molecules. The intact bilirubin molecule reflects light at and near a wavelength of approximately 550 nm (yellow light), and is not affected by this light. In the present invention, the retina of the patient's eye may first be imaged with light that does not break down bilirubin, e.g., light at a wavelength of 550 nm with little or no light at 470 nm. The intensity of the reflected light at or near the maximum reflection wavelength of 550 nm is detected. Then the retina is imaged again using light that breaks down bilirubin, e.g. , using light at 470 nm followed by or combined with light at 550 nm, which is projected into the eye. The reflected light at 550 nm that is passed out through the pupil is detected to image the retina a second time. With the addition of light at 470 nm, the bilirubin molecule is rendered optically inactive and will no longer reflect at 550 nm. The difference in the reflected image intensity at 550 nm from the first image to the second image is a function of the bilirubin concentration. A neural network or other processing technique may be used to analyze the two data sets of the images captured by the retinal camera.
Further objects, features and advantages will be apparent from the following detailed description when taken in conjunction with the accompanying drawings.
BRIEF DESCRIPTION OF THE DRAWINGS In the drawings:
Fig. 1 is a schematic diagram of an apparatus for measurement of the concentration of blood components in accordance with the invention.
Fig. 2 is a schematic diagram of a modified form of the apparatus for measurement of blood components in accordance with the invention. Fig. 3 is a schematic side view of a hand-held illumination and camera system that may be utilized in accordance with the invention.
Fig. 4 is an illustrative front view of the illumination and camera system of Fig. 3. Fig. 5 is a schematic diagram of a further apparatus in accordance with the invention that incorporates a communications link to a remote processing system.
Fig. 6 is a simplified schematic diagram of apparatus in accordance 5 with the invention for measuring bilirubin concentration in blood.
Fig. 7 is an illustrative graph of intensity of light at 550 nm reflected from the retina as a function of time, showing the effect of the periodic illumination of the eye at 470 nm.
Fig. 8 is an illustrative graph, similar to Fig. 7, of reflected light 10 intensity over time showing the effect of changes in blood flow in the retinal vessels.
Fig. 9 is a graph of the intensity of light at 550 nm reflected from the retina showing the effect of single pulse illumination at 470 nm.
Fig. 10 is a graph illustrating the correlation between hemoglobin 15 concentration measured in accordance with the invention versus concentration measured by a standard in vitro technique.
Fig. 11 are graphs of light absorption as a function of wavelength for deoxyhemoglobin and oxyhemoglobin.
DETAILED DESCRIPTION OF THE INVENTION
20 The present invention may be used to measure various analytes.
These analytes may be photoreactive or non-photoreactive. Table 1 below summarizes examples of the preferred methodologies in accordance with the invention for the measurement of photoreactive and non-photoreactive analytes. However, it is understood that these are only illustrative of the analytes that may be
25 measured using the present invention.
Device Description
With reference to the drawings, Fig. 1 illustrates a blood analysis 5 apparatus of the invention in conjunction with the eye of the patient, shown illustratively at 10 in Fig. 1. The blood analysis apparatus includes an optics system 11 comprised of lenses for projecting illuminating light onto the fundus, generally although not necessarily directly through the pupil, and for receiving the light reflected from the fundus passed out through the pupil, and for focusing that
10 light to form an image. The lenses preferably include a final lens which can be positioned close to (e.g. , approximately 3 mm from) the cornea of the eye, providing a 10 to 30 degree conical view of the retina to be illuminated and imaged. Such lens systems are of conventional design and are utilized for macroview lens systems in retinal video cameras.
15 An illumination system 12 provides selected illuminating light for viewing and imaging the retina. The illumination system is preferably a monochromatic or multiple discrete wavelength light source that provides light for viewing and imaging the retina. Preferably, the system provides light for viewing and imaging coaxially to reduce the likelihood of extraneous reflections from the
20 interior or exterior of the eye. The light from the illumination system may be projected through the pupil. The frequency content of this light source is selected dependent upon the compound to be analyzed. Illumination light may be composed of two (or more) separate lighting systems, such as a xenon strobe, or multiple laser diodes, for imaging, and a halogen source for viewing. Infrared imaging may be
25 done utilizing a filtered halogen or laser diode source. The light is reflected from the fundus of the eye 10 and passed through the pupil opening of the eye to the optics system 11 and through the illumination system 12, entering, e.g., a charge coupled device (CCD) detector 22. The illumination system 12 may be similar to systems used in existing non-mydriatic fundus cameras, preferably modified to provide a coaxial design for illumination and imaging. A viewing system 14, for example, a liquid crystal display (LCD) screen, may receive the image data and display the image for use by the operator for initially locating the patient's retina, based on an image from the optical system in real time. A coaxial "scene" or visual target may be included in the visual field of the device so that a patient can fixate his or her eye on this scene and reduce eye motion. In addition to reducing eye motion, the location of this visual target will bring the optic disk into the approximate center of the CCD detector. In devices intended for children, the scene may include a visually pleasant object such as a familiar animal. In the currently commercially available video cameras designed for retinal imaging, the LCD (or other display) screen is typically located on a desktop power source that is attached to the hand-held camera by a cable. While such displays may be used in the present invention, the LCD screen (or other display device) is preferably placed on the back of the hand-held camera unit, so that the operator can more easily locate the retina, having the patient's eye and the LCD screen in the same line-of- sight. Current retinal video camera systems that may be modified and utilized in the invention and which include an optics system 11 and an illumination system include the Nidek NM100 Hand-Held Non-Mydriatic Fundus Camera and the Topcon TRC-50EX (TRC-NW5S/TRC-NW5SF) Non-Mydriatic Retinal Camera. The Nidek NM100 camera utilizes a coaxial imaging system with an infrared source, with imaging done through reflected light outside the optical system.
Although the invention may be carried out with a dilated eye pupil, it is preferable that the imaging of the retina be carried out without requiring dilation of the pupil for speed of measurement and patient convenience. The camera preferably includes a shield (not shown) to prevent ambient light from entering the optical system 11 to minimize extraneous reflections and the introduction of optical noise. The optical system 11 also interfaces with a locate and focus system 16, which utilizes feedback from an image capture system 17, also interfaced to the optic system 11, to automatically find and bring the optic disk into focus. A convolver or other pattern recognition software may be utilized to locate the optic disk area by finding the circular pattern of the optic nerve area. After using the pattern recognition information to more precisely locate the optic nerve area in the center of the viewing field, the image may then be magnified using a series of lenses in the optics system 11 such that the optic disk area virtually fills the active area of the CCD (or other detector). The optical system preferably tracks the movement of the fundus while zooming the optics such that the optic disk is centered and occupies most of the optical field of view. The optical system may be formed to track the motion of the fundus through a motor drive system that slightly gimbals the lens system. This motion system is driven and controlled in a closed loop manner utilizing the feedback of the pattern recognition software. The image capture system 17 is selectively controlled by the operator and uses feature and pattern recognition to drive the locate and auto focus system 16 to capture and store an appropriate image for analysis. Image capture itself is analogous to the function provided by a "digital still camera." The image capture system may utilize feature and pattern recognition to drive the locate and focus system to capture and store an appropriate image for analysis. Commercially available pattern recognition software may be used. Actual imaging is preferably timed based on the patient's blood flow, which is preferably sensed from blood vessels through the patient's skin around the ocular structure through a systolic sensing system 13. The light reflected from the retina is preferably detected and an ύnage formed at the time of systole, thus ensuring the maximum blood flow in the vasculature of the retina. Detection of the patient's systolic state can be made through any commonly known means such as commercially available blood pressure transducers. An image analysis system 18 is interfaced with the image capture system 17 to analyze the light reflected from the retina to quantitatively determine the amount of the particular target analyte compound present. The results may be displayed to the operator via the output system 20. This system presents results as well as any feedback associated with the acquisition of the data, and may include an LCD display screen or other display devices.
A modified imaging methodology as shown in Fig. 2 may also be used wherein an imaging device 21 functions in a scanning mode (which may be similar to that utilized in common video cameras) to provide multiple images of the retina to the image capture system 17. The image recognition system 15 then acts to select a valid image from the series of images stored by the image capture system 17. Once selection of an appropriate image is made, calculation of the magnitude of the desired analyte proceeds using the image analysis system 18 as before. Image validity is based on focus, closeness to center of the fundus, and obliqueness of the fundus in the image.
Fig. 3 illustrates a hand-held camera and illumination unit 25 for the analysis system of the invention in which the optic system 11 is mounted, and Fig. 4 illustrates the output viewing system 14 at the back end of the hand-held unit 25 to enable the operator to review the image being obtained of the retina on a real-time basis. If desired, a disposable transparent plastic (e.g. polyethylene, polystyrene, polypropylene, etc.), which is selected to transmit light in the wavelengths required, may be used to cover the unit 25 during use and then disposed of to minimize the risk of transmission of infection. Eye infections are particularly common in newborns and a cover would assist in the prevention of these infections.
Furthermore, the cover may include a soft portion (e.g. foam) that comes into contact with the skin around the orbit. This makes the cover comfortable and, in addition, prevents ambient light from entering into the camera lens during measurements. Currently available CCD detectors may not be sensitive to wavelengths longer than approximately 1000 nm. In measuring analytes requiring the sensing of these longer wavelengths, an alternative approach may be used. The illumination source may instead scan across the area of interest on the retina, with the reflected beam being read by a single sensor (or a small multiplicity of sensors) that are sensitive in the infrared (IR) wavelengths above normal CCD sensitivity. This method may be used to digitally reconstruct the retinal image if desired. As illustrated in Fig. 5, image processing and analysis may take place at a location remote from the clinical setting by using a wired or wireless internet link (or dedicated communication link) to transfer data from the image capture system 17 to a central computer at a remote location (i.e. , anywhere in the world linked by the internet) at which the image analysis system 18 is implemented. The output data from the output system 20 may be transferred back through an access link 29 to the viewing system 14 at the clinic (or to another location, as desired).
Non-Photoreactive Analyte (Hemoglobin) Measurement In one implementation of the device for the detection of hemoglobin using multiple beam splitters, the image of the optic disk returning from the eye may be split into three simultaneous and equal images. Each image is then passed through a filter with the preferred wavelengths for the images of 640, 766 and 800 nm. Different wavelengths of light are used for the analysis of other substances such as glucose. Although these preferred wavelengths will yield accurate measurement of hemoglobin, other wavelengths in the visible or near IR may also be used effectively by this invention for hemoglobin.
To obtain accurate measurements of hemoglobin concentration without having to account for different levels of oxygen saturation, the measurement of hemoglobin may be carried out in the present invention using wavelengths of light at which the extinction coefficients for oxyhemoglobin and deoxyhemoglobin match. Thus, the total absorption of energy at that wavelength will be proportional to the total hemoglobin. Examples of such wavelengths are 550 nm and 800 nm. Absorption curves for oxyhemoglobin (HbO2) and deoxyhemoglobin (Hb) as a function of illumination wavelength are shown in Fig. 11. As illustrated therein, the absorption curves are closely matched in the wavelength range from about 380 nm to 580 nm, and particularly from about 530 nm to 580 nm, allowing most (or all) wavelengths in these ranges to be used.
The areas that are preferably used for analysis are the retinal arteries and veins overlaying the optic disk. Previous work by Hickam et al. suggested that when the optic disk is illuminated with light directed toward the fundus, the optic disk acts as a light source directing the light back through the retinal vessels that lay over the disk. See, John B. Hickam, et al. , "A Study of Retinal Venous Blood Oxygen Saturation in Human Subjects by Photographic Means," Circulation, Vol. XXVII, March, 1963, pp. 375-385. Hickam, et al. believed that these vessels then functioned as cuvettes, filled with blood, that could be analyzed by the spectral pattern that is measured from the light passing through these vessels and emitted out through the pupil. In actuality, light does not pass through these vessels and reflect off the optic disk and then pass through these vessels again as suggested in Hickam, et al. Instead, light reflects directly off the surfaces of these vessels and the blood components within these vessels. In the present invention, the retinal arteries are the sub-target areas that are analyzed by measuring the amplitude of the signal at each selected wavelength. This is done by determining the effective reflected image intensity of the pixels for the sub-target areas corresponding to the arteries at each selected wavelength. Within the sub-target area, the peak concentration of blood is determined by viewing the peak absorption at each measured wavelength. The sub- target area is then normalized by this peak and then may be averaged using any common digital averaging technique, such as a convolver. Within the sub-target area, a histogram is created to represent different signal levels after averaging. These data comprised of histogram values and values representing the rate of change in local intensity are then the direct input into an analysis program, e.g., a neural network, for analysis. A computer implemented neural network is preferably utilized to analyze the pixel data for comparison to known blood concentrations. A preferred type of neural network is Back Propagation.
The effect of differences in illumination from one retinal image to another is preferably neutralized by comparing the background illumination of the optic disk to the vessel illumination and "zeroing" for differences in illumination. This allows the input from the sub-target areas to be consistent from patient to patient and camera to camera.
Although the present invention is well suited to be carried out on a "real time" basis with the apparatus of Figs. 1 and 2 as described above, it may be implemented using photographic fundus images which are scanned and processed. As an example of the present invention using photographic images, a group of individuals was tested to measure hemoglobin levels utilizing the present invention. A standard in vitro test was also performed on a sample of blood drawn from each individual. The clinical data were obtained as follows. Each ophthalmologist in the clinic agreed to refer for study patients that already had their eyes dilated. A physician asked the patient if they would agree to have their eyes photographed and to allow blood to be obtained for a hemoglobin test. An informed consent document was signed by each patient. A retinal photographer with the clinic took all of the retinal photographs. The slide film used was Kodachrome 64 Select, 24 exposures per roll. The photographer took photos of each eye, with the fovea centered in the picture. The exact same conditions were used for each photograph including aperture, shutter speed, and illumination. A code was given for each patient to insure confidentiality and to allow accurate tracking of each patient. The code appeared on each photograph and the same code appeared on the blood tube. A licensed phlebotomist obtained antecubital blood samples from each patient. These samples were drawn with vacutainers into purple-top tubes for later analysis. The tubes were stored cold and run the same evening. Following the analysis, the blood tubes were saved if later analysis were required. The blood samples were analyzed for hemoglobin content with a HemoCue® B-Hemoglobin Analyzer. The machine was calibrated with calibration slides. This device is CLIA certified and the technician who analyzed the samples was also CLIA certified. Each sample was run three times on the machine to ensure accurate results. These results were recorded along with the patient's ID code. Kodachrome 64 Select Slide Film was used for each retinal photograph. The film was sent to Kodak for processing. The Kodak development lab used the same lot of chemicals for all of the slides. The developed slides were then scanned into a digital format (jpeg files) with a Polaroid Sprintscan 4000 scanner.
Multiple images of each subject were taken, and images were selected for analysis based on uniformity of illumination, quality of focus, obliqueness of fovea to illumination axis, and systole status. The (normalized) green portion of the RGB image data in the jpeg file was used for analysis, where green = G/(R+G+B). As illustrated in Fig. 11, in the green wavelength range (about 500 nm to 550 nm), the absorption of oxy- and deoxyhemoglobin is similar. The image analysis proceeded with the following steps for each selected image:
Find the optic disk. Create a circular area of data entirely within the optic disk that is less in diameter than the optic disk. Convolve the data in this circle with a small convolver (0.5 mm) to smooth the data.
Find the maximum and minimum levels of green in pixels within the circle. Use this min. level to normalize the values of all pixels within the circle. Compute the gradient of green within the circle.
Find the centroid of the gradient magnitude.
Construct a circle (subtarget) of the image that is approximately 0.5 mm in diameter centered at the centroid and within the disk. (This procedure locates a sub-target area within a retinal vessel in the optic disk.) Using the data in the pixels having green magnitudes in the range of
25-45% of the maximum level of green in the subtarget, create a histogram of this area with 5 buckets for values and 5 buckets for derivative magnitudes. For each magnitude range, calculate the average derivative (gradient) magnitude and average magnitude. These values then become the input for a learning algorithm, such as a neural network simulation, which is trained to associate measured hemoglobin with the data sets.
The neural net employed for exemplification was the "Back Propagation" neural net which is contained in the MATLAB Toolbox of MATLAB Version 5.3.
The neural net is trained with the data sets determined above by the following technique:
(a) remove one data set (representing one image) from the total number of sets. (b) use the data sets remaining to train the neural net mentioned above. (c) use the trained neural net to calculate a hemoglobin value from the data set left out at step (a) above.
By repeating the neural net calculation above, a curve was constructed of non-invasively calculated values versus actual lab values. Correlation data showing the measurements of hemoglobin concentration for each individual as determined in accordance with the present invention versus the hemoglobin measurement values obtained by the in vitro laboratory measurements are shown in Fig. 10. These data indicate a strong correlation, 0.89, between the measurements obtained by the present invention and measurements obtained by standard in vitro laboratory techniques.
The results of the analysis of the serum concentration values of the blood components may be displayed on an output system 20 to the operator. The output system 20 may utilize the LCD screen 14 of the viewing system to present data to the operator as well as feedback on any problems occurring with the acquisition of the image or the device. In the event that the image is not acceptable and will not allow the device to calculate accurate blood values, the output system 20 preferably prompts the operator to capture another image.
In a subset of the patient population, because of particular anatomical characteristics of the eye, various degrees of light scattering may be encountered. This scattering of the light may be the result of various disease states including senile cataracts. A polarized light source may be included in the device to measure the degree of scattering. The returned light at orthogonal polarization may be used as a measure of scattering. This data is fed into the neural network as the scattering variable from patient to patient to allow the device to account for this variable. Several analytes that are measured with the device of the invention are also secreted into the anterior chamber of the eye. The aforementioned embodiment of the device directs light through the anterior chamber to the retina. The image returned from the retina again passes through this area of the eye. The presence of the analyte in this section of the eye could create false data sets and render the device inaccurate. Therefore, when measuring analytes such as glucose that are present in the anterior chamber, the light may be directed along an alternate path to the retina. The illuminating light emitting from the device may be directed toward the retina at an angle into the eye just lateral to the cornea near the corneoscleral junction (limbus). This angle avoids light passing through the anterior chamber of the eye. The exiting light would then be detected at an angle at the opposite side of the eye, again just lateral to the cornea near the corneoscleral junction (limbus). Although this area near the surface of the eye is not optically clear in the visual range of the electromagnetic spectrum, it is transparent in the longer wavelengths (> 1000 nm) needed to measure analytes such as glucose. Photoreactive Analyte (Bilirubin) Measurement Further in accordance with the present invention, the concentration of a photoreactive analyte may be determined by taking advantage of its photoreactivity. For example, bilirubin concentration may be determined by taking advantage of the fact that the bilirubin molecule exhibits peak absorption of light at 470 nm, and that at or near this wavelength the molecule breaks down into optically inactive molecules. The bilirubin molecule will also effectively break down when exposed to light in the range of 470 nm ± 30 nm. The bilirubin molecule ordinarily reflects light maximally at or near a wavelength of approximately 550 nm (yellow light) . In accordance with the invention, a time lapse image of the retina may be made wherein the first image is illuminated at 550 nm (± 30 nm) followed by a second image illuminated at 470 nm (± 30 nm) and a third image illuminated at 550 nm (±30 nm) . The second and third images are separated in time sufficiently that the photoreactive analyte will change chemical state. In the case of bilirubin, the change is almost instantaneous and the two wavelengths may be projected simultaneously as well as sequentially. The first exposure provides an image including the photoreactive analyte (bilirubin in this example) while the third exposure provides a reference point for this patient without the photoreactive analyte (bilirubin in this example) present. The concentration of the photoreactive analyte can be computed using a neural net or other well known analysis process based on differences in the first and third exposures. Light at wavelengths other than 550 nm may also be used to illuminate the retina as long as such wavelengths do not precipitate a photo-chemical reaction from the analyte (bilirubin in this example).
In one embodiment of the invention, with reference to Fig. 6 and with bilirubin as the target analyte, light at a wavelength of 550 nm is directed on a beam 30 to a partially transmissive and reflective mirror 31, passing therethrough on a beam path 32 to a beam splitter 34 and thence to the eye 10. The light at a wavelength of 550 nm is directed at the retina to create a first image. Light from a source at 470 nm is provided on a path 36 to the partial mirror 31 and is reflected on the path 32 through the beam splitter 34 to the eye 10. The reflected light at 470 nm is directed by the element 34 on a path 37 to an absorber 38. The light at 470 nm is pulsed onto the retina at very short time intervals. With each pulsation of light at 470 nm, the bilirubin molecule is rendered optically inactive and is not reflected from the retina at 550 nm. As illustrated in Fig. 7, the reflected 550 nm light intensity is high at the intervals 40 when there is no 470 nm light illumination and is lower at the intervals 41 at which the 470 nm light is applied. The difference in reflected light intensity from the peak to the trough with each pulsation is a function of the bilirubin concentration. The time intervals 40 and 41 chosen will be dependent on the blood flow to the retina. Fig. 8 illustrates the change over time with blood flow. A time interval is required such that there is a partial filling up of the retinal circulation by blood that contains bilirubin. The invention may also be implemented using a single pulse application of 470 nm light to measure the bilirubin concentration as shown in Fig. 9.
The data corresponding to the returned light at 550 nm comprised of pixel values are then the direct input into a neural network or other well known procedure for analysis. A neural network is preferably utilized to analyze the pixel data for comparison to known blood concentrations of bilirubin. The difference in pixel data from reflected light at 550 nm before and after the 470 nm light pulse is a direct function of the serum bilirubin level.
The results of the serum values of the bilirubin may be displayed on an output system 20 to the operator. The output system 20 may utilize the LCD screen of the viewing system to present data to the operator as well as feedback on any problems occurring with the acquisition of the image or the device. In the event that the image is not acceptable and will not allow the device to calculate accurate bilirubin values, the output system 20 preferably prompts the operator to capture another image. Other photo-reactive analytes may be measured in a manner analogous to the measurement of bilirubin as discussed above.
It is understood that the invention is not limited to the embodiments set forth herein as illustrative, but embraces all such forms thereof as come within the scope of the following claims.

Claims

What is claimed is: 1. A method for the detection of the concentration of a blood component in an individual comprising: (a) projecting light having selected wavelengths into an eye of the individual to illuminate the fundus; (b) detecting the light reflected from the fundus and forming an image of a portion of the fundus containing blood vessels; (c) analyzing selected wavelength components in the detected light from the blood vessels in the image to determine the concentration of a selected blood component.
2. The method of Claim 1 wherein the selected blood component is hemoglobin.
3. The method of Claim 1 wherein the selected blood component is glucose.
4. The method of Claim 1 wherein the selected blood component is bilirubin.
5. The method of Claim 1 wherein in the step of analyzing the wavelength components, only light from the regions of the image corresponding to blood vessels is analyzed.
6. The method of Claim 1 wherein the light projected into the eye contains wavelengths in the visible or near infrared range and wherein detecting the light reflected from the fundus includes detecting the light in the visible or near infrared range.
7. The method of Claim 1 wherein the step of forming an image forms an image of the blood vessels in the region overlying the optic disk of the eye and wherein the step of analyzing the wavelength components analyzes the light reflected from the optic disk.
8. The method of Claim 1 including sensing the blood flow of the individual being tested to detect systole and wherein this information is used to time the step of detecting the light reflected from the fundus and forming an image.
9. The method of Claim 1 wherein multiple images are formed of the fundus at discrete times over a period of time and including selecting an image from the multiple images and analyzing that image to determine the concentration of the blood component.
10. The method of Claim 1 wherein the image is split into multiple images that are passed through filters that pass different wavelengths to provide multiple filtered images, and analyzing the multiple filtered images to determine the concentration of the blood component.
11. The method of Claim 10 wherein the blood component is hemoglobin and the multiple images are filtered to pass light centered at wavelengths of 640 nm, 766 nm and 800 nm.
12. The method of Claim 1 including the step of transmitting data corresponding to the image over a communications link to a remote location, and performing the step of analyzing selected wavelength components at the remote location.
13. The method of Claim 1 wherein the step of projecting light into the eye is carried out by projecting light through the pupil of the eye onto the fundus.
14. The method of Claim 1 wherein the step of projecting light into the eye is carried out by projecting light taking a path at an angle into the eye just lateral to the cornea, near the corneoscleral junction.
15. A method of detecting the concentration of a photoreactive analyte in the blood of an individual comprising: (a) projecting light into the eye of the individual to illuminate the fundus that contains wavelengths not including light at wavelengths that will break down the photoreactive analyte and detecting the light reflected from the fundus to determine the intensity of the reflected light at these wavelengths; (b) projecting light into the eye to illuminate the fundus containing wavelengths that break down the photoreactive analyte, and projecting light into the eye to illuminate the fundus containing the wavelengths that do not break down the photoreactive analyte and detecting the intensity of such light reflected from the fundus; and (c) determining the difference between the intensity of light detected with no wavelengths that break down the photoreactive analyte projected on the fundus and the intensity of light detected when light which breaks down the photoreactive analyte has been projected onto the fundus, from which the analyte concentration may be determined.
16. The method of Claim 15 wherein the target analyte is bilirubin or an associated molecule.
17. The method of Claim 16 wherein in the steps of projecting light that do not break down bilirubin, the light projected does not contain wavelengths in the range of 470 nm ± 30 nm.
18. The method of Claim 17 wherein the light projected that does not break down bilirubin contains light centered at 550 nm.
19. The method of Claim 17 wherein the step of projecting light that breaks down bilirubin comprises projecting light having wavelengths in the range of 470 nm ± 30 nm.
20. The method of Claim 16 wherein step (b) includes projecting light containing wavelengths at 470 nm and at 550 nm simultaneously.
21. The method of Claim 16 wherein step (b) is carried out by projecting light at 470 nm followed thereafter by projecting light containing wavelengths at 550 mn to illuminate the fundus, and wherein the light at 550 nm reflected from the fundus is detected.
EP00926006A 2000-04-14 2000-04-14 Non-invasive measurement of blood components using retinal imaging Withdrawn EP1278452A4 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/US2000/010088 WO2001078589A1 (en) 2000-04-14 2000-04-14 Non-invasive measurement of blood components using retinal imaging

Publications (2)

Publication Number Publication Date
EP1278452A1 true EP1278452A1 (en) 2003-01-29
EP1278452A4 EP1278452A4 (en) 2005-04-13

Family

ID=21741278

Family Applications (1)

Application Number Title Priority Date Filing Date
EP00926006A Withdrawn EP1278452A4 (en) 2000-04-14 2000-04-14 Non-invasive measurement of blood components using retinal imaging

Country Status (4)

Country Link
EP (1) EP1278452A4 (en)
JP (1) JP2003532461A (en)
AU (1) AU2000244608A1 (en)
WO (1) WO2001078589A1 (en)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2375679A (en) * 2001-04-09 2002-11-20 Patrick Kerr Retinal function camera using plural light wavelengths to produce a retinal function image showing haemoglobin oxygenation.
US6709109B1 (en) 2002-04-16 2004-03-23 University Of South Florida Differential spectroscopic imaging of the human retina
DE102004016435B4 (en) * 2004-03-31 2009-05-28 Imedos Gmbh Method for the spectrophotometric determination of the oxygen saturation of the blood in optically accessible blood vessels
CA2582097A1 (en) * 2004-09-29 2006-04-13 University Of Delaware Ir spectrographic apparatus and method for diagnosis of disease
JP5129549B2 (en) * 2007-11-19 2013-01-30 パナソニック株式会社 Optical scanning measurement device
JP5388765B2 (en) * 2009-09-01 2014-01-15 キヤノン株式会社 Fundus camera
WO2016054079A1 (en) 2014-09-29 2016-04-07 Zyomed Corp. Systems and methods for blood glucose and other analyte detection and measurement using collision computing
US9554738B1 (en) 2016-03-30 2017-01-31 Zyomed Corp. Spectroscopic tomography systems and methods for noninvasive detection and measurement of analytes using collision computing
WO2018208233A1 (en) * 2017-05-12 2018-11-15 National University Of Singapore Noninvasive optical sensor for analyzing a level of a substance in a subject by illuminating the sclera

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4267844A (en) * 1978-05-15 1981-05-19 Minolta Camera Kabushiki Kaisha Medical instrument for determining jaundice
DE19741198A1 (en) * 1996-12-06 1998-06-18 Siemens Ag Device for non=invasive measurement of vital parameters
US5791345A (en) * 1993-09-03 1998-08-11 Toa Medical Electronics Co., Ltd. Non-invasive blood analyzer
US5836872A (en) * 1989-04-13 1998-11-17 Vanguard Imaging, Ltd. Digital optical visualization, enhancement, quantification, and classification of surface and subsurface features of body surfaces
GB2342182A (en) * 1998-09-11 2000-04-05 Keeler Ltd Ophthalmoscope

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4877322A (en) * 1987-04-30 1989-10-31 Eyedentify, Inc. Method and apparatus for measuring blood oxygen levels in selected areas of the eye fundus
JP3562847B2 (en) * 1994-11-15 2004-09-08 謙 石原 Hemoglobin concentration measuring device
US5919132A (en) * 1998-03-26 1999-07-06 Universite De Montreal On-line and real-time spectroreflectometry measurement of oxygenation in a patient's eye

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4267844A (en) * 1978-05-15 1981-05-19 Minolta Camera Kabushiki Kaisha Medical instrument for determining jaundice
US5836872A (en) * 1989-04-13 1998-11-17 Vanguard Imaging, Ltd. Digital optical visualization, enhancement, quantification, and classification of surface and subsurface features of body surfaces
US5791345A (en) * 1993-09-03 1998-08-11 Toa Medical Electronics Co., Ltd. Non-invasive blood analyzer
DE19741198A1 (en) * 1996-12-06 1998-06-18 Siemens Ag Device for non=invasive measurement of vital parameters
GB2342182A (en) * 1998-09-11 2000-04-05 Keeler Ltd Ophthalmoscope

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of WO0178589A1 *

Also Published As

Publication number Publication date
WO2001078589A1 (en) 2001-10-25
AU2000244608A1 (en) 2001-10-30
JP2003532461A (en) 2003-11-05
EP1278452A4 (en) 2005-04-13

Similar Documents

Publication Publication Date Title
US6305804B1 (en) Non-invasive measurement of blood component using retinal imaging
US11800990B2 (en) Perfusion assessment using transmission laser speckle imaging
JP3701031B2 (en) Noninvasive blood test equipment
AU2002251229B2 (en) Retinal function camera
JP2736002B2 (en) Device for in vivo measurement of optical properties of aqueous humor of the eye
JP4621496B2 (en) Line scan ophthalmoscope
US20050267344A1 (en) Non-invasive measurement of blood glucose using retinal imaging
US20090147217A1 (en) Apparatus, Methods and Systems for Non-Invasive Ocular Assessment of Neurological Function
US11172816B2 (en) Digital 3D infrared slit lamp with pupil measurement
US6149589A (en) On-line and real-time spectroreflectometry measurement of oxygenation in a patient's eye
US5919132A (en) On-line and real-time spectroreflectometry measurement of oxygenation in a patient's eye
EP1278452A1 (en) Non-invasive measurement of blood components using retinal imaging
JP2004525694A (en) Non-invasive spectrophotometer
US20230064792A1 (en) Illumination of an eye fundus using non-scanning coherent light
WO2000021432A1 (en) Methods and apparatus for digital ocular imaging
Lompado et al. Multispectral confocal scanning laser ophthalmoscope for retinal vessel oximetry
Di Cecilia et al. Hyperspectral imaging of the human iris
RU204680U1 (en) DEVICE FOR CONTACT INFRARED VISUALIZATION OF BLOOD VESSELS BY BACKSCATTERED LASER RADIATION
JP3580607B2 (en) Blood glucose measurement device using corneal natural fluorescence
CA2596285C (en) Spectroreflectometry measurement of oxygenation in a patient's eye
Kanagami FUNDUS CAMERA

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20021017

AK Designated contracting states

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE

AX Request for extension of the european patent

Extension state: AL LT LV MK RO SI

A4 Supplementary search report drawn up and despatched

Effective date: 20050228

RIC1 Information provided on ipc code assigned before grant

Ipc: 7A 61B 3/14 B

Ipc: 7A 61B 5/00 A

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20060321