WO2002093450A1 - Information processing for distinguishing an object - Google Patents

Information processing for distinguishing an object Download PDF

Info

Publication number
WO2002093450A1
WO2002093450A1 PCT/SE2002/000882 SE0200882W WO02093450A1 WO 2002093450 A1 WO2002093450 A1 WO 2002093450A1 SE 0200882 W SE0200882 W SE 0200882W WO 02093450 A1 WO02093450 A1 WO 02093450A1
Authority
WO
WIPO (PCT)
Prior art keywords
segment
measuring function
value
segment region
region
Prior art date
Application number
PCT/SE2002/000882
Other languages
French (fr)
Inventor
Björn Nilsson
Original Assignee
Cellavision Ab
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from SE0101712A external-priority patent/SE0101712L/en
Application filed by Cellavision Ab filed Critical Cellavision Ab
Publication of WO2002093450A1 publication Critical patent/WO2002093450A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/11Region-based segmentation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/60Type of objects
    • G06V20/69Microscopic objects, e.g. biological cells or cellular parts
    • G06V20/695Preprocessing, e.g. image segmentation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10Character recognition
    • G06V30/14Image acquisition
    • G06V30/148Segmentation of character regions
    • G06V30/15Cutting or merging image elements, e.g. region growing, watershed or clustering-based techniques
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10056Microscopic image
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30004Biomedical image processing
    • G06T2207/30024Cell structures in vitro; Tissue sections in vitro
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10Character recognition

Definitions

  • the present invention relates to a method of identifying an object in a digital microscope image which reproduces biological material according to the preamble to claim 1, an arrangement according to the preamble to claim 12, a computer program according to the preamble to claim 13 and a digital storage medium according to claim 14.
  • Segmentation is a frequent operation in processing of digital microscope images which reproduce biological material.
  • segmentation a number of picture elements (often referred to as pixels) in an image are identified and selected, which together reproduce an object.
  • a perfect segmentation means that all picture elements that reproduce the object are selected, i.e. no other picture elements are selected.
  • An example of utilisation of segmentation is in analysing a specimen of blood. Such an analysis can be carried out in such manner that all or at least several white blood cells in a blood smear are searched and reproduced by a digital microscope.
  • the white blood cells are segmented from the images and analysed by means of image analysis.
  • the image analysis can result in the blood cells being divided into different classes based on their respective appearances.
  • the distribution of the blood cells in the different classes can then constitute a basis for making a diagnosis regarding the organism from which the specimen of blood originates.
  • thresholding properties of picture elements in the image are compared with a threshold value to determine whether the picture elements reproduce part of a searched object or not. If, for instance, bright objects against a dark background are to be identified, the thresholding can be carried out by assuming that all picture elements having a light intensity that exceeds a threshold value reproduce objects of the searched type. It can be assumed that a connected cluster of such picture elements then reproduces an object.
  • a segmentation condition which is made sharper may thus result in incorrect segmentation, which deteriorates the result of the analysis.
  • An object of the present invention is to wholly or partly remedy the above-mentioned problems.
  • the invention concerns more specifically a method in distinguishing an object of a predetermined type in a digital microscope image which reproduces biological material and which comprises a set of connected segments.
  • the object consists of at least one segment in the set and the method is characterized by the steps of a) selecting a start segment, b) calculating a value of a measuring function for a first segment region which comprises at least the start segment in the set, the measuring function being dependent on at least the relationship between the segment region area and - perimeter, and c) distinguishing the object on the basis of the value of said measuring function.
  • the calculating step is repeated for a second segment region which differs from the first segment region. If a plurality of segment regions are tested, the segment region that gives a most favourable value can be selected, which results in greater reli- ability in the assessment of which segments are to be put together.
  • the second segment region may consist of the segments in the first segment region, for which the value of the measuring function has already been calculated, and an added segment which is connected with the first segment region.
  • the measuring function of the second segment region is then calculated as the measuring function of the first segment region adjusted with an addition regarding the added segment. This results in quicker calculation of the measuring function of a segment region since previous calculations can be reused.
  • measuring func- tions for a plurality of segment regions are calculated and the object is distinguished as the segment region whose measuring function value is closest to a value which is ideal for objects of the predetermined type. If a plurality of segment regions are tested, there will be greater possibilities of finding one that actually reproduces an object.
  • measuring functions are calculated for essentially all segment regions, in which the Euclidean distance between all pairs of picture elements included in the segment region is smaller than a distance threshold value. If the distinguishing is carried out in this way, all segment regions that are not too large to constitute an object can be tested.
  • measuring functions corresponding to segment regions can be calculated until the value of a measuring function has been found, the deviation of which from a value which is ideal for objects of the predetermined type is below a measuring function threshold value, and wherein the object is identified as the corresponding segment region of this measuring function.
  • the distin- guished object is excluded from said set of connected segments, after which a process according to the method is repeated on the resulting remaining quantity.
  • a process according to the method is repeated on the resulting remaining quantity.
  • step (a) a segment which, probably not on its own, reproduces an object of the searched type is selected as the start segment.
  • the method according to the invention can be repeated several times with different choices of start segment, the correspondence between the results from the different times being checked. Also a statistical processing of the results can be carried out, in which case distinguishing takes place based on the result of this processing. This results in greater safety in the distinguishing of the objects in a cluster of segments. Furthermore a measure of how reliable the distinguishing is can be obtained.
  • the invention relates to an arrangement for distinguishing an object of a predetermined type in a digital microscope image which reproduces biological material and which comprises a set of connected segments, the object consisting of at least one segment in the set.
  • the arrangement is characterized by means for selecting a start segment in the set, means for calculating a value of a measuring function for a first segment region which comprises at least the start segment in the set, the measuring function being dependent on at least the relationship between the area and perimeter of the segment region, and means for distinguishing the object based on the value of said measuring function.
  • This arrangement implies advantages corresponding to those of the method and can be varied accordingly.
  • the invention relates to a computer program for distinguishing an object of a predetermined type in a digital microscope image which reproduces biological material and which comprises a set of connected segments, the object consisting of at least one segment in the set.
  • the computer program is characterized by instructions corresponding to the steps of a) selecting a start segment, b) calculating a value of a measuring function for a first segment region which comprises at least the start segment in the set, the measuring function being dependent on at least the relationship between the area and - perimeter of the segment region, and c) distinguishing the object based on the value of said measuring function.
  • the invention concerns a digital storage medium comprising such a computer program.
  • Fig. 1 shows an example of a digital microscope image.
  • Fig. 2 shows the microscope image in Fig. 1 where segmenting has been carried out so that oversegmenting of a white blood cell has taken place.
  • Fig. 3a shows schematically the segments in the image in Fig. 2.
  • Fig. 3b shows a graph corresponding to Fig. 3a.
  • Fig. 4a shows a graph which constitutes a first proposal for joining of the segments in Fig. 2.
  • Fig. 4b indicates a segment region corresponding to the graph in Fig. 4a.
  • Fig. 4c shows a graph which constitutes a second proposal for joining of the segments in Fig. 2.
  • Fig. 4d indicates a segment region corresponding to the graph in Fig. 4c.
  • Fig. 5 illustrates a method according to a first embodiment of the invention.
  • Fig. 6 illustrates a method according to a second embodiment of the invention.
  • Fig. 7 illustrates, according to an embodiment of the invention, a joining of the segments in Fig. 2.
  • Fig. 8 illustrates an example of the appearance of the segments in a cluster of segments.
  • Fig. 9 shows a system in which the present invention can be applied.
  • Fig. 10 shows an arrangement according to an embodiment of the invention. Description of Preferred Embodiments
  • Fig. 1 shows an example of a digital microscope image .
  • the image reproduces two neighbouring white blood cells, and a large number of surrounding red blood cells.
  • the white blood cells have dark nuclei, which within the membrane of the cells are surrounded by cytoplasm.
  • An operation that can be executed on the image in Fig. 1 is segmentation of white blood cells. As mentioned above, such a segmentation is difficult if white blood cells in the image adjoin each other, which is the case in Fig. 1. With a segmentation condition which is set low, there is a risk of the two cells being segmented as a single cell.
  • a possibility of segmenting white blood cells is to use the fact that they normally have a low green component, i.e. they are dark in the green part of the colour spectrum. This can be utilized, for example, in segmentation by thresholding. If the segmentation condition is made sharper, i.e. in this case if the green component threshold value is set lower, there is a risk of overseg- menting .
  • Fig. 2 shows the microscope image in Fig. 1 where segmentation has been carried out so that oversegmenting of one of the white blood cells has occurred.
  • the reason for the overseg enting is that the nuclei of the upper white blood cell has indentations which are perceived by the system as boundary lines between white blood cells. As a result, the upper white blood cell has been divided into three segments .
  • An object of the present invention is to provide a method for quick and accurate correction of such overseg- mentations .
  • Fig. 3a shows schematically the segments in the image in Fig. 2.
  • the segments in the oversegmented image have been numbered.
  • the background surrounding the cluster of segments can be referred to as the zero segment.
  • Fig. 3b shows a graph corresponding to Fig. 3a and describing how the segments are connected. Segment 1 is connected with segment 2 and segment 3. Segment 2 is connected with segment 1 and segment 3. Segment 3 is connected with segment 1, segment 2 and segment 4. Segment 4 is connected with segment 3 only.
  • the person looking at Fig. 1 realizes that all the connections are "true" except for the one between segment 3 and segment 4. By a connection being true is here meant that it connects two segments which reproduce the same object.
  • the graph shown in Fig. 3b can be said to constitute a tree. According to an embodiment of the invention, this tree is to be divided into (one or more) subtrees which only contain true connections.
  • Fig. 4a shows a graph which constitutes a first proposal for joining the segments in Fig. 2.
  • the connection between segment 1 and segment 3 constitutes a proposal for subtrees .
  • the other connections are indicated by dashed lines.
  • Fig. 4b shows a segment region drawn by full lines and corresponding to the graph in Fig. 4a. Segment 1 and segment 3 together constitute a segment region.
  • segment region is here generally meant a set of connected segments in an image that has been segmented.
  • a corresponding measuring function can be calculated, as will be described below.
  • the measuring function is pref- erably based on the relationship between the perimeter and area of the segment region.
  • parameters such as the greatest extent of the segment region and variations in appearance, for instance texture, between different segments in a segment region can be utilized in the measuring function.
  • Fig. 4c shows a graph which constitutes a second proposal for joining of the segments in Fig. 2.
  • segment 2 has been added.
  • Fig. 4d shows a segment region corresponding to the graph in Fig. 4c.
  • a process according to an embodiment of the invention comprises at least the following steps: selection of a start segment in a cluster of segments, which start segment will be the starting point of the process; calculation of a value of a measuring function for a segment region which comprises at least the start segment in the cluster, and distinguishing a searched object based on the value of the measuring function.
  • the start segment can basically be selected randomly or arbitrarily from the segments in a cluster. Preferably, however, a start segment which probably does not itself reproduce an object is selected since this may result in a more reliable process. The reason for this is apparent from the example in Fig. 8.
  • There two segments 801 and 802 are reproduced, which are included in a cluster of segments. The two segments together reproduce an object.
  • the first segment 801 is relatively round and will therefore probably give a high value of a measuring function of the type that will be described below.
  • the second segment 802 is shaped as a crescent and will therefore probably obtain a low corresponding value .
  • the second segment 802 here constitutes a suitable start segment. If the first segment 801 should be selected, there is in fact a risk that it will be incor- rectly assessed by the system as an object since it has a high corresponding measuring function value. This risk, however, does not exist for the second segment 802. To be able to make such a choice, it is convenient to calculate, for at least part of the segments in a cluster, the measuring function or some other suitable measure for an isolated segment. The start segment can then be selected, for instance, as the segment that has the lowest measuring function value, or as the first segment that has a measuring function value which is lower than a threshold value . CALCULATION OF MEASURING FUNCTION
  • a measuring function should generally be designed so as to give a value, close to an ideal value, for a segment region which is very similar to an object of the searched type .
  • a measuring function is preferably based on the relationship between the area and perimeter of a segment region.
  • the square of P makes the compactness dimension-less. C can be minimum
  • the area and perimeter of the segment region can preferably be calculated cumulatively. Now assume that the area and perimeter of a first segment region have been calculated. The area and perimeter of a second segment region are to be calculated. The second segment region consists of the first segment region, to which a further segment has been added. In a cumulative process, the previously effected calculation of the area and perimeter of the first segment region is used. This calculation is adjusted only in respect of the added segment (analogously if a segment has been removed) .
  • A(T) ⁇ (a (Ni) ) (where Ni is the segments that are included in the segment region T) in the course of the search.
  • P(i,0) is the length of the boundary line between the segment i and the zero segment, i.e. the background in Fig. 3a. Also the boundary lines of the zero segment are calculated. It is to be noted that p(3,0) in Fig. 4b consists of two non-connected parts.
  • p(i,j) 0, which can be used to limit the number p(i,j) that need be calculated.
  • P (T) ⁇ (p (i, j ) ) where i is included in T and j is not included in T, can be calculated.
  • T When T is changed, it is easy to add or subtract corresponding p ⁇ s to or from P. Consequently, also this quantity can be calculated cumulatively.
  • Region 2 is changed from not being included to being included, and therefore all p's for region 2 will have to be used for the updating.
  • p(2,l) and p(2,3) were included in P (T) , which means that they should be subtracted, while p(2,0) and p(2,4), which were previously not included, are to be added relative to the just mentioned P (T) .
  • the measuring function In addition to compactness or another measure of the relationship between the perimeter and area of a segment region, other parameters can be included in the measuring function. Generally, the measuring function should "punish" segment regions with such parameters as deviate from expected parameters of objects of the searched type.
  • An example of such a parameter can be the size of the segment region. It may be expected that a white blood cell has a size within a certain range.
  • the measuring function can reward segment regions in which the longest Euclidian distance d between two picture elements in the segment region is below a threshold value D. The distance d can quickly be calculated approximately by approximating the segments in the segment region as polygons. Alternatively, the total area of the segment region can be compared with one or more threshold values. One more alternative is to base the measuring function on the deviation of a longest distance or an area from a corre- sponding mode or mean value.
  • a function of the size of the segment region can generally be a factor or a term in the measuring function.
  • Another parameter can be the variation in appearance between different segments in the segment region.
  • segments with significantly different colourings or textures are probably not connected as an object.
  • measures of colouring or texture can then be calculated for each of the segments in a cluster.
  • the variance is calculated for each of these measures. This variance can be included as a factor or term in the measuring function.
  • a great variance indicates that the segments in a segment region do not belong to the same object.
  • variances can preferably be cumulatively calculated for segment regions. When a segment is added, this segments variance is also included, and the total is adjusted using the square mean values .
  • the measuring function is first calculated for a segment region which comprises merely the start segment . Subsequently calculation can take place for segment regions which com- prise the start segment and a further segment which is connected with the start segment . Then calculation for a segment region can take place, which comprises the start segment and two additional segments etc.
  • this can proceed as long as topologically possible and untested segment regions (including the start segment) are still in the cluster.
  • segment regions including the start segment
  • this is also suitable.
  • the object is distinguished as the segment region that obtains an optimally corresponding measuring function value .
  • Another alternative is to test different segment regions until a sufficiently good measuring function value has been obtained, which will be described below.
  • Fig. 5 shows a flow chart of a method 500 according to an embodiment of the invention.
  • a start segment is then selected as shown above.
  • the value of a measuring function is calculated for a segment region which contains the start segment.
  • the segment region may comprise merely the start segment.
  • the size condition can be expressed in such manner that the above distance d is below a threshold value D.
  • the segment region is changed in a fourth step 504 into conformity with one of the remaining segment regions. This can be carried out by adding and/or subtracting a segment, optionally repeatedly. Then the second step 502 is repeated, where the measuring function for the modified segment region is calculated.
  • segment region is distinguished in a fifth step 505, which segment region has obtained the best (usually the greatest) measuring function value, as the searched object. Then this segment region can be analysed using, for example, image analysis .
  • the distinguished segment region is excluded from the cluster of segments to which it belongs, so that calculations will henceforth not be carried out with segments in the distinguished segment region.
  • a seventh step 507 it is checked in a seventh step 507 whether segments remain in the cluster. If this is the case, the procedure is repeated from the first step 501. Otherwise, the process has been completed.
  • Fig. 6 shows a flow chart for a method 600 according to an alternative embodiment of the invention.
  • a start segment is selected, as shown above.
  • the value of a measuring function is calculated for a segment region containing the start segment.
  • the segment region can comprise merely the start segment .
  • the second step 602 is repeated, where a measuring function for the modified segment region is calculated.
  • segment region is distinguished in a fifth step 605 as the searched obj ect . Then the segment region can be analysed using, for instance, image analysis.
  • the distinguished segment region is excluded from the cluster of segments to which it belongs, so that henceforth segments in the distinguished segment region will not be taken into consideration.
  • a seventh step 607 it is checked in a seventh step 607 whether segments remain in the cluster. If this is the case, the procedure is repeated from the first step 601. Otherwise, the process has been completed.
  • Figs 5 and 6 can be repeated once or several times with new first choices of start segment .
  • the correspondence between the results the different times can be checked.
  • statistical processing of the results can be carried out and distinguishing can be effected based on the results of this processing.
  • Fig. 7 illustrates a joining of the segments in
  • FIG. 2 according to an embodiment of the invention. As is evident from Fig. 7, the segments in Fig. 2 have been joined in a correct manner.
  • Fig. 9 shows a system 900 in which the method described above can be applied.
  • the system 900 comprises a digital microscope 901 which is connected to a computer unit 902 with an associated display 903 and keyboard 904.
  • the digital microscope 901 generates digital microscope images which are processed and analysed by the computer unit 902.
  • the computer unit 902 can be integrated into the digital microscope 901, but it can also be positioned at a great distance therefrom and then obtain digital microscope images, for example, via the Internet.
  • Fig. 10 shows an arrangement 1000 for distinguishing a searched object according to an embodiment of the invention.
  • Input data to the arrangement is an image which has been segmented in a segmenting module 1001 in such manner that oversegmentation can have taken place.
  • the image may comprise a number of segments which are connected in a cluster.
  • the arrangement comprises means 1002 for selecting a start segment. This carries out selection of the start segment in such manner as has been described above .
  • the arrangement comprises means 1003 for calculating a value of a measuring function for at least a first segment region, which comprises the selected start segment in the set, as shown above.
  • the arrangement further comprises means 1004 for distinguishing the object based on the value of the measuring function.
  • Distinguished objects can be forwarded to an analysing module 1005 in which, for instance, image analysis can be carried out .
  • Fig. 10 can be implemented in terms of software in a computer unit 902 as the one shown in Fig. 9. In some cases it is also possible to implement a means in terms of hardware in the form of an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array) .
  • ASIC Application Specific Integrated Circuit
  • FPGA Field Programmable Gate Array

Abstract

The invention relates to a method in distinguishing an object of a predetermined type in a digital microscope image which reproduces biological material and which comprises a set of connected segments, the object consisting of at least one segment in the set. The method is characterized by the steps of a) selecting a start segment, b) calculating a value of a measuring function for a first segment region which comprises at least the start segment in the set, the measuring function being dependent on at least the relationship between the area and perimeter of the segment region, and c) distinguishing the object based on the value of said measuring function.

Description

INFORMATION PROCESSING FOR DISTINGUISHING AN OBJECT
Field of the Invention
The present invention relates to a method of identifying an object in a digital microscope image which reproduces biological material according to the preamble to claim 1, an arrangement according to the preamble to claim 12, a computer program according to the preamble to claim 13 and a digital storage medium according to claim 14.
Cross reference to related applications: This application claims benefit from Swedish patent application no SE-0101712-8, filed 16 May, 2001, and US provisional patent application no US-60/316 277, filed 4 September, 2001. Background Art
Segmentation, or distinguishing, is a frequent operation in processing of digital microscope images which reproduce biological material. In segmentation, a number of picture elements (often referred to as pixels) in an image are identified and selected, which together reproduce an object. A perfect segmentation means that all picture elements that reproduce the object are selected, i.e. no other picture elements are selected. An example of utilisation of segmentation is in analysing a specimen of blood. Such an analysis can be carried out in such manner that all or at least several white blood cells in a blood smear are searched and reproduced by a digital microscope. The white blood cells are segmented from the images and analysed by means of image analysis. The image analysis can result in the blood cells being divided into different classes based on their respective appearances. The distribution of the blood cells in the different classes can then constitute a basis for making a diagnosis regarding the organism from which the specimen of blood originates.
A common method for segmenting is so-called thresholding. In thresholding, properties of picture elements in the image are compared with a threshold value to determine whether the picture elements reproduce part of a searched object or not. If, for instance, bright objects against a dark background are to be identified, the thresholding can be carried out by assuming that all picture elements having a light intensity that exceeds a threshold value reproduce objects of the searched type. It can be assumed that a connected cluster of such picture elements then reproduces an object.
A problem of prior art segmenting methods arises when several objects of the searched type are positioned close to each other, as shown in Fig. 1 where two white blood cells engage each other. An obvious risk in this case is that the two cells are segmented as a single cell, which results in incorrect sizing of the cells and a deteriorated result of the analysis.
One method of avoiding undersegmentation, i.e. that several objects are segmented as a single object, is to utilise a sharper segmentation condition (in the case of thresholding, a higher or lower threshold value) . However, this involves a risk of oversegmentation, i.e. that an object is segmented as if it were several objects. This happens not only to objects adjoining each other, but also separate objects.
A segmentation condition which is made sharper may thus result in incorrect segmentation, which deteriorates the result of the analysis. Summary of the Invention
An object of the present invention is to wholly or partly remedy the above-mentioned problems.
This object is achieved by a method of identifying an object in a digital microscope image which reproduces biological material according to claim 1, an arrangement according to claim 12, a computer program according to claim 13 and a digital storage medium according to claim 14. According to a first aspect, the invention concerns more specifically a method in distinguishing an object of a predetermined type in a digital microscope image which reproduces biological material and which comprises a set of connected segments. The object consists of at least one segment in the set and the method is characterized by the steps of a) selecting a start segment, b) calculating a value of a measuring function for a first segment region which comprises at least the start segment in the set, the measuring function being dependent on at least the relationship between the segment region area and - perimeter, and c) distinguishing the object on the basis of the value of said measuring function.
Using such a method it will be possible to put to- gether oversegmented objects in a reliable fashion. This affords a possibility of setting a segmentation condition high so that undersegmentation does certainly not take place, which gives an overall segmentation with great accuracy. Preferably, the calculating step is repeated for a second segment region which differs from the first segment region. If a plurality of segment regions are tested, the segment region that gives a most favourable value can be selected, which results in greater reli- ability in the assessment of which segments are to be put together.
The second segment region may consist of the segments in the first segment region, for which the value of the measuring function has already been calculated, and an added segment which is connected with the first segment region. Preferably, the measuring function of the second segment region is then calculated as the measuring function of the first segment region adjusted with an addition regarding the added segment. This results in quicker calculation of the measuring function of a segment region since previous calculations can be reused.
According to a preferred embodiment, measuring func- tions for a plurality of segment regions are calculated and the object is distinguished as the segment region whose measuring function value is closest to a value which is ideal for objects of the predetermined type. If a plurality of segment regions are tested, there will be greater possibilities of finding one that actually reproduces an object.
Preferably, measuring functions are calculated for essentially all segment regions, in which the Euclidean distance between all pairs of picture elements included in the segment region is smaller than a distance threshold value. If the distinguishing is carried out in this way, all segment regions that are not too large to constitute an object can be tested.
Alternatively, measuring functions corresponding to segment regions can be calculated until the value of a measuring function has been found, the deviation of which from a value which is ideal for objects of the predetermined type is below a measuring function threshold value, and wherein the object is identified as the corresponding segment region of this measuring function. This results in a comparatively quick process.
According to a preferred embodiment, the distin- guished object is excluded from said set of connected segments, after which a process according to the method is repeated on the resulting remaining quantity. In this manner, a whole cluster of segments can be analysed. The distinguishing will be quicker and quicker, the smaller the remaining cluster.
Preferably, in step (a) a segment which, probably not on its own, reproduces an object of the searched type is selected as the start segment. This may result in a more reliable joining of segments. Preferably, the method according to the invention can be repeated several times with different choices of start segment, the correspondence between the results from the different times being checked. Also a statistical processing of the results can be carried out, in which case distinguishing takes place based on the result of this processing. This results in greater safety in the distinguishing of the objects in a cluster of segments. Furthermore a measure of how reliable the distinguishing is can be obtained. According to a second aspect, the invention relates to an arrangement for distinguishing an object of a predetermined type in a digital microscope image which reproduces biological material and which comprises a set of connected segments, the object consisting of at least one segment in the set. The arrangement is characterized by means for selecting a start segment in the set, means for calculating a value of a measuring function for a first segment region which comprises at least the start segment in the set, the measuring function being dependent on at least the relationship between the area and perimeter of the segment region, and means for distinguishing the object based on the value of said measuring function. This arrangement implies advantages corresponding to those of the method and can be varied accordingly.
According to a third aspect, the invention relates to a computer program for distinguishing an object of a predetermined type in a digital microscope image which reproduces biological material and which comprises a set of connected segments, the object consisting of at least one segment in the set. The computer program is characterized by instructions corresponding to the steps of a) selecting a start segment, b) calculating a value of a measuring function for a first segment region which comprises at least the start segment in the set, the measuring function being dependent on at least the relationship between the area and - perimeter of the segment region, and c) distinguishing the object based on the value of said measuring function.
The computer program implies advantages corresponding to those of the method and can be varied accordingly. According to a fourth aspect, the invention concerns a digital storage medium comprising such a computer program.
Brief Description of the Drawings
Fig. 1 shows an example of a digital microscope image.
Fig. 2 shows the microscope image in Fig. 1 where segmenting has been carried out so that oversegmenting of a white blood cell has taken place.
Fig. 3a shows schematically the segments in the image in Fig. 2.
Fig. 3b shows a graph corresponding to Fig. 3a.
Fig. 4a shows a graph which constitutes a first proposal for joining of the segments in Fig. 2.
Fig. 4b indicates a segment region corresponding to the graph in Fig. 4a.
Fig. 4c shows a graph which constitutes a second proposal for joining of the segments in Fig. 2.
Fig. 4d indicates a segment region corresponding to the graph in Fig. 4c.
Fig. 5 illustrates a method according to a first embodiment of the invention.
Fig. 6 illustrates a method according to a second embodiment of the invention. Fig. 7 illustrates, according to an embodiment of the invention, a joining of the segments in Fig. 2.
Fig. 8 illustrates an example of the appearance of the segments in a cluster of segments.
Fig. 9 shows a system in which the present invention can be applied.
Fig. 10 shows an arrangement according to an embodiment of the invention. Description of Preferred Embodiments
When using a microscope system of such a type as will be described in more detail in connection with Fig. 9, digital microscope images are generated.
Fig. 1 shows an example of a digital microscope image . The image reproduces two neighbouring white blood cells, and a large number of surrounding red blood cells. The white blood cells have dark nuclei, which within the membrane of the cells are surrounded by cytoplasm.
An operation that can be executed on the image in Fig. 1 is segmentation of white blood cells. As mentioned above, such a segmentation is difficult if white blood cells in the image adjoin each other, which is the case in Fig. 1. With a segmentation condition which is set low, there is a risk of the two cells being segmented as a single cell. A possibility of segmenting white blood cells is to use the fact that they normally have a low green component, i.e. they are dark in the green part of the colour spectrum. This can be utilized, for example, in segmentation by thresholding. If the segmentation condition is made sharper, i.e. in this case if the green component threshold value is set lower, there is a risk of overseg- menting .
Fig. 2 shows the microscope image in Fig. 1 where segmentation has been carried out so that oversegmenting of one of the white blood cells has occurred. The reason for the overseg enting is that the nuclei of the upper white blood cell has indentations which are perceived by the system as boundary lines between white blood cells. As a result, the upper white blood cell has been divided into three segments .
An object of the present invention is to provide a method for quick and accurate correction of such overseg- mentations .
Fig. 3a shows schematically the segments in the image in Fig. 2. The segments in the oversegmented image have been numbered. The background surrounding the cluster of segments can be referred to as the zero segment.
Fig. 3b shows a graph corresponding to Fig. 3a and describing how the segments are connected. Segment 1 is connected with segment 2 and segment 3. Segment 2 is connected with segment 1 and segment 3. Segment 3 is connected with segment 1, segment 2 and segment 4. Segment 4 is connected with segment 3 only. The person looking at Fig. 1 realizes that all the connections are "true" except for the one between segment 3 and segment 4. By a connection being true is here meant that it connects two segments which reproduce the same object.
The graph shown in Fig. 3b can be said to constitute a tree. According to an embodiment of the invention, this tree is to be divided into (one or more) subtrees which only contain true connections.
To achieve this, an evaluation of proposals for subtrees is to be carried out. Fig. 4a shows a graph which constitutes a first proposal for joining the segments in Fig. 2. The connection between segment 1 and segment 3 constitutes a proposal for subtrees . The other connections are indicated by dashed lines. Fig. 4b shows a segment region drawn by full lines and corresponding to the graph in Fig. 4a. Segment 1 and segment 3 together constitute a segment region. By segment region is here generally meant a set of connected segments in an image that has been segmented. For the segment region in Fig. 4b, a corresponding measuring function can be calculated, as will be described below. The measuring function is pref- erably based on the relationship between the perimeter and area of the segment region. Moreover, parameters such as the greatest extent of the segment region and variations in appearance, for instance texture, between different segments in a segment region can be utilized in the measuring function.
Fig. 4c shows a graph which constitutes a second proposal for joining of the segments in Fig. 2. In relation to the tree in Fig. 4a, segment 2 has been added. Fig. 4d shows a segment region corresponding to the graph in Fig. 4c.
When calculating a measuring function for this increased segment region, calculations that have already been made for the previous segment region can be used to a great extent, as will be shown below. The calculations can thus be carried out in a cumulative manner, which makes them quick.
A process according to an embodiment of the invention comprises at least the following steps: selection of a start segment in a cluster of segments, which start segment will be the starting point of the process; calculation of a value of a measuring function for a segment region which comprises at least the start segment in the cluster, and distinguishing a searched object based on the value of the measuring function. SELECTION OF START SEGMENT
The start segment can basically be selected randomly or arbitrarily from the segments in a cluster. Preferably, however, a start segment which probably does not itself reproduce an object is selected since this may result in a more reliable process. The reason for this is apparent from the example in Fig. 8. There two segments 801 and 802 are reproduced, which are included in a cluster of segments. The two segments together reproduce an object. The first segment 801 is relatively round and will therefore probably give a high value of a measuring function of the type that will be described below. The second segment 802 is shaped as a crescent and will therefore probably obtain a low corresponding value .
The second segment 802 here constitutes a suitable start segment. If the first segment 801 should be selected, there is in fact a risk that it will be incor- rectly assessed by the system as an object since it has a high corresponding measuring function value. This risk, however, does not exist for the second segment 802. To be able to make such a choice, it is convenient to calculate, for at least part of the segments in a cluster, the measuring function or some other suitable measure for an isolated segment. The start segment can then be selected, for instance, as the segment that has the lowest measuring function value, or as the first segment that has a measuring function value which is lower than a threshold value . CALCULATION OF MEASURING FUNCTION
A measuring function should generally be designed so as to give a value, close to an ideal value, for a segment region which is very similar to an object of the searched type .
White blood cells are normally round or oval. Therefore, a measuring function is preferably based on the relationship between the area and perimeter of a segment region. A common measure of this relationship is the - compactness C (T) =P (T) 2/A(T) , where P (T) is the perimeter and A(T) is the area of a segment region T. The square of P makes the compactness dimension-less. C can be minimum
4π («12.6), which is applicable if the segment region is a circle. If the segment region is a square, C=16. The compactness is merely an example of how the relationship between the perimeter and area of a segment region can be expressed. Other ways are conceivable. The area and perimeter of the segment region can preferably be calculated cumulatively. Now assume that the area and perimeter of a first segment region have been calculated. The area and perimeter of a second segment region are to be calculated. The second segment region consists of the first segment region, to which a further segment has been added. In a cumulative process, the previously effected calculation of the area and perimeter of the first segment region is used. This calculation is adjusted only in respect of the added segment (analogously if a segment has been removed) .
By calculating in advance a(Ni), i.e. the area, of all regions i, it is easy to cumulatively update
A(T) =Σ (a (Ni) ) (where Ni is the segments that are included in the segment region T) in the course of the search. When calculating A(T) for the segment region in Fig. 4b, for instance a(l) and a (3) are summed up. When the similar tree i Fig. 4c is to be evaluated, it is sufficient to update A(T) by adding a (2) .
It is also possible to update the perimeter P (T) cumulatively. It is sufficient to calculate in advance p(i,j), i.e. the length of the common boundary line or the common boundary lines, of all possible pairs of segments Ni, Nj .
P(i,0) is the length of the boundary line between the segment i and the zero segment, i.e. the background in Fig. 3a. Also the boundary lines of the zero segment are calculated. It is to be noted that p(3,0) in Fig. 4b consists of two non-connected parts.
For the pairs of segments that do not adjoin each other, p(i,j)=0, which can be used to limit the number p(i,j) that need be calculated. The fact that p (i, j ) =p (j , i) also saves calculations. Nor is it meaningful to calculate p(i,i) .
Based on these p(i,j), P (T) =Σ (p (i, j ) ) where i is included in T and j is not included in T, can be calculated. When T is changed, it is easy to add or subtract corresponding p^s to or from P. Consequently, also this quantity can be calculated cumulatively. For the tree in Fig. 4a, for instance the following will be obtained P(T) =p(l, 0)+p(l,2) +p(l,4) +p(3, 0) +p(3,2) +p(3,4) , where p(l,4)=0. When the similar tree in Fig. 4c is to be evaluated, a few easily executed changes are sufficient. Region 2 is changed from not being included to being included, and therefore all p's for region 2 will have to be used for the updating. Previously, p(2,l) and p(2,3) were included in P (T) , which means that they should be subtracted, while p(2,0) and p(2,4), which were previously not included, are to be added relative to the just mentioned P (T) . The new P (T) will thus be P(T)=p(l,0)+p(l,2)+p(l,4)+p(3,0)+p(3,2)+p(3,4)-p(2,l)- p(2,3)+p(2,0)+p(2,4) = p (1, 0) +p(l,4) +p (2, 0) +p (2,4) +p (3, 0) +p (3,4) , which agrees with the definition of P(T) above.
In addition to compactness or another measure of the relationship between the perimeter and area of a segment region, other parameters can be included in the measuring function. Generally, the measuring function should "punish" segment regions with such parameters as deviate from expected parameters of objects of the searched type.
An example of such a parameter can be the size of the segment region. It may be expected that a white blood cell has a size within a certain range. The measuring function can reward segment regions in which the longest Euclidian distance d between two picture elements in the segment region is below a threshold value D. The distance d can quickly be calculated approximately by approximating the segments in the segment region as polygons. Alternatively, the total area of the segment region can be compared with one or more threshold values. One more alternative is to base the measuring function on the deviation of a longest distance or an area from a corre- sponding mode or mean value. A function of the size of the segment region can generally be a factor or a term in the measuring function.
Another parameter can be the variation in appearance between different segments in the segment region. As a rule, segments with significantly different colourings or textures are probably not connected as an object. In general, measures of colouring or texture can then be calculated for each of the segments in a cluster. For a segment region, the variance is calculated for each of these measures. This variance can be included as a factor or term in the measuring function. A great variance indicates that the segments in a segment region do not belong to the same object. It should be noted that also variances can preferably be cumulatively calculated for segment regions. When a segment is added, this segments variance is also included, and the total is adjusted using the square mean values . DISTINGUISHING OF OBJECTS
On the basis of the values of the measuring function for different segment regions, distinguishing of the object can be carried out. In a typical process, the measuring function is first calculated for a segment region which comprises merely the start segment . Subsequently calculation can take place for segment regions which com- prise the start segment and a further segment which is connected with the start segment . Then calculation for a segment region can take place, which comprises the start segment and two additional segments etc.
Basically, this can proceed as long as topologically possible and untested segment regions (including the start segment) are still in the cluster. For small clusters of segments, as the one shown in Fig. 2, this is also suitable. When all combinations have been tested, the object is distinguished as the segment region that obtains an optimally corresponding measuring function value .
For great clusters, however, this is less convenient. Great clusters can be found, for instance, in smears of bone marrow where white blood cells are often positioned very close to each other. It can be assumed that the size of the searched object will be below a certain threshold value and thus, as will be shown below, calculations will only be carried out for segment regions where the above-mentioned distance d is below the threshold value. It is also possible to make the threshold value dynamic, i.e. allow great distances if merely poor measuring function values have appeared and require smaller distances if good measuring function values have appeared, which may indicate that the object has already been found .
Another alternative is to test different segment regions until a sufficiently good measuring function value has been obtained, which will be described below.
Fig. 5 shows a flow chart of a method 500 according to an embodiment of the invention. In a first step 501, a start segment is then selected as shown above. In a second step 502, the value of a measuring function is calculated for a segment region which contains the start segment. In the first calculation, the segment region may comprise merely the start segment. Subsequently it is checked in a third step whether segment regions which satisfy a size condition and for which measuring functions have not been calculated still remain. The size condition can be expressed in such manner that the above distance d is below a threshold value D.
If this is the case, the segment region is changed in a fourth step 504 into conformity with one of the remaining segment regions. This can be carried out by adding and/or subtracting a segment, optionally repeatedly. Then the second step 502 is repeated, where the measuring function for the modified segment region is calculated.
If no such segment regions remain, the segment region is distinguished in a fifth step 505, which segment region has obtained the best (usually the greatest) measuring function value, as the searched object. Then this segment region can be analysed using, for example, image analysis .
In a sixth step 506, the distinguished segment region is excluded from the cluster of segments to which it belongs, so that calculations will henceforth not be carried out with segments in the distinguished segment region.
Then it is checked in a seventh step 507 whether segments remain in the cluster. If this is the case, the procedure is repeated from the first step 501. Otherwise, the process has been completed.
Fig. 6 shows a flow chart for a method 600 according to an alternative embodiment of the invention. In a first step 601, a start segment is selected, as shown above. In a second step 602, the value of a measuring function is calculated for a segment region containing the start segment. In the first calculation, the segment region can comprise merely the start segment . Then it is checked in a third step 603 whether the measuring function of the segment region exceeds (or with a different design of the measuring function, is below) a threshold value. This indicates that the segment region is "sufficiently similar to" an object of the searched type. If this is not the case, the segment region is changed in a fourth step 604. This can be carried out by adding and/or subtracting a segment, optionally repeatedly. Then the second step 602 is repeated, where a measuring function for the modified segment region is calculated.
If the condition in the third step is satisfied, that segment region is distinguished in a fifth step 605 as the searched obj ect . Then the segment region can be analysed using, for instance, image analysis.
In a sixth step 606, the distinguished segment region is excluded from the cluster of segments to which it belongs, so that henceforth segments in the distinguished segment region will not be taken into consideration.
Subsequently it is checked in a seventh step 607 whether segments remain in the cluster. If this is the case, the procedure is repeated from the first step 601. Otherwise, the process has been completed.
In a preferred embodiment, the methods illustrated in Figs 5 and 6 can be repeated once or several times with new first choices of start segment . The correspondence between the results the different times can be checked. Optionally, statistical processing of the results can be carried out and distinguishing can be effected based on the results of this processing. Fig. 7 illustrates a joining of the segments in
Fig. 2 according to an embodiment of the invention. As is evident from Fig. 7, the segments in Fig. 2 have been joined in a correct manner.
Fig. 9 shows a system 900 in which the method described above can be applied. The system 900 comprises a digital microscope 901 which is connected to a computer unit 902 with an associated display 903 and keyboard 904. The digital microscope 901 generates digital microscope images which are processed and analysed by the computer unit 902. The computer unit 902 can be integrated into the digital microscope 901, but it can also be positioned at a great distance therefrom and then obtain digital microscope images, for example, via the Internet.
Fig. 10 shows an arrangement 1000 for distinguishing a searched object according to an embodiment of the invention. Input data to the arrangement is an image which has been segmented in a segmenting module 1001 in such manner that oversegmentation can have taken place. In any case, the image may comprise a number of segments which are connected in a cluster. The arrangement comprises means 1002 for selecting a start segment. This carries out selection of the start segment in such manner as has been described above . Furthermore the arrangement comprises means 1003 for calculating a value of a measuring function for at least a first segment region, which comprises the selected start segment in the set, as shown above. The arrangement further comprises means 1004 for distinguishing the object based on the value of the measuring function. Distinguished objects can be forwarded to an analysing module 1005 in which, for instance, image analysis can be carried out .
The means and modules illustrated in Fig. 10 can be implemented in terms of software in a computer unit 902 as the one shown in Fig. 9. In some cases it is also possible to implement a means in terms of hardware in the form of an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array) .
The invention is not restricted to the embodiments illustrated above and may be varied within the scope of the appended claims .

Claims

1. A method in distinguishing an object of a predetermined type in a digital microscope image which reproduces biological material and which comprises a set of connected segments, the object consisting of at least one segment in the set , c h a r a c t e r i z e d by the steps of a) selecting (501) a start segment, b) calculating (502) a value of a measuring function for a first segment region which comprises at least the start segment in the set, the measuring function being dependent on at least the relationship between the area and perimeter of the segment region, and c) distinguishing (505) the object on the basis of the value of said measuring function.
2. A method as claimed in claim 1, wherein the calculating step is repeated for a second segment region which differs from the first segment region.
3. A method as claimed in claim 2, wherein the sec- ond segment region consists of the segments in the first segment region for which the value of the measuring function has already been calculated, and an added segment which is connected with the first segment region.
4. A method as claimed in claim 3, wherein the meas- uring function of the second segment region is calculated as the measuring function of the first segment region adjusted with an addition regarding the added segment.
5. A method as claimed in any one of the preceding claims, wherein measuring functions for a plurality of segment regions are calculated and wherein the object is distinguished as the segment region whose measuring func- tion value is closest to a value which is ideal for objects of the predetermined type.
6. A method as claimed in any one of the preceding claims, wherein measuring functions are calculated for essentially all segment regions, in which the Euclidean distance between all pairs of picture elements included in the segment region is smaller than a distance threshold value.
7. A method as claimed in any one of claims 1-5, wherein measuring functions corresponding to segment re- gions are calculated until a measuring function value is found, the deviation of which from a value which is ideal for objects of the predetermined type is below a measuring function threshold value, and wherein the object is identified as the corresponding segment region of this measuring function.
8. A method as claimed in any one of the preceding claims, wherein the distinguished object is excluded from said set of connected segments, after which a process according to the method is repeated on the resulting re- maining quantity.
9. A method as claimed in any one of the preceding claims, wherein in step (a) a segment which, probably not on its own, reproduces an object of the searched type is selected as the start segment .
10. A method as claimed in any one of the preceding claims, which is repeated several times with different choices of start segment, the correspondence between the results from the different times being checked.
11. A method as claimed in claim 10, wherein a statistical processing of the results is carried out and distinguishing takes place based on the result of this processing.
12. An arrangement for distinguishing an object of a predetermined type in a digital microscope image which reproduces biological material and which comprises a set of connected segments, the object consisting of at least one segment in the set , c h a r a c t e r i z e d by means (1002) for selecting a start segment, means (1003) for calculating a value of a measuring function for a first segment region which comprises at least the start segment in the set, the measuring function being depend- ent on at least the relationship between the area and - perimeter of the segment region, and means (1004) for distinguishing the object based on the value of said measuring function.
13. A computer program for distinguishing an object of a predetermined type in a digital microscope image which reproduces biological material and which comprises a set of connected segments, the object consisting of at least one segment in the set, c h a r a c t e r i z e d by instructions corresponding to the steps of a) selecting a start segment, b) calculating a value of a measuring function for a first segment region which comprises at least the start segment in the set, the measuring function being dependent at least on the relationship between the area and - perimeter of the segment region, and c) distinguishing the object based on the value of said measuring function.
14. A digital storage medium comprising a computer program as claimed in claim 13.
PCT/SE2002/000882 2001-05-16 2002-05-08 Information processing for distinguishing an object WO2002093450A1 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
SE0101712A SE0101712L (en) 2001-05-16 2001-05-16 Ways to handle information
SE0101712-8 2001-05-16
US31627701P 2001-09-04 2001-09-04
US60/316,277 2001-09-04

Publications (1)

Publication Number Publication Date
WO2002093450A1 true WO2002093450A1 (en) 2002-11-21

Family

ID=26655464

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/SE2002/000882 WO2002093450A1 (en) 2001-05-16 2002-05-08 Information processing for distinguishing an object

Country Status (1)

Country Link
WO (1) WO2002093450A1 (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7576912B2 (en) 2004-05-07 2009-08-18 P.A.L.M. Microlaser Technologies Gmbh Microscope table and insert
US7848552B2 (en) 2004-05-11 2010-12-07 P.A.L.M. Microlaser Technologies Gmbh Method for processing a material by means of a laser irradiation and control system
CN104766324A (en) * 2015-04-08 2015-07-08 山东大学 White blood cell segmentation method based on super pixels and anomaly detection color blood cell image
US9955910B2 (en) 2005-10-14 2018-05-01 Aranz Healthcare Limited Method of monitoring a surface feature and apparatus therefor
US10013527B2 (en) 2016-05-02 2018-07-03 Aranz Healthcare Limited Automatically assessing an anatomical surface feature and securely managing information related to the same
CN108765426A (en) * 2018-05-15 2018-11-06 南京林业大学 automatic image segmentation method and device
US10874302B2 (en) 2011-11-28 2020-12-29 Aranz Healthcare Limited Handheld skin measuring or monitoring device
US11116407B2 (en) 2016-11-17 2021-09-14 Aranz Healthcare Limited Anatomical surface assessment methods, devices and systems
CN116320535A (en) * 2023-04-14 2023-06-23 北京百度网讯科技有限公司 Method, device, electronic equipment and storage medium for generating video
US11903723B2 (en) 2017-04-04 2024-02-20 Aranz Healthcare Limited Anatomical surface assessment methods, devices and systems

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5768405A (en) * 1993-07-22 1998-06-16 U.S Philips Corporation Digital image processing method for local determination of the center and the width of objects in the form of contrasting bands on a background
US5848198A (en) * 1993-10-08 1998-12-08 Penn; Alan Irvin Method of and apparatus for analyzing images and deriving binary image representations
US5857030A (en) * 1995-08-18 1999-01-05 Eastman Kodak Company Automated method and system for digital image processing of radiologic images utilizing artificial neural networks
US5887074A (en) * 1996-12-13 1999-03-23 Siemens Corporate Research, Inc. Local principal component based method for detecting activation signals in functional MR images
WO1999044010A1 (en) * 1998-02-27 1999-09-02 Gutkowicz Krusin Dina Systems and methods for the multispectral imaging and characterization of skin tissue
US5987094A (en) * 1996-10-30 1999-11-16 University Of South Florida Computer-assisted method and apparatus for the detection of lung nodules
US6014452A (en) * 1997-07-28 2000-01-11 R2 Technology, Inc. Method and system for using local attention in the detection of abnormalities in digitized medical images
WO2000065985A2 (en) * 1999-04-29 2000-11-09 University Of South Florida Method and system for knowledge guided hyperintensity detection and volumetric measurement
US6167146A (en) * 1997-08-28 2000-12-26 Qualia Computing, Inc. Method and system for segmentation and detection of microcalcifications from digital mammograms
US6307957B1 (en) * 1997-02-28 2001-10-23 Electro-Optical Sciences Inc Multispectral imaging and characterization of biological tissue

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5768405A (en) * 1993-07-22 1998-06-16 U.S Philips Corporation Digital image processing method for local determination of the center and the width of objects in the form of contrasting bands on a background
US5872861A (en) * 1993-07-22 1999-02-16 U.S. Philips Corporation Digital image processing method for automatic detection of stenoses
US5848198A (en) * 1993-10-08 1998-12-08 Penn; Alan Irvin Method of and apparatus for analyzing images and deriving binary image representations
US5857030A (en) * 1995-08-18 1999-01-05 Eastman Kodak Company Automated method and system for digital image processing of radiologic images utilizing artificial neural networks
US5987094A (en) * 1996-10-30 1999-11-16 University Of South Florida Computer-assisted method and apparatus for the detection of lung nodules
US5887074A (en) * 1996-12-13 1999-03-23 Siemens Corporate Research, Inc. Local principal component based method for detecting activation signals in functional MR images
US6081612A (en) * 1997-02-28 2000-06-27 Electro Optical Sciences Inc. Systems and methods for the multispectral imaging and characterization of skin tissue
US6307957B1 (en) * 1997-02-28 2001-10-23 Electro-Optical Sciences Inc Multispectral imaging and characterization of biological tissue
US6014452A (en) * 1997-07-28 2000-01-11 R2 Technology, Inc. Method and system for using local attention in the detection of abnormalities in digitized medical images
US6167146A (en) * 1997-08-28 2000-12-26 Qualia Computing, Inc. Method and system for segmentation and detection of microcalcifications from digital mammograms
WO1999044010A1 (en) * 1998-02-27 1999-09-02 Gutkowicz Krusin Dina Systems and methods for the multispectral imaging and characterization of skin tissue
WO2000065985A2 (en) * 1999-04-29 2000-11-09 University Of South Florida Method and system for knowledge guided hyperintensity detection and volumetric measurement

Cited By (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7576912B2 (en) 2004-05-07 2009-08-18 P.A.L.M. Microlaser Technologies Gmbh Microscope table and insert
US7848552B2 (en) 2004-05-11 2010-12-07 P.A.L.M. Microlaser Technologies Gmbh Method for processing a material by means of a laser irradiation and control system
DE102004023262B4 (en) * 2004-05-11 2012-08-09 Carl Zeiss Microimaging Gmbh Method for processing a mass by means of laser irradiation and control system
DE102004023262B8 (en) * 2004-05-11 2013-01-17 Carl Zeiss Microimaging Gmbh Method for processing a mass by means of laser irradiation and control system
US10827970B2 (en) 2005-10-14 2020-11-10 Aranz Healthcare Limited Method of monitoring a surface feature and apparatus therefor
US9955910B2 (en) 2005-10-14 2018-05-01 Aranz Healthcare Limited Method of monitoring a surface feature and apparatus therefor
US11850025B2 (en) 2011-11-28 2023-12-26 Aranz Healthcare Limited Handheld skin measuring or monitoring device
US10874302B2 (en) 2011-11-28 2020-12-29 Aranz Healthcare Limited Handheld skin measuring or monitoring device
CN104766324A (en) * 2015-04-08 2015-07-08 山东大学 White blood cell segmentation method based on super pixels and anomaly detection color blood cell image
US10777317B2 (en) 2016-05-02 2020-09-15 Aranz Healthcare Limited Automatically assessing an anatomical surface feature and securely managing information related to the same
US11250945B2 (en) 2016-05-02 2022-02-15 Aranz Healthcare Limited Automatically assessing an anatomical surface feature and securely managing information related to the same
US10013527B2 (en) 2016-05-02 2018-07-03 Aranz Healthcare Limited Automatically assessing an anatomical surface feature and securely managing information related to the same
US11923073B2 (en) 2016-05-02 2024-03-05 Aranz Healthcare Limited Automatically assessing an anatomical surface feature and securely managing information related to the same
US11116407B2 (en) 2016-11-17 2021-09-14 Aranz Healthcare Limited Anatomical surface assessment methods, devices and systems
US11903723B2 (en) 2017-04-04 2024-02-20 Aranz Healthcare Limited Anatomical surface assessment methods, devices and systems
CN108765426A (en) * 2018-05-15 2018-11-06 南京林业大学 automatic image segmentation method and device
CN116320535A (en) * 2023-04-14 2023-06-23 北京百度网讯科技有限公司 Method, device, electronic equipment and storage medium for generating video
CN116320535B (en) * 2023-04-14 2024-03-22 北京百度网讯科技有限公司 Method, device, electronic equipment and storage medium for generating video

Similar Documents

Publication Publication Date Title
JP4420821B2 (en) Histological assessment
US8129990B2 (en) Image processing apparatus and computer program product
CN108629761B (en) Breast cancer image identification method and device and user terminal
US9466103B2 (en) Biomarker evaluation through image analysis
JP6168426B2 (en) Disease analysis apparatus, control method, and program
JP3581149B2 (en) Method and apparatus for identifying an object using a regular sequence of boundary pixel parameters
JP2002008013A (en) Device and method for preparing appearance inspection program
JP2012013675A (en) Device and method for analyzing corrosion inside steel pipe
JP2006153742A (en) Pathological diagnosis support device, pathological diagnosis support program, pathological diagnosis support method and pathological diagnosis support system
CN104540444A (en) Image-processing device, image-processing method, program and image-processing system
KR20180090756A (en) System and method for scoring color candidate poses against a color image in a vision system
WO2002093450A1 (en) Information processing for distinguishing an object
CN110633651A (en) Abnormal cell automatic identification method based on image splicing
CN110189329A (en) System and method for positioning the color block areas of colour atla
CN110838094B (en) Pathological section dyeing style conversion method and electronic equipment
CN113034528A (en) Target area and organ-at-risk delineation contour accuracy testing method based on image omics
US8406514B2 (en) Image processing device and recording medium storing image processing program
Huang et al. HEp-2 cell images classification based on textural and statistic features using self-organizing map
CN105574844B (en) Rdaiation response Function Estimation method and apparatus
CN110689586B (en) Tongue image identification method in traditional Chinese medicine intelligent tongue diagnosis and portable correction color card used for same
CN113762395B (en) Pancreatic bile duct type ampulla carcinoma classification model generation method and image classification method
JP4452624B2 (en) Automatic histological categorization of tubules
JP4981112B2 (en) Histological assessment
JP7405303B2 (en) Coal analyzer, coal analysis method, mixed coal preparation method, and coke manufacturing method
CN115546208B (en) Method, device and application for measuring plant height of field crops

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ CZ DE DE DK DK DM DZ EC EE EE ES FI FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ OM PH PL PT RO RU SD SE SG SI SK SK SL TJ TM TN TR TT TZ UA UG US UZ VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: JP

WWW Wipo information: withdrawn in national office

Country of ref document: JP