US20080287807A1 - Global motion invariant signatures for fast and accurate motion tracking in a digital image-based elasto-tomography system - Google Patents
Global motion invariant signatures for fast and accurate motion tracking in a digital image-based elasto-tomography system Download PDFInfo
- Publication number
- US20080287807A1 US20080287807A1 US11/749,594 US74959407A US2008287807A1 US 20080287807 A1 US20080287807 A1 US 20080287807A1 US 74959407 A US74959407 A US 74959407A US 2008287807 A1 US2008287807 A1 US 2008287807A1
- Authority
- US
- United States
- Prior art keywords
- markers
- motion
- subclass
- fiducial markers
- invariant
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
- A61B5/0082—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence adapted for particular medical purposes
- A61B5/0091—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence adapted for particular medical purposes for mammography
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0048—Detecting, measuring or recording by applying mechanical forces or stimuli
- A61B5/0051—Detecting, measuring or recording by applying mechanical forces or stimuli by applying vibrations
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/43—Detecting, measuring or recording for evaluating the reproductive systems
- A61B5/4306—Detecting, measuring or recording for evaluating the reproductive systems for evaluating the female reproductive systems, e.g. gynaecological evaluations
- A61B5/4312—Breast evaluation or disorder diagnosis
Definitions
- the invention relates generally to the field of breast cancer screening, and in particular to a technique of breast surface motion tracking in a digital image-based elasto-tomography system.
- Breast cancer is a significant health problem in both developed and developing countries. It is estimated that each year the disease is diagnosed in over 1,000,000 women worldwide and is the cause of death in over 400,000 women. There are many treatment options available, including surgery, chemotherapy, radiation therapy, and hormonal therapy. These treatments are significantly more effective in reducing the mortality of the disease with early detection through breast cancer screening programmes.
- mammography The standard method for detection of breast cancer is mammography.
- mammography can cause significant patient discomfort and requires radiation exposure.
- Digital Image based Elasto-tomography is an emerging technology for non-invasive breast cancer screening without the requirement of radiation.
- Digital Image-based Elasto-Tomography system will be referred to as a DIET system.
- the DIETM system uses digital imaging of an actuated breast surface to determine tissue surface motion. It then reconstructs the three-dimensional internal tissue stiffness distribution from that motion. Regions of high stiffness suggest cancer since cancerous tissue is between 3 and 10 times stiffer than healthy tissue in the breast. This approach eliminates the need for X-Rays and excessive, potentially painful compression of the breast as required in a mammogram. Hence, screening could start much younger and enjoy greater compliance.
- elasto-tomographic methods based on magnetic resonance and ultrasound modalities. Both methods are capable of measuring the tissue elasticity and they are undergoing rapid development across the globe. However, they are also costly, in terms of equipment, and take significant time to use. They are therefore limited for practical screening applications.
- the DIET system in contrast, is silicon based and is thus potentially low cost and portable, so the technology could be used in any medical centre, particularly in remote areas.
- the use of silicon technology ensures that as it improves and scales upward in capability so will the DIET system performance. This scalability of performance is not true for X-Ray or ultrasound based approaches.
- the DIET system relies on a fast and accurate measurement of the actuated breast using multiple calibrated high-resolution digital cameras. Furthermore small perturbations and variations on the surface must be measured accurately to ensure smaller tumours are not missed. Therefore, there exists a need in the art for very high-resolution feature registration and motion tracking system that can deal with the unique requirements of a DIET system. In addition, for clinical effectiveness, the measured motion must be done with a minimal amount computation.
- the present invention is directed towards overcoming the problem of very high resolution feature registration and motion tracking with a minimal amount of computation in connection with the DIET system; consisting of a patient bed, an actuator to induce oscillation in the breast, an array of digital cameras and computer software for processing images of the breast surface and transforming into measured motion, and computer software for converting measured motion into a three-dimensional distribution of stiffness of the breast.
- a method for converting digital images of an actuated breast into an accurate description of breast surface motion from such a DIET system as described above comprises the steps of artificially placing a high density of fiducial markers on the breast surface, whereby the fiducial markers have different qualities and are placed in different proportions according to their quality; utilizing motion invariant properties of the fiducial markers to form a global motion invariant signature; tracking the markers on the actuated breast surface from image to image in each digital camera using the global motion invariant signature; and using the cameras calibration to measure the breast surface motion.
- the invention is a method for generating a high resolution feature registration and motion tracking system with minimal computation wherein the method comprising the steps of artificially placing a plurality of fiducial markers on a surface of a breast, each of the markers having a characteristic according to a class of characteristics, the class having a plurality of subclasses wherein the markers in each subclass have a common characteristic, the subclasses each having a unique number of markers; tracking the motion of the markers of a first subclass having the fewest number of markers on the surface from a first image to a second image; partitioning the surface based upon the first subclass of markers; tracking the motion of the markers of a second subclass with the next fewest number of markers within each partition; and partitioning the surface based upon the second subclass of markers.
- the invention is a method for generating a high resolution feature registration and motion tracking system with minimal computation in connection with a digital image-based elasto-tomography system, the method comprising the steps of: artificially placing a plurality of fiducial markers on a tissue surface; actuating the tissue surface; imaging the tissue surface with an array of digital cameras; choosing motion invariant properties of the fiducial markers to form a global motion invariant signature; tracking the markers on the actuated tissue surface from image to image in each digital camera using the global motion invariant signature; and using the tracked motion in each camera and the camera calibration to measure tissue surface motion.
- the invention is a method for generating a high resolution feature registration and motion tracking system with minimal computation in connection with a digital image-based elasto-tomography system the method comprising the steps of: artificially placing a plurality of fiducial markers on a tissue surface; imaging the tissue surface with an array of spatially calibrated digital cameras; choosing camera invariant properties of the fiducial markers and forming camera angle invariant signatures; identifying common markers in the images of a non-actuated tissue between all cameras in the array using the camera angle invariant signatures; tracking the markers on the actuated tissue surface from image to image in each digital camera using a global motion invariant signature; using the tracked motion in each camera and the camera calibration to measure tissue surface motion.
- the invention is a digital image-based elasto-tomography apparatus, comprising: an array of spatially calibrated cameras; a vibration unit situated proximate to the array of cameras; and a computer system in electrical communication with the cameras and configured for computing the surface motion of an object actuated by the vibration unit and within a field of view of the cameras.
- the invention has the advantages of accurately and efficiently tracking large numbers of markers that are close together for a large array of digital cameras.
- the invention has flexibility in varying the type of pattern and shape of the fiducial markers, and distribution density of the fiducial markers for improved accuracy and allows significant freedom in the amount of pixel movement between images in feature registration for improved efficiency.
- FIG. 1A is a view of an apparatus implementing the DIET system according to the present invention.
- FIG. 11B is a diagram summary of the DIET system.
- FIG. 2 is a block diagram of a method, according to the present invention, of generating the measurement of the breast surface motion under actuation in a DIET system.
- FIG. 3 is a block diagram of a detailed embodiment of the step of determining the motion of the red points as shown in FIG. 2 .
- FIG. 4 is an artificially simulated group of blue dots in an image differing by an induced linear motion in a first example.
- FIG. 5 is the linear invariant signature for the example of blue dots demonstrating the concept in the first example.
- FIG. 6 is the registration of the blue dots between images in the first example.
- FIG. 7 is an artificially generated binary image containing 1000 circles according to a second example.
- FIG. 8 is the induced motion field of the binary image in FIG. 7 .
- FIG. 9 is a geometric method of ruling out non-corresponding points in the second example.
- FIG. 10 is the registration of blue points between images in the second example.
- FIG. 11 is two images of deformations of a visco-elastic breast phantom according to a third example.
- FIG. 12 is the registration of the blue dots between images in the third example.
- FIG. 13 is the final motion field of all the points in the third example.
- the DIET system of the present invention preferably relies on tracking high densities of artificially placed fiducial markers.
- the fiducial markers are features of the tissue itself such as natural markers or changes in skin tone. This alternative will require higher quality cameras (better contrast) and possibly more image processing, such as the use of color filters, than the preferred embodiment with artificial fiducial markers.
- FIG. 1A shows the apparatus with the patient lying prone on a patient support 105 .
- a vibration unit 102 under the bed/table contacts a breast 108 , which is preferably marked with artificial fiducial markers, as described below.
- two or more vibration units 102 are used to actuate the breast from different locations.
- An array of cameras 104 below the bed/table captures images of the breast 108 as it is vibrated by the vibration unit 102 .
- the cameras 104 are preferably high resolution cameras, such as those that produce 1 mega-pixel frames.
- the vibration unit 102 vibrates the breast 108 at a rate that is close to, but offset from the camera speed.
- the vibration rate would be about 101 Hz for a camera speed of about 100 frames per second.
- the camera speed may be a fraction of 100 frames per second and used with the same vibration rate to achieve similar results.
- the point is to capture a small amount of movement with each frame.
- the low vibration rates (on the order of 100 Hz) are chosen (as opposed to ultrasonic rates typically used in elasto-tomography) because the breast tissue is much more responsive to vibrations near those frequencies than higher frequencies, such as ultrasonic frequencies.
- the cameras 104 are arrayed around the breast 108 and calibrated such that any point on the breast is visible to at least two cameras.
- the cameras 104 are spatially calibrated by standard techniques used for tracking points with multiple cameras, and the images captured by the cameras are transmitted to the computer 110 for image registration and motion tracking with software to measure the surface motion of the breast 108 .
- the computer 110 then uses software to convert the surface motion into a stiffness distribution 106 .
- markers are randomly applied to the breast according to a class of characteristics with two or more subclasses wherein each subclass has a different number of markers.
- the class of characteristics may be, for example, color wherein each subclass has markers with a common color that is different from the colors of markers in different classes. For example, one subclass may have red markers and another subclass may have blue markers.
- the class is shape and each subclass has markers with a common shape that is different from the shapes of markers in other subclasses.
- the different shapes may include a triangle, a circle, a square, etc.
- the class is size and each subclass has markers with a common size.
- the invention is described with the markers applied according to a class having three primary colours with subclasses of red, green and blue.
- the markers may be applied with a local pattern such as pattern having a red marker surrounded by four green markers and sixteen blue markers. Further, the markers may use alternative colors to red, green, and blue.
- step 200 the coloured points red, green, and blue are placed with increasing densities in the preferred ratio 1:4:16 where the blue points are in a sufficiently high density to accurately measure surface motion on the scale of ⁇ 1 cm 2 .
- Alternative ratios may also be used, such as 1:2:4.
- the smaller number of red points serve to allow rapid overall motion tracking and the green and blue points account for progressively smaller motions.
- the invention will accommodate substantially any density of markers; however, generally speaking, the higher the density, the more accurate the results. A user may determine the appropriate density of markers by considering the resolution of the image and the desired accuracy of the analysis.
- a density of less than one marker per pixel would be sufficient.
- a density of more than 1-2 dots per pixel would be required.
- the global colour-based signatures representing the red points in each image are computed for each pair of consecutive frames in step 204 .
- This global signature is developed using motion invariant properties of the markers, which do not change substantially between the sequential frames. For example the distances between a particular point and its two closest points is generally motion invariant.
- Step 204 is shown in more detail in Steps 300 to 308 in FIG. 3 described below.
- the global signature for the red points is used to interpolate between the red points to approximately register first the green and then the blue points from the second frame to the first frame. The system performs a closest point search to match the approximately registered green and blue points to the respective green and blue points of the first frame.
- step 210 the system selects points on the red point 3-D continuous trajectories that correspond to the actual points in the chosen frame sequence to thereby use the computed curves to predict the location of the points in the respective frames.
- the system computes the error between the predicted and actual motion in step 212 using normalized cross-correlation (NCC) or another error metric. If these computed errors are within tolerances set by the user, step 214 outputs the final surface motion to a data file 216 . Otherwise, step 214 returns the system to step 202 to choose a new sequence of frames and repeat the following steps. The loop continues until the error is within tolerances or it is stopped by the user.
- NCC normalized cross-correlation
- the system forms the color based global signature of the red points in each of two consecutive frames in the chosen sequence by representing each red point by the distance to the closest green and blue point, respectively, in step 300 .
- the global signature is substantially invariant to local linear or affine transformations.
- the system locates the nearest red point in the second frame to each of the red points in the first frame to provide an initial correspondence of red points in the two frames.
- the system in step 304 applies a maximum distance between the correlated red points set by a user and eliminates any correlated points that differ by distances higher than this maximum. Step 304 thus eliminates a large number of non-corresponding points.
- the system rules out further non-corresponding points in step 306 by forming a triangle between a red point, the closest point to the first red point, and the second closest point to the first red point in the first frame and then comparing the lengths of the three sides to the sides of a triangle formed between the points in the second frame that were correlated to the three points in the first frame in step 302 . If the three differences between the three lengths is less than a predetermined tolerance, the two red points are accepted. If any of the differences in lengths are outside the tolerance, both points are rejected as non-corresponding. The remaining red points in the first frame are each correlated to a point in the second frame so the system may compute and output a motion vector between the corresponding dots in step 308 . Steps 300 - 308 are repeated for each set of two consecutive frames in the chosen sequence.
- the differing densities of blue, green, and red points serves two purposes. First, they maximise discrimination between non-corresponding landmark points and second, they provide a hierarchical method of matching all the points, dramatically reducing the computation required. Referring to FIG. 2 , the hierarchical method involves first matching the smaller density of red points in step 204 , then using interpolation and a closest point search to the higher density of green and blue points in step 206 .
- the blue dots in the two resulting images are shown in the plot 400 of FIG. 4 .
- the linear invariant signatures are calculated in step 300 for the blue dots and shown in the linear invariant signatures plot 500 of FIG. 5 .
- steps 302 and 306 are applied without step 304 to match the blue points and rule out non-corresponding points.
- the resulting corresponding blue points are used to compute the best least squares linear transformation mapping ⁇ to I.
- the resulting registration of ⁇ onto 1600 is shown in FIG. 6 . All blue, green, and red points in the registered version of ⁇ are then matched to the closest blue, green and red points in I within a noise threshold of 6 pixels. This process is repeated for 100 random simulations and no false identifications are made.
- FIG. 9 shows a plot 900 illustrating step 306 with three red points, 902 , 904 , and 906 , in I and three red points, 902 ′, 904 ′, and 906 ′, in ⁇ which are initially corresponding points after step 302 and 304 .
- Point 906 / 906 ′ is non-corresponding, however, and is denoted by a circle. This demonstrates the importance of Step 306 which would reject the circle of red points since the three distances of the triangle in I are significantly different from the three distances of the corresponding triangle in ⁇ , with a maximum absolute difference of ⁇ 67 pixels, which is much greater than the error tolerance of 10 pixels.
- Step 206 is then performed where interpolation is done with two-dimensional cubic splines which interpolate x-direction motion and y-direction motion between the red points separately.
- the plot 1000 of FIG. 10 shows an example of blue points in ⁇ registered by interpolation between the red points onto blue points of I. After the registration a closest point search matches all red, blue, and green points of image ⁇ onto I.
- FIG. 11 are denoted by crosses in FIG. 12 and show a close match.
- a closest point search is then performed to match the crosses precisely to the corresponding points in the image 1100 in FIG. 11 , which produces the motion field 1300 shown in FIG. 13 for all the red, green, and blue points excluding overlaps.
- the signature method can be applied on all consecutive pairs of frames in an actuation sequence to track a high density of points very accurately and with minimal computation. Furthermore the method is not restricted to very small motion between images and so the method of adaptive frame sampling in steps 202 - 214 can be applied, significantly further reducing computation.
- a global colour-based motion invariant signature utilizing different proportions of fiducial markers in a hierarchical structure is a very effective method for tracking large numbers of points, ensuring that small local perturbations as well as large global motions on the breast surface can be accurately measured with low computational requirements.
- the markers may be applied in a global pattern, such as in the case that the markers are applied to the breast with a template.
- the colors of the markers may be ignored, or the markers may be applied in a single color.
- the patient support 105 shown in FIG. 1A is illustrated as a bed/table with the patient in a prone position; however the DIET system 100 may be alternatively configured with the patient in a supine position. Further, the patient support 105 may be configured as a platform or a seat with the patient in a non-horizontal position.
- the invention has been described as tracking the surface motion of a breast for the purpose of providing data that may be used to determine the stiffness distribution throughout the breast.
- the invention may alternatively be used to track the surface motion of any organ or tissue wherein dysfunction or damage may be determined by altered or variable tissue elastic, damping, or mass properties.
- the invention may be used in conjunction with MRI, laser sheets, point laser, PIV methods via digital or analog imaging, or ultrasound.
- DIET System 102 vibration unit 104 arrayed and calibrated digital cameras 105 patient support 106 stiffness distribution of breast 108 breast 110 computer 200 step of placing points on breast 202 step of choosing sequence of frames and identifying points 204 step of determining the global motion invariant signature to track red points 206 step of interpolation to register blue and green points 208 step of computing three-dimensional trajectories 210 step of predicting motion between frames 212 step of comparing predicted motion with actual motion 214 step of determining if the results are within chosen tolerances 216 step of outputting the surface motion 300 step of computing global signature using closest distances 302 step of determining the initial correspondence of red points 304 step of performing the first test for ruling out points 306 step of performing the second test for ruling out points 308 step of outputting the corresponding red points 400 first example plot showing blue dots in images I and I 500 linear invariant signatures plot 600 registration of blue dots in I onto I 700 second example - binary image plot 800 motion field 900 plot illustrating step 306 902, 904, red
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Biomedical Technology (AREA)
- Molecular Biology (AREA)
- Veterinary Medicine (AREA)
- Biophysics (AREA)
- Pathology (AREA)
- Engineering & Computer Science (AREA)
- Public Health (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Physics & Mathematics (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Gynecology & Obstetrics (AREA)
- Reproductive Health (AREA)
- Image Processing (AREA)
- Apparatus For Radiation Diagnosis (AREA)
Abstract
Description
- The invention relates generally to the field of breast cancer screening, and in particular to a technique of breast surface motion tracking in a digital image-based elasto-tomography system.
- Breast cancer is a significant health problem in both developed and developing countries. It is estimated that each year the disease is diagnosed in over 1,000,000 women worldwide and is the cause of death in over 400,000 women. There are many treatment options available, including surgery, chemotherapy, radiation therapy, and hormonal therapy. These treatments are significantly more effective in reducing the mortality of the disease with early detection through breast cancer screening programmes.
- The standard method for detection of breast cancer is mammography. However mammography can cause significant patient discomfort and requires radiation exposure. Furthermore there are often variable results and inconsistencies in reading and interpreting the images of breast tissue from the X-Ray machine especially for smaller tumour sizes of the order of 1-5 mm.
- Digital Image based Elasto-tomography is an emerging technology for non-invasive breast cancer screening without the requirement of radiation. As used herein, Digital Image-based Elasto-Tomography system will be referred to as a DIET system. The DIE™ system uses digital imaging of an actuated breast surface to determine tissue surface motion. It then reconstructs the three-dimensional internal tissue stiffness distribution from that motion. Regions of high stiffness suggest cancer since cancerous tissue is between 3 and 10 times stiffer than healthy tissue in the breast. This approach eliminates the need for X-Rays and excessive, potentially painful compression of the breast as required in a mammogram. Hence, screening could start much younger and enjoy greater compliance. Presently, there are other elasto-tomographic methods based on magnetic resonance and ultrasound modalities. Both methods are capable of measuring the tissue elasticity and they are undergoing rapid development across the globe. However, they are also costly, in terms of equipment, and take significant time to use. They are therefore limited for practical screening applications.
- The DIET system, in contrast, is silicon based and is thus potentially low cost and portable, so the technology could be used in any medical centre, particularly in remote areas. In addition, the use of silicon technology ensures that as it improves and scales upward in capability so will the DIET system performance. This scalability of performance is not true for X-Ray or ultrasound based approaches.
- The DIET system relies on a fast and accurate measurement of the actuated breast using multiple calibrated high-resolution digital cameras. Furthermore small perturbations and variations on the surface must be measured accurately to ensure smaller tumours are not missed. Therefore, there exists a need in the art for very high-resolution feature registration and motion tracking system that can deal with the unique requirements of a DIET system. In addition, for clinical effectiveness, the measured motion must be done with a minimal amount computation.
- The present invention is directed towards overcoming the problem of very high resolution feature registration and motion tracking with a minimal amount of computation in connection with the DIET system; consisting of a patient bed, an actuator to induce oscillation in the breast, an array of digital cameras and computer software for processing images of the breast surface and transforming into measured motion, and computer software for converting measured motion into a three-dimensional distribution of stiffness of the breast.
- Briefly summarized, according to one aspect of the invention a method for converting digital images of an actuated breast into an accurate description of breast surface motion from such a DIET system as described above comprises the steps of artificially placing a high density of fiducial markers on the breast surface, whereby the fiducial markers have different qualities and are placed in different proportions according to their quality; utilizing motion invariant properties of the fiducial markers to form a global motion invariant signature; tracking the markers on the actuated breast surface from image to image in each digital camera using the global motion invariant signature; and using the cameras calibration to measure the breast surface motion.
- In one form, the invention is a method for generating a high resolution feature registration and motion tracking system with minimal computation wherein the method comprising the steps of artificially placing a plurality of fiducial markers on a surface of a breast, each of the markers having a characteristic according to a class of characteristics, the class having a plurality of subclasses wherein the markers in each subclass have a common characteristic, the subclasses each having a unique number of markers; tracking the motion of the markers of a first subclass having the fewest number of markers on the surface from a first image to a second image; partitioning the surface based upon the first subclass of markers; tracking the motion of the markers of a second subclass with the next fewest number of markers within each partition; and partitioning the surface based upon the second subclass of markers.
- In another form, the invention is a method for generating a high resolution feature registration and motion tracking system with minimal computation in connection with a digital image-based elasto-tomography system, the method comprising the steps of: artificially placing a plurality of fiducial markers on a tissue surface; actuating the tissue surface; imaging the tissue surface with an array of digital cameras; choosing motion invariant properties of the fiducial markers to form a global motion invariant signature; tracking the markers on the actuated tissue surface from image to image in each digital camera using the global motion invariant signature; and using the tracked motion in each camera and the camera calibration to measure tissue surface motion.
- In another form, the invention is a method for generating a high resolution feature registration and motion tracking system with minimal computation in connection with a digital image-based elasto-tomography system the method comprising the steps of: artificially placing a plurality of fiducial markers on a tissue surface; imaging the tissue surface with an array of spatially calibrated digital cameras; choosing camera invariant properties of the fiducial markers and forming camera angle invariant signatures; identifying common markers in the images of a non-actuated tissue between all cameras in the array using the camera angle invariant signatures; tracking the markers on the actuated tissue surface from image to image in each digital camera using a global motion invariant signature; using the tracked motion in each camera and the camera calibration to measure tissue surface motion.
- In another form, the invention is a digital image-based elasto-tomography apparatus, comprising: an array of spatially calibrated cameras; a vibration unit situated proximate to the array of cameras; and a computer system in electrical communication with the cameras and configured for computing the surface motion of an object actuated by the vibration unit and within a field of view of the cameras.
- The invention has the advantages of accurately and efficiently tracking large numbers of markers that are close together for a large array of digital cameras. The invention has flexibility in varying the type of pattern and shape of the fiducial markers, and distribution density of the fiducial markers for improved accuracy and allows significant freedom in the amount of pixel movement between images in feature registration for improved efficiency.
- These and other aspects, objects, features and advantages of the present invention will be more clearly understood and appreciated from a review of the following description of the preferred embodiment and appended claims, and by reference to the accompanying drawings.
- The present invention is disclosed with reference to the accompanying drawings, wherein:
-
FIG. 1A is a view of an apparatus implementing the DIET system according to the present invention. -
FIG. 11B is a diagram summary of the DIET system. -
FIG. 2 is a block diagram of a method, according to the present invention, of generating the measurement of the breast surface motion under actuation in a DIET system. -
FIG. 3 is a block diagram of a detailed embodiment of the step of determining the motion of the red points as shown inFIG. 2 . -
FIG. 4 is an artificially simulated group of blue dots in an image differing by an induced linear motion in a first example. -
FIG. 5 is the linear invariant signature for the example of blue dots demonstrating the concept in the first example. -
FIG. 6 is the registration of the blue dots between images in the first example. -
FIG. 7 is an artificially generated binary image containing 1000 circles according to a second example. -
FIG. 8 is the induced motion field of the binary image inFIG. 7 . -
FIG. 9 is a geometric method of ruling out non-corresponding points in the second example. -
FIG. 10 is the registration of blue points between images in the second example. -
FIG. 11 is two images of deformations of a visco-elastic breast phantom according to a third example. -
FIG. 12 is the registration of the blue dots between images in the third example. -
FIG. 13 is the final motion field of all the points in the third example. - Corresponding reference characters indicate corresponding parts throughout the several views. The examples set out herein illustrate several embodiments of the invention but should not be construed as limiting the scope of the invention in any manner.
- There are many different methods in the literature for registering images [Jan Modersitzki (2004), “Numerical Methods for Image Registration”, Oxford University Press, New York]. These methods are usually either feature or intensity based. Intensity based methods avoid the feature extraction stage but work on whole intensity images so are computationally demanding. In the context of the DIET system as shown in
FIGS. 1A and 1B , to capture the full motion of the breast surface with very fine detail requires a large array of high resolution cameras and potentially 1000's of frames for each camera to be analyzed to capture small subtle variations in the breast surface due to a small tumour. Thus methods that work with whole intensity images, for example Normalized Cross-Correlation (NCC) based [J. P. Lewis (1995), “Fast Normalized Cross-Correlation”, Vision Interface, 120-1231 are not feasible for the DIET system. - Feature based methods are potentially suitable since they minimize the amount of pixel information used. However natural feature extraction on the breast may miss vital areas due to low contrast and consequently miss an abnormal surface perturbation due to a tumour. Thus the DIET system of the present invention preferably relies on tracking high densities of artificially placed fiducial markers. In an alternative embodiment, however, the fiducial markers are features of the tissue itself such as natural markers or changes in skin tone. This alternative will require higher quality cameras (better contrast) and possibly more image processing, such as the use of color filters, than the preferred embodiment with artificial fiducial markers.
- Common methods like snakes [M. Kass, A. Witkin and D. Terzopoiulos (1988), “Snakes: Active Contour Models”, International Journal of Computer Vision, 1(4):321-331; N. Peterfreund (1999), “Robust tracking of position and velocity with Kalman Snakes”, IBEE Transactions on Pattern Analysis and Machine Intelligence, 21(6):564-569] and gradient decent (GDS) [Q. Qheng and R. Chellapa (1995), Automatic Feature Point Extraction and Tracking in Image Sequences for Arbitrary Camera Motion, International Journal of Computer vision, vol. 15, pp. 31-76] are limited to small numbers of points, track each point separately and are highly dependent on fuzziness or varying light conditions. It only requires one occasion where a particular landmark point jumps to another landmark nearby for the whole trajectory to be corrupted. There are also methods based on surface fitting of the points, for example thin plate splines [H. Chui and A. Rangarajan (2003), “A New Point Matching Algorithm for Non-Rigid Registration”, 89 (2-3);114-141]. However the problem with these methods is the significantly large number of points that need to be interpolated over as well as the huge number of times the methods would need to be applied to track tiny to large scale oscillations of the breast surface, especially during non-steady state motion. Thus the DIET system proposes unique challenges for image registration and motion tracking.
- The present invention is generally shown in
FIGS. 1A and 1B .FIG. 1A shows the apparatus with the patient lying prone on apatient support 105. Avibration unit 102 under the bed/table contacts abreast 108, which is preferably marked with artificial fiducial markers, as described below. In an alternative embodiment, two ormore vibration units 102 are used to actuate the breast from different locations. An array ofcameras 104 below the bed/table captures images of thebreast 108 as it is vibrated by thevibration unit 102. Thecameras 104 are preferably high resolution cameras, such as those that produce 1 mega-pixel frames. Thevibration unit 102 vibrates thebreast 108 at a rate that is close to, but offset from the camera speed. For example, the vibration rate would be about 101 Hz for a camera speed of about 100 frames per second. Of course, the camera speed may be a fraction of 100 frames per second and used with the same vibration rate to achieve similar results. The point is to capture a small amount of movement with each frame. The low vibration rates (on the order of 100 Hz) are chosen (as opposed to ultrasonic rates typically used in elasto-tomography) because the breast tissue is much more responsive to vibrations near those frequencies than higher frequencies, such as ultrasonic frequencies. - As shown in
FIG. 1B , thecameras 104 are arrayed around thebreast 108 and calibrated such that any point on the breast is visible to at least two cameras. Thecameras 104 are spatially calibrated by standard techniques used for tracking points with multiple cameras, and the images captured by the cameras are transmitted to thecomputer 110 for image registration and motion tracking with software to measure the surface motion of thebreast 108. Thecomputer 110 then uses software to convert the surface motion into astiffness distribution 106. - Accordingly, the present invention focuses on pre-determined qualities and patterns in artificially placed fiducial markers and completely reformulating the problem by computing a global motion invariant signature. According to one aspect of the invention and referring to
FIG. 2 , markers are randomly applied to the breast according to a class of characteristics with two or more subclasses wherein each subclass has a different number of markers. The class of characteristics may be, for example, color wherein each subclass has markers with a common color that is different from the colors of markers in different classes. For example, one subclass may have red markers and another subclass may have blue markers. In an alternative example, the class is shape and each subclass has markers with a common shape that is different from the shapes of markers in other subclasses. The different shapes may include a triangle, a circle, a square, etc. In another alternative example, the class is size and each subclass has markers with a common size. For simplicity, the invention is described with the markers applied according to a class having three primary colours with subclasses of red, green and blue. In alternative embodiments, the markers may be applied with a local pattern such as pattern having a red marker surrounded by four green markers and sixteen blue markers. Further, the markers may use alternative colors to red, green, and blue. - In step 200 (
FIG. 2 ), the coloured points red, green, and blue are placed with increasing densities in the preferred ratio 1:4:16 where the blue points are in a sufficiently high density to accurately measure surface motion on the scale of ≈1 cm2. Alternative ratios may also be used, such as 1:2:4. The smaller number of red points serve to allow rapid overall motion tracking and the green and blue points account for progressively smaller motions. The invention will accommodate substantially any density of markers; however, generally speaking, the higher the density, the more accurate the results. A user may determine the appropriate density of markers by considering the resolution of the image and the desired accuracy of the analysis. For example, if one wanted an accuracy of 1 mm and a pixel covered a 0.01 mm2 area, a density of less than one marker per pixel would be sufficient. For an accuracy of 1 μm with the same resolution, a density of more than 1-2 dots per pixel would be required. - After identifying blue, green, and red points and a chosen sequence of frames representing breast motion in
step 202, the global colour-based signatures representing the red points in each image are computed for each pair of consecutive frames instep 204. This global signature is developed using motion invariant properties of the markers, which do not change substantially between the sequential frames. For example the distances between a particular point and its two closest points is generally motion invariant. Step 204 is shown in more detail inSteps 300 to 308 inFIG. 3 described below. Instep 206, the global signature for the red points is used to interpolate between the red points to approximately register first the green and then the blue points from the second frame to the first frame. The system performs a closest point search to match the approximately registered green and blue points to the respective green and blue points of the first frame. - The system then, using the data associated with the spatial calibration of the cameras and cubic splines, computes the 3-D space curves for the red point trajectories parameterized in time for the chosen sequence of frames in
step 208. Instep 210, the system selects points on the red point 3-D continuous trajectories that correspond to the actual points in the chosen frame sequence to thereby use the computed curves to predict the location of the points in the respective frames. The system computes the error between the predicted and actual motion instep 212 using normalized cross-correlation (NCC) or another error metric. If these computed errors are within tolerances set by the user,step 214 outputs the final surface motion to adata file 216. Otherwise, step 214 returns the system to step 202 to choose a new sequence of frames and repeat the following steps. The loop continues until the error is within tolerances or it is stopped by the user. - These steps are then repeated for each camera to output the surface motion over the
entire breast 108. This data may then be used to determine thestiffness distribution 106 throughout the breast, such as with Integral-Based Parameter Identification Applied to three-dimensional Tissue Reconstruction in a DIET System described in my copending patent application Integral-Based Parameter Identification Applied to Three-Dimensional tissue Stiffness Reconstruction in a Digital Image-Based Elasto-Tomography System, attorney docket number 3023246 US01, the disclosure of which is herein incorporated by reference. - Referring to
FIG. 3 , the system forms the color based global signature of the red points in each of two consecutive frames in the chosen sequence by representing each red point by the distance to the closest green and blue point, respectively, instep 300. Thus the global signature is substantially invariant to local linear or affine transformations. Instep 302, the system locates the nearest red point in the second frame to each of the red points in the first frame to provide an initial correspondence of red points in the two frames. The system instep 304 applies a maximum distance between the correlated red points set by a user and eliminates any correlated points that differ by distances higher than this maximum. Step 304 thus eliminates a large number of non-corresponding points. - The system rules out further non-corresponding points in
step 306 by forming a triangle between a red point, the closest point to the first red point, and the second closest point to the first red point in the first frame and then comparing the lengths of the three sides to the sides of a triangle formed between the points in the second frame that were correlated to the three points in the first frame instep 302. If the three differences between the three lengths is less than a predetermined tolerance, the two red points are accepted. If any of the differences in lengths are outside the tolerance, both points are rejected as non-corresponding. The remaining red points in the first frame are each correlated to a point in the second frame so the system may compute and output a motion vector between the corresponding dots instep 308. Steps 300-308 are repeated for each set of two consecutive frames in the chosen sequence. - Locally, with a high enough density of points, the motion over a sufficiently small patch on the breast surface will be close to linear. Thus even though some patches will move significantly more than other patches on the breast surface, corresponding to significantly different local linear or affine transformations, the majority of this global difference in motion will be corrected for by the signature. The problem of identifying landmark points between images related by a global motion reduces to the much simpler problem of identifying the overlap of two global motion invariant signatures.
- The differing densities of blue, green, and red points serves two purposes. First, they maximise discrimination between non-corresponding landmark points and second, they provide a hierarchical method of matching all the points, dramatically reducing the computation required. Referring to
FIG. 2 , the hierarchical method involves first matching the smaller density of red points instep 204, then using interpolation and a closest point search to the higher density of green and blue points instep 206. - To specifically demonstrate one aspect of this invention, the rest of this detailed part of the disclosure will consist of three examples which progressively become a more realistic representation of motion tracking in a DIET system. Consider an example where the global motion is a linear transformation:
-
(x,y)→(x cos θ+y sin θ+c, −x sin θ+y cos θ+f) (1) - Let there be 40 blue dots, 20 green, and 10 red dots placed randomly on a 500K pixel image I; though, a ratio of 16:4:1 is preferred in practice. A linear transformation of Equation (1) is applied on image I where θ=45°, c=500, f=1000 to produce an image I. Random noise of up to ±3 pixels is added to the points in I and Ī and 10% of each of the blue, green, and red dots are taken randomly out of the points on Ī to simulate misidentification of colours. The blue dots in the two resulting images are shown in the
plot 400 ofFIG. 4 . In this case the linear invariant signatures are calculated instep 300 for the blue dots and shown in the linear invariant signatures plot 500 ofFIG. 5 . For this simple proof of concept example, the motion is very large, sosteps step 304 to match the blue points and rule out non-corresponding points. The resulting corresponding blue points are used to compute the best least squares linear transformation mapping Ī to I. The resulting registration of Ī onto 1600 is shown inFIG. 6 . All blue, green, and red points in the registered version of Ī are then matched to the closest blue, green and red points in I within a noise threshold of 6 pixels. This process is repeated for 100 random simulations and no false identifications are made. - To demonstrate the concept on a non-uniform global motion field, 1000 circles with a diameter of to pixels are randomly placed on a 1 mega-pixel image I shown in the
plot 700 ofFIG. 7 . 144 red points, 285 green points, and 571 blue points are chosen to give a ratio of 1:2:4 for the purpose of illustrating the invention, though the preferred ratio is 1:4:16 in practice. Thenon-uniform motion field 800 shown inFIG. 8 is applied on the image I ofFIG. 7 to produce a new image Ī. Using the centres of the circles, global signatures for the red points are calculated usingstep 300, and steps 302-306 are performed to match the red points.FIG. 9 shows aplot 900 illustratingstep 306 with three red points, 902, 904, and 906, in I and three red points, 902′, 904′, and 906′, in Ī which are initially corresponding points afterstep Point 906/906′ is non-corresponding, however, and is denoted by a circle. This demonstrates the importance ofStep 306 which would reject the circle of red points since the three distances of the triangle in I are significantly different from the three distances of the corresponding triangle in Ī, with a maximum absolute difference of ≈67 pixels, which is much greater than the error tolerance of 10 pixels. - Step 206 is then performed where interpolation is done with two-dimensional cubic splines which interpolate x-direction motion and y-direction motion between the red points separately. The
plot 1000 ofFIG. 10 shows an example of blue points in Ī registered by interpolation between the red points onto blue points of I. After the registration a closest point search matches all red, blue, and green points of image Ī onto I. - Finally, to prove the concept on real images, two ≈1
mega-pixel images FIG. 11 though the colors are not shown in the black and white figures. Using a combination of thresholding and labeling connected 1 pixel paths, the centre and colour of each marker are found. For simplicity, markers that overlap are automatically detected and are not used to build the signature. Applying steps 302-306 to determine the motion of thered points 204, then interpolating the red points using two-dimensional cubic splines, to approximately register the green and blue points produces the registeredimages 1200 shown for the blue points inFIG. 12 . The blue points corresponding to theimage 1102 inFIG. 11 are denoted by crosses inFIG. 12 and show a close match. A closest point search is then performed to match the crosses precisely to the corresponding points in theimage 1100 inFIG. 11 , which produces themotion field 1300 shown inFIG. 13 for all the red, green, and blue points excluding overlaps. - The signature method can be applied on all consecutive pairs of frames in an actuation sequence to track a high density of points very accurately and with minimal computation. Furthermore the method is not restricted to very small motion between images and so the method of adaptive frame sampling in steps 202-214 can be applied, significantly further reducing computation. Thus a global colour-based motion invariant signature utilizing different proportions of fiducial markers in a hierarchical structure is a very effective method for tracking large numbers of points, ensuring that small local perturbations as well as large global motions on the breast surface can be accurately measured with low computational requirements.
- In an alternative embodiment, the markers may be applied in a global pattern, such as in the case that the markers are applied to the breast with a template. In a further alternative embodiment, the colors of the markers may be ignored, or the markers may be applied in a single color.
- The
patient support 105 shown inFIG. 1A is illustrated as a bed/table with the patient in a prone position; however theDIET system 100 may be alternatively configured with the patient in a supine position. Further, thepatient support 105 may be configured as a platform or a seat with the patient in a non-horizontal position. - The invention has been described as tracking the surface motion of a breast for the purpose of providing data that may be used to determine the stiffness distribution throughout the breast. However, the invention may alternatively be used to track the surface motion of any organ or tissue wherein dysfunction or damage may be determined by altered or variable tissue elastic, damping, or mass properties. Further the invention may be used in conjunction with MRI, laser sheets, point laser, PIV methods via digital or analog imaging, or ultrasound.
- While the invention has been described with reference to particular embodiments, it will be understood by those skilled in the art that various changes may be made and equivalents may be substituted for elements thereof without departing from the scope of the invention. In addition, many modifications may be made to adapt a particular situation or material to the teachings of the invention without departing from the scope of the invention.
-
PARTS LIST 100 DIET System 102 vibration unit 104 arrayed and calibrated digital cameras 105 patient support 106 stiffness distribution of breast 108 breast 110 computer 200 step of placing points on breast 202 step of choosing sequence of frames and identifying points 204 step of determining the global motion invariant signature to track red points 206 step of interpolation to register blue and green points 208 step of computing three-dimensional trajectories 210 step of predicting motion between frames 212 step of comparing predicted motion with actual motion 214 step of determining if the results are within chosen tolerances 216 step of outputting the surface motion 300 step of computing global signature using closest distances 302 step of determining the initial correspondence of red points 304 step of performing the first test for ruling out points 306 step of performing the second test for ruling out points 308 step of outputting the corresponding red points 400 first example plot showing blue dots in images I and I 500 linear invariant signatures plot 600 registration of blue dots in I onto I 700 second example - binary image plot 800 motion field 900 plot illustrating step 306 902, 904, red points in I and 906 902′, 904′, red points in I and 906′ 1000 plot registering blue dots 1100 third example - visco-elastic breast phantom image - first deformation 1102 visco-elastic breast phantom image - second deformation 1200 registered image 1300 motion field
Claims (22)
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/749,594 US20080287807A1 (en) | 2007-05-16 | 2007-05-16 | Global motion invariant signatures for fast and accurate motion tracking in a digital image-based elasto-tomography system |
US13/037,046 US8249691B2 (en) | 2007-05-16 | 2011-02-28 | Global motion invariant signatures for fast and accurate motion tracking in a digital image-based elasto-tomography system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/749,594 US20080287807A1 (en) | 2007-05-16 | 2007-05-16 | Global motion invariant signatures for fast and accurate motion tracking in a digital image-based elasto-tomography system |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/037,046 Division US8249691B2 (en) | 2007-05-16 | 2011-02-28 | Global motion invariant signatures for fast and accurate motion tracking in a digital image-based elasto-tomography system |
Publications (1)
Publication Number | Publication Date |
---|---|
US20080287807A1 true US20080287807A1 (en) | 2008-11-20 |
Family
ID=40028231
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/749,594 Abandoned US20080287807A1 (en) | 2007-05-16 | 2007-05-16 | Global motion invariant signatures for fast and accurate motion tracking in a digital image-based elasto-tomography system |
US13/037,046 Expired - Fee Related US8249691B2 (en) | 2007-05-16 | 2011-02-28 | Global motion invariant signatures for fast and accurate motion tracking in a digital image-based elasto-tomography system |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/037,046 Expired - Fee Related US8249691B2 (en) | 2007-05-16 | 2011-02-28 | Global motion invariant signatures for fast and accurate motion tracking in a digital image-based elasto-tomography system |
Country Status (1)
Country | Link |
---|---|
US (2) | US20080287807A1 (en) |
Cited By (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP2429398A1 (en) * | 2009-05-13 | 2012-03-21 | Koninklijke Philips Electronics N.V. | System for detecting global patient movement during imaging procedures |
US20150182191A1 (en) * | 2014-01-02 | 2015-07-02 | Metritrack, Inc. | System and method for tracking completeness of co-registered medical image data |
US9208581B2 (en) | 2013-01-07 | 2015-12-08 | WexEbergy Innovations LLC | Method of determining measurements for designing a part utilizing a reference object and end user provided metadata |
US9230339B2 (en) | 2013-01-07 | 2016-01-05 | Wexenergy Innovations Llc | System and method of measuring distances related to an object |
US9691163B2 (en) | 2013-01-07 | 2017-06-27 | Wexenergy Innovations Llc | System and method of measuring distances related to an object utilizing ancillary objects |
US10196850B2 (en) | 2013-01-07 | 2019-02-05 | WexEnergy LLC | Frameless supplemental window for fenestration |
US10501981B2 (en) | 2013-01-07 | 2019-12-10 | WexEnergy LLC | Frameless supplemental window for fenestration |
US10533364B2 (en) | 2017-05-30 | 2020-01-14 | WexEnergy LLC | Frameless supplemental window for fenestration |
US11970900B2 (en) | 2020-12-16 | 2024-04-30 | WexEnergy LLC | Frameless supplemental window for fenestration |
Families Citing this family (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP2023812B1 (en) | 2006-05-19 | 2016-01-27 | The Queen's Medical Center | Motion tracking system for real time adaptive imaging and spectroscopy |
US9031701B2 (en) | 2011-02-15 | 2015-05-12 | Hemosonics Llc | Characterization of blood hemostasis and oxygen transport parameters |
US9606209B2 (en) | 2011-08-26 | 2017-03-28 | Kineticor, Inc. | Methods, systems, and devices for intra-scan motion correction |
US10327708B2 (en) | 2013-01-24 | 2019-06-25 | Kineticor, Inc. | Systems, devices, and methods for tracking and compensating for patient motion during a medical imaging scan |
US9717461B2 (en) | 2013-01-24 | 2017-08-01 | Kineticor, Inc. | Systems, devices, and methods for tracking and compensating for patient motion during a medical imaging scan |
US9305365B2 (en) | 2013-01-24 | 2016-04-05 | Kineticor, Inc. | Systems, devices, and methods for tracking moving targets |
WO2014120734A1 (en) | 2013-02-01 | 2014-08-07 | Kineticor, Inc. | Motion tracking system for real time adaptive motion compensation in biomedical imaging |
US10004462B2 (en) | 2014-03-24 | 2018-06-26 | Kineticor, Inc. | Systems, methods, and devices for removing prospective motion correction from medical imaging scans |
WO2016014718A1 (en) | 2014-07-23 | 2016-01-28 | Kineticor, Inc. | Systems, devices, and methods for tracking and compensating for patient motion during a medical imaging scan |
US9726647B2 (en) | 2015-03-17 | 2017-08-08 | Hemosonics, Llc | Determining mechanical properties via ultrasound-induced resonance |
US9943247B2 (en) | 2015-07-28 | 2018-04-17 | The University Of Hawai'i | Systems, devices, and methods for detecting false movements for motion correction during a medical imaging scan |
WO2017091479A1 (en) | 2015-11-23 | 2017-06-01 | Kineticor, Inc. | Systems, devices, and methods for tracking and compensating for patient motion during a medical imaging scan |
Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5474070A (en) * | 1989-11-17 | 1995-12-12 | The Board Of Regents Of The University Of Texas System | Method and apparatus for elastographic measurement and imaging |
US5524636A (en) * | 1992-12-21 | 1996-06-11 | Artann Corporation Dba Artann Laboratories | Method and apparatus for elasticity imaging |
US5810731A (en) * | 1995-11-13 | 1998-09-22 | Artann Laboratories | Method and apparatus for elasticity imaging using remotely induced shear wave |
US6270459B1 (en) * | 1998-05-26 | 2001-08-07 | The Board Of Regents Of The University Of Texas System | Method for estimating and imaging of transverse displacements, transverse strains and strain ratios |
US6494834B2 (en) * | 2000-03-17 | 2002-12-17 | The Board Of Regents Of The University Of Texas System | Power spectral strain estimators in elastography |
US6514204B2 (en) * | 2000-07-20 | 2003-02-04 | Riverside Research Institute | Methods for estimating tissue strain |
US6585647B1 (en) * | 1998-07-21 | 2003-07-01 | Alan A. Winder | Method and means for synthetic structural imaging and volume estimation of biological tissue organs |
US20040015079A1 (en) * | 1999-06-22 | 2004-01-22 | Teratech Corporation | Ultrasound probe with integrated electronics |
US20040165767A1 (en) * | 2002-09-30 | 2004-08-26 | Gokturk Salih B. | Three-dimensional pattern recognition method to detect shapes in medical images |
Family Cites Families (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB0121984D0 (en) | 2001-09-11 | 2001-10-31 | Isis Innovation | Method and apparatus for ultrasound examination |
JP5028751B2 (en) * | 2005-06-09 | 2012-09-19 | ソニー株式会社 | Action recognition device |
-
2007
- 2007-05-16 US US11/749,594 patent/US20080287807A1/en not_active Abandoned
-
2011
- 2011-02-28 US US13/037,046 patent/US8249691B2/en not_active Expired - Fee Related
Patent Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5474070A (en) * | 1989-11-17 | 1995-12-12 | The Board Of Regents Of The University Of Texas System | Method and apparatus for elastographic measurement and imaging |
US5524636A (en) * | 1992-12-21 | 1996-06-11 | Artann Corporation Dba Artann Laboratories | Method and apparatus for elasticity imaging |
US5810731A (en) * | 1995-11-13 | 1998-09-22 | Artann Laboratories | Method and apparatus for elasticity imaging using remotely induced shear wave |
US6270459B1 (en) * | 1998-05-26 | 2001-08-07 | The Board Of Regents Of The University Of Texas System | Method for estimating and imaging of transverse displacements, transverse strains and strain ratios |
US6585647B1 (en) * | 1998-07-21 | 2003-07-01 | Alan A. Winder | Method and means for synthetic structural imaging and volume estimation of biological tissue organs |
US20040015079A1 (en) * | 1999-06-22 | 2004-01-22 | Teratech Corporation | Ultrasound probe with integrated electronics |
US6494834B2 (en) * | 2000-03-17 | 2002-12-17 | The Board Of Regents Of The University Of Texas System | Power spectral strain estimators in elastography |
US6514204B2 (en) * | 2000-07-20 | 2003-02-04 | Riverside Research Institute | Methods for estimating tissue strain |
US20040165767A1 (en) * | 2002-09-30 | 2004-08-26 | Gokturk Salih B. | Three-dimensional pattern recognition method to detect shapes in medical images |
Cited By (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP2429398A1 (en) * | 2009-05-13 | 2012-03-21 | Koninklijke Philips Electronics N.V. | System for detecting global patient movement during imaging procedures |
US9955927B2 (en) | 2009-05-13 | 2018-05-01 | Koninklijke Philips N.V. | System for detecting global patient movement during imaging procedures |
US9208581B2 (en) | 2013-01-07 | 2015-12-08 | WexEbergy Innovations LLC | Method of determining measurements for designing a part utilizing a reference object and end user provided metadata |
US9230339B2 (en) | 2013-01-07 | 2016-01-05 | Wexenergy Innovations Llc | System and method of measuring distances related to an object |
US9691163B2 (en) | 2013-01-07 | 2017-06-27 | Wexenergy Innovations Llc | System and method of measuring distances related to an object utilizing ancillary objects |
US10196850B2 (en) | 2013-01-07 | 2019-02-05 | WexEnergy LLC | Frameless supplemental window for fenestration |
US10346999B2 (en) | 2013-01-07 | 2019-07-09 | Wexenergy Innovations Llc | System and method of measuring distances related to an object utilizing ancillary objects |
US10501981B2 (en) | 2013-01-07 | 2019-12-10 | WexEnergy LLC | Frameless supplemental window for fenestration |
US20150182191A1 (en) * | 2014-01-02 | 2015-07-02 | Metritrack, Inc. | System and method for tracking completeness of co-registered medical image data |
US10835204B2 (en) * | 2014-01-02 | 2020-11-17 | Metritrack, Inc. | System and method for tracking completeness of co-registered medical image data |
US10533364B2 (en) | 2017-05-30 | 2020-01-14 | WexEnergy LLC | Frameless supplemental window for fenestration |
US11970900B2 (en) | 2020-12-16 | 2024-04-30 | WexEnergy LLC | Frameless supplemental window for fenestration |
Also Published As
Publication number | Publication date |
---|---|
US20110208043A1 (en) | 2011-08-25 |
US8249691B2 (en) | 2012-08-21 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8249691B2 (en) | Global motion invariant signatures for fast and accurate motion tracking in a digital image-based elasto-tomography system | |
US20200268339A1 (en) | System and method for patient positioning | |
US11253171B2 (en) | System and method for patient positioning | |
CN105027163B (en) | Scanning area determining device | |
US11576578B2 (en) | Systems and methods for scanning a patient in an imaging system | |
US10507002B2 (en) | X-ray system and method for standing subject | |
US20190000318A1 (en) | System and method for the coregistration of medical image data | |
US8121669B2 (en) | Method for tracking soft tissue masses in images using directed graphs | |
CN107468265A (en) | Position the check object to imaging method | |
JP6304970B2 (en) | Image processing apparatus and image processing method | |
CN103402453A (en) | System and method for automated initialization and registration of navigation system | |
JP2009512527A (en) | Image registration method, algorithm for performing the image registration method, program for registering an image using the algorithm, and biomedical image handling method for reducing image artifacts due to object movement | |
US10244945B2 (en) | System for reconstructing surface motion in an optical elastography system | |
CN1973776A (en) | Three-dimensional ultrasonic detection method | |
US10074199B2 (en) | Systems and methods for tissue mapping | |
CN107106128A (en) | Supersonic imaging device and method for splitting anatomical object | |
Meng et al. | An automatic markerless registration method for neurosurgical robotics based on an optical camera | |
US20230410346A1 (en) | Object keypoint detection | |
Ben-Hamadou et al. | Construction of extended 3D field of views of the internal bladder wall surface: A proof of concept | |
Sivaramakrishna | 3D breast image registration—a review | |
Richey et al. | Soft tissue monitoring of the surgical field: detection and tracking of breast surface deformations | |
CN104305996A (en) | Image recognition technology-based respiration monitoring method and system | |
KR101227272B1 (en) | Image registration method of ultrasound imaging and magnetic resonance imaging | |
Rigotti et al. | Surface scanning: an application to mammary surgery | |
Rodrigues | 3D Breast Cancer Models: Multimodal Data Registration |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: BOUNDARY LIFE SCIENCES, NEW ZEALAND Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:CHASE, JAMES GEOFFREY;HANN, CHRISTOPHER ERIC;RAY, LAWRENCE ALLEN;REEL/FRAME:020046/0126;SIGNING DATES FROM 20070725 TO 20071005 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |
|
AS | Assignment |
Owner name: BOUNDARY LIFESCIENCES LIMITED, NEW ZEALAND Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE RECEIVING PARTY DATA, ASSIGNMENT DOCUMENT, AND CORRESPONDENCE INFORMATION PREVIOUSLY RECORDED ON REEL 020046 FRAME 0126. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT;ASSIGNORS:CHASE, JAMES GEOFFREY;HANN, CHRISTOPHER ERIC;RAY, LAWRENCE ALLEN;SIGNING DATES FROM 20070725 TO 20071005;REEL/FRAME:038400/0018 |