CA2689950A1 - Color space transformations for use in identifying objects of interest in biological specimens - Google Patents

Color space transformations for use in identifying objects of interest in biological specimens Download PDF

Info

Publication number
CA2689950A1
CA2689950A1 CA2689950A CA2689950A CA2689950A1 CA 2689950 A1 CA2689950 A1 CA 2689950A1 CA 2689950 A CA2689950 A CA 2689950A CA 2689950 A CA2689950 A CA 2689950A CA 2689950 A1 CA2689950 A1 CA 2689950A1
Authority
CA
Canada
Prior art keywords
biological specimen
image
component
pixels
transformed
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CA2689950A
Other languages
French (fr)
Other versions
CA2689950C (en
Inventor
James Douglass
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ventana Medical Systems Inc
Original Assignee
Ventana Medical Systems, Inc.
James Douglass
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ventana Medical Systems, Inc., James Douglass filed Critical Ventana Medical Systems, Inc.
Publication of CA2689950A1 publication Critical patent/CA2689950A1/en
Application granted granted Critical
Publication of CA2689950C publication Critical patent/CA2689950C/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Classifications

    • G01N15/1433
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0012Biomedical image inspection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/60Type of objects
    • G06V20/69Microscopic objects, e.g. biological cells or cellular parts
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N15/00Investigating characteristics of particles; Investigating permeability, pore-volume, or surface-area of porous materials
    • G01N15/10Investigating individual particles
    • G01N15/14Electro-optical investigation, e.g. flow cytometers
    • G01N15/1468Electro-optical investigation, e.g. flow cytometers with spatial resolution of the texture or inner structure of the particle
    • G01N2015/1472Electro-optical investigation, e.g. flow cytometers with spatial resolution of the texture or inner structure of the particle with colour
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30004Biomedical image processing

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Theoretical Computer Science (AREA)
  • General Health & Medical Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Medical Informatics (AREA)
  • Quality & Reliability (AREA)
  • Multimedia (AREA)
  • Biomedical Technology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Radiology & Medical Imaging (AREA)
  • Molecular Biology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Investigating Or Analysing Biological Materials (AREA)
  • Image Processing (AREA)
  • Image Analysis (AREA)
  • Apparatus For Radiation Diagnosis (AREA)
  • Spectrometry And Color Measurement (AREA)

Abstract

Two color transformations, as described herein, facilitate identification of the objects of interest in the biological specimen. One of the color transformations, a Minus Clear Plus One (MC+1) transformation, can be conceptualized as either translating and rotating axes of a three-dimensional coordinate space that defines an image of the biological specimen or calculating differences between vectors in the three dimensional coordinate space that defines the image of the biological specimen. The other of the color transformations, a Quantitative Chromatic Transformation (QCT),is a colorimetric transformation that produces three new quantitities from the original red, green, and blue pixel values for each color pixel of an image. These three new quantities, X, Y, and Z
can each be related to the quantitative amount of absorbing molecules sampled by that pixel. Application of one or both of the color transformations to the image of the biological specimen results in a transformed image, in which objects of interest are more readily identifiable.

Description

76~ .236D

COLOR SPACE TRANSFORMATIONS FOR USE IN IDENTIFYING
OBJECTS OF INTEREST IN BIOLOGICAL SPECIMENS

This is a divisional of Canadian Patent Application Serial No. 2,442,339 filed September 23, 2003.

1. Field of the Invention This invention relates generally to the field of identification and analysis of biological specimens, and more particularly to a method and system for identifying objects of interest, such as cancerous cells or cellular objects, in a biological specimen.
The invention is also related to the field of color space transformations, in which a representation of an object in one color space (e.g., red, green and blue components) is transformed mathematically into a new representation in a new color space, in order to more easily observe or identify objects.
2. Description of Related Art A biological specimen such as samples of bone marrow, cervical tissue, lymph nodes, or peripheral blood, may have objects of interest to a pathologist or histologist.
Such samples are typically fixed to a slide and examined under a microscope.
An important aspect of medical diagnostics is detecting, identifying, and.
quantitating the objects of interest within the biological specimen. The objects of interest may be, for example, cancer cells, cell objects such as nuclei, or particular proteins or clusters of proteins present in die biological specimen. The cancer cells or the particular proteins in the biological specimen can be difficult to detect. However, by staining the biological specimen with a stain, the objects of interest in the biological specimen can be made more readily identifiable.

A staining process involves introducing a probe that is reactive with a component of the objects of interest. The probe typically is a monoclonal antibody, a polyclonal antiserum, or a nucleic acid that reacts with the component of the objects of interest.
Another probe with an enzyme, such as alkaline phosphatase or glucose oxidase then detects a reaction. The probe with the enzyme produces an enzymatic reaction that results in the objects of interest being stained a particular color. On the other hand, background areas and normal cells, for exaniple, are stained colors, different from the particular color. Thus, the enzymatic reaction makes identifiable the objects of interest, if any, from the background areas and normal cells of the biological specimen.

A lab technician can manually examine the biological specimen to identify the objects of interest with a microscope. Recently, however, automated microscope systems and associated software for image analysis of the captured images of the slides have been developed to examine the biological specimen. These systems improve speed and accuracy in identifying the objects of interest in the biological specimen.

For example, U.S. Patent No. 6,215,892 (4892 patent), assigned to ChromaVision Medical Systems, discloses an apparatus for automated cell analysis. The apparatus consists of a microscope with objective tenses, a stage for holding a slide, and a charged coupled device (CCD) camera. The slide inchtdes the biological specimen to be examined. As a result, the CCD camera can capture an image of the biological specimen at a magnification level determined by the objective lenses.

The image of the biological specimen facilitates identification of the objects of interest. Picture elements, i.e., pixels, typically defme the image of the biological specimen captured by the camera. Each of the pixels is made up of three components: a red component, a green component, and a blue components. Separate red, blue and green CCD cameras can be used to generate the red, blue and green pixels. The image of McDonnell Boehnen Hulbert & Berghoff 3 300 South Wacker Drive Chicago IL 60606 the biological specimen, i.e., the pixels defined by the red components, green components, and blue components, are transformed into a new representation or form.
The new representation or form makes the objects of interest within the biological specimen readily identifiable.

The process of mathematically transforming an image from one representation, into another representation or form is known as applying a "color space transformation."
Several such color transformations exist, including hue saturation and intensity transformations, and a color transformation described in the `892 patent. The color space transformation described in the `892 patent involves forming a ratio of two different color components for each pixel in the image of the biological specimen. The ratio provides a means for discriminating color information. With three components for each pixel, nine possible color ratios can be formed: R/R, R/G, R/B, G/G, G/B, G/R, B/B, B/G, and B/R. The ratio to select for the color transformation depends on a range of colors expected in the biological specimen. For example, typical stains used for detecting objects of interest such as tumor cells are predominately red, as opposed to predominately green or blue. Thus, the pixels of an object of interest contain a red component which is larger than either the green or blue components. A ratio of red divided by blue (R/B) provides a value which is greater than one for tumor cells, but is approximately one for any clear or white areas on the slide. Since the remaining cells, i.e., normal cells, typically are stained blue, the R'B ratio for pixels of these latter cells yield values of less than one. The RB ratio is preferred for clearly separating color information typical in these applications. Those pixels having color ratios that exceed a threshold level are associated with the objects of interest.

McDonnell Boehnen Hulbert & Berghoff 4 300 South Wacker Drive Chicago IL 60606 The automated cell analysis improves speed and accuracv in identifying the objects of interest in the biological specimen. The lab technician can manually review and evaluate whether pixels having ratios that exceed the threshold level are associated with the objects of interest. The lab technician need not manually analyze the biological specimen, as a whole, to identify the objects of interest.

It is not uncominon that areas of intense staining or foreign debris, such as dirt, appear on the slide. The areas of intense staining and foreign debris can cause the ratio-based color transformation of the '892 patent to improperly characterize the areas of intense staining or foreign debris as objects of interest. Since the components of the pixels in such areas are relatively "low," and since low components that make up such pixels can appear in the denominator of the ratios, the color ratio can have falsely high values, causing "false" objects of interest to appear. These false objects of interest are objects identified as being objects of interest, but are in fact either normal cells or background areas of the biological specimen.

A presence of false objects of interest associated with the ratio-based color transformation drives one to use extensive morphological processing following the color transformation to recognize and attempt to eliminate the false objects of interest.
Therefore, there exists a need for a method and system to more reliably identify objects of interest in the biological specimen, which is less sensitive to intense staining or foreign debris produced as a result of the staining process.

McDonnell Boehnen Hulbert & Berghoff ~
300 South Wacker Drive Chicago IL 60606 SLMMARY

Methods are provided llerein tor identif~.in T objects (Df intcrest, vdiich ;.al:c ad\anta`e ot usin(-Y one or nlol-e novel color space transtonnations described herein.
Several metllods are described herein Lor concCptualizin~J the color space transfortnations.

~ and for carr'ving out the transfoniiations in practice using a Ueneral-purpose computer.
The nicthods described below are pr::terabl :- coded in softwarz as a set ot instruetions ior the '-Teneral-purpos:, computer. The nietliods are particularlv desivned for use in processing an image havin` red green and blue pixel components and transtormini-, that imaUe to anotlier representation with the computer and displaying the transtormed image to the user. The transformed image enables a human operator (e.~=..
pathologist or technician) to more readily observe and identify objects of interest that are contained in specimen.

The tirst transfornlation. referred to herein as "~linus Clear Plus One- or is suited to staining methods that produce at least two different colors.
1~ Conceptually, the VIC+1 transfotniation involves translating and rotating axes ot a three-dinlensional coordinate space that defuies an image of the biolo-ical specimen.
Alternatively, the MC+1 transfonnation involves calculating differences between vectors in the tluee dimensional coordinate space. The IvIC+- transfonnation has a hiih deizree of sensitivity to objects of interest, while being insensitive to characterizing areas of ~c) intetlse staining or forei~.Tn debris produced as a result of the staining as objects ot intet-est. Tlieretore. thz VIC+l transfontiation does not pt-oduce false i(Ientificati.on ot objects of interest, tNt)ical of tlie ratio-based color transfot-mation.

McDonnell 13uthnen liulbert &- t3er,hott 6 ~00 south Wacker DriN r CI;ica,o IL liQut)(, 2. !'_-9 I?. -UQI11 The other of the color space transformations is referred to herein as the "Quantitative Chromatic Transformation" or "the QCT". Like the MC+l transformation, the QCT is also sensitive to identifying objects of interest, but insensitive to characterizing areas of intense staining or foreign debris produced as a result of the staining as objects of interest. The QCT quantitates, for each pixel, a number of absorbing molecules. The QCT produces quantities that are linearly related to concentration of analytes and is robust in the presence of instrument calibration errors.
The QCT has a high specificity to colors of interest in the biological specimen and does not introduce quantitation errors, also typical of the ratio-based color transformation.

Application of one, or both, of the above two color transformations to the image of the biological specimen results in a transformed image (or transformed images if both are used) that aid in the identification of the objects of interest in the biological specimen.

According to one exemplary embodiment of the present invention, the MC+1 color transformation involves reorienting the three-dimensional coordinate space defining the image of the biological specimen. The three-dimensional coordinate space has axes corresponding to the red component, green component, and blue component of the pixels in the image of the biological specimen. In the three-dimensional coordinate space, positive object pixels define the objects of interest in the biological specimen, counter-stained object pixels define normal cells in the biological specimen, and background pixels define background areas, e.g., clear areas, of the biological specimen.
The tliree-dimensional coordinate space is reoriented such that a cluster of the background pixels is at an origin of the three-dimensional coordinate space and the counter-stained object pixels lie substantially along an axis of the three-dimensional coordinate space. As a N4cDonnell Boehnen Hulbert & Berghoff 7 300 South Wacker Drive Chicago IL 60606 result, the positive object pixels, defining the objects of interest, if any, lie substantially between the axes of the three-dimensional coordinate space.

According to an alternative exemplary embodiment of the present invention, the MC+l color transformation, described above as reorienting the three dimensional coordinate space, may be mathematically characterized by a sum of products for each of the pixels in the image of the biological specimen. Coefficients and complements define the sum of products. Stains which identify the objects of interest in the biological specimen define the coefficients for the MC+l transformation. On the other hand, the complements are defined by the difference between the actual value of the red component and a maximum value of the red component, the actual value of the green component and the maximum value of the green component, and the actual value of the blue component and the maximum value of the blue component. The sum of the products between the coefficient and the complements, for each pixel, produces a transformed image which identifies the objects of interest, if any, in the biological specimen.

According to yet another alternative exemplary embodiment of the present invention, the MC+1 transformation may be implemented by calculating differences between vectors in the three-dimensional coordinate space. A counter-stained object vector extends from a cluster of the background pixels through counter-stained object pixels in the three-dimensional space. On the other hand, a positive object vector extends fronl the cluster of the background pixels to a positive object pixel also in the three dimensional space. The image of the biological specimen is transformed by calculating, for each pixel, a difference between the positive object vector and the counter-stained McDonnell Boehnen Hulbert & Berghoff 8 300 South Wacker Drive Chicago IL 60606 object vector. The differences for each of the pixels define a transfornied image which identifies the objects of interest, if any, in the biological specimen.

According to an alternative exemplary embodiment of the present invention, the MC+1 transformation, described above as calculating differences between vectors, may be mathematically characterized by executing instructions in software that calculate a transform value, for each pixel, the value defined by a square root of (pt' +
p,- + p; x (pic2 + pac` + p3c 2) -(pi X ptc+ P2 X P2c+ p3 ?t p3c)7- Quantities pt, p2, and p3, represent a complement of first component, e.g., red component, second component, e.g., green component, and third component, e.g., blue component, respectively, of a pixel to be transformed. On the other hand, quantities pll, P2c, and P3 represent a complement of the first component, a complement of the second component, and a complement of the third component, respectively of a representative counterstained pixel. The transform values for each of the pixels define a transformed image which can be used by an operator or through software to identify the objects of interest, if any, in the biological specimen.

The Quantitative Chromatic Transform is a colorimetric transformation that produces three new quantitities fiom the original red, green, and blue pixel values for each color pixel of an image. These three new quantities, X, Y, and Z can each be easily related to the quantitative amount of absorbing molecules sampled by that pixel by the logarithm function. The distinctive feature of the QCT, is its ability to quantitate analytes from color image data.

The QCT transformation can be implemented by calculating a quotient between a first value and a second value, the quotient defining the number of absorbing molecules, per pixel. The first value is a square of a first component, e.g., red, green, or blue McDonnell Boehnen Hulbert & Berghoff 9 300 South Wacker Drive Chicago (L 60606 component, of a pixel to be transforlned. The second value, on the other hand, is a product of a second component, e.g., also red, green, or blue component of the pixel to be transformed, and a third component, e.g., red, green, or blue component of the pixel to be transformed. The number of absorbing molecules for each pixel defines a transformed image which identifies the objects of interest, if any, in the biological specimen.

These as well as other aspects and advantages will become apparent to those of ordinary skill in the art by reading the following detailed description, with appropriate reference to the accompanying drawings.

McDonnell Boehnen Hulbert & Berghoff 10 300 South Wacker Drive Chicago IL 60606 BRIEF DESCRIPTION OF THE DRAWINGS

Exemplary embodiments of the present invention are described herein with reference to the drawings, in which:

Figure 1 is a block diagram of a representative apparatus for automated cell analysis of a biological specimen;

Figure 2 illustrates a process for identifying objects of interest in the biological specimen;

Figure 3 illustrates a pixel plotted in a three-dimensional coordinate space;

Figure 4 illustrates a mapping of pixels of the exemplary image of the biological specimen into a two-dimensional coordinate space;

Figure 5 illustrates rotating and translating the two-dimensional coordinate space of Figure 4 to produce another two-dimensional coordinate space;

Figure 6 illustrates a horizontal view of the other two-dimensional coordinate space of Figure 5;

Figure 7 illustrates results of a MC+1 transformation of the image of the biological specimen according to a rotation and translation operation;

Figure 8 illustrates defining yet another two-dimensional coordinate space which is a translation of the two-dimensional coordinate system of Figure 3;

Fiaure 9 illustrates a horizontal view of the two-dimensional coordinate space of Figure 8;

Fio,ure 10 illustrates defining vectors ranging from background pixels to positive object pixels and from background pixels to counterstained object pixels in the two dimensional coordinate space of Figure 9; and McDonnell. Boehnen Hulbei-t & Berghoff 11 300 South Wacker Drive Chicago IL 60606 Fi~ure 11 illustrates results of the MC=1 transformation of the image of the biological specimen according to vector operations.

McDonnell Boehnen Hulbert & Berghoff 12 300 South Wacker Drive Chicago IL 60606 DETAILED DESCRIPTION OF
PREFERRED EI~IBODIMENTS

Figure 1 is a block diagram of exemplary apparatus for automated cell analysis of a bioloaical specimen, in which exemplary embodiments of the present invention may be employed. It should be understood that this and other arrangements and elements (e.g., machines, interfaces, functions, orders of elements, etc.) can be added or used instead and some elements may be omitted altogether. Additionally, those skilled in the art will appreciate that many of the elements described herein are functional entities that may be implemented as discrete components or in conjunction with other components, in any suitable combination and location. Moreover, the various functions described herein as being performed by one or more entities may be carried out by hardware or by a processor programmed to execute an appropriate set of computer instnictions stored in memory. Provided with the present disclosure, those skilled in the art can constnict the hardware and develop the appropriate set of computer instructions to perform such functions. Indeed, the invention is suitable for use with existing microscope systems in current use today, including those supplied by Chromavision, Bacus Laboratories, Accumed International (now Molecular Diagnostics, Inc.) and others, with the associated computers of such systems being modified to include code performing the color space transformations described herein.

By way of example, the apparatus for performin; the automated cell analysis may include a microscope system 104, an image processinc, system 106, and a display 108.
The microscope system 104 allows for obtaining an image of the biological specimen contained on a slide 100 by means of an charged coupled device (CCD) camera McDonnell Boehnen Hulbert & Berghoff 1~
300 South Wacker Drive Chicago IL 60606 having appropriatz red, blue and green filters, or separate red blue and green CCD
cameras. The microscope svstem 104 has a motorized X-Y stage 114 holding the slide, a Z stage focus 116, objective lenses 110, a light source 112. The X-Y stage 114 allows for the slide 100 to be moved horizontally in an X-Y plane so that the biological specimen is under the objective lenses 110. X-Y positions where the slide is imaged in particular fields of view may be recorded and stored for future reference, or other means may be used to store locations on the slide where particular fields of view are obtained.

The objective lenses 110 magnify the biological specimen 100 so that individual cells, cellular structure, and other matter in the biological specimen can be discriminated.
The microscope system also has the Z stage focus 116. The Z stage focus 116 adjusts displacement of the X-Y stage 114 in a Z direction. The displacement of the X-Y stage 114 in the Z direction allows for focusing the biological specimen while under the objective lenses 110.

The camera 102 captures an electronic image of the biological specimen so that objects of interest can be identified in the biological specimen. The light from the source 112 passes through the biological specimen mounted on the slide 100, and is imaged by the objective lenses 110 on the focal plane of the CCD camera. The camera 102 captures an in-focus, magnified, electronic image of the biological specimen for analysis that is converted to digital form and stored in memory.

A digital link, e.g., data bus or communication network, connects the image processing system 106 to the microscope system 104. The microscope system 104 sends the image of the biological specimen (i.e., the electronic iznage) to the image processing system 106 so that a color transformation, i.e., the MC+l transform or QCT, as described McDonnell Boehnen Hulbert & Ber~hoff 14 300 South Wacker Drive -Chicago IL 60606 . CA 02689950 2010-01-12 herein, can be applied to the imaae. The image processing system 106 inav take the form of a general purpose computer having a processor (CPU) and a main memory. The memory stores computer instructions executable by the processor for applying the MC+l transform and/or the QCT to the image of the bioloQical specimen. As a result of applying the color transformation, the image processing system 106 produces a transformed image in which the objects of interest in the biological specimen, if any, are identifiable.

Additionally, if so equipped, the image processing system 106 may send the transformed image to a display screen 108. The display screen 108 may be a monochrome or color display coupled to the image processing system 106. The display screen 108 may present the transformed image on the display screen 108 so that a lab technician, for example, can see whether the biological specimen has any objects of interest.

Figure 2 illustrates, in more detail, a process for identifving objects of interest in the biological specimen that employs exemplary apparatus of Figure 1.

At step 120, the biological specimen is stained with one or more probes. The MC+1 transformation and the QCT performed by the image processing system 106 rely on the objects of interest being stained a different color from normal cells and background areas of the biological specimen. As a result, the biological specimen is stained with the one or more probes prior to obtaining the image of the stained biological specimen.

The one or more probes consist of reagents and/or enzymes that react differently with the cells, structures, and other matter defining the bioloaical specimen 100. For McDonnell Boehnen l-Iulbert & Bercrhoff 15 300 South Wacker Drive Chicago IL 60606 example, the probes typically result in the objects of interest reacting with the probe to produce a stain with a first color, the normal cells reacting with the probe to produce a stain with a second color, and, if the biological specimen is mounted on a slide, background areas, i.e., clear areas, being unstained. Of course, other arrangements are also possible depending on the stains emploved.

At step 122, the microscope system 104 obtains the image of the biological specimen. Pixels typically define the image of the biological specimen (i.e., the cells, structure, and other matter in the biological specimen). Each of the pixels 142 may consist of a cluster of colors 134, e.g., a red component 136, a green component 138, and a blue component 140. Alternatively, the image of the biological specimen may be defined by pixels with components such as luminance and chrominance components (Y, Cr, Cb) or hue, saturation, intensity (H, S, I) components. Preferably, however, the image may be defined by the pixels with the red components, the green components, and the blue components. These components are digitized in memory in a scale of 0 to 255 with higher numbers representing more intensity.

The pixels in the image may be classified as positive object pixels, i.e., associated with the objects of interest, and counterstained object pixels, i.e., associated with normal cells. Moreover, if the biological specimen in mounted on a slide, then clear areas of the slide may be classified as background area pixels. The staining by the one or more probes results in the positive object pixels taking on a different color from the normal pixels and the background area pixels of the biological specimen. For example, the objects of interest may take on a reddish brown color while normal cells may take on a grayish color. If the biological specimen is mounted on a clear slide, then the McDonnell Boehnen Hulbert & Ber-hoff 16 300 South Wacker Drive Chicago IL 60606 background areas may take on a whitish color. Of course, other arranaements are also possible depending on the particular staining method in use.

At step 126, the image processing svstem will transform the imaae of the biological specimen to produce a transformed image. A processor on the image processing system 106 executes the computer instructions stored in memory that defme one of two color transformations, the MCTI transformation and QCT. The color transformation allows for automated identification of the objects of interest in the biological specimen from normal cells and background areas. The color transformation produces a new set of pixel values, i.e., the transformed image, in which the normal cells and the background areas are identifiable from the objects of interest.

If so equipped, the automated cell analysis apparatus may perform steps 128 and 130. At step 128, the image processing system may, but need not, morphologically process the transformed image. Application of morphological processing fitrther refines the identification of the objects of interest within the biological specimen.
For example, the morphological processing results in boundaries of the cells of interest in the biological specimen being more clearly identified. The image processing system may use standard techniques, such as dilation or erosion, well known to those skilled in the art, to perform the morphological processing.

Additionally, if the image processing system 106 is coupled to a display, then, at step 130, the image processing system will present the transformed image 132 on the display. The image processing system 104 typically presents the transformed image on the display in a manner such that the objects of interest are presented at a different intensity or color from that of the normal cells and the background areas. By presenting McDonnell Boehnen t-[ulbert & Ber;hoff 17 300 South Wacker Drive Chicago IL 60606 tlie objects of interest at the different intensity, the transformed iznage identifies the objects of interest, if anv, in the biological specimen.

As noted above, the image processing system 106 uses a color transformation to identify the objects of interest in the image of the biological specimen 124.
The image processing system applies the MC+1 transformation, the QCT, or both transformations, to produce the transformed image identifying the objects of interest.
Advantageously, the MC+l transformation and QCT allows for identifying the objects of interest with a high degree of quantitation, withotit falsely identifying, as objects of interest, areas of intense staining or presence of foreign objects, produced as a result of the staining.

M('+1 Transformation The MC+l transformation is suited to identifying objects of interest in the image of the biological specimen, when the staining methods produce at least two different colors. The MC+1 transformation results a transformed image where the normal cells and the background areas are close to black and the objects of interest are close to white.
Hence, the name minus clear (MC, e.g., minus or subtraction of normal cells and background areas), plus one (e.g., positive objects).

Conceptually, the MC+l transformation involves visualizing pixels in the image of the biological specimen as a point objects in a three dimensional coordinate space.
Figure 3 illustrates the three dimensional coordinate space in which the pixels of the image of the biological specimen can be visualized. Axes of the three dimensional coordinate space correspond to the red component, green component, and blue component of the pixels. As a result, the pixels take a tmique position in the coordinate McDonnell Boehnen Hulbert & Berahoff 18 300 South Wacker Drive Chicago IL 60606 space depending on values of the red components, the green components, and the blue components.

tlIC+1 Transformation Based on Translation afad Rotatiorz In accordance with an exemplary embodiment of the present invention, image processing system 106 may apply a 1VIC=1 transformation that involves reorienting the three-dimensional coordinate space of Figure 3. The reorientation produces another three-dimensional coordinate space in which the pixels associated with the objects of interest are identifiable.

The reorientation consists of a translation and a rotation operation of the three dimensional coordinate space. For ease of visualization of the translation and rotation operation to be described herein, the positive object pixels, background pixels, and normal pixels, i.e., counter-stained object pixels, which define the image of the biological specimen are plotted in a two-dimensional coordinate space rather than the three dimensional coordinate space. Each pixel has red, green, and blue components, but the pixels are assumed, for purposes of illustration, to have just two coinponents, the red components and the green components.

Figure 4 illustrates plotting the pixels in a two dimensional coordinate space 150.
In the two dimensional coordinate space, a red component of the pixel constitutes an "x-axis" and a green component of the pixel constitutes tlie "y axis." The two dimensional coordinate space has clusters of pixels. The clusters of pixels correspond to pixels defining the objects of interest, pixels defining the normal cells, and pixels defining the background areas of the image of the biological specimen.

McDonnell Boehnen Hulbert & Berghoff 19 300 South Wacker Drive Chicago IL 60606 { CA 02689950 2010-01-12 = ' The background pixels typically lie in a small cluster in the two dimensional coordinate space. The background pixels correspond to clear areas of the slide. As a result, the background pixels typically have a same value for both the red component and the green component. However, the background pixels will not have color components that are identical. Noise and illumination non-uniformities affect the color components of the background pixels. The noise and illumination non-uniformities cause the pixels to lie in the small cluster in the two dimensional coordinate space 150.

The cluster of the cotulter-stained object pixels lie in a roughly linear group extending from the background pixels. As the counterstained objects may represent normal cells, the counterstained object pixels are a different color from the backgrotmd pixels. Noise and illumination non-uniformity, however, results in the counter stained object pixels being spread out in the two dimensional coordinate space 150.
Additionally, varying degrees of staining intensity spreads the counter-stained object pixels. The variation in staining intensity makes the counter-stained object pixels lie in an elongated cluster extending from the background cluster.

Pixels defining the objects of interest will lie in another cluster of the two dimensional coordinate space. The pixels may lie in another cluster because the stain used to identify the positive object pixels will be different from the stain used to identify the counter-stained object pixels. The different stain results in the positive object pixels lying separately from the background pixels and the counter-stained object pixels in the two dimensional coordinate space 150.

As iliustrated by Figure 5, the MC+1 transformation can be viewed as involving translating and rotating the two dimensional coordinate space 150 to produce another t~vo McDonnell Boehnen Hulbert & Berghoff 20 300 South Wacker Drive Chicago IL 60606 dimensional coordinate space 160 having an origin at, for example, an average pixel value of the cluster of background pixels. The translation and rotation results in the counterstained pixels and the background pixels having nominallv zero color components while the positive object pixels having non-zero color components. The two dimensional coordinates space 160, defined by axis r' and axis g', are not "actual"
colors.
Nonetheless, the non-zero color coinponents of the positive object pixels make the positive object pixels readily identifiable in the two-dimensional coordinate space 160.
The pixels, as plotted within the two-dimensional coordinate space 160, (or conceptually a three-dimensional coordinate space so oriented) define a transformed image.

Additionally, the transformed image identifies the objects of interest, if any, in the biological specimen.

The transformation of the pixels according to the MC+1 transformation, conceptualized as a rotation and translation, involves mathematically complementing respective pixel components by a maximum pixel value (to translate the axes of the two dimensional coordinate space 150) and then applying rotation matrices (to rotate the axes of the two dimensional coordinate 150) to prodttce the two-dimensional coordinate space 160. The components of the pixels in the image of biological specimen may be quantized as 8 bit values ranging from 0 to 255, but other quantizations are also possible. If, however, the components are quantized as 8 bit values and a maximum component value is 255, then the processor of the image processing system 106 will execute computer instructions that result in a calculation of the complement of the respective pixel components as follows:

McDonnell Boehnen Hulbert & Berghoff 21 300 South Wacker Drive Chicago IL 60606 R' = 255-R

G' = 255-G
B' = 255-B

Then, the processor of image processing system 106 executes computer instructions for performing three cascaded rotations to reduce the color coniponents of the counter-stained pixels to zero and to maximize the color components of the positive object pixels:

The pixels in the first color space are rotated about the r' axis (defined by a translation of the r axis) and given by:

ct st 0 R> > R' G" -st ct 0 G' g" - 0 0 1 Bl The matrix components are sins and cosines of the required rotation angle (theta).
These are given by:

Gb Rb st := ct:=
(RbZ + Gb'") 0.5 (Rb 2 + Gb*-) 0.5 where the subscript "b" denotes a component value for a respective component of the counterstained object pixel. The component value is based on a "typical"
counterstained object pixel of the cluster of counter-stained object pixels, dependent on a particular staining method in use. The component value may be an average staining intensity, but other arrangements are also possible.

McDonnell Boehnen Hulbert & Berghoff 22 300 South Wacker Drive Chicago IL 60606 312-9li-0001 The pixels in the first color space are then rotated about the Q' axis (defined bv a translation of the Q' axis) and given by:

R,,, sp 0 cp Rõ
G: " - 0 1 0 G"
B,,, - -cp 0 sp B"

where the rotation coefficients are sins and cosines of an angle phi, given by ~ ~ o.s (Rb" + Gb") _ Bb Sp cp (Rb 2 + Gb 2 + Bb 2)0.5 . (Rb v + Gb o ` + Bb2 ) 0.5 and the subscripts having the same meaning as before.

The pixels are then rotated about the b' axis (defined by a translation of the b' axis), thereby producing final color values in a rotated three dimensional coordinate space:

I FinalR 1 0 0 R> > 7 FinalG --- 0 ca -sa G>>>
LFmna1B - 0 sa ca B>>>

where the rotation coefficients are the sins and cosines of an angle alpha and are given by:

McDonnell Boehnen Hulbert & Berghoff 2 3 300 South Wacker Drive Chicago IL 60606 [ [-st=(Rt) + ct=Gt] ]
sa ~ ~ 0.5 [[(-cp=ct=Rt) - cp=st=Gt= sp=Bt]" + (-st-Rt + ct=Gt)"~
(-cp=ct=Rt) - cp=st=Gt= sp=Bt ca ~ ., 0.5 [[(-cp=ct=Rt) - cp=st=Gt+ sp-Bt]- = (-st=Rt+ ct=Gt) Here, the subscript "t" represents component values for a "typical" positive object pixel, also determined by the particular staining method in use.

The three rotation matrices, cascaded together, define an expression for the MC+1 value for each pixel in the image of the biological specimen. By calculating the MC+l value for each pixel, the image processing system 106 transforms the ima;e of the biological specimen to produce a transformed image. The transformed image consists of the MC+1 value for each of the pixels in the image of the biological specimen.
Additionally, the transformed image identifies the objects of interest, if any, in the biological specimen. For example, the objects of interest may be defined by those pixels having an MC+l value above a threshold value.

The expression for calculating the MC+1 value, i.e., the three rotation matrices, cascaded together, consists of a sum of a plurality of products between weighing coefficients and the complement of the red component, green component, or the blue component. The processor executes computer instnlctions stored in the memory for calculating the MC+l transformation based on the sum of the plurality of products.
Specifically, the expression is a sum of products between a first coefficient and the complement of the first component, e.g., red, for a pixel to be transformed, a second coefficient and the complement of the second component, e.g., green, for the pixel to be McDonnell Boehnen Hulbert & Berghoff 24 300 South Wacker Drive Chicago IL 60606 transformed, and a third coefficient and the complement of the third component, e.g., blue, for the pixel to be transformed, or:

MC+1 value = (-sa*cp*ct-ca*st)*R' + (-sa*cp*st+ca*ct)*G' +
(sa*sp)*B', where the first coefficient is -sa*cp*ct-ca*st, the second coefficient is -sa*cp*st+ca*ct, and the third coefficient is sa*sp, and R', G' and B' are the complements of the actual red, blue and green pixel values.

A variety of stains and counterstains can be used to make the objects of interest in the biological specimen more readily identifiable and the present invention is not limited to a particular staining chemistry. Values of the weighting coefficients in the above expression depend on a number of factors, including the actual staining chemistry used, the preparation of the stain and how it is used, and noise in the image and from other sources. AEC and Hematoxylin stains have been used which results for the first, second and third coefficients falling in a range of between approximately -0.7 to -0.8, 0.5 to 0.65, and 0.3 to 0.4, respectively. Actual values for the three components in one calculation were -0.721, 0.612, and 0.381, respectively. The weighting coefficients remain fixed throughout the transformation of the image of the biological specimen to the transformed image. Thus, in this particular' example, the pixels in the image of the biological specimen, stained by AEC and Hematoxylin, are transformed by forming a following MC+1 value for each pixel in the image of the stained biological specimen:

MC+1 value = -0.721*(255-red) + 0.612*(255-green) +
0.381*(255-blue), where the red, green, and blue are components of the pixels in the image of the biological specimen. The transformed image is defined by the MC+1 value calculated for the pixels 25a in the image of the bioloaical specimen. Additionally, the objects of interest mav be defined by those pixels having a MC+1 value above a threshold value.

As sliown by Figure 6, the MC+1 transformation results in the color components of the background pixels and the counter-stained object pixels along the g axis being nominally zero and the positive object pixels having a component along the g' axis. The pixels, as oriented in the two-dimensional coordinate space 160, define the transformed image in which the positive object pixels are visible in the transformed image and the background pixels and the counterstained object pixels are not visible.

Figure 7 shows a transformed image produced as a result of applying the MC+1 transformation to the image of the biological specimen. W eighting the red component, green component, and blue component of the pixel values and forming a sum of weighted components, produces a new "color", or value. The new color or "value" for each of the pixels in the image of the biological specimen defines the transformed image.
The transforzned image is ideally suited for subsequent morphological processing, such as classification (thresholding), centroiding, dilation, or erosion so as to ftirther refine identification of the objects of interest in the transformed image.

MC+1 Transformation Based on Vector Operations In accordance with an alternative exemplary embodiment of the present ulvention, the image processing system 106 may apply an MC+1 transformation that involves vector operations, rather than a translation and rotation operation. The vector operations produce the transformed image which identifies the objects of interest, if any, in the biological specimen. The vector operations consist of defining two vectors in the three dimensional coordinate space. A counter-stained object vector extends from a typical McDonnell Boehnen Hulbert & Berghoff 26 300 South Wacker Drive Chicago IL 60606 313-913 -000( background pixel of the background pixels through the counter-stained object pixels. On the other hand, a positive object vector extends from the typical background pixel to a positive object pixel. A difference between the positive object vector and the counter-stained object vector defines an MC+l value for the positive object pixel.
Steps of the MC+1 transformation based on the vector operations are different than steps of the MC + 1 transformation based on the translation and rotation. However, as shown below, the results of the MC+1 transformation are the same.

Figure 8 illustrates transforming the pixels in the image of the biological specimen based on the vector operation. Again, for ease of visualization of the transformation operation to be described herein, the positive object pixels, the background pixels, and the counter-stained object pixels, which define the image of the biological specimen, are assumed to exist in an two dimensional coordinate space 190 rather than a three dimensional coordinate space. Each pixel has red, green, and blue components, but, for purposes of illustration, the pixels are assumed to have just two components, the red components and the green components.

The two dimensional coordinate space 190 has axes corresponding to the red component and green component of the pixels. Another two dimensional coordinate 194 includes axis r' and axis g', a translation of the axes defining the two dimensional coordinate space 190. The translation of the axes 190 result in an origin of the axes 194 being centered within cluster of the background pixels, e.g., at an average pixel value of the cluster of the background pixels.

Figure 9 illustrates redrawing the two dimensional coordinate space 194 to facilitate an understanding of the transfonnation process, as described below.

McDonnell Boehnen Hulbert & Berghoff 27 300 South Wacker Drive Chicago IL 60606 Figure 10 illustrates two vectors drawn from a cluster of the background pixels to the positive object pixel and counterstained object pixels, respectively, in the two dimensional coordinate space 194. A positive object pixel vector 198 extends from the cluster of the background pixels to the positive object pixel. Additionally, a counter-stained object pixel vector 200 extends through the counter-stained object pixels.

A dotted line 196 represents a difference between the positive object pixel vector 198 and the counter-stained object pixel vector 200 for the positive object pixel. The difference defines the MC+l value for the positive object pixel.

Generally, the image of the biological image is transfomled by calculating a difference between a vector and the counter-stained object pixel vector. The vector extends from the cluster of the background pixels to a pixel to be transformed, e.g., another background pixel, a positive object pixel, or a counterstained object pixel. The difference represents the MC+1 value for the pixel to be transformed. The difference for each pixel in the image of the biological specimen defines the transformed image.

Additionally, the transformed image identifies the objects of interest, if any, in the biological specimen.

Elementary vector algebra mathematically defines the difference between the positive object pixel vector 198 and the counter-stained object pixel vector 200. The processor of the image processing system 106 calculates the difference by forming a complement of a first component, e.g., red component, a complement of a second component, e.g., green component, and a complement of a third component, e.g., blue component, for each of the pixels and then calculating a transform value, as described below.

McDonnell Boehnen Hulbert & Berghoff 28 300 South Wacker Drive Chicago IL 60606 ~ . .

The iinage processing system 106, in performina MC+1 transformation based on the vector operations, has computer instructions stored in the memory and executable by the processor for calculating a dot product of two vectors. The dot product is:

P dot C= Mag(P) * Mag C* cos (included angle), where the included angle represents the angle between the positive object vector and the counter stained object vector, P represents a magnitude of the positive object pixel vector, P, and C represents the magnitude of the counter-stained object vectors, C.

Expanding the dot product, the MC+1 value, or transform based on the vector operation is represented as:

MC+1 value =sqrt ((R''+G'`+B'Z)*(Rb'+GbZ+Bb')-(R'*Rb-f-U'*Gb+B'*Bb)') where R', G', and B' represent a complimented red component, green component, and blue component, of the pixels in the image of the biological specimen.
Additionally, the quantities Rb, Gb, and Bb are the complemented component values of pixels for a "typical" counterstained object. The image processing system 106 transforms the image of the biological specimen by calculating the MC+l value for each pixel the image of the biological specimen. The MC+l value for each of the pixels defmes a transformed image which identifies the objects of interest, if any, in the biological specimen.
For example, the objects of interest may be defined by those pixels having a MC+l value above a threshold value. Additionally, morphological processing can be applied to the transformed image so as to further refine identification of the objects of interest.

Figure 11 illustrates the transformed image produced as a result of applying the MC+l transfomi based on the vector operation to an image of the. biolojical specimen.
Comparing Figure 7 to Figure 11, the MC+1 transformation based on the vector McDonnell Boehnen Hulbert & Berghoff 29 300 South Wacker Drive Chicago IL 60606 operation produces same results as the iVIC=1 transfonnation based on the translation and rotation operation. Thus, the MC-4-l transformation based on the vector operation is another metliod for identifying object of interest in the image of the biological specimen.
Quantitative Chromatic Transformation (QCT) Instead of, or in addition to the MC=1 transformation, the image processing system 106 may apply a QCT to identify the objects of interest in the image of the biological specimen. The QCT results in a characterization of a quantitative amount of absorbing molecules sampled by a pixel.

The QCT involves calculating three new quantities from the red component, the green component, and the blue component of the pixels in the image of the biological specimen. The three new quantities, X, Y, aud Z linearly relate, to a sampled pixel, a quantitative amount of absorbing n2olecules, N. Each of the three new quantities X, Y, and Z involves calculating a quotient. The quotient consists of fust value divided by a second value, where the first value is a square of a component, e.g., red, green, blue, of a pixel to be transformed and the second value is product of two different components, e.g., red, green, blue, of the pixel to be transformed.

The following expressions define the quotient, or, a number of absorbing molecules sampled by a pixel having a red component, r, a green component, g, aiid a blue component, b, respectively:

X = log(r'/(g x b)) Y= log(g'/(r x b)) Z = log(b'/(r x g)) One or more of these three quantities represents an acceptable estimate of N.
As a result, the processor of the image processing system 106 may execute computer McDonnell Boehnen Hulbert & Ber~hoff 30 300 South Wacker Drive v Chicago IL 60606 = CA 02689950 2010-01-12 . = .

instructions for calculating the amount of absorbing molecules per pixel, as described by the above expressions. Preferably, however, the average of these quantities produces a better estimate of N. The processor may execute computer instructions for applying weighting coefficients, k,, k, and k2 to weight the three component values X, Y, and Z

such that the component with the most noise contributes the least to the weighted average and vice-versa. The weighing coefficients, as applied to the three component values, produce a weighted average, i.e., a QCT value:

QCT value = kYX + k,,Y + 1czZ

Optimal estimation theory defines the weighing coefficients. Taking three estimates for a quantity X (not the same quantity as the X of QCT, but instead a variant X: X1, X2, and X3), the three estimates can be averaged to reduce the noise of the final estimate, or:

X1+X2+X3 X:=
or X:= 1=Xl+ 1=X2+ 1-X3 3 3 3 (1) For such a case, the noise (standard deviation) of the final estimate of X is given in terms of the standard deviations of each estimate as:

(3 61 l4+(3=6?l2 +(~ 63)2 If all the standard deviations are equal, then the noise equals a root sum squared (RSS) of X1, X2, and X3. Thus, the processor may execute computer instntctions stored in the memory for weighing the amount of absorbing molecules given by X, Y, and Z, by McDonnell Boehnen Hulbert & Ber;hoff 31 300 South Wacker Drive Chicago IL 60606 coefficients k,, ky, and lcZ equal to 1/3, to produce the weighted average, i.e., the QCT
value. The QCT value for each of the pixels in the image of the biological specimen defines a transformed image. The transformed image identifies the object of interest in the biological specimen, if any. For example, the objects of interest may be defined bv those pixels having a QCT value above a tlireshold value.

Alternatively, the processor of the image processing system 106 may execute computer instructions that produce a weighted average. The weighted average is calculated as a result of applying a small weight to the estimate of the amount of absorbing molecules with highest noise and a large weight to the estimate of the amount of absorbing molecules value with lowest noise. So, instead of forming an average with equal weighting coefficients, a weighted average can be produced according to:

X:=kl-X1 + k2=X2+ k3-X3 where the "k's" are not equal, and are subject to:
kl + k2 + k3 := 1 The noise values will combine according to:

(a)2 := (k1=a-1)2 + (k2=6?) 2 + (k3=a3)2 62 kl2=612 + k22-622 + k32=Q32 The values for kl, k2, and k3 can be obtained by solving:
d 2 d 2 d 2 -6 :=0 -a :=0 -6 :=0 dkl dk2 dk3 These solutions provide the following answers for the weighting coefficients.
kl:= a2r- a3-2 _ _ _ 61 62r + 61 63 + a=2 a3r McDonnell Boehnen Hulbert & Berghoff 3 2 300 South Wacker Drive Chicago IL 60606 =

c2 c3-~? 2 2 2 > >
cl =c2 T c1=c3 + 62 =63l (~) ~ ?
k3:= cl-c2 '1 2 , 1 _ _ 6I =c2- + cl =63 + c2 =c3 Thus, the QCT value may be calculated as a result of calculating variances for X, Y, and Z, calculating the weighting coefficients, and then weighting the three estimates of absorbing molecules by the weighting coefficients to obtain the weighed average.

Taking, for instance, the definition of X (without the logarithm):

.' _ Y
bb where r, g, and b are the pixel values for the red, green, and blue component, respectively, for a pixel in the image of the biological specimen. For each of the component values of the pixels, Beer's Law shows that:

r=ro10-k''C*' 9 = go10 kY*c`' and b= bol0-k *C'`

That is, the component values of the pixels is exponentially related to an absorption constant for each spectral band, an analyte concentration C, , i.e., the number of absorbing molecules, and a patll length through the sample. Substitution into the definition of X above results in:

r ~' 10-'k"Cr X gobol0-kCI10_kCt For a colorimetrically calibrated system, ro 1, the above expression can be gobo siinplified to obtain:

McDonnell Boehnen Hulbert & Berghoff 33 3 300 South Wacker Drive Chicago lL 60606 =k,Ct .~' _ =10 ctl=k. ,;-k~
10-k,Ci 10 _kyCf TakinQ the log of this expression, and solving for the C*1 product (which is the product of the analyte concentration times the path length) produces the followinQ
quantitv:

log(X) C*lN=-2k, + kg + kb 5 The number of absorbing molecules sampled by a pixel may also be estimated for the other two quantities of QCT, namely the Y and Z quantities. The three different estimates of N become:

N=_ log(X) N-_ log(Y) N__ log(Z) r 2k, +kg +kb Y k,. +2kg+kb Z k, +ko + 2kb Given variances for the red components, green components, and blue components 10 of the pixels, the variances of these three quantities are calculated as:

2 dlogX 2 ~ d logX ? , d logX)2 ~ , 6x 3 2kr+ko. +k ( dr ) 6'' + dg ~e +( db o-b eq(.) "
) ~

From the defuiition of X:

X= r and logX= 1 ln X
gb 2.303 dlogX 1 dlnX 1 1 2r 1 gb 2r 1 2 dr 2.303 dt= 2.303 ~' gb 2.303 r' ~;b 2.303 r And similarly for the other derivatives:

d1ogX 1 1 dg 2.303 and dlogX I I
db 2.303 b ivlcDonnell Boehnen Hulbert & Berehoff 34 300 South Wacker Drive ~
Chicago IL 60606 Substitution of these expression into eq (3) yields:

~
1 [(2)' 1 2 + 1 - _ 3~`2.303'' * (2 kr +ko kb f 6r +g (b) 6 b For equal variances for the red components, green components, and the blue components:

~
1 ~ , 6N` 3*2.303'* 2k +ko+k r 2" + 1_ a +o \(b) 6 r i This same analysis can be applied to calculate the variances for Y and Z. The final three expressions are:

, 2 2_ 1 2~ 1 1( 4) eqs 2.303' * Zkr+k o+ki Y 9 ) + +Cb)2],2 b 6 _ 2 1 2 2 2 1 2 ~"Y 3*2.303Z * k +2ko +k r) + ~ +~ J
g r i 2 +12 +2' , b1 6 6NZ 3*2.3032* kr+kg+2ki 1 Y) u Finally, making use of eq (2) and using the values fiom eq (4) and substituting:
_ 1 1 _ 1 C=Y 2kr + ke + k CY _ kr + 2k9 + k CZ ~ kr + k, + 2k 0'` NF. 6 N, k.r 6 V c= 6Nr +~,Yr acvZ + 6iV} 6,vZ

result in:

McDonnell Boehnen Hulbert & Ber~-hoff 35 300 South Wacker Drive Chicago IL 60606 i_' 1 l~' %1~' ~1~ (? l'1 T
Ci=Cz it 2~ 12 2i c1~ Lri j2j~ _ 1 1-_I'~~~--~lY
( I 'r( 1 "1'( 1 ( } (' l -- --" - } - ( l ( i 1~-I
Cr Cr ~\+'J \o i lb J lY i \o ~ -bJ Cr Cz _lbJ i.b~ ~ Cr Cz [!~O
"l ~9 b ~ , ' , ~
_ 2 +(1)2 +(b)()2 +(~)+(b1 k-Y , [c'j }~g ~ +~b/ ~r /,*~O/ b~'1+ ,t G \~' +~~'+~b/_~r/_ JY]~[(')2 T(b~
(!~(yi +
~

~~
~
C~Cr ( +~gJ +(b)21(,)2+(2 ~z= J
l3lZ+lb)2J)2 J2)2+Ct Cz lrJ2+(a)'+lbJ' ()'}l J2+()2][7 J2 ~Jz CrCi \2/'}
~rb/ ~
Thus, kc, kY, and kz, as above, defines the weighting coefficients for X, Y, and Z

according to the QCT. The processor of the image processing system 106 may apply these weighting coefficients, instead of equal weighting coefficients of 1/3, to calculate the QCT value for each of the pixels. The QCT value for each of the pixels defines a transformed image which identifies the objects of interest in the biological specimen, if any. For example, the objects of interest may be defined by those pixels having a QCT
value above a threshold value. Additionally, morphological processing can be applied to the transformed image so as to further refine identification of the objects of interest.

Exemplary embodiments of the present invention have thus been illustrated and described. It will be l.mderstood, however, that changes and modifications may be made to the invention as described without deviating from the spirit and scope of the invention, as defined by the following claims. For example, a general-purpose computer associated witli the microscope, in a separate workstation, a programmable microprocessor, or any McDonnell Boehnen Hulbert & Berghoff 36 300 South Wacker Drive Chica;o IL 60606 = other suitable computing device, may execute the instructions that code the color space transformations. The details of the microscope system, the cameras used to capture the images of the slide are likewise are not particularly pertinent and can vary widely.

McDonnell Boehnen Hulbert Sc Berghoff 37 300 South Wacker Drive = Chica,o fL 60606

Claims (49)

1. A method for identifying objects of interest in a biological specimen, the objects of interest being identified from normal cells and background areas of the biological specimen, the method comprising:

obtaining an image of the biological specimen, the image of the biological specimen comprising positive object pixels, counterstained object pixels, and background pixels;

storing pixel values representing the image in a memory;

executing instructions in a computing device that operate on said stored pixel values so as to transform the image of the biological specimen to produce a transformed image, the transformed image being characterized by a three dimensional coordinate space, the image of the biological specimen being transformed by said instructions by orienting a cluster of the background pixels at an origin of the three-dimensional coordinate space and the counter-stained object pixels substantially along an axis of the three-dimensional coordinate space whereby the positive object pixels lie substantially between axes of the three-dimensional coordinate space, whereby the transformed image assists in identification of the objects of interest, if any, in the biological specimen.
2. The method of claim 1, wherein the origin of the three-dimensional coordinate space is located at an average of the cluster of background pixels.
3. The method of claim 1, wherein orienting the cluster of the background pixels and the counter-stained object pixels comprises translating and rotating the axes of the three-dimensional coordinate space.
4. The method of claim 1, further comprising morphologically processing the transformed image to refine identification of the objects of interest, if any, in the biological specimen.
5. A method for identifying objects of interest in a biological specimen, the objects of interest being identified from normal cells and background areas of the biological specimen, the method comprising:

obtaining an image of the biological specimen, the image of the biological specimen comprising pixels, each of the pixels being defined by a first component, a second component, and a third component;

storing pixel values representing the first, second and third components in a memory;

forming a complement of the first component, the second component, and the third component for each of the pixels;

executing instructions in a computing device that operate on said stored pixel values so as to transform the image of the biological specimen to produce a transformed image, the image of the biological specimen being transformed by calculating, for each of the pixels, a sum of a plurality of products, the plurality of products being between (a) a first coefficient and the complement of the first component for a pixel to be transformed;

(b) a second coefficient and the complement of the second component for the pixel to be transformed; and (c) a third coefficient and the complement of the third component for the pixel to be transformed, whereby the transformed image assists in identification of the objects of interest, if any, in the biological specimen.
6. The method of claim 5, wherein transforming the image of the biological specimen further comprises summing the plurality of products computed for each of the pixels.
7. The method of claim 5, wherein the biological specimen is stained with a given staining combination that uniquely defines the first coefficient, the second coefficient, and the third coefficient.
8. The method of claim 7, wherein the given staining combination is AEC and Hematoxylin.
9. The method of claim 8, wherein the first coefficient is between -0.8 and -0.7, the second coefficient is between 0.5 and 0.65, and the third coefficient is between 0.3 and 0.4.
10. The method of claim 5, further comprising morphologically processing the transformed image to refine identification of the objects of interest, if any, in the biological specimen.
11. The method of claim 5, wherein the complement of the first component, the second component, and the third component for each of the pixels comprise subtracting a maximum component level from the first component, the second component, and the third component.
12. The method of claim 11, wherein the maximum component level is 255.
13. The method of claim 5, wherein the first, the second, and the third components of the pixel to be transformed are red, green, and blue components, respectively.
14. A method for identifying objects of interest in a biological specimen, the objects of interest being identified from normal cells and background areas of the biological specimen, the method comprising:

obtaining an image of the biological specimen, the image of the biological specimen comprising positive object pixels, counter-stained object pixels, and background pixels, the positive object pixels, the counter-stained object pixels, and the background pixels each being defined by a first component, a second component, and a third component of a three-dimensional coordinate space;

storing pixel values representing the first, second and third components in a memory;

executing instructions in a computing device that operate on said stored pixel values so as to define (a) a counter-stained object vector in the three dimensional coordinate space, the counter-stained object vector extending from a cluster of the background pixels through the counter-stained object pixels whereby the counter-stained object pixels lies substantially along the counter-stained object vector; and (b) positive object vectors extending from the cluster of the background pixels to the positive object pixels;

said instructions transforming the image of the biological specimen to produce a transformed image, the image of the biological specimen being transformed by calculating differences between the positive object vectors and the counter-stained object vector, whereby the transformed image assists in identifying the objects of interest, if any, in the biological specimen.
15. The method of claim 14, wherein the counter-stained object vector extending from a cluster of the background pixels through the counter-stained object pixels comprises the counter-stained object vector extending from an average of the cluster of background pixels through the counter-stained object pixels.
16. The method of claim 14 further comprising morphologically processing the transformed image to refine identification of the objects of interest, if any, in the biological specimen.
17. A method for identifying objects of interest in a biological specimen, the objects of interest being identified from normal cells and background areas of the biological specimen, the method comprising:

obtaining an image of the biological specimen, the image of the biological specimen comprising pixels, each of the pixels being defined by a first component, a second component, and a third component;

storing pixel values representing the first, second and third components in a memory;

forming a complement of the first component, the second component, and the third component for each of the pixels;

executing instructions with a computing device that operate on said stored pixel values so as to transform the image of the biological specimen to produce a transformed image, the image of the biological specimen being transformed by calculating for each of the pixels a transform value, the transform value being defined by a square root of (p1 2 +

p2 2, + p3 2) x (p1c2+ p2c2 + p3c2) - (p1 x p1c + p2 x p2c + p3 x p3c)2, wherein p1, p2, and p3, are a complement of the the first component, the second component, and the third component, respectively, of a pixel to be transformed and p1c, p2c, and p3c, are the complement of the first component, second component, and third component, respectively, of a representative counterstained pixel, whereby the transformed image assists in identifying the objects of interest, if any, in the biological specimen.
18. The method of claim 17, further comprising morphologically processing the transformed image to refine identification of the objects of interest, if any, in the biological specimen.
19. The method of claim 17, wherein the complement of the first component, the second component, and the third component for each of the pixels are calculated by subtracting a maximum component level from the first component, the second component, and the third component.
20. The method of claim 19, wherein the maximum component level is 255.
21. The method of claim 17, wherein the first, the second, and the third components of the pixel to be transformed are red, green, and blue components, respectively.
22. A method for identifying objects of interest in a biological specimen, the objects of interest being identified from normal cells and background areas of the biological specimen, the method comprising:

obtaining an image of the biological specimen, the image of the biological specimen comprising pixels;

storing pixel values representing said image in a memory;

executing instructions with a computing device that operate on said stored pixel values so as to transform the image of the biological specimen to produce a transformed image, the transformed image defining a number of absorbing molecules sampled by each of the pixels, whereby the transformed image assists in identifying the objects of interest, if any in the biological specimen.
23. The method of claim 22, wherein the image of the biological specimen comprises pixels, each of the pixels being defined by a first component, a second component, and a third component and wherein the set of instructions transforming the image of the biological specimen to produce the transformed image comprises instructions:

calculating at least one transform value for each of the pixels, the at least one transform value being a quotient of a first value and a second value, the first value being a square of the first component of a pixel to be transformed and the second value being a product of the second component and the third component of the pixel to be transformed;
and calculating an average of the at least one transform value for each of the pixels.
24. The method of claim 22, wherein the average is a weighted average.
25. The method of claim 22, wherein the calculating of the at least one transform value comprises calculating a logarithm of the quotient for each of the pixels.
26. The method of claim 22, further comprising morphologically processing the transformed image to refine identification of the objects of interest, if any, in the biological specimen.
27. The method of claim 22, wherein the first, the second, and the third components are red, green, and blue components, respectively of the pixel to be transformed.
28. The method of claim 22, wherein the at least transform value is defined by an expression selected from the group consisting of r2/(g x b), g2/(r x b), and b2/(r x g), wherein r, g, b is the red, the green, and the blue components, respectively, of the pixel to be transformed.
29. A system for identifying objects of interest in a biological specimen, the objects of interest being identified from normal cells and background areas of the biological specimen, the system comprising:

a processor;
memory;

computer instructions stored in memory and executable by the processor for performing the functions of:

obtaining an image of the biological specimen, the image of the biological specimen comprising positive object pixels, counterstained object pixels, and background pixels:

transforming the image of the biological specimen to produce a transformed image, the transformed image being characterized by a three-dimensional coordinate space, the image of the biological specimen being transformed by orienting a cluster of the background pixels at an origin of the three-dimensional coordinate space and the counter-stained object pixels substantially along an axis of the three-dimensional coordinate space whereby the positive object pixels lie substantially between axes of the three-dimensional coordinate space, whereby the transformed image assists in identifying objects of interest, if any, in the biological specimen.
30. The system of claim 29, wherein the first, the second, and the third components of the pixel to be transformed are red, green, and blue components, respectively.
31. The system of claim 29, further comprising computer instructions executable by the processor for performing the function of morphologically processing the transformed image to refine identification of the objects of interest, if any, in the biological specimen.
32. A system for identifying objects of interest in a biological specimen, the objects of interest being identified from normal cells and background areas of the biological specimen, the system comprising:

a processor;
memory;
computer instructions stored in the memory and executable by the processor for performing the functions of:

obtaining an image of the biological specimen, the image of the biological specimen comprising pixels, each of the pixels being defined by a first component, a second component, and a third component;

forming a complement of the first component, the second component, and the third component for each of the pixels;

transforming the image of the biological specimen to produce a transformed image, the image of the biological specimen being transformed by calculating, for each of the pixels, a sum of a a plurality of products, the plurality of products being between (a) a first coefficient and the complement of the first component for a pixel to be transformed; (b) a second coefficient and the complement of the second component for the pixel to be transformed; and (c) a third coefficient and the complement of the third component for the pixel to be transformed, whereby the transformed image assists in identifying the objects of interest, if any, in the biological specimen.
33. The system of claim 32, wherein the biological specimen is stained with a given staining combination that uniquely defines the first coefficient, the second coefficient, and the third coefficient.
34. The system of claim 33, wherein the given staining combination is AEC and Hematoxylin.
35. The system of claim 34, wherein the first coefficient is between -0.8 and -0.7, the second coefficient is between 0.5 and 0.65, and the third coefficient is between 0.3 and 0.4.
36. The system of claim 32, wherein the first, the second, and the third components of the pixel to be transformed are red, green, and blue components, respectively.
37. The system of claim 32, further comprising computer instructions executable by the processor for performing the function of morphologically processing the transformed image to refine identification of the objects of interest, if any, in the biological specimen.
38. A system for identifying objects of interest in a biological specimen, the objects of interest being identified from normal cells and background areas of the biological specimen, the system comprising:

a processor;
memory;
computer instructions stored in memory and executable by the processor for performing the functions of:

obtaining an image of the biological specimen, the image of the biological specimen comprising positive object pixels, counterstained object pixels, and background pixels, the positive object pixels, the counter-stained object pixels, and the background pixels each being defined by a first component, a second component, and a third component of a three-dimensional coordinate space;

defining (a) a counter-stained object vector in the three dimensional coordinate space, the counter-stained object vector extending from a cluster of the background pixels through the counter-stained object pixels whereby the counter-stained object pixels lies substantially along the counter-stained object vector; and (b) positive object vectors extending from the cluster of the background pixels to the positive object pixels;

transforming the image of the biological specimen to produce a transformed image, the image of the biological specimen being transformed by calculating differences between the positive object vectors and the counter-stained object vector, whereby the transformed image identifies the objects of interest, if any, in the biological specimen.
39. The system of claim 38, further comprising computer instructions executable by the processor for performing the function of morphologically processing the transformed image to refine identification of the objects of interest, if any, in the biological specimen.
40. A system for identifying objects of interest in a biological specimen, the objects of interest being identified from normal cells and background areas of the biological specimen, the system comprising:

a processor;
memory;
computer instructions stored in memory and executable by the processor for performing the functions of:

obtaining an image of the biological specimen, the image of the biological specimen comprising pixels, each of the pixels being defined by a first component, a second component, and a third component;

forming a complement of the first component, the second component, and the third component for each of the pixels;

transforming the image of the biological specimen to produce a transformed image, the image of the biological specimen being transformed by calculating for each of the pixels a transform value, the transform value being defined by a square root of (p1 2 + p2 2 + p3 2) x (p1c2 + p2c2 + p3c2) -(p1 x p1c + p2 x p2c + p3 x p3c)2, wherein p1, p2, and p3, are a complement of the first component, the second component, and the third component, respectively, of a pixel to be transformed and p1, p2c, and p3c, are the complement of the first component, second component, and third component, respectively, of a representative counterstained pixel, whereby the transformed image identifies the objects of interest, if any, in the biological specimen.
41. The system of claim 40, wherein the first, the second, and the third components of the pixel to be transformed are red, green, and blue components, respectively.
42. The system of claim 40, further comprising computer instructions executable by the processor for performing the function of morphologically processing the transformed image to refine identification of the objects of interest, if any, in the biological specimen.
43. A system for identifying objects of interest in a biological specimen, the objects of interest being identified from normal cells and background areas of the biological specimen, the system comprising:

a processor;
memory;

computer instructions stored in memory and executable by the processor for performing the functions of:

obtaining an image of the biological specimen, the image of the biological specimen comprising pixels;

transforming the image of the biological specimen to produce a transformed image, the transformed image quantitating a number of absorbing molecules sampled by each of the pixels, whereby the transformed image identifies the objects of interest, if any, in the biological specimen.
44. The system of claim 43, further comprising computer instructions executable by the processor for performing the function of morphologically processing the transformed image to refine identification of the objects of interest, if any, in the biological specimen.
45. A system for 43, wherein the image of the biological specimen comprises pixels, each of the pixels being defined by a first component, a second component, and a third component and wherein the computer instructions for performing the function of transforming the image of the biological specimen to produce the transformed image further comprises computer instructions executable by the processor for performing the functions of:

calculating at least one transform value for each of the pixels, the at least one transform value being a quotient of a first value and a second value, the first value being a square of the first component of a pixel to be transformed and the second value being a product of the second component and the third component of the pixel to be transformed; and calculating an average of the at least one transform value for each of the pixels;
46. The system of claim 45, wherein the calculating of the at least one transform value comprises calculating a logarithm of the quotient for each of the pixels.
47. The system of claim 45, wherein the first, the second, and the third components are red, green, and blue components, respectively of the pixel to be transformed.
48. The system of claim 45, wherein the at least transform value is defined by an expression selected from the group consisting of r2/(g x b), g2/(r x b), and b2/(r x g), wherein r, g, b is the red, the green, and the blue components, respectively, of the pixel to be transformed.
49. The system of claim 45, further comprising computer instructions executable by the processor for performing the function of morphologically processing the transformed image to refine identification of the objects of interest, if any, in the biological specimen.
CA2689950A 2002-10-28 2003-09-23 Color space transformations for use in identifying objects of interest in biological specimens Expired - Fee Related CA2689950C (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US10/282,362 US7200252B2 (en) 2002-10-28 2002-10-28 Color space transformations for use in identifying objects of interest in biological specimens
US10/282,362 2002-10-28
CA2442339A CA2442339C (en) 2002-10-28 2003-09-23 Color space transformations for use in identifying objects of interest in biological specimens

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
CA2442339A Division CA2442339C (en) 2002-10-28 2003-09-23 Color space transformations for use in identifying objects of interest in biological specimens

Publications (2)

Publication Number Publication Date
CA2689950A1 true CA2689950A1 (en) 2004-04-28
CA2689950C CA2689950C (en) 2014-04-01

Family

ID=32093468

Family Applications (2)

Application Number Title Priority Date Filing Date
CA2442339A Expired - Fee Related CA2442339C (en) 2002-10-28 2003-09-23 Color space transformations for use in identifying objects of interest in biological specimens
CA2689950A Expired - Fee Related CA2689950C (en) 2002-10-28 2003-09-23 Color space transformations for use in identifying objects of interest in biological specimens

Family Applications Before (1)

Application Number Title Priority Date Filing Date
CA2442339A Expired - Fee Related CA2442339C (en) 2002-10-28 2003-09-23 Color space transformations for use in identifying objects of interest in biological specimens

Country Status (6)

Country Link
US (2) US7200252B2 (en)
EP (2) EP1484595B1 (en)
JP (1) JP4071186B2 (en)
AT (1) ATE556310T1 (en)
AU (1) AU2003248207B2 (en)
CA (2) CA2442339C (en)

Families Citing this family (35)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6944333B2 (en) * 2003-04-30 2005-09-13 Ventana Medical Systems, Inc. Color image compression via spectral decorrelation and elimination of spatial redundancy
US8068988B2 (en) 2003-09-08 2011-11-29 Ventana Medical Systems, Inc. Method for automated processing of digital images of tissue micro-arrays (TMA)
US20050136509A1 (en) 2003-09-10 2005-06-23 Bioimagene, Inc. Method and system for quantitatively analyzing biological samples
US7426289B2 (en) * 2004-10-14 2008-09-16 The Brigham And Women's Hospital, Inc. Overlay of tinted images for visualizing change in serial radiologic images
US20060189893A1 (en) * 2005-01-06 2006-08-24 Diamics, Inc. Systems and methods for detecting abnormal cells
US20060161076A1 (en) * 2005-01-06 2006-07-20 Diamics, Inc. Systems and methods for collection of cell clusters
JP4767591B2 (en) 2005-06-01 2011-09-07 オリンパスメディカルシステムズ株式会社 Endoscope diagnosis support method, endoscope diagnosis support device, and endoscope diagnosis support program
US7526116B2 (en) * 2006-01-19 2009-04-28 Luigi Armogida Automated microscopic sperm identification
US20070250548A1 (en) * 2006-04-21 2007-10-25 Beckman Coulter, Inc. Systems and methods for displaying a cellular abnormality
JP5032792B2 (en) * 2006-05-22 2012-09-26 浜松ホトニクス株式会社 Cell sorter
ES2663080T3 (en) 2006-11-01 2018-04-11 Ventana Medical Systems, Inc. Haptenos, haptens conjugates, compositions thereof and method for their preparation and use
US9697582B2 (en) 2006-11-16 2017-07-04 Visiopharm A/S Methods for obtaining and analyzing images
ES2731432T3 (en) 2007-05-23 2019-11-15 Ventana Med Syst Inc Polymeric transporters for immunohistochemistry and in situ hybridization
DE602007009080D1 (en) * 2007-07-06 2010-10-21 Perkinelmer Cellular Technolog Method for quantifying an underlying property of a set of samples
DE102007045897A1 (en) * 2007-09-26 2009-04-09 Carl Zeiss Microimaging Gmbh Method for the microscopic three-dimensional imaging of a sample
WO2009149013A2 (en) 2008-06-05 2009-12-10 Ventana Medical Systems, Inc. Compositions comprising nanomaterials and method for using such compositions for histochemical processes
EP2327040B1 (en) * 2008-08-15 2013-12-18 Visiopharm A/s A method and a system for determining a target in a biological sample by image analysis
WO2010046821A1 (en) * 2008-10-23 2010-04-29 Koninklijke Philips Electronics N.V. Colour management for biological samples
US8849006B2 (en) * 2009-03-25 2014-09-30 Quorum Technologies Inc. Darkfield imaging system and methods for automated screening of cells
JP5253284B2 (en) * 2009-04-22 2013-07-31 三鷹光器株式会社 Derivation method of threshold value for nail plate pigment line discrimination
CN102055882B (en) * 2009-10-30 2013-12-25 夏普株式会社 Image processing apparatus, image forming apparatus and image processing method
US8655009B2 (en) * 2010-09-15 2014-02-18 Stephen L. Chen Method and apparatus for performing color-based reaction testing of biological materials
WO2012061650A2 (en) 2010-11-03 2012-05-10 Teco Diagnostics All-in-one specimen cup with optically readable results
US9083918B2 (en) * 2011-08-26 2015-07-14 Adobe Systems Incorporated Palette-based image editing
JP5576993B2 (en) 2012-05-30 2014-08-20 パナソニック株式会社 Image measuring apparatus, image measuring method, and image measuring system
US9285323B2 (en) 2012-08-08 2016-03-15 Scanadu Incorporated Quantifying color changes of chemical test pads induced concentrations of biological analytes under different lighting conditions
US9528941B2 (en) 2012-08-08 2016-12-27 Scanadu Incorporated Method and apparatus for determining analyte concentration by quantifying and interpreting color information captured in a continuous or periodic manner
WO2014025415A2 (en) 2012-08-08 2014-02-13 Scanadu Incorporated Method and apparatus for performing and quantifying color changes induced by specific concentrations of biological analytes in an automatically calibrated environment
US9654742B2 (en) * 2012-11-30 2017-05-16 Safety Management Services, Inc. System and method of automatically determining material reaction or sensitivity using images
CN103925895B (en) * 2014-04-24 2016-04-27 无锡新吉凯氏测量技术有限公司 A kind of industrial tag system of feature based spatial coordinated information
US9863811B2 (en) 2014-08-15 2018-01-09 Scanadu Incorporated Precision luxmeter methods for digital cameras to quantify colors in uncontrolled lighting environments
JP7216707B2 (en) * 2017-08-04 2023-02-01 ベンタナ メディカル システムズ, インコーポレイテッド Color Separation Using Scatter Correction
CN112424824A (en) 2018-07-11 2021-02-26 维尔纽斯大学 Computer-implemented method for imaging biological samples
CN111353932B (en) * 2020-03-27 2023-04-25 浙江大华技术股份有限公司 Coordinate conversion method and device, electronic equipment and storage medium
USD970033S1 (en) 2020-10-23 2022-11-15 Becton, Dickinson And Company Cartridge imaging background device

Family Cites Families (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3824393A (en) * 1971-08-25 1974-07-16 American Express Invest System for differential particle counting
US5202931A (en) * 1987-10-06 1993-04-13 Cell Analysis Systems, Inc. Methods and apparatus for the quantitation of nuclear protein
US4965725B1 (en) * 1988-04-08 1996-05-07 Neuromedical Systems Inc Neural network based automated cytological specimen classification system and method
US5740270A (en) * 1988-04-08 1998-04-14 Neuromedical Systems, Inc. Automated cytological specimen classification system and method
US5016173A (en) * 1989-04-13 1991-05-14 Vanguard Imaging Ltd. Apparatus and method for monitoring visually accessible surfaces of the body
US5268966A (en) * 1989-08-10 1993-12-07 International Remote Imaging Systems, Inc. Method of differentiating particles based upon a dynamically changing threshold
JPH06503415A (en) * 1990-11-07 1994-04-14 ニューロメディカル システムズ インコーポレイテッド Device and method for inspecting images displayed on a display while performing inspection audits
US5257182B1 (en) * 1991-01-29 1996-05-07 Neuromedical Systems Inc Morphological classification system and method
US5231580A (en) * 1991-04-01 1993-07-27 The United States Of America As Represented By The Secretary Of The Department Of Health And Human Services Automated method and apparatus for determining characteristics of nerve fibers
US5428690A (en) 1991-09-23 1995-06-27 Becton Dickinson And Company Method and apparatus for automated assay of biological specimens
US5375177A (en) * 1991-09-27 1994-12-20 E. I. Du Pont De Nemours And Company Method of identifying and characterizing a valid object by color
JP3129015B2 (en) * 1993-02-16 2001-01-29 株式会社日立製作所 Inspection method and apparatus for dyed particles
JP3039594B2 (en) * 1993-10-08 2000-05-08 株式会社日立製作所 Staining reagent and method of use
US5625705A (en) * 1994-06-03 1997-04-29 Neuromedical Systems, Inc. Intensity texture based classification system and method
US5499097A (en) * 1994-09-19 1996-03-12 Neopath, Inc. Method and apparatus for checking automated optical system performance repeatability
US6330349B1 (en) * 1995-11-30 2001-12-11 Chromavision Medical Systems, Inc. Automated method for image analysis of residual protein
US6215892B1 (en) * 1995-11-30 2001-04-10 Chromavision Medical Systems, Inc. Method and apparatus for automated image analysis of biological specimens
US6151405A (en) * 1996-11-27 2000-11-21 Chromavision Medical Systems, Inc. System and method for cellular specimen grading
US6175700B1 (en) 2000-01-18 2001-01-16 Xerox Corporation Inserting test patterns in large print jobs
WO2002097716A1 (en) 2001-05-29 2002-12-05 Tissueinformatics, Inc. Robust stain detection and quantification for histological specimens based on a physical model for stain absorption
US7065236B2 (en) 2001-09-19 2006-06-20 Tripath Imaging, Inc. Method for quantitative video-microscopy and associated system and computer software program product
US7133547B2 (en) 2002-01-24 2006-11-07 Tripath Imaging, Inc. Method for quantitative video-microscopy and associated system and computer software program product

Also Published As

Publication number Publication date
US7292718B2 (en) 2007-11-06
AU2003248207A1 (en) 2004-05-13
US20070041627A1 (en) 2007-02-22
CA2442339A1 (en) 2004-04-28
ATE556310T1 (en) 2012-05-15
JP2004151101A (en) 2004-05-27
EP1416262A3 (en) 2004-08-11
US7200252B2 (en) 2007-04-03
CA2442339C (en) 2010-03-23
EP1484595A3 (en) 2008-04-09
EP1416262B1 (en) 2015-12-30
AU2003248207B2 (en) 2006-05-04
EP1416262A2 (en) 2004-05-06
EP1484595B1 (en) 2012-05-02
US20040081345A1 (en) 2004-04-29
CA2689950C (en) 2014-04-01
JP4071186B2 (en) 2008-04-02
EP1484595A2 (en) 2004-12-08

Similar Documents

Publication Publication Date Title
CA2689950A1 (en) Color space transformations for use in identifying objects of interest in biological specimens
EP1470411B1 (en) Method for quantitative video-microscopy and associated system and computer software program product
EP1428016B1 (en) Method of quantitative video-microscopy and associated system and computer software program product
JP6086949B2 (en) Image analysis method based on chromogen separation
EP0534948B1 (en) Dual color camera microscope and methodology for cell staining and analysis
US6453060B1 (en) Method and apparatus for deriving separate images from multiple chromogens in a branched image analysis system
EP1576521B1 (en) Scoring estrogen and progesterone receptors expression based on image analysis
AU2002334590A1 (en) Method quantitative video-microscopy and associated system and computer software program product
AU2003236675A1 (en) Method for quantitative video-microscopy and associated system and computer software program product
WO1997020198A3 (en) Method and apparatus for automated image analysis of biological specimens
Rigaut et al. Three‐dimensional DNA image cytometry by confocal scanning laser microscopy in thick tissue blocks
AU2006201607B2 (en) Color space transformations for use in identifying objects of interest in biological specimens
US9122904B2 (en) Method for optimization of quantitative video-microscopy and associated system
Ploem et al. Automated cell analysis for DNA studies of large cell populations using the LEYTAS image cytometry system
Poon Algorithms for detecting and segmenting nucleated blood cells

Legal Events

Date Code Title Description
EEER Examination request
MKLA Lapsed

Effective date: 20170925