Purpose: Multiplex staining allows molecular co-localization analysis of same cell or tissue sections and maximizes the amount of data acquired from individual samples. We developed a non-linear registration framework for automated alignment of whole mount multiplexed histology images of prostate cancer. To achieve a precise automatic fit of bleached and restained high resolution tissue samples, a patch-based approach is proposed to improve annotation speed and analysis. Methods: The three-step co-registration process begins with a coarse low-resolution registration of the IHC stained image to the fixed H&E-stained image. The initial registration is then refined separately for each high-resolution patch using a smaller search window. Finally, registered patches are stitched back together using speeded up robust features (SURF). We apply the method to five multiplex whole mount prostate histology slides. To determine its effectiveness, we compare the automatic registration to the initial coarse registration and a manual control point based-method varying the number of control points. Results: For the control point-based approach, 25, 50, and 100 manually placed set landmarks resulted in a decrease of - 76.20%, -75.9% and -75.48% of the root mean squared error (RMSE), respectively. Compared to the initial registration an improvement of -76.29% of RMSE can be seen, illustrating the potential benefits of a patch-based automatic approach. Conclusion: The proposed method achieved excellent registration of the IHC to the input image. The automated method for registration of multiplexed histology images achieves high accuracy in shorter time and with greater reproducibility than conventional registration approaches and semi-automatic control points without the need for time consuming and subjective manual control-point setting. The accuracy of the fit especially improves in complex areas close to tissue tears and folds.
Purpose: Prostate cancer primarily arises from the glandular epithelium. Histomophometric techniques have been used to assess the glandular epithelium in automated detection and classification pipelines; however, they are often rigid in their implementation, and their performance suffers on large datasets where variation in staining, imaging, and preparation is difficult to control. The purpose of this study is to quantify performance of a pixelwise segmentation algorithm that was trained using different combinations of weak and strong stroma, epithelium, and lumen labels in a prostate histology dataset.Approach: We have combined weakly labeled datasets generated using simple morphometric techniques and high-quality labeled datasets from human observers in prostate biopsy cores to train a convolutional neural network for use in whole mount prostate labeling pipelines. With trained networks, we characterize pixelwise segmentation of stromal, epithelium, and lumen (SEL) regions on both biopsy core and whole-mount H&E-stained tissue.Results: We provide evidence that by simply training a deep learning algorithm on weakly labeled data generated from rigid morphometric methods, we can improve the robustness of classification over the morphometric methods used to train the classifier.Conclusions: We show that not only does our approach of combining weak and strong labels for training the CNN improve qualitative SEL labeling within tissue but also the deep learning generated labels are superior for cancer classification in a higher-order algorithm over the morphometrically derived labels it was trained on.
Sean McGarry, John Bukowy, Kenneth Iczkowski, Allison Lowman, Michael Brehler, Samuel Bobholz, Andrew Nencka, Alex Barrington, Kenneth Jacobsohn, Jackson Unteriner, Petar Duvnjak, Michael Griffin, Mark Hohenwalter, Tucker Keuter, Wei Huang, Tatjana Antic, Gladell Paner, Watchareepohn Palangmonthip, Anjishnu Banerjee, Peter LaViolette
Purpose: Our study predictively maps epithelium density in magnetic resonance imaging (MRI) space while varying the ground truth labels provided by five pathologists to quantify the downstream effects of interobserver variability.
Approach: Clinical imaging and postsurgical tissue from 48 recruited prospective patients were used in our study. Tissue was sliced to match the MRI orientation and whole-mount slides were stained and digitized. Data from 28 patients (n = 33 slides) were sent to five pathologists to be annotated. Slides from the remaining 20 patients (n = 123 slides) were annotated by one of the five pathologists. Interpathologist variability was measured using Krippendorff’s alpha. Pathologist-specific radiopathomic mapping models were trained using a partial least-squares regression using MRI values to predict epithelium density, a known marker for disease severity. An analysis of variance characterized intermodel means difference in epithelium density. A consensus model was created and evaluated using a receiver operator characteristic classifying high grade versus low grade and benign, and was statistically compared to apparent diffusion coefficient (ADC).
Results: Interobserver variability ranged from low to acceptable agreement (0.31 to 0.69). There was a statistically significant difference in mean predicted epithelium density values (p < 0.001) between the five models. The consensus model outperformed ADC (areas under the curve = 0.80 and 0.71, respectively, p < 0.05).
Conclusion: We demonstrate that radiopathomic maps of epithelium density are sensitive to the pathologist annotating the dataset; however, it is unclear if these differences are clinically significant. The consensus model produced the best maps, matched the performance of the best individual model, and outperformed ADC.
Multiparametric magnetic resonance imaging (MP-MRI), including diffusion-weighted imaging, is commonly used to diagnose prostate cancer. This radiology–pathology study correlates prostate cancer grade and morphology with common b-value combinations for calculating apparent diffusion coefficient (ADC). Thirty-nine patients undergoing radical prostatectomy were recruited for MP-MRI prior to surgery. Diffusion imaging was collected with seven b-values, and ADC was calculated. Excised prostates were sliced in the same orientation as the MRI using 3-D printed slicing jigs. Whole-mount slides were digitized and annotated by a pathologist. Annotated samples were aligned to the MRI, and ADC values were extracted from annotated peripheral zone (PZ) regions. A receiver operating characteristic (ROC) analysis was performed to determine accuracy of tissue type discrimination and optimal ADC b-value combination. ADC significantly discriminates Gleason (G) G4-5 cancer from G3 and other prostate tissue types. The optimal b-values for discriminating high from low-grade and noncancerous tissue in the PZ are 50 and 2000, followed closely by 100 to 2000 and 0 to 2000. Optimal ADC cut-offs are presented for dichotomized discrimination of tissue types according to each b-value combination. Selection of b-values affects the sensitivity and specificity of ADC for discrimination of prostate cancer.
Sharareh Bayat, Farhad Imani, Carlos Gerardo, Guy Nir, Shekoofeh Azizi, Pingkun Yan, Amir Tahmasebi, Storey Wilson, Kenneth Iczkowski, M. Scott Lucia, Larry Goldenberg, Septimiu Salcudean, Parvin Mousavi, Purang Abolmaesumi
KEYWORDS: Tissues, Ultrasonography, Finite element methods, In vivo imaging, Prostate, Breast cancer, Image segmentation, Prostate cancer, Physics, Computer simulations, Cancer, Pathology, Data acquisition
Temporal enhanced ultrasound (TeUS) is an imaging approach where a sequence of temporal ultrasound data is acquired and analyzed for tissue typing. Previously, in a series of in vivo and ex vivo studies we have demonstrated that, this approach is effective for detecting prostate and breast cancers. Evidences derived from our experiments suggest that both ultrasound-signal related factors such as induced heat and tissue-related factors such as the distribution and micro-vibration of scatterers lead to tissue typing information in TeUS. In this work, we simulate mechanical micro-vibrations of scatterers in tissue-mimicking phantoms that have various scatterer densities reflecting benign and cancerous tissue structures. Finite element modeling (FEM) is used for this purpose where the vertexes are scatterers representing cell nuclei. The initial positions of scatterers are determined by the distribution of nuclei segmented from actual digital histology scans of prostate cancer patients. Subsequently, we generate ultrasound images of the simulated tissue structure using the Field II package resulting in a temporal enhanced ultrasound. We demonstrate that the micro-vibrations of scatterers are captured by temporal ultrasound data and this information can be exploited for tissue typing.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.