Innovative computer vision approach to 3D bladder model reconstruction from flexible cystoscopy

Nestor Orlando Falcon; Sorush Ranjbar; Exal Cisneros; Bao Vu; Austin Schoppe; Pedro Sanchez; Yufang Jin; JingYong Ye; Yusheng Feng; Dharam Kaushik; R. Lyle Hood

doi:10.1117/12.2510725

26 February 2019 Innovative computer vision approach to 3D bladder model reconstruction from flexible cystoscopy

Nestor Orlando Falcon, Sorush Ranjbar, Exal Cisneros, Bao Vu, Austin Schoppe, Pedro Sanchez, Yufang Jin, JingYong Ye, Yusheng Feng, Dharam Kaushik, R. Lyle Hood

Author Affiliations +

Proceedings Volume 10852, Therapeutics and Diagnostics in Urology 2019; 1085207 (2019) https://doi.org/10.1117/12.2510725
Event: SPIE BiOS, 2019, San Francisco, California, United States

Abstract

Bladder cancer is the fourth most common cancer in men and is considered to have the highest rate of recurrence of all cancers at ~70%, and transitional cell carcinoma (TCC) is the most common form of intrabladder malignancy. Current standard-of-care for Stages 2 or higher is radical cystectomy, which involves removal of the urinary bladder and nearby lymph nodes. Alternative, organ-sparing treatments such as chemo- or radiotherapy are relatively ineffective against these cancers. The latter is effective when precisely targeted, but suffers from accuracy issues due to low contrast from computed tomography guidance. These motivate an innovative approach to more precisely visualize and spatially pinpoint TCC. This manuscript presents a novel non-invasive computer vision pipeline that can extract 3D structural information from 2D images obtained during routine flexible cystoscopy. The pipeline utilized camera calibration, adaptive thresholding, Scale Invariant Feature Transform (SIFT), and a Structure from Motion (SFM) implementation to reconstruct 3D point clouds of the inner surface of organ phantoms and an ex vivo porcine bladder. 3D point clouds were processed by Poisson reconstruction to generate a textured, triangle meshed 3D surface. The reconstruction pipeline generated a visually recognizable, qualitative 3D representation of the bladder from 2D video captured via flexible cystoscopy. Once further developed, this approach will enhance the targeting precision of external beam radiotherapy, providing clinicians with better organ-sparing methods to treat TCC.

Conference Presentation

Citation Download Citation

Nestor Orlando Falcon, Sorush Ranjbar, Exal Cisneros, Bao Vu, Austin Schoppe, Pedro Sanchez, Yufang Jin, JingYong Ye, Yusheng Feng, Dharam Kaushik, and R. Lyle Hood "Innovative computer vision approach to 3D bladder model reconstruction from flexible cystoscopy", Proc. SPIE 10852, Therapeutics and Diagnostics in Urology 2019, 1085207 (26 February 2019); https://doi.org/10.1117/12.2510725

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available