Intra- and interreader reproducibility of PI-RADSv2: A multireader study
Document Type
Journal Article
Publication Date
6-1-2019
Journal
Journal of Magnetic Resonance Imaging
Volume
49
Issue
6
DOI
10.1002/jmri.26555
Keywords
MRI; PI-RADS; prostate cancer; reader reproducibility
Abstract
© 2018 International Society for Magnetic Resonance in Medicine Background: The Prostate Imaging Reporting and Data System version 2 (PI-RADSv2) has been in use since 2015; while interreader reproducibility has been studied, there has been a paucity of studies investigating the intrareader reproducibility of PI-RADSv2. Purpose: To evaluate both intra- and interreader reproducibility of PI-RADSv2 in the assessment of intraprostatic lesions using multiparametric magnetic resonance imaging (mpMRI). Study Type: Retrospective. Population/Subjects: In all, 102 consecutive biopsy-naïve patients who underwent prostate MRI and subsequent MR/transrectal ultrasonography (MR/TRUS)-guided biopsy. Field Strength/Sequences: Prostate mpMRI at 3T using endorectal with phased array surface coils (TW MRI, DW MRI with ADC maps and b2000 DW MRI, DCE MRI). Assessment: Previously detected and biopsied lesions were scored by four readers from four different institutions using PI-RADSv2. Readers scored lesions during two readout rounds with a 4-week washout period. Statistical Tests: Kappa (κ) statistics and specific agreement (P o ) were calculated to quantify intra- and interreader reproducibility of PI-RADSv2 scoring. Lesion measurement agreement was calculated using the intraclass correlation coefficient (ICC). Results: Overall intrareader reproducibility was moderate to substantial (κ = 0.43–0.67, P o = 0.60–0.77), while overall interreader reproducibility was poor to moderate (κ = 0.24, P o = 46). Readers with more experience showed greater interreader reproducibility than readers with intermediate experience in the whole prostate (P = 0.026) and peripheral zone (P = 0.002). Sequence-specific interreader agreement for all readers was similar to the overall PI-RADSv2 score, with κ = 0.24, 0.24, and 0.23 and P o = 0.47, 0.44, and 0.54 in T 2 -weighted, diffusion-weighted imaging (DWI), and dynamic contrast-enhanced (DCE), respectively. Overall intrareader and interreader ICC for lesion measurement was 0.82 and 0.71, respectively. Data Conclusion: PI-RADSv2 provides moderate intrareader reproducibility, poor interreader reproducibility, and moderate interreader lesion measurement reproducibility. These findings suggest a need for more standardized reader training in prostate MRI. Level of Evidence: 2. Technical Efficacy: Stage 2.
APA Citation
Smith, C., Harmon, S., Barrett, T., Bittencourt, L., Law, Y., Shebel, H., An, J., Czarniecki, M., Mehralivand, S., Coskun, M., Wood, B., Pinto, P., Shih, J., Choyke, P., & Turkbey, B. (2019). Intra- and interreader reproducibility of PI-RADSv2: A multireader study. Journal of Magnetic Resonance Imaging, 49 (6). http://dx.doi.org/10.1002/jmri.26555