Relational reasoning network for anatomical landmarking

Authors

Neslisah Torosdagli, University of Central Florida, Orlando, Florida, United States.
Syed Anwar, University of Central Florida, Orlando, Florida, United States.
Payal Verma, National Institute of Dental and Craniofacial Research (NIDCR), National Institutes of Health (NIH), Craniofacial Anomalies and Regeneration Section, Bethesda, Maryland, United States.
Denise K. Liberton, National Institute of Dental and Craniofacial Research (NIDCR), National Institutes of Health (NIH), Craniofacial Anomalies and Regeneration Section, Bethesda, Maryland, United States.
Janice S. Lee, National Institute of Dental and Craniofacial Research (NIDCR), National Institutes of Health (NIH), Craniofacial Anomalies and Regeneration Section, Bethesda, Maryland, United States.
Wade W. Han, Boston Children's Hospital, Harvard Medical School, Department of Otolaryngology - Head and Neck Surgery, Boston, Maryland, United States.
Ulas Bagci, University of Central Florida, Orlando, Florida, United States.

Document Type

Journal Article

Publication Date

3-1-2023

Journal

Journal of medical imaging (Bellingham, Wash.)

Volume

10

Issue

2

DOI

10.1117/1.JMI.10.2.024002

Keywords

anatomical landmarking; craniomaxillofacial bones; deep relational learning; relational reasoning; surgical modeling

Abstract

PURPOSE: We perform anatomical landmarking for craniomaxillofacial (CMF) bones without explicitly segmenting them. Toward this, we propose a simple, yet efficient, deep network architecture, called relational reasoning network (RRN), to accurately learn the local and the global relations among the landmarks in CMF bones; specifically, mandible, maxilla, and nasal bones. APPROACH: The proposed RRN works in an end-to-end manner, utilizing learned relations of the landmarks based on dense-block units. For a given few landmarks as input, RRN treats the landmarking process similar to a data imputation problem where predicted landmarks are considered missing. RESULTS: We applied RRN to cone-beam computed tomography scans obtained from 250 patients. With a fourfold cross-validation technique, we obtained an average root mean squared error of per landmark. Our proposed RRN has revealed unique relationships among the landmarks that help us in inferring informativeness of the landmark points. The proposed system identifies the missing landmark locations accurately even when severe pathology or deformations are present in the bones. CONCLUSIONS: Accurately identifying anatomical landmarks is a crucial step in deformation analysis and surgical planning for CMF surgeries. Achieving this goal without the need for explicit bone segmentation addresses a major limitation of segmentation-based approaches, where segmentation failure (as often is the case in bones with severe pathology or deformation) could easily lead to incorrect landmarking. To the best of our knowledge, this is the first-of-its-kind algorithm finding anatomical relations of the objects using deep learning.

APA Citation

Torosdagli, Neslisah; Anwar, Syed; Verma, Payal; Liberton, Denise K.; Lee, Janice S.; Han, Wade W.; and Bagci, Ulas, "Relational reasoning network for anatomical landmarking" (2023). GW Authored Works. Paper 2637.
https://hsrc.himmelfarb.gwu.edu/gwhpubs/2637

Department

Radiology