• Specifications
• ImageSegmentation

Clear message

-- aerdemir 2016-04-14 17:10:18 This specification is asking for input from the community. Please provide your feedback

• by editing the /Discussion page, or

• by responding to relevant forum entry, or

• by sending an e-mail to Ahmet Erdemir, <erdemira@ccf.org>.

---

Target Outcome

This specification targets at volumetric reconstruction of a tissue of interest, specifically the definition of the boundaries of the tissue,

• as an image volume, and
• as a surface representation.

Prerequisites

Infrastructure

Previous Protocols

For more details, see Specifications/ExperimentationAnatomicalImaging.

Protocols

Input

Set(s) of MRI in NifTI format

Slicer

Overview

• Download desired image volume for the desired specimen (NifTI, .nii).
• Load the desired image volume into Slicer.
• Segment the tissue of interest using the detailed segmentation procedures described below.
  • NOTES:

  • Save the segmented label map regularly to avoid losing tedious work through program crashes. The file should be saved in the NifTI (.nii) format and file naming convention should rely on tissue labeling described in Specifications/DataManagement, e.g., oks001-fmb-01.nii, indicating the segmentation for femur bone of the Open Knee(s) - Specimen 1, the appended number indicates the segmentation label (to accommodate multiple segmentations of the same volume by others).

  • Segmented volume can be overlayed on other image sets to evaluate boundaries, however it can only be further edited when overlayed on MRIs with the same size/resolution as the MRI from which it was originally created.
• After completion of the segmentation, the volume should be exported as an image volume (NIFTI) and a triangulated surface (without smoothing) in STL format, e.g. oks001-fmb-01.stl

Image/Data Input/Output Procedures

Load MRI data:

• NifTI:

  • File -> Add Data (or click Data icon button)

  • Click "Choose File(s) to add" button.
  • Select desired MRI(s) (.nii)
  • Click "Open".
• DICOM:

  • File -> DICOM (or click DCM icon button).

  • Click "Import" button.
  • Select directory containing DICOM image slices (.IMA).
  • Click 'Add link'.
  • CLick 'OK' after images load.
  • Select desired Series in DICOM Browser window.
  • Click 'Load'.

Load segmented label map image data (NifTI):

• File -> Add Data (or click Data icon button).

• Click 'Choose File(s) to Add'.
• Select Segmented label map image(s) (NifTI, .nii).
• Click 'Open'.
• Select 'Show Options'.

• Select 'LabelMap' for all label map volumes.

• Click 'Ok'.
  • NOTES:
  • Link 2D slice views in drop-down tack menu to ensure same label map is displayed in all views.
  • In Editor module, make sure 'Merge Volume' is set to label map if applying grow-cut or other editor methods.

Save segmented label map (as NifTI):

• File -> Save, or Save icon

• Deselect all modified/selected files in the 'File Name' field
• Select/Check the desired segmented label map volume (default type: NRRD, .nrrd)
• Set the 'File Format' to NifTI (.nii)

• Rename the label map volume as desired, see naming convention: Specifications/DataManagement

• Click 'Save'

Save triangulated surface, STL (a.k.a. Slicer Model):

• File -> Save, or Save icon

• Deselect all modified/selected files in the 'File Name' field
• Select/Check the desired triangulated surface (default type: VTK, .vtk)
• Set the 'File Format' to STL (.stl)

• Rename the triangulated surface as desired, see naming convention: Specifications/DataManagement

• Click 'Save'

Viewing Options

Under the pin drop-down menu (under >> button) in any of the 2D slicer viewers:

• Link viewers to ensure that they all display the same label map volumes.
• Two label maps can be overlayed on the MRI in order to compare segmented boundaries between two different structures. The label map you want to edit should be set as the Label Layer (icon in pin drop-down 2D viewer menu with an "L"). The other label map can be loaded as the Foreground Layer (icon with an "F").
• Change transparency of the label map in 2D viewers by changing the percent opacity by changing value near the eye (display/hide) icon: 0.0 (transparent) to 1.0 (opaque).

Change contrast/brightness of MRI using the default mouse cursor pointer tool by clicking and dragging up/down and left/right in any of the 2D viewers.

Segmentation Procedures

Segmentation Setup

• From the "Modules" drop-down menu, select "Editor"
• When multiple MRI sets are loaded, in most cases the desired MRI to be segmented should be the same as the Master Volume. It is also possible to do segmentation on a different MRI than the Master Volume. For example, different MRIs can be displayed in different windows, e.g. those that are ligament specific and cartilage specific. When linked, Slicer uses interpolation for coupled viewing of the image sets that are already spatially aligned. For segmentation, one can use one image set as the master volume but segment in the other allowing high resolution segmentation volume from images with lower resolution.

• If it is the first time entering Editor Module, click Apply to select the default GenericAnatomyColors to create a new Merge Volume (i.e. label map, with the same size/resolution as the Master Volume)

  • If not the first time, make sure the desired label map overlayed (i.e. being edited) in the 2D slice viewers is the same as the Merge Volume.

Manual Segmentation

-- arielschwartz 2018-02-23 15:07:40 a link to a 3D slicer tutorial may be beneficial here. This page provides more detailed explanation of all the tools in the editor module: https://www.slicer.org/wiki/Documentation/4.8/Modules/Editor

• Perform 'Segmentation Setup'.
• Highlight the anatomy of interest in every slice, in each image plane orientation as appropriate (coronal, sagittal, axial).
• Different tools are available to highlight anatomy of interest a desired label (e.g. label1):
  • Use the Paint Effect (under 'Edit Selected Label Map' tab, top row of icons, 3rd icon from left) [with an appropriate/largest radius] to fill in the area using a brush.
  • Use the Draw Effect (under 'Edit Selected Label Map' tab, top row of icons, 4th icon from left) to draw the boundaries of the area - freehand or by right mouse click to set the polygon corners and left click to fill in the polygon.
  • Use the eraser (under 'Edit Selected Label Map' tab, top row of icons, 2nd icon from left) to change the behaviour of the tool, e.g. brush or pencil, to erase rather than draw.

Grow-Cut Segmentation

• Perform 'Segmentation Setup'
• Perform the following steps on roughly equally-spaced slices in each image plane orientation as appropriate (coronal, sagittal, axial).
  • Use the Paint Effect (under 'Edit Selected Label Map' tab, top row of icons, 3rd icon from left) [with an appropriate/largest radius] to highlight anatomy of interest (foreground) using a specific label (e.g. label1).
  • Use the Paint Effect to highlight area around anatomy of interest (background) with a different label (e.g. label2).
  • Use the Paint Effect to "cap" boundaries of anatomy of interest (background) to prevent foreground leakage (before/after anatomy of interest appears).

• Select GrowCutEffect icon (under 'Edit Selected Label Map' tab, bottom row of icons, 3rd icon from left).

• Click the "Apply" button (Slicer window graphics will freeze until the grow cut algorithm is complete).
• Remove the background label:

  • Select ChangeLabelEffect (under 'Edit Selected Label Map' tab, bottom row of icons, 3rd icon from right).

  • Select label2 as input and background [0] as output.
  • Click the "Apply" button.

• See figures below for example of segmentation using GrowCutEffect with foreground (green) and background (yellow).

• For more information on Growth Cut Effect refer to the 3DSlicerWiki http://www.slicer.org/slicerWiki/index.php/Modules:GrowCutSegmentation-Documentation-3.6.

• Tips and Shortcuts using 3DSlicer:
  • In Editor Mode:
    • 'c' to open list of labels, type # of label id and enter to switch labels quickly
    • 'z' to undo
    • 'y' to redo
    • 'd' for Draw Effect
    • 'p' for Paint Effect
    • 'e' to erase from label
    • arrow keys to move forward/background a slice

Image Processing Procedures

Label Map Smoothing

• From the Modules drop-down menu, select 'Surface Models' -> 'Label Map Smoothing'

• Set Gaussian Smoothing Parameters, Sigma based on image resolution (e.g. 0.7 for cartilage MRI, resolution = 0.35 x 0.35 x 0.7 mm)
• From 'Input Volume' drop-down menu, select desired label map
• From 'Output Volume' drop-down menu, select 'Create and rename new Volume'
• Enter new name as desired, click 'OK'
• Click Apply

Generate Triangulated Surface (STL) from Label Map

• From the Modules drop-down menu, select 'Surface Models' -> 'Model Maker'

  • Under 'IO' tab, from 'Input Volume' drop-down menu, select desired Label Map
  • In Model drop-down menu, either 'Create and rename new Hierarchy' (e.g. default 'Models'), or select an existing Model Hierarchy.
    • NOTE: all models can be generated under the same or separate model hierarchies
  • Under 'Create Model' tab, specify a desired 'Model Name' for the select Label Map.
  • FOR RAW STL:
    • Under 'Model Maker Parameters', set 'Smooth' to zero.
    • Under 'Model Maker Parameters', set 'Decimate' to zero.
  • Click Apply button.
• From Editor:

  • Select the MakeModelEffect

  • Set desired Label Map as the Merge Volume
  • If no smoothing is desired, deselect 'smooth model'
  • Click Apply button.

Tissue-Specific Procedures

Registration Markers

INPUT: general purpose MRI

Procedure for registration marker segmentation:

1. Use level tracing effect (foreground label) to segment registration markers on various slices, in various orthogonal viewing planes.
2. On slices which were segmented in the prior step, manually define the area surrounding the markers with a different color (background label)
3. Apply the Grow Cut effect automatically segment the remaining regions of the registration marker (as described above).

4. Remove the background label using the ChangeLabelEffect (as described in the Grow Cut procedure).

5. FOR SPHERICAL FEMUR/TIBIA MARKERS:
   • Manually segment to fill in the screw hole on spherical registration markers on femur and tibia.
6. IF MARKERS ARE PLASTIC SPHERES WITH ULTRASOUND GEL:
   • Manually segment to fill in bubbles using 'art' to define outer spherical boundary.

LABELS: FMR-M, FMR-L, FMR-P, TBR-M, TBR-L, TBR-P, PTR-S, PTR-M, PTR-L (includes bone and relative marker location, e.g. FMR-M is comprised of FM for femur, R for registration marker, and -M for medial).

oks001, femur and tibia registration markers (posterior):

Bones

INPUT: cartilage MRI (sagittal)

Procedure for bone segmentation:

1. Perform Grow Cut segmentation procedure on desired bone
2. Perform Label Map Smoothing to remove Grow Cut boundary noise
3. Perform manual segmentation to more accurately define bone boundary
4. Iteratively repeat last two steps until boundary is as desired

NOTE: Cortical bone will appear black in MR images, so outer edge of black cortical region defines the bone surface.

LABELS: FMB (femur), TBB (tibia), FBB (fibula), PTB (patella).

oks001, femur:

oks001, tibia:

oks001, patella:

oks001, fibula:

Cartilage

INPUT: cartilage MRI

Procedure for cartilage segmentation:

• See procedure for bone segmentation

Cartilage segmentation should be informed by bone segmentation (i.e. use bone boundary to help define cartilage boundary).

LABELS: FMC (femoral), TBC-M (medial tibial), TBC-L (lateral tibial), PTC (patellar).

oks001, femur cartilage:

oks001, patella cartilage:

oks001, medial tibia cartilage:

oks001, lateral tibia cartilage:

Menisci

INPUT: cartilage MRI

Procedure for menisci segmentation:

1. Manual segmentation
2. Label map smoothing
3. Manual touch-up

Menisci segmentation should be informed by cartilage segmentation (i.e. use cartilage boundary to help define meniscus boundary).

LABELS: MNS-M (medial), MNS-L (lateral).

oks001, medial meniscus:

oks001, lateral meniscus:

Connective Tissue - Ligaments & Tendons

Procedure for patellar ligament, quadriceps tendon, ACL, PCL (and any connective tissue when applicable):

• PHASE 1 (INPUT: ligament MRI):
  1. Load sagittal ligament MRI.
  2. Perform the Grow Cut segmentation procedure on desired tissue.
  3. Modify the label map boundary manually if desired.
  PHASE 2 (INPUT: cartilage MRI):
  1. Load cartilage MRI.
  2. Overlay previous ligament MRI segmented label map (from PHASE 1) over the cartilage MRI (as Foreground Layer, NOTE: make sure to increase opacity, default is 0).
  3. Create new label map (Merge Volume) from cartilage MRI (set as Label Layer).
  4. Manually segment the tissue using the ligament MRI label map boundaries as a guide.

Alternatively, one can display the ligament specific MRIs and the cartilage specific MRI in different windows. When linked, Slicer uses interpolation for coupled viewing of the image sets that are already spatially aligned. In return, one can do the segmentation on interpolated ligament MRIs using the cartilage MRI as the master volume for segmentation. This allows high resolution segmentation volume from images with lower resolution directly.

Procedure for LCL, etc.:

1. Manual segmentation
2. Label map smoothing
3. Manual touch-up

Connective tissue segmentation should be informed by bone segmentation (i.e. use bone boundary to help define connective tissue boundary).

LABELS: ACL, PCL, LCL, PTL, QAT.

oks001, patellar ligament:

oks001, quadriceps tendon:

oks001, ACL:

oks001, PCL:

oks001, LCL:

Sample Results

3D SURFACE REPRESENTATION OF SEGMENTED REGIONS:

Output

• Volume of tissue of interest as a binary image aligned with original MRI coordinate system (raw, without filtering and smoothing)
• Surface representation of tissue of interest in STL format in MRI coordinate system (raw, without filtering and smoothing)