Evaluation Metric [code]

Metric: As widely used for 2D instance segmentation, we choose the metric AP-75, requiring at least 75% intersection over union (IoU) with the ground truth for a detection to be a true positive. We implement an efficient 3D version based on the MS COCO evaluation API. 

Leaderboard Score: The ranking score for the challenge is the average of the AP-75 on both volumes (AVR_AP@75 in the leaderboard).