How to make Non-local work for MaskRCNN?

[PkuRainBow]

Hi, Xiaolong

I noticed that you mentioned that you add a non-local block "right before the last residual block of res4".

First, I am wondering whether there exist any modifications when you employ the "non-local block" within mask-rcnn.

Thanks!

Thus I am wondering could you give me some advice? @xiaolonw

Especially, I report my performance by adding non-local block after the output of the res4 feature map,

# ResNet-50+FPN
# INFO task_evaluation.py:  65: Evaluating segmentations is done!
# INFO task_evaluation.py: 180: copypaste: Dataset: coco_2017_val
# INFO task_evaluation.py: 182: copypaste: Task: box
# INFO task_evaluation.py: 185: copypaste: AP,AP50,AP75,APs,APm,APl
# INFO task_evaluation.py: 186: copypaste: 0.3823,0.5902,0.4182,0.2157,0.4120,0.5029
# INFO task_evaluation.py: 182: copypaste: Task: mask
# INFO task_evaluation.py: 185: copypaste: AP,AP50,AP75,APs,APm,APl
# INFO task_evaluation.py: 186: copypaste: 0.3392,0.5556,0.3605,0.1522,0.3672,0.5045

# ResNet-50 +FPN + non-lolca-v4
# INFO task_evaluation.py:  65: Evaluating segmentations is done!
# INFO task_evaluation.py: 180: copypaste: Dataset: coco_2017_val
# INFO task_evaluation.py: 182: copypaste: Task: box
# INFO task_evaluation.py: 185: copypaste: AP,AP50,AP75,APs,APm,APl
# INFO task_evaluation.py: 186: copypaste: 0.3810,0.5885,0.4142,0.2197,0.4079,0.4918
# INFO task_evaluation.py: 182: copypaste: Task: mask
# INFO task_evaluation.py: 185: copypaste: AP,AP50,AP75,APs,APm,APl
# INFO task_evaluation.py: 186: copypaste: 0.3369,0.5544,0.3560,0.1540,0.3614,0.4951


# ResNet-50 +FPN + non-lolca-v2
# INFO task_evaluation.py:  65: Evaluating segmentations is done!
# INFO task_evaluation.py: 180: copypaste: Dataset: coco_2017_val
# INFO task_evaluation.py: 182: copypaste: Task: box
# INFO task_evaluation.py: 185: copypaste: AP,AP50,AP75,APs,APm,APl
# INFO task_evaluation.py: 186: copypaste: 0.3811,0.5891,0.4152,0.2175,0.4101,0.4935
# INFO task_evaluation.py: 182: copypaste: Task: mask
# INFO task_evaluation.py: 185: copypaste: AP,AP50,AP75,APs,APm,APl
# INFO task_evaluation.py: 186: copypaste: 0.3369,0.5556,0.3565,0.1500,0.3636,0.4941