A differential network with multiple gated reverse attention for medical image segmentation

Krizhevsky, A., Sutskever, I. & Hinton, G. E. Imagenet classification with deep convolutional neural networks. Adv. Neural Inf. Process. Syst. 25 (2012).Ronneberger, O., Fischer, P. & Brox, T. U-net: Convolutional networks for biomedical image segmentation. in Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings, Part III 18 234–241 (Springer, 2015).Long, J., Shelhamer, E. & Darrell, T. Fully convolutional networks for semantic segmentation. in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 3431–3440 (2015).Amer, A., Lambrou, T. & Ye, X. Mda-unet: A multi-scale dilated attention u-net for medical image segmentation. Appl. Sci. 12(7), 3676 (2022).Article 

Google Scholar 
Gao, S.-H. et al. Res2net: A new multi-scale backbone architecture. IEEE Trans. Patt. Anal. Mach. Intell. 43(2), 652–662 (2019).Article 

Google Scholar 
Zhao, X., Zhang, L. & Lu, H. Automatic polyp segmentation via multi-scale subtraction network. in Medical Image Computing and Computer Assisted Intervention–MICCAI 2021: 24th International Conference, Strasbourg, France, September 27–October 1, 2021, Proceedings, Part I 24 120–130 (Springer, 2021).Zhou, Z., Siddiquee, M. M. R., Tajbakhsh, N. & Liang, J. Unet++: Redesigning skip connections to exploit multiscale features in image segmentation. IEEE Trans. Med. Imag. 39(6), 1856–1867 (2019).Article 

Google Scholar 
Cai, Y. & Wang, Y. Ma-unet: An improved version of unet based on multi-scale and attention mechanism for medical image segmentation. in Third International Conference on Electronics and Communication; Network and Computer Technology (ECNCT 2021), vol. 12167, 205–211 (SPIE, 2022).Fan, D.-P., Ji, G.-P., Zhou, T., Chen, G., Fu, H., Shen, J. & Shao, L. Pranet: Parallel reverse attention network for polyp segmentation. in International Conference on Medical Image Computing and Computer-assisted Intervention 263–273 (Springer, 2020).Oktay, O., Schlemper, J., Folgoc, L. L., Lee, M., Heinrich, M., Misawa, K., Mori, K., McDonagh, S., Hammerla, N. Y. & Kainz, B. et al. Attention u-net: Learning where to look for the pancreas. arXiv preprint arXiv:1804.03999 (2018)Chen, J., Lu, Y., Yu, Q., Luo, X., Adeli, E., Wang, Y., Lu, L., Yuille, A. L. & Zhou, Y. Transunet: Transformers make strong encoders for medical image segmentation. arXiv preprint arXiv:2102.04306 (2021)Cao, H., Wang, Y., Chen, J., Jiang, D., Zhang, X., Tian, Q. & Wang, M. Swin-unet: Unet-like pure transformer for medical image segmentation. in European Conference on Computer Vision 205–218 (Springer, 2022).Petit, O., Thome, N., Rambour, C., Themyr, L., Collins, T. & Soler, L. U-net transformer: Self and cross attention for medical image segmentation. in Machine Learning in Medical Imaging: 12th International Workshop, MLMI 2021, Held in Conjunction with MICCAI 2021, Strasbourg, France, September 27, 2021, Proceedings 12 267–276 (Springer, 2021).Valanarasu, J. M. J., Oza, P., Hacihaliloglu, I. & Patel, V. M.: Medical transformer: Gated axial-attention for medical image segmentation. in Medical Image Computing and Computer Assisted Intervention–MICCAI 2021: 24th International Conference, Strasbourg, France, September 27–October 1, 2021, Proceedings, Part I 24 36–46 (Springer, 2021).Cheng, J. et al. Ddu-net: A dual dense u-structure network for medical image segmentation. Appl. Soft Comput. 126, 109297 (2022).Article 

Google Scholar 
Lou, A., Guan, S. & Loew, M. Dc-unet: Rethinking the u-net architecture with dual channel efficient CNN for medical image segmentation. in Medical Imaging 2021: Image Processing, vol. 11596, 758–768 (SPIE, 2021).Xie, M., Li, Y., Xue, Y., Huntress, L., Beckerman, W., Rahimi, S. A., Ady, J. W. & Roshan, U. W. Two-stage and dual-decoder convolutional u-net ensembles for reliable vessel and plaque segmentation in carotid ultrasound images. in 2020 19th IEEE International Conference on Machine Learning and Applications (ICMLA) 1376–1381 (IEEE, 2020).Zeng, Q., Xie, Y., Lu, Z., Lu, M. & Xia, Y. Discrepancy matters: Learning from inconsistent decoder features for consistent semi-supervised medical image segmentation. arXiv preprint arXiv:2309.14819 (2023)Chen, L.-C., Papandreou, G., Kokkinos, I., Murphy, K. & Yuille, A. L. Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs. IEEE Trans. Patt. Anal. Mach. Intell. 40(4), 834–848 (2017).Article 

Google Scholar 
Yang, M., Yu, K., Zhang, C., Li, Z. & Yang, K. Denseaspp for semantic segmentation in street scenes. in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 3684–3692 (2018).Lin, T.-Y., Dollár, P., Girshick, R., He, K., Hariharan, B. & Belongie, S. Feature pyramid networks for object detection. in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition 2117–2125 (2017).Wu, Y. et al. Mutual consistency learning for semi-supervised medical image segmentation. Med. Image Anal. 81, 102530 (2022).Article 
PubMed 

Google Scholar 
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Ł. & Polosukhin, I. Attention is all you need. Adv. Neural Inf. Process. Syst. 30 (2017).Gao, Y., Zhou, M. & Metaxas, D. N. Utnet: A hybrid transformer architecture for medical image segmentation. in Medical Image Computing and Computer Assisted Intervention–MICCAI 2021: 24th International Conference, Strasbourg, France, September 27–October 1, 2021, Proceedings, Part III 24 61–71 (Springer, 2021).Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S. & Guo, B. Swin transformer: Hierarchical vision transformer using shifted windows. in Proceedings of the IEEE/CVF International Conference on Computer Vision 10012–10022 (2021).Zhao, X., Jia, H., Pang, Y., Lv, L., Tian, F., Zhang, L., Sun, W. & Lu, H. M\(^{2}\)snet: Multi-scale in multi-scale subtraction network for medical image segmentation. arXiv preprint arXiv:2303.10894 (2023).Sinha, A. & Dolz, J. Multi-scale self-guided attention for medical image segmentation. IEEE J. Biomed. Health Inform. 25(1), 121–130 (2020).Article 

Google Scholar 
Ahmad, P. et al. Mh unet: A multi-scale hierarchical based architecture for medical image segmentation. IEEE Access 9, 148384–148408 (2021).Article 

Google Scholar 
Qin, X. et al. U2-net: Going deeper with nested u-structure for salient object detection. Patt. Recognit. 106, 107404 (2020).Article 

Google Scholar 
Deng, Z., Hu, X., Zhu, L., Xu, X., Qin, J., Han, G., & Heng, P.-A.: R3net: Recurrent residual refinement network for saliency detection. in Proceedings of the 27th International Joint Conference on Artificial Intelligence 684–690 (AAAI Press Menlo Park, 2018).Zhao, X., Pang, Y., Zhang, L., Lu, H. & Zhang, L.: Suppress and balance: A simple gated network for salient object detection. in Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part II 16, 35–51 (Springer, 2020).Rahman, M. M. & Marculescu, R. Medical image segmentation via cascaded attention decoding. in Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision 6222–6231 (2023).Jha, A., Kumar, A., Pande, S., Banerjee, B. & Chaudhuri, S. Mt-unet: A novel u-net based multi-task architecture for visual scene understanding. in 2020 IEEE International Conference on Image Processing (ICIP) 2191–2195 (IEEE, 2020).Huang, X., Deng, Z., Li, D. & Yuan, X. Missformer: An effective medical image segmentation transformer. arXiv preprint arXiv:2109.07162 (2021)Dong, B., Wang, W., Fan, D.-P., Li, J., Fu, H. & Shao, L. Polyp-pvt: Polyp segmentation with pyramid vision transformers. arXiv preprint arXiv:2108.06932 (2021)Vázquez, D. et al. A benchmark for endoluminal scene segmentation of colonoscopy images. J. Healthc. Eng. 2017, 4037190 (2017).Article 
PubMed 
PubMed Central 

Google Scholar 
Heidari, M., Kazerouni, A., Soltany, M., Azad, R., Aghdam, E.K., Cohen-Adad, J. & Merhof, D. Hiformer: Hierarchical multi-scale representations using transformers for medical image segmentation. in Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision 6202–6212 (2023).Liu, S. & Huang, D., et al: Receptive field block net for accurate and fast object detection. in Proceedings of the European Conference on Computer Vision (ECCV) 385–400 (2018)Milletari, F., Navab, N. & Ahmadi, S.-A. V-net: Fully convolutional neural networks for volumetric medical image segmentation. in 2016 Fourth International Conference on 3D Vision (3DV) 565–571 (IEEE, 2016).

Hot Topics

Related Articles