Efficient labeling of french mammogram reports with MammoBERT

Ferlay, J. et al. Cancer statistics for the year 2020: An overview. Int. J. Cancer 149, 778–789 (2021).Article 
CAS 

Google Scholar 
Wang, X., Peng, Y., Lu, L., Lu, Z., Bagheri, M. & Summers, R. M. ChestX-ray8: Hospital-scale chest x-ray database and benchmarks on weakly-supervised classification and localization of common thorax diseases. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2097–2106 (2017).Drozdov, I. et al. Supervised and unsupervised language modelling in chest X-ray radiological reports. PLoS One 15, e0229963 (2020).Article 
CAS 
PubMed 
PubMed Central 

Google Scholar 
Wood, D. A., Lynch, J., Kafiabadi, S., Guilhem, E., Al Busaidi, A., Montvila, A., Varsavsky, T., Siddiqui, J., Gadapa, N., Townend, M. et al. Automated labelling using an attention model for radiology reports of mri scans (alarm). In Medical Imaging with Deep Learning, PMLR, pp. 811–826 (2020).Martin, L., Muller, B., Ortiz Suarez, P. J., Dupont, Y., Romary, L., de la Clergerie, É. V., Seddah, D. & Sagot, B. Camembert: a tasty French language model. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics (2020).Pons, E., Braun, L. M., Hunink, M. M. & Kors, J. A. Natural language processing in radiology: a systematic review. Radiology 279, 329–343 (2016).Article 
PubMed 

Google Scholar 
Yadav, K. et al. Automated outcome classification of computed tomography imaging reports for pediatric traumatic brain injury. Acad. Emerg. Med. 23, 171–178 (2016).Article 
PubMed 
PubMed Central 

Google Scholar 
Hassanpour, S., Langlotz, C. P., Amrhein, T. J., Befera, N. T. & Lungren, M. P. Performance of a machine learning classifier of knee mri reports in two large academic radiology practices: a tool to estimate diagnostic yield. Am. J. Roentgenol., 750–753 (2017).Chen, M. C. et al. Deep learning to classify radiology free-text reports. Radiology 286, 845–852 (2018).Article 
PubMed 

Google Scholar 
Bozkurt, S., Alkim, E., Banerjee, I. & Rubin, D. L. Automated detection of measurements and their descriptors in radiology reports using a hybrid natural language processing algorithm. J. Digit. Imaging 32, 544–553 (2019).Article 
PubMed 
PubMed Central 

Google Scholar 
Chapman, W. W., Bridewell, W., Hanbury, P., Cooper, G. F. & Buchanan, B. G. A simple algorithm for identifying negated findings and diseases in discharge summaries. J. Biomed. Inform. 34, 301–310 (2001).Article 
CAS 
PubMed 

Google Scholar 
Irvin, J. et al. Chexpert: A large chest radiograph dataset with uncertainty labels and expert comparison. In Proceedings of the AAAI Conference on Artificial Intelligence, vol. 33, pp. 590–597 (2019).Bustos, A., Pertusa, A., Salinas, J.-M. & De La Iglesia-Vaya, M. Padchest: A large chest X-ray image dataset with multi-label annotated reports. Med. Image Anal. 66, 101797 (2020).Article 
PubMed 

Google Scholar 
Chapman, B. E., Lee, S., Kang, H. P. & Chapman, W. W. Document-level classification of CT pulmonary angiography reports based on an extension of the context algorithm. J. Biomed. Inform. 44, 728–737 (2011).Article 
PubMed 
PubMed Central 

Google Scholar 
Devlin, J., Chang, M.-W., Lee, K. & Toutanova, K.: Bert: Pre-training of deep bidirectional transformers for language understanding, arXiv preprint arXiv:1810.04805 (2018).Yang, Z., Dai, Z., Yang, Y., Carbonell, J., Salakhutdinov, R. R., & Le, Q. V. Xlnet: Generalized autoregressive pretraining for language understanding. Adv. Neural Inf. Process. Syst. 32 (2019).Lee, J. et al. Biobert: a pre-trained biomedical language representation model for biomedical text mining. Bioinformatics 36, 1234–1240 (2020).Article 
CAS 
PubMed 

Google Scholar 
Labrak, Y., Bazoge, A., Dufour, R., Rouvier, M., Morin, E., Daille, B. & Gourraud, P.-A. DrBERT: A Robust Pre-trained Model in French for Biomedical and Clinical domains. In Proceedings of the 61th Annual Meeting of the Association for Computational Linguistics (ACL’23), Long Paper (Association for Computational Linguistics, 2023).Buonocore, T. M., Parimbelli, E., Tibollo, V., Napolitano, C., Priori, S. & Bellazzi, R. A rule-free approach for cardiological registry filling from Italian clinical notes with question answering transformers. In International Conference on Artificial Intelligence in Medicine, 153–162 (Springer, 2023).Jantscher, M. et al. Information extraction from German radiological reports for general clinical text and language understanding. Sci. Rep. 13, 2353 (2023).Article 
ADS 
CAS 
PubMed 
PubMed Central 

Google Scholar 
Sun, C., Qiu, X., Xu, Y. & Huang, X. How to fine-tune bert for text classification?. In Chinese Computational Linguistics: 18th China National Conference, CCL 2019, Kunming, China, October 18–20, 2019, Proceedings 18, 194–206 (Springer, 2019).Croce, D., Castellucci, G. & Basili, R. GAN-BERT: Generative adversarial learning for robust text classification with a bunch of labeled examples. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Association for Computational Linguistics, Online (eds. Jurafsky, D. et al.), 2114–2119 (2020). https://aclanthology.org/2020.acl-main.191. https://doi.org/10.18653/v1/2020.acl-main.191Chan, B., Schweter, S. & Möller, T. German’s next language model. In Proceedings of the 28th International Conference on Computational Linguistics, International Committee on Computational Linguistics, Barcelona, Spain (Online) (eds. Scott, D. et al.), 6788–6796 (2020). https://aclanthology.org/2020.coling-main.598. https://doi.org/10.18653/v1/2020.coling-main.598Virtanen, A., Kanerva, J., Ilo, R., Luoma, J., Luotolahti, J., Salakoski, T., Ginter, F. & Pyysalo, S. Multilingual is not enough: Bert for finnish, arXiv preprint arXiv:1912.07076 (2019).