[Research on three-dimensional skull repair by combining residual and informer attention]

Sheng Wu Yi Xue Gong Cheng Xue Za Zhi. 2022 Oct 25;39(5):897-908. doi: 10.7507/1001-5515.202202047.
[Article in Chinese]

Abstract

Cranial defects may result from clinical brain tumor surgery or accidental trauma. The defect skulls require hand-designed skull implants to repair. The edge of the skull implant needs to be accurately matched to the boundary of the skull wound with various defects. For the manual design of cranial implants, it is time-consuming and technically demanding, and the accuracy is low. Therefore, an informer residual attention U-Net (IRA-Unet) for the automatic design of three-dimensional (3D) skull implants was proposed in this paper. Informer was applied from the field of natural language processing to the field of computer vision for attention extraction. Informer attention can extract attention and make the model focus more on the location of the skull defect. Informer attention can also reduce the computation and parameter count from N 2 to log( N). Furthermore,the informer residual attention is constructed. The informer attention and the residual are combined and placed in the position of the model close to the output layer. Thus, the model can select and synthesize the global receptive field and local information to improve the model accuracy and speed up the model convergence. In this paper, the open data set of the AutoImplant 2020 was used for training and testing, and the effects of direct and indirect acquisition of skull implants on the results were compared and analyzed in the experimental part. The experimental results show that the performance of the model is robust on the test set of 110 cases fromAutoImplant 2020. The Dice coefficient and Hausdorff distance are 0.940 4 and 3.686 6, respectively. The proposed model reduces the resources required to run the model while maintaining the accuracy of the cranial implant shape, and effectively assists the surgeon in automating the design of efficient cranial repair, thereby improving the quality of the patient's postoperative recovery.

临床脑瘤手术或意外创伤引起的颅骨缺损需要手工设计颅骨植入物进行修复。颅骨植入物的边缘需要精确地吻合形态各异的缺损颅骨创伤口边界,但颅骨植入物手工设计用时周期长、技术门槛高且准确度低。为此,本文提出用于三维颅骨植入物自动化设计的信息器残差注意力U形网络(IRA-Unet)。本文将信息器(Informer)从自然语义处理领域应用到计算机视觉领域,设计信息器注意力进行注意力的提取,让模型更加关注颅骨缺损位置,将计算量和参数量从 N 2降到log( N)。本文进一步构建信息器残差注意力,将信息器注意力和残差结合并置于模型靠近输出层的位置,让模型能根据需求在全局感受野和局部信息中进行选择和综合,提高模型精度和加快模型收敛速度。本文使用颅骨植入物自动化设计挑战赛2020(AutoImplant 2020)公开数据集进行训练和测试,并在实验部分对比分析直接获得颅骨植入物和间接获得颅骨植入物两种方式对结果的影响。实验结果表明,本文所提模型具有较好鲁棒性,在AutoImplant 2020的110例测试集上取得戴斯系数值为0.9404,豪斯多夫距离值为3.6866的结果;本文所提模型在保证颅骨植入物外形精度的同时减少了模型运行所需的资源,可有效地辅助外科医生完成高效的颅骨修复自动化设计,从而提高患者术后的康复质量。.

Keywords: Cranial implant design; Informer attention; Residual block.

Publication types

  • English Abstract

MeSH terms

  • Computer-Aided Design*
  • Head
  • Humans
  • Prostheses and Implants
  • Skull* / surgery

Grants and funding

国家自然科学基金项目(61771347);广东省基础与应用基础研究基金(2021A1515011576);广东普通高校人工智能重点领域专项(2019KZDZX1017);广东省创新强校团队建设项目(2017KCXTD015);2022年广东省教育厅研究生教育创新计划项目(粤教研函〔2022〕1号)