+高级检索
基于残差变换器的并行傅里叶卷积修复算法
DOI:
作者:
作者单位:

作者简介:

通讯作者:

基金项目:


Parallel Fast Fourier Convolutions Inpainting Algorithm Based on Residual Transformer
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
    摘要:

    为解决现有图像修复算法因缺乏上下文信息和有效的感受野导致修复大面积随机破损时效果差且只能修复低分辨率图像的缺陷,提出了基于残差变换器的并行傅里叶卷积修复算法.首先,提出基于变换器的改进残差网络模块提取待修复图像的纹理特征;然后,设计并行快速傅里叶卷积模块增强损失图像的高度有效感受野捕捉结构信息;最后,提出门控双特征融合模块交换和结合图像的结构与纹理分量,融合上下文特征,改善生成纹理的细粒度.在两个公开数据集上进行定性和定量实验,实验结果表明:所提算法可有效修复结构复杂且纹理精细的随机不规则大面积破损区域,生成结构合理、纹理细腻和语义丰富的高保真图像,并能用于高分辨率图像的目标移除.

    Abstract:

    To solve of the defects of the existing image inpainting algorithms, such as the lack of contextual information and effective perceptual field, leading to poor performance when recovering large random damages and being restricted to low-resolution images, a parallel fast Fourier convolution generation inpainting algorithm based on residual transformer is proposed. Firstly, a transformer-based improved residual network module is proposed to extract the texture features from the image to be inpainted. Subsequently, a parallel fast Fourier convolution module is designed to enhance highly effective sensory field and capture the structural information from the corrupt areas. Finally, the gated dual-feature fusion module is developed to exchange and combine the structural and texture components of the images to fuse the contextual features and improve the fine-grained nature of the generated textures. Qualitative and quantitative experiments are conducted on two public datasets, and the experimental results show that the proposed algorithm can effectively restore random irregular large broken regions with complex structures and fine textures, generate high-fidelity images with reasonable structures, fine textures and rich semantics, and can be used for target removal of high-resolution images.

    参考文献
    相似文献
    引证文献
文章指标
  • PDF下载次数:
  • HTML阅读次数:
  • 摘要点击次数:
  • 引用次数:
引用本文

李海燕 ,宋应清 ,郭磊 ?,周丽萍 ,陈泉 .基于残差变换器的并行傅里叶卷积修复算法[J].湖南大学学报:自然科学版,2023,(8):42~51

复制
历史
  • 收稿日期:
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2023-08-29
  • 出版日期:
作者稿件一经被我刊录用,如无特别声明,即视作同意授予我刊论文整体的全部复制传播的权利,包括但不限于复制权、发行权、信息网络传播权、广播权、表演权、翻译权、汇编权、改编权等著作使用权转让给我刊,我刊有权根据工作需要,允许合作的数据库、新媒体平台及其他数字平台进行数字传播和国际传播等。特此声明。
关闭