+高级检索
结构门控与纹理联合引导的生成对抗壁画修复
DOI:
作者:
作者单位:

作者简介:

通讯作者:

基金项目:


Generative Adversarial Mural Restoration Based on Structural Gated and Texture Joint Guidance
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
    摘要:

    现有深度学习修复方法修复壁画时,受结构和纹理影响较大,修复结果易出现结构紊乱和纹理模糊等问题.针对这些问题,提出了一种结构门控融合与纹理联合引导的生成对抗壁画修复模型.首先,构建由结构引导编码子网络和纹理引导解码子网络构成的生成网络,利用结构信息引导编码,并通过门控特征增强边缘轮廓信息.然后,设计纹理引导器和方向注意力模块提取分层纹理特征,引导解码器重构修复,提高壁画的纹理一致性.最后,采用跳跃连接促进结构和纹理的特征互补,并利用谱归一化马尔科夫判别模型对抗完成壁画修复.对真实敦煌壁画数字化修复实验的结果表明:所提方法主客观评价均优于比较算法,修复结果更加清晰、自然.

    Abstract:

    In view of the problems that the existing deep learning repair methods are greatly affected by the structure and texture, resulting in structural disorder and texture blur in the repair results, a generative adversarial mural restoration model jointly guided by structure-gated fusion and texture is proposed. Firstly, the generation net-work composed of a structure-guided coding sub-network and texture-guided decoding sub-network is designed, which uses structure information to guide coding, and enhances edge contour information through gated features. Then, the texture guide and orientation attention module are used to extract layered texture features, guide the de-coder to repair, and improve the texture consistency of murals. Finally, skip connection is used to promote the feature complementarity of structure and texture, and the spectral-normalized PatchGAN discriminant model is used to com-plete mural restoration. The results from the digital restoration experiment of real Dunhuang murals show that the subjective and objective evaluation of the proposed method is better than the comparison algorithm, and the restora-tion results are clearer and more natural.

    参考文献
    相似文献
    引证文献
文章指标
  • PDF下载次数:
  • HTML阅读次数:
  • 摘要点击次数:
  • 引用次数:
引用本文

陈永?,陶美风,赵梦雪.结构门控与纹理联合引导的生成对抗壁画修复[J].湖南大学学报:自然科学版,2023,(2):1~11

复制
历史
  • 收稿日期:
  • 最后修改日期:
  • 录用日期:
  • 在线发布日期: 2023-03-06
  • 出版日期:
作者稿件一经被我刊录用,如无特别声明,即视作同意授予我刊论文整体的全部复制传播的权利,包括但不限于复制权、发行权、信息网络传播权、广播权、表演权、翻译权、汇编权、改编权等著作使用权转让给我刊,我刊有权根据工作需要,允许合作的数据库、新媒体平台及其他数字平台进行数字传播和国际传播等。特此声明。
关闭