基于风格解耦和自适应层实例归一化的图像翻译方法
DOI:
作者:
作者单位:

作者简介:

通讯作者:

中图分类号:

TP391.9

基金项目:

国家自然科学基金(61503005),北京市社会科学基金(19YTC043, 20YTB011),北方工业大学毓优人才培养项目(NCUTYY19XN132);


Image-to-Image Translation based Style Disentangled and Adaptive Layer-Instance Normalization
Author:
Affiliation:

Fund Project:

  • 摘要
  • |
  • 图/表
  • |
  • 访问统计
  • |
  • 参考文献
  • |
  • 相似文献
  • |
  • 引证文献
  • |
  • 资源附件
  • |
  • 文章评论
    摘要:

    针对当前无监督图像翻译方法在翻译过程中存在着图像内容变化过大、目标图像域风格传递不佳而导致生成的图像质量较低、多样性较差等问题,提出一种基于风格解耦和自适应层实例归一化的图像翻译方法。首先,采用基于解耦表示的自编码器作为模型的生成器,共享内容编码器来增强图像翻译的内容一致性;然后,在解码器中实现自适应层实例归一化运算,可以自适应地改变图像的风格,以改善风格传递的效果;接着,将随机风格编码融合至损失函数中,使得设计的模型具有生成随机风格图像的能力,来提升生成图像的多样性;最后设计并实现了该方法,并在多个数据集上进行验证和分析。实验验证表明,与现有的无监督图像翻译方法相比,所研究的方法生成的图像质量较高、多样性较好。

    Abstract:

    The existing unsupervised image translation methods have some problems in the process of translation, such as the excessive change of image’s content and the poor style transmission of the target image domain, which result in the poor quality and diversity of the generated image. In order to solve these problems, an Image-to-Image Translation method based on style disentangled and Adaptive Layer-Instance Normalization was proposed in this paper. Firstly, an auto-encoder based on disentangled representation was adapted as the generator of model, and the content encoder was shared to enhance the content consistency of image to image translation. Secondly, the Adaptive Layer-Instance Normalization was added to the decoder, to change the image style adaptively and improve the effect of style transmission. Thirdly, the random style code was integrated into the loss function, and the model was made to have the ability to generate random style images and enhance the diversity of generated images. Finally, this method was designed and implemented, then verified and analyzed it on multiple datasets. Compared with the existing unsupervised image translation methods, the experimental results show that the images generated by our method have higher quality and better diversity.

    参考文献
    相似文献
    引证文献
引用本文

蔡兴泉,魏岳超,孙海燕. 基于风格解耦和自适应层实例归一化的图像翻译方法[J]. 科学技术与工程, 2021, 21(17): 7249-7257.
Cai Xingquan, Wei Yuechao, Sun Haiyan. Image-to-Image Translation based Style Disentangled and Adaptive Layer-Instance Normalization[J]. Science Technology and Engineering,2021,21(17):7249-7257.

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2020-09-29
  • 最后修改日期:2021-06-14
  • 录用日期:2021-02-16
  • 在线发布日期: 2021-07-02
  • 出版日期:
×
律回春渐,新元肇启|《科学技术与工程》编辑部恭祝新岁!
亟待确认版面费归属稿件,敬请作者关注