SwapInpaint: Identity-Specific Face Inpainting With Identity Swapping | |
Li, Honglei1,2; Wang, Wenmin1; Yu, Cheng1; Zhang, Shixiong1 | |
2022-07 | |
发表期刊 | IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY
![]() |
ISSN | 1051-8215 |
EISSN | 1558-2205 |
卷号 | 32期号:7页码:4271-4281 |
摘要 | As face editing scenarios have become popular, the face inpainting technique has become a hot topic. Although some existing methods can inpaint faces with preserved identity information, they fail to solve a more flexible inpainting problem that fills the holes with identity-specific content from other faces. In this work, we propose a disentangle and subject-agnostic framework that affects both full and partial-face inpainting with the guidance of a reference face image. The framework consists of an identity encoding module, a content inference module and a generative module. The identity encoding module extracts the identity embedding from the reference image, the content inference module learns to predict the content image, and the generative module integrates the content image and the reference identity embedding to generate the identity-specific inpainted result. To minimize the structure and style gap between the incomplete image and inpainted image, we use a double attribute loss to the generative module and a postprocess of blending operation to the swapped result. We compare our method with state-of-the-art works and demonstrate that our method achieves higher identity similarity and better structural correctness. |
关键词 | Faces Face recognition Task analysis Training Codes Semantics Predictive models Identity-specific inpainting partial-face inpainting face swapping |
DOI | 10.1109/TCSVT.2021.3130196 |
收录类别 | SCIE ; EI |
语种 | 英语 |
WOS研究方向 | Engineering |
WOS类目 | Engineering, Electrical & Electronic |
WOS记录号 | WOS:000819817700016 |
出版者 | IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC |
EI入藏号 | 20214911284843 |
EI主题词 | Face recognition |
EI分类号 | 716.1 Information Theory and Signal Processing ; 723.2 Data Processing and Image Processing ; 723.4 Artificial Intelligence |
原始文献类型 | Article ; 期刊论文 |
出版地 | PISCATAWAY |
引用统计 | |
文献类型 | 期刊论文 |
条目标识符 | https://ir.cqcet.edu.cn/handle/39TD4454/13927 |
专题 | 重庆电子科技职业大学 |
作者单位 | 1.Macau Univ Sci & Technol, Int Inst Next Generat Internet, Macau, Peoples R China; 2.Chongqing Coll Elect Engn, Chongqing, Peoples R China |
推荐引用方式 GB/T 7714 | Li, Honglei,Wang, Wenmin,Yu, Cheng,et al. SwapInpaint: Identity-Specific Face Inpainting With Identity Swapping[J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY,2022,32(7):4271-4281. |
APA | Li, Honglei,Wang, Wenmin,Yu, Cheng,&Zhang, Shixiong.(2022).SwapInpaint: Identity-Specific Face Inpainting With Identity Swapping.IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY,32(7),4271-4281. |
MLA | Li, Honglei,et al."SwapInpaint: Identity-Specific Face Inpainting With Identity Swapping".IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY 32.7(2022):4271-4281. |
条目包含的文件 | 条目无相关文件。 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论