Improving Neural Style Transfer by Incorporating Mid-Level Representation

Lazo Cahua J.R.; Eduardo Ochoa-Luna J. · 2021 IEEE Latin American Conference on Computational Intelligence, LA-CCI 2021 (2021) · DOI: 10.1109/la-cci48322.2021.9769780

Resumen

Gatys et al. [1] has demonstrated that convolutional neural networks (CNN) are able to separate the style and content of images and then recombine them into an artistic image. This process is known as neural style transfer (NST) and has had repercussions in both academia and industry. This paper covers the approach based on image optimization that allows the selection of artistic styles arbitrarily; however, the process has a high computational cost. For this reason, it is proposed to make some modifications that allow performing the neural style transfer with a lower computational cost, in addition to adding a similarity indicator that determines whether the synthesized image has reached the desired style using mid-level representation techniques. These modifications have given better visual qualitative results, in addition, the execution time of an iteration has improved up to 1.53× times compared to other similar methods, and with the similarity indicator, it has been possible to reduce the number of iterations necessary to obtain the synthesized image.

Instituciones: Universidad Católica San Pablo