A novel approach to reconstruction based saliency detection via convolutional neural network stacked with auto-encoder

Xinchen Lin*, Yang Tang, Huaglory Tianfield, Feng Qian, Weimin Zhong

*Corresponding author for this work

Research output: Contribution to journalArticle

66 Downloads (Pure)

Abstract

Visual saliency detection, aimed at the simulation of human visual system (HVS), has drawn wide attention in recent decades. Reconstruction based saliency detection models are established methods for saliency detection, which predict unexpected regions via linear combination or auto-encoder network. However, these models are ineffective in dealing with images due to the loss of spatial information caused by the conversion from images to vectors. In this paper, a novel approach is proposed to solve this problem. The core is a deep reconstruction model, i.e., convolutional neural network for reconstruction stacked with auto-encoder (CNNR for short). On the one hand, the use of CNN is able to directly take two-dimensional data as input rather than having to convert the matrix to a series of vectors as in conventional reconstruction based saliency detection methods. On the other hand, the training process of CNN is augmented with the initialization obtained by an unsupervised learning process of convolutional auto-encoder (CAE). By this way, our CNNR model can be trained on limited labeled data, with the weights of the CNN being meaningfully initialized by CAE instead of random initialization. Performance evaluations are conducted through comprehensive experiments on four benchmark datasets and the comparisons with eight state-of-the-art saliency detection models show that our proposed deep reconstruction model outperforms most of the eight state-of-the-art saliency detection models.
Original languageEnglish
Pages (from-to)145-155
Number of pages11
JournalNeurocomputing
Volume349
Early online date23 Jan 2019
DOIs
Publication statusPublished - 15 Jul 2019

Keywords

  • convolutional neural network
  • auto-encoder
  • deep learning
  • reconstruction
  • saliency detection

Fingerprint Dive into the research topics of 'A novel approach to reconstruction based saliency detection via convolutional neural network stacked with auto-encoder'. Together they form a unique fingerprint.

  • Profiles

    Cite this