Improving generalization ability of deep neural networks for visual recognition tasks

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review


This article discusses generalization ability of convolutional neural networks (CNNs) for visual recognition with special focus on robustness to image degradation. It has been long since CNNs were claimed to surpass human vision, for example, in an object recognition task. However, such claims simply report experimental results that CNNs perform better than humans on a closed set of testing inputs. In fact, CNNs can easily fail for images to which noises are added, when they have not learned the noisy images; this is the case even if humans are barely affected by the added noises. As a solution to this problem, we discuss an approach that first restores the clean image from an input distorted image and then uses it for the target recognition task, where a CNN trained only on clean images is used. For solutions to the first step, we show our recent studies of image restoration. There are multiple different types of image distortion, such as noise, defocus/motion blur, rain-streaks, raindrops, haze etc. We first introduce our recent study of architectural design of CNNs for image restoration targeting at a single, identified type of distortion. We then introduce another study, which proposes to use a single CNN to remove combination of multiple types of distortion with unknown mixture ratio. Although it achieves only lower accuracy than the first method in the case of a single, identified type of distortion, the method will be more useful in practical applications.

Original languageEnglish
Title of host publicationComputational Color Imaging - 7th International Workshop, CCIW 2019, Proceedings
EditorsAlain Trémeau, Takahiko Horiuchi, Shoji Tominaga, Raimondo Schettini
PublisherSpringer Verlag
Number of pages11
ISBN (Print)9783030139391
Publication statusPublished - 2019
Event7th Computational Color Imaging Workshop, CCIW 2019 - Chiba, Japan
Duration: 2019 Mar 272019 Mar 29

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11418 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349


Conference7th Computational Color Imaging Workshop, CCIW 2019


  • Convolutional neural networks
  • Generalization ability
  • Visual recognition


Dive into the research topics of 'Improving generalization ability of deep neural networks for visual recognition tasks'. Together they form a unique fingerprint.

Cite this