Mobile QR Code QR CODE : The Transactions of the Korean Institute of Electrical Engineers
Title Hybrid Pruning of Deep Learning System
Authors 이성준(Sungjun Lee) ; 서기성(Kisung Seo)
Page pp.1750-1754
ISSN 1975-8359
Keywords Deep learning; Pruning; Convolutional neural network; Filter reduction; Genetic algorithm; APoZ
Abstract A convolutional neural network (CNN), which is one of the deep learning models, has been very successful in a variety of computer vision tasks. Filters of a CNN are automatically generated, however, they can be further optimized since there exist the possibility of existing redundant and less important features. Evolutionary algorithms is adopted to remove the unnecessary filters in order to minimize the parameters of CNN networks while maintaining a good performance of classification. Previous approach using evolutionary algorithm shows excellent performance for the filter reduction, but has a limitation of huge amount of computation.
Hybrid approach combining evolutionary algorithm and weight based pruning (APoZ) is proposed to enhance the efficiency of reduction and to reduce computation complexity. We demonstrate the proposed filter reduction method performing experiments on CIFAR-10 data based on the classification performance.