Mixed Integer Programming for Sparse Coding: Application to Image Denoising

Yuan Liu (1) , Stephane Canu (1) , Paul Honeine (1) , Su Ruan (2)

1 DocApp - LITIS - Equipe Apprentissage
2 QuantIF-LITIS - Equipe Quantification en Imagerie Fonctionnelle

Dictionary learning for sparse representations is generally conducted in two alternating steps: sparse coding and dictionary updating. In this paper, a new approach to solve the sparse coding step is proposed. Because this step involves an L0-norm, most, if not all existing solutions only provide a local or approximate solution. Instead, a real L0 optimization is considered for the sparse coding problem providing a global solution. The proposed method reformulates the optimization problem as a Mixed-Integer Quadratic Program (MIQP), allowing then to obtain the global optimal solution by using an off-the-shelf optimization software. Because computing time is the main disadvantage of this approach, two techniques are proposed to improve its computational speed. One is to add suitable constraints and the other to use an appropriate initialization. The results obtained on an image denoising task demonstrate the feasibility of the MIQP approach for processing real images while achieving good performance compared to the most advanced methods.

Keywords: sparse representation; sparse coding; dictionary learning; image denoising; K-SVD; Dictionaries; Matching pursuit algorithms; Image coding; Task analysis; Machine learning; Encoding; Mixed-integer quadratic programming

Domains: Statistics [stat]; Machine Learning [stat.ML]; Engineering Sciences [physics]; Signal and Image processing; Mathematics [math]; Statistics [math.ST]; Computer Science [cs]; Signal and Image Processing; Computer Science [cs]; Neural and Evolutionary Computing [cs.NE]; Computer Science [cs]; Machine Learning [cs.LG]; Computer Science [cs]; Computers and Society [cs.CY]; Computer Science [cs]; Computer Vision and Pattern Recognition [cs.CV]; Computer Science [cs]; Artificial Intelligence [cs.AI]

Yuan Liu, Stephane Canu, Paul Honeine, Su Ruan. Mixed Integer Programming for Sparse Coding: Application to Image Denoising. IEEE Transactions on Computational Imaging, inPress, pp.1-1. ⟨10.1109/TCI.2019.2896790⟩. ⟨hal-02183028⟩