2024

A Task-guided, Implicitly-searched and Meta-initialized Deep Model for Image Fusion.

Risheng Liu*, Zhu Liu, Jinyuan Liu, Xin Fan, Zhongxuan Luo
IEEE TPAMI [Paper]

Learning with Constraint Learning: New Perspective, Solution Strategy and Various Applications.

Risheng Liu*, Jiaxin Gao, Xuan Liu, Xin Fan
IEEE TPAMI [Paper]

Moreau Envelope for Nonconvex Bi-Level Optimization: A Single-loop and Hessian-free Solution Strategy.

Risheng Liu, Zhu Liu, Wei Yao, Shangzhi Zeng, Jin Zhang
ICML [Paper|Code]

Bi-level Learning of Task-Specific Decoders for Joint Registration and One-Shot Segmentation.

Xin Fan, Xiaolin Wang, Jiaxin Gao, Jia Wang, Zhongxuan Luo, Risheng Liu
CVPR[Paper|Code]

2023

Hierarchical Optimization-Derived Learning.

Risheng Liu, Xuan Liu, Shangzhi Zeng, Jin Zhang, Yixuan Zhang
IEEE TPAMI [Paper]

Value-Function-based Sequential Minimization for Bi-level Optimization.

Risheng Liu, Xuan Liu, Shangzhi Zeng, Jin Zhang, Yixuan Zhang
IEEE TPAMI [Paper]

Learning with Nested Scene Modeling and Cooperative Architecture Search for Low-Light Vision.

Risheng Liu*, Long Ma, Tengyu Ma, Xin Fan, Zhongxuan Luo
IEEE TPAMI [Paper|Code]

Optimization-Inspired Learning with Architecture Augmentations and Control Mechanisms for Low-Level Vision.

Risheng Liu*, Zhu Liu, Pan Mu, Xin Fan, Zhongxuan Luo
IEEE TIP[Paper|Code]

CoCoNet: Coupled Contrastive Learning Network with Multi-level Feature Ensemble for Multi-modality Image Fusion.

Jinyuan Liu, Runjia Lin, Guanyao Wu, Risheng Liu, Zhongxuan Luo, Xin Fan
IJCV [Paper]

Bilevel Fast Scene Adaptation for Low-Light Image Enhancement.

Long Ma, Dian Jin, Nan An, Jinyuan Liu, Xin Fan, Zhongxuan Luo, Risheng Liu*
IJCV [Paper]

Automated Learning for Deformable Medical Image Registration by Jointly Optimizing Network Architectures and Objective Functions.

Xin Fan, Zi Li, Ziyang Li, Xiaolin Wang, Risheng Liu, Zhongxuan Luo, Hao Huang
IEEE TIP

Investigating intrinsic degradation factors by multi-branch aggregation for real-world underwater image enhancement.

Xinwei Xue, Zexuan Li, Long Ma, Qi Jia, Risheng Liu*, Xin Fan
Pattern Recognition [Paper]

Multi-interactive Feature Learning and a Full-time Multi-modality Benchmark for Image Fusion and Segmentation.

Jinyuan Liu, Zhu Liu, Guanyao Wu, Long Ma, Risheng Liu, Wei Zhong, Zhongxuan Luo, Xin Fan
ICCV (Oral, Acceptance Rate ≤ 1.8%) [Paper|Code]

Averaged Method of Multipliers for Bi-Level Optimization without Lower-Level Strong Convexity.

Risheng Liu, Yaohua Liu, Wei Yao, Shangzhi Zeng, Jin Zhang
ICML [Paper]

Bi-level Dynamic Learning for Jointly Multi-modality Image Fusion and Beyond.

Zhu Liu, Jinyuan Liu, Guanyao Wu, Long Ma, Xin Fan, Risheng Liu*
IJCAI [Paper]

WaterFlow: Heuristic Normalizing Flow for Underwater Image Enhancement and Beyond.

Zengxi Zhang, Zhiying Jiang, Jinyuan Liu, Xin Fan, Risheng Liu*
ACM MM

Bilevel Generative Learning for Low-Light Vision.

Yingchi Liu, Zhu Liu, Long Ma, Jinyuan Liu, Xin Fan, Zhongxuan Luo, Risheng Liu*
ACM MM

PAIF: Perception-Aware Infrared-Visible Image Fusion for Attack-Tolerant Semantic Segmentation.

Zhu Liu, Jinyuan Liu, Benzhuang Zhang, Long Ma, Xin Fan, Risheng Liu*
ACM MM

Multi-Spectral Image Stitching via Spatial Graph Reasoning.

Zhiying Jiang, Zengxi Zhang, Jinyuan Liu, Xin Fan, Risheng Liu*
ACM MM

PEARL: Preprocessing Enhanced Adversarial Robust Learning of Image Deraining for Semantic Segmentation.

Xianghao Jiao, Yaohua Liu, Jiaxin Gao, Xinyuan Chu, Xin Fan, Risheng Liu*
ACM MM

Fearless Luminance Adaptation: a Macro-Micro-Hierarchical Transformer for Exposure Correction.

Gehui Li, Jinyuan Liu, Long Ma, Zhiying Jiang, Xin Fan, Risheng Liu*
ACM MM

2022

Twin Adversarial Contrastive Learning for Underwater Image Enhancement and Beyond.

Risheng Liu*, Zhiying Jiang, Shuzhou Yang, Xin Fan
IEEE TIP [Paper|Code]

Target Oriented Perceptual Adversarial Fusion Network for Underwater Image Enhancement.

Zhiying Jiang, Zhuoxiao Li, Shuzhou Yang, Xin Fan, Risheng Liu*
IEEE TCSVT [Paper|Code]

Hierarchical domain adaptation with local feature patterns.

Jun Wen, Junsong Yuan, Qian Zheng, Risheng Liu, Zhefeng Gong, Nenggan Zheng
Pattern Recognition [Paper]

Low-Light Image Enhancement via Self-Reinforced Retinex Projection Model.

Long Ma, Risheng Liu, Yiyang Wang, Xin Fan, Zhongxuan Luo
IEEE TMM [Paper|Code]

Attention-guided Global-local Adversarial Learning for Detail-preserving Multi-exposure Image Fusion.

Jinyuan Liu, Jingjie Shang, Risheng Liu, Xin Fan
IEEE TCSVT [Paper]

Towards All Weather and Unobstructed Multi-Spectral Image Stitching: Algorithm and Benchmark.

Zhiying Jiang, Zengxi Zhang, Xin Fan, Risheng Liu*
ACM MM

PIA: Parallel Architecture with Illumination Allocator for Joint Enhancement and Detection in Low-Light.

Tengyu Ma, Long Ma, Xin Fan, Zhongxuan Luo, Risheng Liu*
ACM MM

Best of Both Worlds: See and Understand Clearly in the Dark.

Xinwei Xue, Jia He, Long Ma, Yi Wang, Xin Fan, Risheng Liu
ACM MM

Optimization-Derived Learning with Essential Convergence Analysis of Training and Hyper-training.

Risheng Liu, Xuan Liu, Shangzhi Zeng, Jin Zhang, Yixuan Zhang
ICML [Paper|Code]

Unsupervised Misaligned Infrared and Visible Image Fusion via Cross-Modality Image Generation and Registration.

Di Wang, Jinyuan Liu, Xin Fan, Risheng Liu*
IJCAI (Long Presentation, Acceptance Rate ≤ 3.75%) [Code]

Hierarchical Bilevel Learning with Architecture and Loss Search for Hadamard-based Image Restoration.

Guijing Zhu, Long Ma, Xin Fan, Risheng Liu*
IJCAI [Code]

Toward Fast, Flexible, and Robust Low-Light Image Enhancement.

Long Ma, Tengyu Ma, Risheng Liu*, Xin Fan, Zhongxuan Luo
CVPR (Oral, Acceptance Rate ≤ 4.5%) [Paper|Code|Supplement Material|Online Demo|Media Report (in Chinese)]

Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detection.

Jinyuan Liu, Xin Fan, Zhanbo Huang, Guanyao Wu, Risheng Liu, Wei Zhong, Zhongxuan Luo
CVPR (Oral, Acceptance Rate ≤ 4.5%) [Paper|Code]

Self-augmented Unpaired Image Dehazing via Density and Depth Decomposition.

Yang Yang, Chaoyue Wang, Risheng Liu, Lin Zhang, Xiaojie Guo, Dacheng Tao
CVPR [Paper|Code]

Segment, Magnify and Reiterate: Detecting Camouflaged Objects the Hard Way.

Qi Jia, Shuilian Yao, Yu Liu, Xin Fan, Risheng Liu, Zhongxuan Luo
CVPR [Paper|Code]

ReCoNet: Recurrent Correction Network for Fast and Efficient Multi-modality Image Fusion.

Zhanbo Huang, Jinyuan Liu, Xin Fan, Risheng Liu, Wei Zhong, Zhongxuan Luo
ECCV

Semantic-aware Texture-Structure Feature Collaboration for Underwater Image Enhancement.

Di Wang, Long Ma, Risheng Liu, Xin Fan
ICRA

2021

A General Descent Aggregation Framework for Gradient-based Bi-level Optimization.

Risheng Liu, Pan Mu, Xiaoming Yuan, Shangzhi Zeng, Jin Zhang
IEEE TPAMI [Paper]

Investigating Bi-Level Optimization for Learning and Vision from a Unified Perspective: A Survey and Beyond.

Risheng Liu, Jiaxin Gao, Jin Zhang, Deyu Meng, Zhouchen Lin
IEEE TPAMI [Paper|Project Page]

Learning Deformable Image Registration from Optimization: Perspective, Modules, Bilevel Training and Beyond.

Risheng Liu, Zi Li, Xin Fan, Chenying Zhao, Hao Huang, Zhongxuan Luo
IEEE TPAMI [Paper]

Task-Oriented Convex Bilevel Optimization with Latent Feasibility.

Risheng Liu, Long Ma, Xiaoming Yuan, Shangzhi Zeng, Jin Zhang
IEEE TIP [Paper]

Triple-level Model Inferred Collaborative Network Architecture for Video Deraining.

Pan Mu, Zhu Liu, Yaohua Liu, Risheng Liu*, Xin Fan
IEEE TIP [Paper|Code]

Investigating Customization Strategies and Convergence Behaviors of Task-Specific ADMM.

Risheng Liu, Pan Mu, Jin Zhang
IEEE TIP [Paper]

Underexposed Image Correction via Hybrid Priors Navigated Deep Propagation.

Risheng Liu, Long Ma, Jiaao Zhang, Xin Fan, Zhongxuan Luo
IEEE TNNLS [Paper]

Learning Deep Context-Sensitive Decomposition for Low-Light Image Enhancement.

Long Ma, Risheng Liu*, Jiaao Zhang, Xin Fan, Zhongxuan Luo
IEEE TNNLS [Paper|Code]

Learning a Deep Multi-scale Feature Ensemble and an Edge-attention Guidance for Image Fusion.

Jinyuan Liu, Xin Fan, Ji Jiang, Risheng Liu, Zhongxuan Luo
IEEE TCSVT [Paper]

A Convergent Framework with Learnable Feasibility for Hadamard-based Image Recovery.

Yiyang Wang, Long Ma, Risheng Liu
CVIU [Paper]

Retinex-Inspired Unrolling With Cooperative Prior Architecture Search for Low-Light Image Enhancement.

Risheng Liu, Long Ma, Jiaao Zhang, Xin Fan, Zhongxuan Luo
CVPR [Paper|Code]

Bridging the Gap between Low-Light Scenes: Bilevel Learning for Fast Adaptation.

Dian Jin, Long Ma, Risheng Liu*, Xin Fan
ACM MM [Paper]

Searching a Hierarchically Aggregated Fusion Architecture for Fast Multi-Modality Image Fusion.

Risheng Liu, Zhu Liu, Jinyuan Liu, Xin Fan
ACM MM [Paper|Code]

Underwater Species Detection using Channel Sharpening Attention.

Lihao Jiang, Yi Wang, Qi Jia, Shengwei Xu. Yu Liu, Xin Fan, Haojie Li, Risheng Liu, Xinwei Xue, Ruili Wang
ACM MM [Paper]

A Value-Function-based Interior-point Method for Non-convex Bi-level Optimization.

Risheng Liu, Xuan Liu, Xiaoming Yuan, Shangzhi Zeng, Jin Zhang
ICML [Paper|Code]

Towards Gradient-based Bilevel Optimization with Non-convex Followers and Beyond.

Risheng Liu, Yaohua Liu, Shanghai Zeng, Jin Zhang
NeurIPS (Spotlight, Acceptance Rate ≤ 3%) [Paper|Code]

BOML: A Modularized Bilevel Optimization Library in Python for Meta Learning.

Yaohua Liu, Risheng Liu*
ICME (Best Open Source Project Award) [Paper|Code]

2020

A Bilevel Integrated Model with Data-driven Layer Ensemble for Multi-modality Image Fusion.

Risheng Liu, Jinyuan Liu, Zhiying Jiang, Xin Fan, Zhongxuan Luo
IEEE TIP [Paper]

A Deep Framework Assembling Principled Modules for CS-MRI: Unrolling Perspective, Convergence Behaviors, and Practical Modeling.

Risheng Liu, Yuxi Zhang, Shichao Cheng, Zhongxuan Luo, Xin Fan
IEEE TMI [Paper]

Location-aware and Regularization-adaptive Correlation Filters for Robust Visual Tracking.

Risheng Liu, Qianru Chen, Yuansheng Yao, Xin Fan, Zhongxuan Luo
IEEE TNNLS [Paper]

Investigating Task-driven Latent Feasibility for Nonconvex Image Modeling.

Risheng Liu, Pan Mu, Jian Chen, Xin Fan, Zhongxuan Luo
IEEE TIP [Paper]

Learning Hadamard-Product-Propagation for Image Dehazing and Beyond.

Risheng Liu, Shiqi Li, Jinyuan Liu, Long Ma, Xin Fan, Zhongxuan Luo
IEEE TCSVT [Paper]

Dual Neural Networks Coupling Data Regression with Explicit Priors for Monocular 3D Face Reconstruction.

Xin Fan, Shichao Cheng, Kang Huyan, Minjun Hou, Risheng Liu, Zhongxuan Luo
IEEE TMM [Paper]

Real-world Underwater Enhancement: Challenges, Benchmarks, and Solutions under Natural Light.

Risheng Liu, Xin Fan, Ming Zhu, Minjun Hou, Zhongxuan Luo
IEEE TCSVT [Paper|Data]

Bi-level Probabilistic Feature Learning for Deformable Image Registration.

Risheng Liu, Zi Li, Yuxi Zhang, Xin Fan, Zhongxuan Luo
IJCAI [Paper|Code]

Optimization Learning: Perspective, Method, and Applications.

Risheng Liu
IJCAI [Paper]

A Generic First-Order Algorithmic Framework for Bi-Level Programming Beyond Lower-Level Singleton.

Risheng Liu, Pan Mu, Xiaoming Yuan, Shangzhi Zeng, Jin Zhang
ICML [Paper]

2019

Learning Converged Propagations with Deep Prior Ensemble for Image Enhancement.

Risheng Liu, Long Ma, Yiyang Wang, Lei Zhang
IEEE TIP [Paper]

Deep Proximal Unrolling: Algorithmic Framework, Convergence Analysis and Applications.

Risheng Liu, Shichao Cheng, Long Ma, Xin Fan, Zhongxuan Luo
IEEE TIP [Paper]

On the Convergence of Learning-based Iterative Methods for Nonconvex Inverse Problems.

Risheng Liu, Shichao Cheng, Yi He, Xin Fan, Zhouchen Lin, Zhongxuan Luo
IEEE TPAMI [Paper]

Learning Aggregated Transmission Propagation Networks for Haze Removal and Beyond.

Risheng Liu, Xin Fan, Minjun Hou, Zhiying Jiang, Zhongxuan Luo, Lei Zhang
IEEE TNNLS [Paper]

Knowledge-driven Deep Unrolling for Robust Image Layer Separation.

Risheng Liu, Zhiying Jiang, Xin Fan, Zhongxuan Luo
IEEE TNNLS [Paper]

Toward Efficient Image Representation: Sparse Concept Discriminant Matrix Factorization.

Meng Pang, Yiu-ming Cheung, Risheng Liu, Jian Lou, Chuang Lin
IEEE TCSVT [Paper]

Robust Heterogeneous Discriminative Analysis for Face Recognition with Single Sample per Person.

Meng Pang, Yiu-ming Cheung, Binghui Wang, Risheng Liu
Pattern Recognition [Paper]

Blind Image Deblurring via Adaptive Optimization with Flexible Sparse Structure Control.

Risheng Liu, Caisheng Mao, Zhi-Hui Wang, Haojie Li
JCST [Paper]

Semi-supervised Skin Detection by Network with Mutual Guidances.

Yi He, Jiayuan Shi, Chuan Wang, Haibin Huang, Jiaming Liu, Guanbin Li, Risheng Liu, Jue Wang
ICCV [Paper]

Task Embedded Coordinate Update: A Realizable Framework for Multivariate Non-convex Optimization.

Yiyang Wang, Risheng Liu*, Long Ma, Xiaoliang Song.
AAAI [Paper]

A Theoretically Guaranteed Deep Optimization Framework for Robust Compressive Sensing MRI.

Risheng Liu, Yuxi Zhang, Shichao Cheng, Xin Fan, Zhongxuan Luo
AAAI [Paper]

Exploiting Local Feature Patterns for Unsupervised Domain Adaptation.

Jun Wen, Risheng Liu, Nenggan Zheng, Qian Zheng, Zhefeng Gong, Junsong Yuan
AAAI [Paper]

Asynchronous Proximal Stochastic Gradient Algorithm for Composition Optimization Problems.

Pengfei Wang, Risheng Liu, Nenggan Zheng, Zhefeng Gong
AAAI [Paper]

2018 and before

Online Low-Rank Representation Learning for Joint Multi-Subspace Recovery and Clustering.

Bo Li, Risheng Liu, Junjie Cao, Jie Zhang, Yukun Lai, and Xiuping Liu
IEEE TIP 2018

Explicit Shape Regression with Characteristic Number for Facial Landmark Localization.

Xin Fan, Risheng Liu, Zhongxuan Luo, Yuntao Li, and Yuyao Feng
IEEE TMM 2018

Learning to Diffuse: A New Perspective to Design PDEs for Visual Analysis.

Risheng Liu, Guangyu Zhong, Junjie Cao, Zhouchen Lin, Shiguang Shan, and Zhongxuan Luo
IEEE TPAMI 2016

Linearized alternating direction method with parallel splitting and adaptive penalty for separable convex programs in machine learning.

Zhouchen Lin, Risheng Liu, Huan Li
Machine Learning 2015

Structure-Constrained Low-Rank Representation.

Kewei Tang, Risheng Liu, Zhixun Su and Jie Zhang
IEEE TNNLS 2014

Low-Rank Structure Learning via Nonconvex Heuristic Recovery.

Yue Deng, Qionghai Dai, Risheng Liu, Zengke Zhang, Sanqing Hu
IEEE TNNLS 2013

Feature Extraction by Learning Lorentzian Metric Tensor and Its Extensions.

Risheng Liu, Zhouchen Lin, Zhixun Su, Kewei Tang
Pattern Recognition 2010

Learning Collaborative Generation Correction Modules for Blind Image Deblurring and Beyond.

Risheng Liu, Yi He, Shichao Cheng, Xin Fan, and Zhongxuan Luo
ACM MM 2018

A Bridging Framework for Model Optimization and Deep Propagation.

Risheng Liu, Shichao Cheng, Xiaokun Liu, Long Ma, Xin Fan, Zhongxuan Luo
NeurIPS 2018

Toward Designing Convergent Deep Operator Splitting Methods for Task-specific Nonconvex Optimization.

Risheng Liu, Shichao Cheng, Yi He, Xin Fan, and Zhongxuan Luo
IJCAI 2018

Fast Factorization-free Kernel Learning for Unlabeled Chunk Data Streams.

Yi Wang, Nan Xue, Xin Fan, Jiebo Luo, Risheng Liu, Bin Chen, Haojie Li, Zhongxuan Luo
IJCAI 2018

Proximal Alternating Direction Network: A Globally Converged Deep Unrolling Framework.

Risheng Liu, Xin Fan, Shichao Cheng, Xiangyu Wang, Zhongxuan Luo
AAAI 2018

Unsupervised Representation Learning with Long-Term Dynamics for Skeleton Based Action Recognition.

Nenggan Zheng, Jun Wen, Risheng Liu, Liangqu Long, Jianhua Dai and Zhefeng Gong
AAAI 2018

Self-reinforced Cascaded Regression for Face Alignment.

Xin Fan, Risheng Liu, Kang Huyan and Zhongxuan Luo
AAAI 2018

Deep Location-Specific Tracking.

Lingxiao Yang, Risheng Liu, David Zhang, and Lei Zhang
ACM MM 2017

Deep Hybrid Residual Learning with Statistic Priors for Single Image Super-Resolution.

Risheng Liu, Xiangyu Wang, Xin Fan, Haojie Li, and Zhongxuan Luo
ICME 2017 (Best Paper Finalist)

Blind Image Deblurring via Adaptive Dynamical System Learning.

Risheng Liu, Shichao Cheng, Xin Fan, Zhongxuan Luo
ICME 2017 (Best Paper Finalist)

Linearized Alternating Direction Method with Penalization for Nonconvex and Nonsmooth Optimization.

Yiyang Wang, Risheng Liu, Xiaoliang Song and Zhixun Su
AAAI 2016

Characteristic Number Regression for Facial Feature Extraction.

Yuntao Li, Xin Fan, Risheng Liu, Yuyao Feng, Zhongxuan Luo and Zezhou Li
ICME 2015 (Best Student Paper Award)

Adaptive Partial Differential Equation Learning for Visual Saliency Detection.

Risheng Liu, Junjie Cao, Zhouchen Lin and Shiguang Shan
CVPR 2014

Robust Visual Tracking Using Latent Subspace Projection Pursuit.

Wei Jin, Risheng Liu*, Zhixun Su, Changcheng Zhang and Shanshan Bai
ICME 2014 (Best Student Paper Award)

Fixed-Rank Representation for Unsupervised Visual Learning.

Risheng Liu, Zhouchen Lin, Fernando De la Torre, Zhixun Su
CVPR 2012

Linearized Alternating Direction Method with Adaptive Penalty for Low-Rank Representation.

Zhouchen Lin, Risheng Liu, Zhixun Su
NIPS 2011

Learning PDEs for Image Restoration via Optimal Control.

Risheng Liu, Zhouchen Lin, Wei Zhang, Zhixun Su
ECCV 2010