2.765

2022影响因子

(CJCR)

  • 中文核心
  • EI
  • 中国科技核心
  • Scopus
  • CSCD
  • 英国科学文摘

留言板

尊敬的读者、作者、审稿人, 关于本刊的投稿、审稿、编辑和出版的任何问题, 您可以本页添加留言。我们将尽快给您答复。谢谢您的支持!

姓名
邮箱
手机号码
标题
留言内容
验证码

深度对比学习综述

张重生 陈杰 李岐龙 邓斌权 王杰 陈承功

张重生, 陈杰, 李岐龙, 邓斌权, 王杰, 陈承功. 深度对比学习综述. 自动化学报, 2023, 49(1): 15−39 doi: 10.16383/j.aas.c220421
引用本文: 张重生, 陈杰, 李岐龙, 邓斌权, 王杰, 陈承功. 深度对比学习综述. 自动化学报, 2023, 49(1): 15−39 doi: 10.16383/j.aas.c220421
Zhang Chong-Sheng, Chen Jie, Li Qi-Long, Deng Bin-Quan, Wang Jie, Chen Cheng-Gong. Deep contrastive learning: A survey. Acta Automatica Sinica, 2023, 49(1): 15−39 doi: 10.16383/j.aas.c220421
Citation: Zhang Chong-Sheng, Chen Jie, Li Qi-Long, Deng Bin-Quan, Wang Jie, Chen Cheng-Gong. Deep contrastive learning: A survey. Acta Automatica Sinica, 2023, 49(1): 15−39 doi: 10.16383/j.aas.c220421

深度对比学习综述

doi: 10.16383/j.aas.c220421
基金项目: 科技部高端外国专家项目(G2021026016L)资助
详细信息
    作者简介:

    张重生:河南大学计算机与信息工程学院教授. 主要研究方向为长尾学习与不均衡学习, 基于深度学习的汉字识别和古文字计算. E-mail: cszhang@henu.edu.cn

    陈杰:河南大学计算机与信息工程学院硕士研究生. 主要研究方向为计算机视觉与模式识别. E-mail: jiechen@henu.edu.cn

    李岐龙:河南大学计算机与信息工程学院博士研究生. 主要研究方向为对比学习和文字识别. 本文通信作者. E-mail: qilonghenu@henu.edu.cn

    邓斌权:河南大学计算机与信息工程学院硕士研究生. 主要研究方向为计算机视觉与模式识别. E-mail: bqdeng@henu.edu.cn

    王杰:河南大学计算机与信息工程学院硕士研究生. 主要研究方向为计算机视觉与模式识别. E-mail: wangjie@henu.edu.cn

    陈承功:河南大学计算机与信息工程学院硕士研究生. 主要研究方向为计算机视觉与模式识别. E-mail: cgcheng@henu.edu.cn

Deep Contrastive Learning: A Survey

Funds: Supported by the High-end Foreign Expert Project of the Ministry of Science and Technology of China (G2021026016L)
More Information
    Author Bio:

    ZHANG Chong-Sheng Professor at the School of Computer and Information Engineering, Henan University. His research interest covers long-tail learning and imbalanced learning, deep learning based OCR and ancient character computing

    CHEN Jie Master student at the School of Computer and Information Engineering, Henan University. Her research interest covers computer vision and pattern recognition

    LI Qi-Long Ph.D. candidate at the School of Computer and Information Engineering, Henan University. His research interest covers contrastive learning and scene text recognition. Corresponding author of this paper

    DENG Bin-Quan Master student at the School of Computer and Information Engineering, Henan University. His research interest covers computer vision and pattern recognition

    WANG Jie Master student at the School of Computer and Information Engineering, Henan University. His research interest covers computer vision and pattern recognition

    CHEN Cheng-Gong Master student at the School of Computer and Information Engineering, Henan University. His research interest covers computer vision and pattern recognition

  • 摘要: 在深度学习中, 如何利用大量、易获取的无标注数据增强神经网络模型的特征表达能力, 是一个具有重要意义的研究问题, 而对比学习是解决该问题的有效方法之一, 近年来得到了学术界的广泛关注, 涌现出一大批新的研究方法和成果. 本文综合考察对比学习近年的发展和进步, 提出一种新的面向对比学习的归类方法, 该方法将现有对比学习方法归纳为5类, 包括: 1) 样本对构造; 2) 图像增广; 3) 网络架构; 4) 损失函数; 5) 应用. 基于提出的归类方法, 对现有对比研究成果进行系统综述, 并评述代表性方法的技术特点和区别, 系统对比分析现有对比学习方法在不同基准数据集上的性能表现. 本文还将梳理对比学习的学术发展史, 并探讨对比学习与自监督学习、度量学习的区别和联系. 最后, 本文将讨论对比学习的现存挑战, 并展望未来发展方向和趋势.
  • 图  1  对比学习方法归类

    Fig.  1  Taxonomy of contrastive learning methods

    图  2  常用的对比学习网络架构

    Fig.  2  Commonly used contrastive learning network architecture

    图  3  对比学习的整体流程及各模块的细分类方法

    Fig.  3  Overall framework of the contrastive learning process and the sub-category of each module

    图  4  困难负样本对示例

    Fig.  4  Example of hard negative pair

    图  5  假负样本示例

    Fig.  5  Example of false negative pair

    图  6  常用图像变换方法示例

    Fig.  6  Example of common image augmentations

    图  7  裁剪操作对正样本对构造的影响示例

    Fig.  7  The influence of constructing positive pairs by image crop

    图  8  同步对称网络架构

    Fig.  8  The architecture of synchronous symmetrical network

    图  9  同步非对称网络架构

    Fig.  9  The architecture of synchronous unsymmetrical network

    图  10  异步对称网络架构

    Fig.  10  The architecture of asynchronous symmetrical network

    图  11  BYOL网络架构

    Fig.  11  The architecture of BYOL

    图  12  SimSiam网络架构

    Fig.  12  The architecture of SimSiam

    图  13  HCSC网络架构

    Fig.  13  The architecture of HCSC

    图  14  不同类型的对比学习方法统计展示

    Fig.  14  The statistical results of different contrastive learning methods

    图  15  完全崩塌与维度崩塌示例

    Fig.  15  Example of complete collapse and dimensional collapse

    图  16  对比学习中一致性和均匀性的概念

    Fig.  16  The concept of uniformity and alignment in contrastive learning

    表  1  对比学习常用数据集总结

    Table  1  Summary of common datasets

    数据集任务类别个数图像总量
    ImageNet-1K[17]分类1 000128万
    Cifar10[18]分类106万
    Cifar100[18]分类1006万
    Food101[19]分类10110万
    Birdsnap[20]分类5005万
    Sun397[21]分类39711万
    Cars[22]分类1961.6万
    Aircraft[23]分类1001万
    DTD[24]分类475 640
    Pets[25]分类373 680
    Caltech-101[26]分类1019 144
    Flowers[27]分类1027 169
    VOC[28]检测&分割201万
    COCO[29]检测&分割8033万
    下载: 导出CSV

    表  2  本文所用符号总结

    Table  2  Summary of the symbols used in this paper

    符号说明
    $X$数据集合, 小写为其中的数据
    $Y$标签集合, 小写为其中的数据
    $T$图像增广方法
    $f$特征提取网络
    $g$投影头
    $s$相似度度量函数
    $h$特征向量, $h = f(x)$
    $z$投影向量, $z = g(h)$
    $c$聚类中心向量
    $\tau$温度系数
    下载: 导出CSV

    表  3  InfoNCE损失函数及其变种

    Table  3  InfoNCE loss and some varieties based on InfoNCE

    损失名文献年份会议/刊物公式主要改进
    InfoNCE[7]2019arXiv$-\ln \dfrac{{\exp (s(q,{h^ + }))}}{{\sum\nolimits_{{x_i} \in X} {\exp (s(q,{h_i}))} }}$初始的InfoNCE损失. 文献[3, 9, 3031, 38]等均采用InfoNCE损失函数.
    ProtoNCE[63]2021ICLR$ - \ln \dfrac{{\exp (s({z_i},{c_i})/\tau )}}{{\sum\limits_{j = 0}^r {\exp (s({z_i},{c_j})/\tau )} }}$从两个样本增广间的对比变为样本增广与聚类中心的对比. 注: ${c_i}$, ${c_j}$为聚类中心.
    总损失包括实例间的对比和实例−原型对比损失, 此处只列出实例-原型对比损失.
    DCL[71]2021ECCV$- \dfrac{ {s({z_i},z_i^ + )} }{\tau } + \ln \displaystyle\sum\limits_{j = 1}^{2N} { {1_{[j \ne i]} } } \exp (s({z_i},{z_j})/\tau)$去除负正耦合系数后通过化简得到该损失.
    DirectNCE[72]2022ICLR$-\ln \dfrac{\exp s((\widehat{h}'_i, \widehat{h}'^+_{i})/\tau)}{\sum\nolimits_j \exp s((\widehat{h}'_i, \widehat{h}'^+_{i})/\tau)}$ $\widehat{h}_i' = \widehat{h}_i'[0:d]$, 即取特征向量的前$d$个维度.
    FNCL[35]2022WACV$- \ln \dfrac{{\exp (s({z_i},z_i^ + )/\tau )}}{{\sum\limits_{j = 1}^{2N} {{1_{[j \ne i,j \ne {F_i}]}}\exp (s({z_i},{z_j})/\tau)}}}$${F_i}$为第$i$个样本的假负样本集.
    SCL[8]2020NIPS$- \displaystyle\sum\limits_{i \in I} {\dfrac{1}{ {p(i)} } } \sum\limits_{p \in p(i)} {\ln \dfrac{ {\exp (s({z_i},{z_p})/\tau )} }{ {\sum\nolimits_{a \in A(i)} {\exp (s({z_i},{z_a})/\tau )} } } }$将标签引入对比学习, $P(i)$是与第$i$个样本相同类的数据集合.
    下载: 导出CSV

    表  4  对比学习方法整体归类分析

    Table  4  Analysis of different contrastive learning methods based on our proposed taxonomy

    文献年份会议/刊物样本对构造图像增广网络架构损失函数数据标注
    [7]2019arXiv随机采样图像变换同步非对称InfoNCE类
    [2]2020ICML随机采样图像变换同步对称InfoNCE类
    [3]2020CVPR随机采样图像变换异步对称InfoNCE类
    [4]2020NIPS随机采样图像变换异步非对称传统损失
    [5]2020NIPS随机采样图像变换聚类/同步对称传统损失
    [8]2020NIPS随机采样图像变换同步对称InfoNCE类
    [9]2020NIPS随机采样图像变换同步对称混合损失部分
    [33]2020NIPS困难样本构造图像变换异步对称InfoNCE类
    [36]2020NIPS剔除假负样本图像变换同步对称InfoNCE类
    [37]2020arXiv正样本扩充图像变换异步对称InfoNCE类
    [42]2020NIPS正样本扩充图像变换同步对称InfoNCE类
    [45]2020ECCV构造多视图图像变换同步对称InfoNCE类
    [52]2020NIPS随机采样语义增广同步对称InfoNCE类
    [55]2020CVPR随机采样图像变换同步非对称InfoNCE类
    [57]2020NIPS随机采样图像变换同步非对称InfoNCE类
    [70]2020arXiv随机采样图像变换异步对称InfoNCE类
    [109]2020ECCV随机采样图像变换同步非对称InfoNCE类
    [6]2021CVPR随机采样图像变换异步非对称传统损失
    [32]2021ICCV困难样本构造图像变换异步对称InfoNCE类
    [34]2021CVPR困难样本构造图像变换同步对称混合损失部分
    [39]2021ICCV正样本扩充图像变换异步对称混合损失
    [40]2021CVPR正样本扩充图像变换同步对称InfoNCE类
    [46]2021CVPRW构造多视图图像变换同步对称混合损失
    [61]2021ICCV随机采样图像变换异步非对称InfoNCE类
    [63]2021ICLR随机采样图像变换聚类/异步对称InfoNCE类
    [64]2021CVPR随机采样图像变换聚类架构InfoNCE类
    [66]2021AAAI随机采样图像变换聚类/同步对称InfoNCE类
    [77]2021CVPR随机采样图像变换同步对称混合损失
    [79]2021ICCV随机采样图像变换同步对称混合损失部分
    [83]2021TGRS随机采样图像变换同步对称混合损失部分
    [78]2021TGRS随机采样图像变换同步对称InfoNCE类
    [85]2021CVPR随机采样图像变换同步对称InfoNCE类
    [35]2022WACV剔除假负样本图像变换同步对称InfoNCE类
    [41]2022CVPR正样本扩充图像变换同步非对称混合损失
    [43]2022ICLR正样本扩充图像变换异步对称混合损失部分
    [44]2022CVPR正样本扩充图像变换同步对称混合损失部分
    [47]2022CVPR随机采样图像变换任意架构InfoNCE类
    [48]2022CVPR随机采样图像合成异步对称InfoNCE类
    [54]2022TAI随机采样图像变换同步非对称InfoNCE类
    [65]2022CVPR剔除假负样本图像变换聚类/异步对称InfoNCE类
    [72]2022ICLR随机采样图像变换同步对称InfoNCE类
    [76]2022AAAI随机采样图像变换同步对称传统损失
    [94]2022ICLR随机采样图像变换同步对称InfoNCE类
    [98]2022CVPR随机采样图像变换同步对称InfoNCE类
    [103]2022ICLR随机采样图像变换同步对称混合损失
    下载: 导出CSV

    表  5  不同对比学习算法在ImageNet数据集上的分类效果

    Table  5  The classification results of different contrastive learning methods on ImageNet

    文献主干网络Top 1 (%)Top 5 (%)数据标注
    MoCov1[3]ResNet5060.6
    CPCv2[100]ResNet5063.885.3
    ResNet16171.590.1
    PCL[63]ResNet5067.6
    SimCLR[2]ResNet5069.389
    MoCov2[70]ResNet5071.1
    SimSiam[6]ResNet5071.3
    BT[101]ResNet5073.291
    VICReg[103]ResNet5073.291.1
    HCSC[65]ResNet5073.3
    MoCov3[61]ResNet5073.8
    Transformer76.5
    BYOL[4]ResNet5074.391.6
    SwAV[5]ResNet5075.3
    DINO[59]ResNet5075.3
    Transormer77
    TSC[96]ResNet5077.1
    SCL[8]ResNet5078.794.3
    PaCo[67]ResNet5079.3
    下载: 导出CSV

    表  6  不同对比学习算法在各数据集上的迁移学习效果

    Table  6  The transfer learning results of different contrastive learning methods on each dataset

    文献Food (%)Cifar10/Cifar100 (%)Birds (%)SUN (%)Cars (%)Aircraft (%)VOC (%)DTD (%)Pets (%)Caltech (%)Flowers (%)
    线性评估
    SimCLR[2]68.490.6/71.637.458.850.350.380.574.583.690.391.2
    SimCLRv2[9]73.992.4/7644.76154.951.181.276.58591.293.5
    BYOL[4]75.391.3/78.457.262.267.860.682.575.590.494.296.1
    微调评估
    MMCL[76]82.496.24/82.189.285.473.587.895.2
    SimCLR[2]88.297.7/85.975.963.591.388.184.173.289.292.197
    SimCLRv2[9]88.297.5/8674.964.691.887.684.174.789.992.397.2
    BYOL[4]88.597.8/86.176.363.791.688.185.476.291.793.897
    FNC[35]88.397.7/86.876.364.29288.584.77690.993.697.5
    SCL[8]87.297.42/84.375.25891.784.185.274.693.59196
    下载: 导出CSV

    表  7  不同半监督对比学习算法在ImageNet上的分类效果

    Table  7  The classification results of different semi-supervised contrastive learning methods on ImageNet

    文献Top 1 (%)Top 5 (%)
    1%10%1%10%
    PIRL[55]30.760.457.283.8
    PCL[63]75.385.6
    SimCLR[2]48.365.675.587.8
    BYOL[4]53.268.878.489
    SwAV[5]53.970.278.589.9
    BT[101]5569.779.289.3
    HCSC[65]55.568.780.988.6
    CoMatch[79]67.173.787.191.4
    SimCLRv2[9]73.977.591.593.4
    下载: 导出CSV

    表  8  不同对比学习算法在图像分割任务上的性能表现

    Table  8  The image segmentation results of different contrastive learning methods on VOC and COCO dataset

    文献APAPm
    VOC (%)COCO (%)COCO (%)
    BYOL[4]55.337.933.2
    SwAV[5]55.437.633.1
    SimCLR[2]55.537.933.3
    MoCov2[70]5739.234.3
    SimSiam[6]5739.234.4
    DenseCL[89]58.740.336.4
    下载: 导出CSV
  • [1] Jing L L, Tian Y L. Self-supervised visual feature learning with deep neural networks: A survey. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2021, 43(11): 4037-4058 doi: 10.1109/TPAMI.2020.2992393
    [2] Chen T, Kornblith S, Norouzi M, et al. A simple framework for contrastive learning of visual representations. In: Proceedings of the 37th International Conference on Machine Learning (ICML). Vitual: ACM, 2020, 1597−1607
    [3] He K M, Fan H Q, Wu Y X, Xie S N, Girshick R. Momentum contrast for unsupervised visual representation learning. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. Seattle, USA: IEEE, 2020. 9726−9735
    [4] Grill J B, Strub F, Altché F, Tallec C, Richemond P H, Buchatskaya E, et al. Bootstrap your own latent a new approach to self-supervised learning. In: Proceedings of the 34th International Conference on Neural Information Processing Systems (NIPS). Vancouver, Canada: Curran Associates Inc., 2020. 21271−21284
    [5] Caron M, Misra I, Mairal J, Goyal P, Bojanowski P, Joulin A. Unsupervised learning of visual features by contrasting cluster assignments. In: Proceedings of the 34th International Conference on Neural Information Processing Systems. Vancouver, Canada: Curran Associates Inc., 2020. 9912−9924
    [6] Chen X L, He K M. Exploring simple Siamese representation learning. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Nashville, USA: IEEE, 2021. 15745−15753
    [7] Van Den Oord A, Li Y Z, Vinyals O. Representation learning with contrastive predictive coding [Online], available: https://arxiv.org/abs/1807.03748, January 22, 2019
    [8] Khosla P, Teterwak P, Wang C, et al. Supervised contrastive learning. In: Proceedings of the Advances in Neural Information Processing Systems, 2020, 33: 18661−18673
    [9] Chen T, Kornblith S, Swersky K, Norouzi M, Hinton G. Big self-supervised models are strong semi-supervised learners. In: Proceedings of the 34th International Conference on Neural Information Processing Systems. Vancouver, Canada: Curran Associates Inc., 2020. Article No. 1865
    [10] Jaiswal A, Babu A R, Zadeh M Z, Banerjee D, Makedon F. A survey on contrastive self-supervised learning. Technologies, 2020, 9(1): 2 doi: 10.3390/technologies9010002
    [11] Le-Khac P H, Healy G, Smeaton A F. Contrastive representation learning: A framework and review. IEEE Access, 2020, 8: 193907-193934 doi: 10.1109/ACCESS.2020.3031549
    [12] Liu X, Zhang F J, Hou Z Y, Mian L, Wang Z Y, Zhang J, et al. Self-supervised learning: Generative or contrastive. IEEE Transactions on Knowledge and Data Engineering, 2021, 35(1): 857-576
    [13] Hadsell R, Chopra S, LeCun Y. Dimensionality reduction by learning an invariant mapping. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR). New York, USA: IEEE, 2006. 1735−1742
    [14] Wu Z R, Xiong Y J, Yu S X, Lin D H. Unsupervised feature learning via non-parametric instance discrimination. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Salt Lake City, USA: 2018. 3733−3742
    [15] Bromley J, Guyon I, LeCun Y, Säckinger E, Shah R. Signature verification using a “Siamese” time delay neural network. In: Proceedings of the 6th International Conference on Neural Information Processing Systems. Denver, USA: Morgan Kaufmann Publishers Inc., 1993. 737−744
    [16] Li D W, Tian Y J. Survey and experimental study on metric learning methods. Neural Networks, 2018, 105: 447-462 doi: 10.1016/j.neunet.2018.06.003
    [17] Jia D, Wei D, Richard S, Li J L, Kai L, Li F F. ImageNet: A large-scale hierarchical image database. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Miami, USA: IEEE, 2009. 248−255
    [18] Krizhevsky A. Learning Multiple Layers of Features from Tiny Images [Master thesis], University of Toronto, Canada, 2009
    [19] Bossard L, Guillaumin M, Van Gool L. Food-101-mining discriminative components with random forests. In: Proceedings of the 13th European Conference on Computer Vision (ECCV). Zurich, Switzerland: Springer, 2014. 446−461
    [20] Berg T, Liu J X, Lee S W, Alexander M L, Jacobs D W, Belhumeur P N. Birdsnap: Large-scale fine-grained visual categorization of birds. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Columbus, USA: IEEE, 2014. 2019−2026
    [21] Xiao J X, Hays J, Ehinger K A, Oliva A, Torralba A. SUN database: Large-scale scene recognition from abbey to zoo. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR). San Francisco, USA: IEEE, 2010. 3485−3492
    [22] Jonathan K, Michael S, Jia D, and Li F F. 3D object representations for fine-grained categorization. In: Proceedings of the IEEE International Conference on Computer Vision Workshops (ICCV). Sydney, Australia: IEEE, 2013: 554−561
    [23] Maji S, Rahtu E, Kannala J, Blaschko M, Vedaldi A. Fine-grained visual classification of aircraft [Online], available: https://arxiv.org/abs/1306.5151, June 6, 2013
    [24] Cimpoi M, Maji S, Kokkinos I, Mohamed S, Vedaldi A. Describing textures in the wild. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Columbus, USA: IEEE, 2014. 3606−3613
    [25] Parkhi O M, Vedaldi A, Zisserman A, Jawahar C V. Cats and dogs. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Providence, USA: IEEE, 2012. 3498−3505
    [26] Li F F, Rob F, Pietro P. Learning generative visual models from few training examples: An incremental bayesian approach tested on 101 object categories. In: Proceedings of the Conference on Computer Vision and Pattern Recognition Workshop (CVPR-W). Washington, USA: IEEE, 2004: 178−178
    [27] Nilsback M E, Zisserman A. Automated flower classification over a large number of classes. In: Proceedings of the Sixth Indian Conference on Computer Vision, Graphics & Image Processing (ICVGIP). Bhubaneswar, India: IEEE, 2008. 722−729
    [28] Everingham M, Van Gool L, Williams C K I, Winn J, Zisserman A. The PASCAL visual object classes (VOC) challenge. International Journal of Computer Vision, 2010, 88(2): 303-338 doi: 10.1007/s11263-009-0275-4
    [29] Lin T Y, Maire M, Belongie S, Hays J, Perona P, Ramanan D, et al. Microsoft coco: Common objects in context. In: Proceedings of the 13th European Conference on Computer Vision (ECCV). Zurich, Switzerland: Springer, 2014. 740−755
    [30] He K M, Zhang X Y, Ren S Q, Sun J. Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Las Vegas, USA: IEEE, 2016. 770−778
    [31] Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez A N, et al. Attention is all you need. In: Proceedings of the 31st International Conference on Neural Information Processing Systems. Long Beach, USA: Curran Associates Inc., 2017. 6000−6010
    [32] Zhu R, Zhao B C, Liu J E, Sun Z L, Chen C W. Improving contrastive learning by visualizing feature transformation. In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV). Montreal, Canada: IEEE, 2021. 10286−10295
    [33] Kalantidis Y, Sariyildiz M B, Pion N, Weinzaepfel P, Larlus D. Hard negative mixing for contrastive learning. In: Proceedings of the 34th International Conference on Neural Information Processing Systems. Vancouver, Canada: Curran Associates Inc., 2020. Article No. 1829
    [34] Zhong Z, Fini E, Roy S, Luo Z M, Ricci E, Sebe N. Neighborhood contrastive learning for novel class discovery. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Nashville, USA: IEEE, 2021. 10862−10870
    [35] Huynh T, Kornblith S, Walter M R, Maire M, Khademi M. Boosting contrastive self-supervised learning with false negative cancellation. In: Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV). Waikoloa, USA: IEEE, 2022. 986−996
    [36] Chuang C Y, Robinson J, Yen-Chen L, Torralba A, Jegelka S. Debiased contrastive learning. In: Proceedings of the 34th International Conference on Neural Information Processing Systems. Vancouver, Canada: Curran Associates Inc., 2020. 8765−8775
    [37] Kim S, Lee G, Bae S, Yun S Y. MixCo: Mix-up contrastive learning for visual representation [Online], available: https://arxiv.org/abs/2010.06300, November 15, 2020
    [38] 王梦琳. 基于对比学习的行人重识别[博士学位论文], 浙江大学, 中国, 2021

    Wang Meng-Lin. Contrastive Learning Based Person Re-identification. [Ph. D. dissertation], Zhejiang University, China, 2021
    [39] Ayush K, Uzkent B, Meng C L, Tanmay K, Burke M, Lobell D, et al. Geography-aware self-supervised learning. In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV). Montreal, Canada: IEEE, 2021. 10161−10170
    [40] Qian R, Meng T J, Gong B Q, Yang M H, Wang H S, Belongie S, et al. Spatiotemporal contrastive video representation learning. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Nashville, USA: IEEE, 2021. 6960−6970
    [41] Kumar S, Haresh S, Ahmed A, Konin A, Zia M Z, Tran Q H. Unsupervised action segmentation by joint representation learning and online clustering. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). New Orleans, USA: IEEE, 2022. 20142−20153
    [42] Han T D, Xie W D, Zisserman A. Self-supervised co-training for video representation learning. In: Proceedings of the 34th International Conference on Neural Information Processing Systems. Vancouver, Canada: Curran Associates Inc., 2020. Article No. 477
    [43] Wang H B, Xiao R, Li S, et al. Contrastive Label Disambiguation for Partial Label Learning. In: Proceedings of the 10th International Conference on Learning Representations. Virtual: ICLR, 2022.
    [44] Yang F, Wu K, Zhang S Y, Jiang G N, Liu Y, Zheng F, et al. Class-aware contrastive semi-supervised learning. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). New Orleans, USA: IEEE, 2022. 14401−14410
    [45] Tian Y L, Krishnan D, Isola P. Contrastive multiview coding. In: Proceedings of the 16th European Conference on Computer Vision (ECCV). Glasgow, UK: Springer, 2020. 776−794
    [46] Rai N, Adeli E, Lee K H, Gaidon A, Niebles J C. CoCon: Cooperative-contrastive learning. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW). Nashville, USA: IEEE, 2021. 3379−3388
    [47] Peng X Y, Wang K, Zhu Z, Wang M, You Y. Crafting better contrastive views for siamese representation learning. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). New Orleans, USA: IEEE, 2022. 16010−16019
    [48] Ding S R, Li M M, Yang T Y, Qian R, Xu H H, Chen Q Y, et al. Motion-aware contrastive video representation learning via foreground-background merging. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). New Orleans, USA: IEEE, 2022. 9706−9716
    [49] Li S, Gong K X, Liu C H, Wang Y L, Qiao F, Cheng X J. MetaSAug: Meta semantic augmentation for long-tailed visual recognition. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Nashville, USA: IEEE, 2021. 5208−5217
    [50] Wang Y L, Pan X R, Song S J, Zhang H, Wu C, Huang G. Implicit semantic data augmentation for deep networks. In: Proceedings of the 33rd International Conference on Neural Information Processing Systems. Vancouver, Canada: Curran Associates Inc., 2019. Article No. 1132
    [51] Li S, Xie M X, Gong K X, Liu C H, Wang Y L, Li F. Transferable semantic augmentation for domain adaptation. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Nashville, USA: IEEE, 2021. 11511−11520
    [52] Tian Y L, Sun C, Poole B, Krishnan D, Schmid C, Isola P. What makes for good views for contrastive learning. In: Proceedings of the 34th International Conference on Neural Information Processing Systems. Vancouver, Canada: Curran Associates Inc., 2020. Article No. 573
    [53] Han T D, Xie W D, Zisserman A. Video representation learning by dense predictive coding. In: Proceedings of the IEEE/CVF International Conference on Computer Vision Workshop (ICCV). Seoul, Korea: IEEE, 2019. 1483−1492
    [54] Nguyen N, Chang J M. CSNAS: Contrastive self-supervised learning neural architecture search via sequential model-based optimization. IEEE Transactions on Artificial Intelligence, 2022, 3(4): 609-624 doi: 10.1109/TAI.2021.3121663
    [55] Misra I, Van Der Maaten L. Self-supervised learning of pretext-invariant representations. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Seattle, USA: IEEE, 2020. 6706−6716
    [56] Bae S, Kim S, Ko J, Lee G, Noh S, Yun S Y. Self-contrastive learning [Online], available: https://arxiv.org/abs/2106.15499, February 9, 2021
    [57] Chaitanya K, Erdil E, Karani N, Konukoglu E. Contrastive learning of global and local features for medical image segmentation with limited annotations. In: Proceedings of the 34th International Conference on Neural Information Processing Systems (NeurIPS). Vancouver, Canada: Curran Associates Inc., 2020. Article No. 1052
    [58] Dosovitskiy A, Beyer L, Kolesnikov A, Weissenborn D, Zhai X H, Unterthiner T, et al. An image is worth 16x16 words: Transformers for image recognition at scale. In: Proceedings of 9th International Conference on Learning Representations. Austria: ICLR, 2021.
    [59] Caron M, Touvron H, Misra I, Jegou H, Mairal J, Bojanowski P, et al. Emerging properties in self-supervised vision transformers. In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV). Montreal, Canada: IEEE, 2021. 9630−9640
    [60] Richemond P H, Grill J B, Altché F, Tallec C, Strub F, Brock A, et al. BYOL works even without batch statistics [Online], available: https://arxiv.org/abs/2010.10241, October 20, 2020
    [61] Chen X L, Xie S N, He K M. An empirical study of training self-supervised vision transformers. In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV). Montreal, Canada: IEEE, 2021. 9620−9629
    [62] Caron M, Bojanowski P, Joulin A, Douze M. Deep clustering for unsupervised learning of visual features. In: Proceedings of the 15th European Conference on Computer Vision (ECCV). Munich, Germany: Springer, 2018. 139−156
    [63] Li J N, Zhou P, Xiong C, et al. Prototypical contrastive learning of unsupervised representations. In: Proceedings of 9th International Conference on Learning Representations. Austria: ICLR, 2021.
    [64] Wang X D, Liu Z W, Yu S X. Unsupervised feature learning by cross-level instance-group discrimination. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Nashville, USA: IEEE, 2021. 12581−12590
    [65] Guo Y F, Xu M H, Li J W, Ni B B, Zhu X Y, Sun Z B, et al. HCSC: Hierarchical contrastive selective coding. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). New Orleans, USA: IEEE, 2022. 9696−9705
    [66] Li Y F, Hu P, Liu Z T, Peng D Z, Zhou J T, Peng X. Contrastive clustering. Proceedings of the AAAI Conference on Artificial Intelligence, 2021, 35(10): 8547-8555 doi: 10.1609/aaai.v35i10.17037
    [67] Cui J Q, Zhong Z S, Liu S, Yu B, Jia J Y. Parametric contrastive learning. In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV). Montreal, Canada: IEEE, 2021. 695−704
    [68] Gutmann M U, Hyvärinen A. Noise-contrastive estimation of unnormalized statistical models, with applications to natural image statistics. The Journal of Machine Learning Research, 2012, 13: 307-361
    [69] Poole B, Ozair S, Van Den Oord A, Alemi A A, Tucker G. On variational bounds of mutual information. In: Proceedings of the 36th International Conference on Machine Learning. Long Beach, USA: PMLR, 2019. 5171−5180
    [70] Chen X L, Fan H Q, Girshick R, He K M. Improved baselines with momentum contrastive learning [Online], available: https://arxiv.org/abs/2003.04297, March 9, 2020
    [71] Yeh C H, Hong C Y, Hsu Y C, Liu T L, Chen Y B, LeCun Y. Decoupled contrastive learning. In: Proceedings of the 17th European Conference. Tel Aviv, Israel: ECCV, 2021.
    [72] Jing L, Vincent P, LeCun Y, et al. Understanding dimensional collapse in contrastive self-supervised learning. In: Proceedings of the 10th International Conference on Learning Representations. Virtual: ICLR, 2022.
    [73] Zhang Z L, Sabuncu M R. Generalized cross entropy loss for training deep neural networks with noisy labels. In: Proceedings of the 32nd International Conference on Neural Information Processing Systems. Red Hook, USA: Curran Associates Inc., 2018. 8792−8802
    [74] Weinberger K Q, Saul L K. Distance metric learning for large margin nearest neighbor classification. The Journal of Machine Learning Research, 2009, 10: 207-244
    [75] Sohn K. Improved deep metric learning with multi-class n-pair loss objective. In: Proceedings of the 30th International Conference on Neural Information Processing Systems. Barcelona: Spain, Curran Associates Inc., 2016. 1857−1865
    [76] Shah A, Sra S, Chellappa R, Cherian A. Max-margin contrastive learning. In: Proceedings of the AAAI Conference on Artificial Intelligence, 2022, 36(8): 8220−8230
    [77] Wang P, Han K, Wei X S, Zhang L, Wang L. Contrastive learning based hybrid networks for long-tailed image classification. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Nashville, USA: IEEE, 2021. 943−952
    [78] Li X M, Shi D Q, Diao X L, Xu H. SCL-MLNet: Boosting few-shot remote sensing scene classification via self-supervised contrastive learning. IEEE Transactions on Geoscience and Remote Sensing, 2021, 60: Article No. 5801112
    [79] Li J N, Xiong C M, Hoi S C H. CoMatch: Semi-supervised learning with contrastive graph regularization. In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV). Montreal, Canada: IEEE, 2021. 9455−9464
    [80] Park T, Efros A A, Zhang R, Zhu J Y. Contrastive learning for unpaired image-to-image translation. In: Proceedings of the 16th European Conference on Computer Vision (ECCV). Glasgow, UK: Springer, 2020. 319−345
    [81] Yang J Y, Duan J L, Tran S, Xu Y, Chanda S, Chen L Q, et al. Vision-language pre-training with triple contrastive learning. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). New Orleans, USA: IEEE, 2022. 15650−15659
    [82] Dong X, Zhan X L, Wu Y X, Wei Y C, Kampffmeyer M C, Wei X Y, et al. M5Product: Self-harmonized contrastive learning for e-commercial multi-modal pretraining. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). New Orleans, USA: IEEE, 2022. 21220−21230
    [83] Hou S K, Shi H Y, Cao X H, Zhang X H, Jiao L C. Hyperspectral imagery classification based on contrastive learning. IEEE Transactions on Geoscience and Remote Sensing, 2021, 60: Article No. 5521213
    [84] 郭东恩, 夏英, 罗小波, 丰江帆. 基于有监督对比学习的遥感图像场景分类. 光子学报, 2021, 50(7): 0710002

    Guo Dong-En, Xia Ying, Luo Xiao-Bo, Feng Jiang-Fan. Remote sensing image scene classification based on supervised contrastive learning. Acta Photonica Sinica, 2021, 50(7): 0710002
    [85] Aberdam A, Litman R, Tsiper S, Anschel O, Slossberg R, Mazor S, et al. Sequence-to-sequence contrastive learning for text recognition. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Nashville, USA: IEEE, 2021. 15297−15307
    [86] Zhang S, Xu R, Xiong C M, Ramaiah C. Use all the labels: A hierarchical multi-label contrastive learning framework. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. New Orleans, USA: IEEE, 2022. 16639−16648
    [87] 卢绍帅, 陈龙, 卢光跃, 管子玉, 谢飞. 面向小样本情感分类任务的弱监督对比学习框架. 计算机研究与发展, 2022, 59(9): 2003−2014

    Lu Shao-Shuai, Chen Long, Lu Guang-Yue, Guan Zi-Yu, Xie Fei. Weakly-supervised contrastive learning framework for few-shot sentiment classification tasks. Journal of Computer Research and Development, 2022, 59(9): 2003−2014
    [88] 李巍华, 何琛, 陈祝云, 黄如意, 晋刚. 基于对称式对比学习的齿轮箱无监督故障诊断方法. 仪器仪表学报, 2022, 43(3): 131-131 doi: 10.19650/j.cnki.cjsi.J2108555

    Li Wei-Hua, He Chen, Chen Zhu-Yun, Huang Ru-Yi, Jin Gang. Unsupervised fault diagnosis of gearbox based on symmetrical contrast learning. Chinese Journal of Scientific Instrument, 2022, 43(3): 131-131 doi: 10.19650/j.cnki.cjsi.J2108555
    [89] Wang X L, Zhang R F, Shen C H, Kong T, Li L. Dense contrastive learning for self-supervised visual pre-training. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Nashville, USA: IEEE, 2021. 3023−3032
    [90] 康健, 王智睿, 祝若鑫, 孙显. 基于监督对比学习正则化的高分辨率SAR图像建筑物提取方法. 雷达学报, 2022, 11(1): 157-167 doi: 10.12000/JR21124

    Kang Jian, Wang Zhi-Rui, Zhu Ruo-Xin, Sun Xian. Supervised contrastive learning regularized high-resolution synthetic aperture radar building footprint generation. Journal of Radars, 2022, 11(1): 157-167 doi: 10.12000/JR21124
    [91] Wang X H, Zhao K, Zhang R X, Ding S H, Wang Y, Shen W. ContrastMask: Contrastive Learning to Segment Every Thing. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). New Orleans, USA: IEEE, 2022. 11594−11603
    [92] He K M, Gkioxari G, Dollár P, Girshick R. Mask R-CNN. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV). Venice, Italy: IEEE, 2017. 2980−2988
    [93] Zhang L, She Q, Shen Z Y, Wang C H. Inter-intra variant dual representations for self-supervised video recognition. In: Proceedings of 32nd British Machine Vision Conference. UK: BMVA Press, 2021.
    [94] Bahri D, Jiang H, Tay Y, et al. SCARF: Self-supervised contrastive learning using random feature corruption. In: Proceedings of the 10th International Conference on Learning Representations. Virtual: ICLR, 2022.
    [95] Kang B, Li Y, Xie S, Yuan Z, Feng J. Exploring Balanced Feature Spaces for Representation Learning. In: Proceedings of the 9th International Conference on Learning Representations. Australia: ICLR, 2021.
    [96] Li T H, Cao P, Yuan Y, Fan L J, Yang Y Z, Feris R, et al. Targeted supervised contrastive learning for long-tailed recognition. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). New Orleans, USA: IEEE, 2022. 6908−6918
    [97] Zhu J G, Wang Z, Chen J J, Chen Y P P, Jiang Y G. Balanced contrastive learning for long-tailed visual recognition. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). New Orleans, USA: IEEE, 2022. 6898−6907
    [98] Afham M, Dissanayake I, Dissanayake D, Dharmasiri A, Thilakarathna K, Rodrigo R. CrossPoint: Self-supervised cross-modal contrastive learning for 3D point cloud understanding. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). New Orleans, USA: IEEE, 2022. 9892−9902
    [99] Laskin M, Srinivas A, Abbeel P. CURL: Contrastive unsupervised representations for reinforcement learning. In: Proceedings of the 37th International Conference on Machine Learning (ICML). Vitual: ACM, 2020. 5639−5650
    [100] Hénaff O, Srinivas A, De FauwJ, Razavi A, Doersch C, Ali Eslami S M, et al. Data-efficient image recognition with contrastive predictive coding. In: Proceedings of the 37th International Conference on Machine Learning (ICML). Vitual: ACM, 2020. 4182−4192
    [101] Zbontar J, Jing L, Misra I, et al. Barlow twins: Self-supervised learning via redundancy reduction. In: Proceedings of the International Conference on Machine Learning (ICML). Vitual: ACM, 2021: 12310−12320
    [102] Hua T Y, Wang W X, Xue Z H, Ren S C, Wang Y, Zhao H. On feature decorrelation in self-supervised learning. In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV). Montreal, Canada: IEEE, 2021. 9578−9588
    [103] Bardes A, Ponce J, Lecun Y. VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning. In: Proceedings of the 10th International Conference on Learning Representations. Virtual: ICLR, 2022.
    [104] Bao H, Nagano Y, Nozawa K. Sharp learning bounds for contrastive unsupervised representation learning [Online], available: https://arxiv.org/abs/2110.02501v1, October 6, 2021
    [105] Wang F, Liu H P. Understanding the behaviour of contrastive loss. In: Proceedings of the IEEE/CVF conference on Computer Vision and Pattern Recognition (CVPR). Nashville, USA: IEEE, 2021. 2495−2504
    [106] Ren P Z, Xiao Y, Chang X J, Huang P Y, Li Z H, Gupta B B, et al. A survey of deep active learning. ACM Computing Surveys, 2022, 54(9): Article No. 180
    [107] 孙琦钰, 赵超强, 唐漾, 钱锋. 基于无监督域自适应的计算机视觉任务研究进展. 中国科学: 技术科学, 2022, 52(1): 26-54 doi: 10.1360/SST-2021-0150

    Sun Qi-Yu, Zhao Chao-Qiang, Tang Yang, Qian Feng. A survey on unsupervised domain adaptation in computer vision tasks. Scientia Sinica Technologica, 2022, 52(1): 26-54 doi: 10.1360/SST-2021-0150
    [108] 范苍宁, 刘鹏, 肖婷, 赵巍, 唐降龙. 深度域适应综述: 一般情况与复杂情况. 自动化学报, 2021, 47(3): 515-548

    Fan Cang-Ning, Liu Peng, Xiao Ting, Zhao Wei, Tang Xiang-Long. A review of deep domain adaptation: General situation and complex situation. Acta Automatica Sinica, 2021, 47(3): 515-548
    [109] Han T D, Xie W D, Zisserman A. Memory-augmented dense predictive coding for video representation learning. In: Proceedings of the 16th European Conference on Computer Vision (ECCV). Glasgow, UK: Springer, 2020. 312−329
  • 加载中
图(16) / 表(8)
计量
  • 文章访问数:  3898
  • HTML全文浏览量:  3076
  • PDF下载量:  2331
  • 被引次数: 0
出版历程
  • 收稿日期:  2022-05-22
  • 录用日期:  2022-08-22
  • 网络出版日期:  2022-12-23
  • 刊出日期:  2023-01-07

目录

    /

    返回文章
    返回