• 中文核心
  • EI
  • 中国科技核心
  • Scopus
  • CSCD
  • 英国科学文摘

留言板

尊敬的读者、作者、审稿人, 关于本刊的投稿、审稿、编辑和出版的任何问题, 您可以本页添加留言。我们将尽快给您答复。谢谢您的支持!

姓名
邮箱
手机号码
标题
留言内容
验证码

面向文本属性图基础模型的“检索−分治”测试时自适应方法

靳毅凡 李懿 宋飞 王瑞 李江梦 刘立祥 孙富春

靳毅凡, 李懿, 宋飞, 王瑞, 李江梦, 刘立祥, 孙富春. 面向文本属性图基础模型的“检索−分治”测试时自适应方法. 自动化学报, xxxx, xx(x): x−xx doi: 10.16383/j.aas.c250517
引用本文: 靳毅凡, 李懿, 宋飞, 王瑞, 李江梦, 刘立祥, 孙富春. 面向文本属性图基础模型的“检索−分治”测试时自适应方法. 自动化学报, xxxx, xx(x): x−xx doi: 10.16383/j.aas.c250517
Jin Yi-Fan, Li Yi, Song Fei, Wang Rui, Li Jiang-Meng, Liu Li-Xiang, Sun Fu-Chun. Divide-and-conquer test-time adaptation with retrieval-augmentation for text-attributed graph foundation model. Acta Automatica Sinica, xxxx, xx(x): x−xx doi: 10.16383/j.aas.c250517
Citation: Jin Yi-Fan, Li Yi, Song Fei, Wang Rui, Li Jiang-Meng, Liu Li-Xiang, Sun Fu-Chun. Divide-and-conquer test-time adaptation with retrieval-augmentation for text-attributed graph foundation model. Acta Automatica Sinica, xxxx, xx(x): x−xx doi: 10.16383/j.aas.c250517

面向文本属性图基础模型的“检索−分治”测试时自适应方法

doi: 10.16383/j.aas.c250517 cstr: 32138.14.j.aas.c250517
基金项目: 国家自然科学基金(62406313)资助
详细信息
    作者简介:

    靳毅凡:中国科学院软件研究所博士研究生. 2020年获得中南大学计算机学院学士学位. 主要研究方向为图表示学习. E-mail: yifan2020@iscas.ac.cn

    李懿:中国科学院软件研究所博士研究生. 2021年获得福州大学物理与信息工程学院学士学位. 主要研究方向为多模态表征学习. E-mail: liyi2022@iscas.ac.cn

    宋飞:中国科学院软件研究所博士研究生. 2021年获得河南大学软件学院学士学位. 主要研究方向为多模态提示学习. E-mail: songfei2022@iscas.ac.cn

    王瑞:中国科学院软件研究所高级工程师.2012年获得山东大学硕士学位. 主要研究方向为深度强化学习和多媒体技术. E-mail: wangrui@iscas.ac.cn

    李江梦:中国科学院软件研究所助理研究员. 2023年在中国科学院软件研究所获得博士学位. 主要研究方向为可信多模态信息融合. 本文通信作者. E-mail: jiangmeng2019@iscas.ac.cn

    刘立祥:中国科学院软件研究所研究员. 2002年获得上海交通大学博士学位. 主要研究方向为天基综合信息系统智能组网, 大规模网络一体化系统地面验证以及复杂信息系统体系结构. E-mail: lixiang@iscas.ac.cn

    孙富春:清华大学计算机科学与技术系教授. 1997年在清华大学获得博士学位. 主要研究方向为人工智能、智能控制与机器人、认知系统中的信息感知与处理. E-mail: fcsun@mail.tsinghua.edu.cn

Divide-and-conquer Test-time Adaptation with Retrieval-augmentation for Text-attributed Graph Foundation Model

Funds: Supported by National Natural Science Foundation of China (62406313)
More Information
    Author Bio:

    JIN Yi-Fan Ph.D. candidate at the Institute of Software, Chinese Academy of Sciences. She received her bachelor degree from School of Computer Science and Engineering, Central South University, in 2020. Her main research focuses on graph representation learning

    LI Yi Ph.D. candidate at the Institute of Software, Chinese Academy of Sciences. He received his bachelor degree from the College of Physics and Information Engineering, Fuzhou University in 2021. His main research direction is multimodal representation learning

    SONG Fei Ph.D. candidate at the Institute of Software, Chinese Academy of Sciences. She received her bachelor degree from the Software College of Henan University in 2021. Her main research focus is on multimodal prompt learning

    WANG Rui Senior engineer at the Institute of Software, Chinese Academy of Sciences. She received her master degree from Shandong University in 2012. Her research interest covers deep reinforcement learning and multimedia technology

    LI Jiang-Meng Assistant researcher at the Institute of Software, Chinese Academy of Sciences. He received his Ph.D. degree from the Institute of Software, Chinese Academy of Sciences in 2023. His primary research focuses on trustworthy multimodal information fusion. Corresponding author of this paper

    LIU Li-Xiang Professor at the In-stitute of Software, Chinese Academy of Sciences. Hereceived his Ph.D. degree from Shanghai Jiao TongUniversity in 2002. His research interest covers intelli-gent networking of space-based integrated informationsystems, ground verification of large-scale network in-tegrated system, and complex information system ar-chitecture

    SUN Fu-Chun Professor in the Department of Computer Science and Technology at Tsinghua University. He received his Ph.D. degree from Tsinghua University in 1997. His main research interests include artificial intelligence, intelligent control and robotics, information sensing and processing in artificial cognitive systems

  • 摘要: 文本属性图基础模型(TAG-FM)旨在通过在大规模图数据集上预训练, 实现稳健的跨域泛化能力. 尽管TAG-FM已在多项下游任务中展现出良好的性能, 但是通过深入分析发现, 其在泛化能力方面仍存在关键弱点: 域适应阈值效应, 即, 当预训练域与测试域之间的分布偏移超过某一临界阈值时, 模型性能将出现显著退化. 由于基础模型复杂度高且测试数据稀缺, 引入测试时自适应方法成为缓解该问题的可行方案. 然而现有测试时自适应方法在实例层和域层均存在局限, 严重制约着TAG-FM对分布外数据的适应性能. 针对此问题, 提出一种面向TAG-FM的“检索—分治”测试时自适应方法, 该方法通过检索增强的特征共形融合模块生成融合图结构和节点文本语义的统一特征, 并引入一种分而治之的测试时自适应策略, 通过渐进式自适应过程学习泛化性语义. 在7个基准文本属性图数据集和12个严重域偏移文本属性图数据集上的实验结果表明, 本文方法能够显著增强TAG-FM的跨域泛化能力.
    1)  11本文将TAG-FM的预训练数据视为预训练域, 将Cora、CiteSeer等测试数据集视为测试域, 一个测试数据集可视为一个测试域. 值得注意的是, TAG-FM的预训练数据仅用于探索实验, 所提方法的实际实现并未使用任何TAG-FM预训练数据.
    2)  22对任意节点$ v_n $, 均存在对应的统一特征$ z_n $, 故可反向利用$ z_n $检索节点$ v_n $.
  • 图  1  不同域偏移强度下TAG-FM性能及预训练域与测试域之间的KL散度

    Fig.  1  TAG-FM performance and the KL divergence between the pretraining and testing domains under varying degrees of domain shifts

    图  2  代表性实例对在不同编码策略下的语义相似度比较

    Fig.  2  Comparison of semantic similarity for representative instance pairs across different encoding strategies

    图  3  GraphCLIP在不同域偏移设置下的性能表现

    Fig.  3  Performance of GraphCLIP under different domain shift settings

    图  4  GraphCLIP+GTrans在不同域偏移下的性能表现

    Fig.  4  Performance of GraphCLIP+GTrans under different domain shift settings

    图  5  DORA的整体框架, 其中扰动$ \delta$随适应过程更新

    Fig.  5  The overall framework of DORA, where the perturbation $ \delta$ is progressively updated during the adaptation process.

    图  6  严重域偏移数据集上的节点分类任务准确率

    Fig.  6  Accuracy for the node classification task on severe domain shift datasets

    图  7  超参数$ k$对模型性能的影响

    Fig.  7  The impact of hyperparameter $ k$ on model performance

    图  8  超参数$ \lambda$对模型性能的影响

    Fig.  8  The impact of hyperparameter $ \lambda$ on model performance

    图  9  Cora和CiteSeer数据集上GraphCLIP与DORA所得特征的t-SNE可视化

    Fig.  9  t-SNE visualization of features produced by GraphCLIP and DORA on Cora and CiteSeer datasets

    图  10  SDS-Cora系列严重域偏移数据集上GraphCLIP与DORA所得特征的t-SNE可视化

    Fig.  10  t-SNE visualization of features produced by GraphCLIP and DORA on SDS-Cora series datasets with severe domain shifts

    图  11  SDS-CiteSeer系列严重域偏移数据集上GraphCLIP与DORA所得特征的t-SNE可视化

    Fig.  11  t-SNE visualization of features produced by GraphCLIP and DORA on SDS-CiteSeer series datasets with severe domain shifts

    图  12  测试时自适应过程中相邻迭代步之间梯度的余弦相似度

    Fig.  12  Cosine similarity of gradients between consecutive iterations during test-time adaptation.

    图  13  测试时自适应过程中高确定性错误样本数量

    Fig.  13  Number of misclassified samples with high certainty during test-time adaptation

    图  14  GraphCLIP与DORA在Cora数据集中两个典型节点上的分类结果对比分析

    Fig.  14  Comparative analysis of classification results of GraphCLIP and DORA on two representative nodes in the Cora dataset

    表  1  文本属性图数据集统计

    Table  1  Statistics of text-attributed graph datasets

    数据集节点数边数领域类别数
    Cora27085429学术7
    CiteSeer31864277学术6
    Ele-Photo48362500928电子商务12
    Ele-Computers87229721081电子商务10
    Books-History41551358574电子商务12
    WikiCS11701215863维基百科10
    Instagram11339144010社交媒体2
    下载: 导出CSV

    表  2  类别相关提示模板汇总

    Table  2  Summary of the class-relevant prompt templates

    数据集提示模板
    Corathis paper has a topic on {class} {class_desc}
    CiteSeergood paper of {class} {class_desc}
    Ele-Photothis product belongs to {class} {class_desc}
    Ele-Computersis {class} category {class_desc}
    Books-Historythis book belongs to {class} {class_desc}
    WikiCSit belongs to {class} research area {class_desc}
    Instagram{class} {class_desc}
    下载: 导出CSV

    表  3  构建查询$ q_n$的提示模板汇总

    Table  3  Summary of prompt templates used to construct the query $ q_n$

    数据集构建查询$q_n$的提示模板
    CoraThe textual description of the citation network centered on node ‘n{id}’ is shown above. Each node in the network represents a scholarly article, and each edge signifies a citation relationship between articles. The textual description of node ‘n{id}’ is: ‘{desc}’. Please summarize the core content of the article represented by node ‘n{id}’ using the information provided above in 200 words:
    CiteSeerThe textual description of the citation network centered on node ‘n{id}’ is shown above. Each node in the network represents a scholarly article, and each edge signifies a citation relationship between articles. The textual description of node ‘n{id}’ is: ‘{desc}’. Please summarize the core content of the article represented by node ‘n{id}’ using the information provided above in 200 words:
    Ele-PhotoThe textual description of the Amazon Electronics graph centered on node ‘n{id}’ is shown above. Each node in the graph represents a electronic product, and each edge signifies frequent co-purchases or co-views. The user review with the most votes of node ‘n{id}’ is: ‘{desc}’. Please summarize the information provided above and re-describe the electronic product represented by node ‘n{id}’ based on the results of the summary in 200 words:
    Ele-ComputersThe textual description of the Amazon Electronics graph centered on node ‘n{id}’ is shown above. Each node in the graph represents a electronic product, and each edge signifies frequent co-purchases or co-views. The user review with the most votes of node ‘n{id}’ is: ‘{desc}’. Please summarize the information provided above and re-describe the electronic product represented by node ‘n{id}’ based on the results of the summary in 200 words:
    Books-
    History
    The textual description of the Amazon-Books graph centered on node ‘n{id}’ is shown above. Each node in the graph represents a book focusing on items labeled as 'History', and each edge signifies frequent co-purchases or co-views between two books. The title and description of the book of node ‘n{id}’ is: ‘{desc}’. Please summarize the information provided above and re-describe the history book represented by node ‘n{id}’ based on the results of the summary in 200 words:
    WikiCSThe textual description of the Wikipedia-based graph centered on node ‘n{id}’ is shown above. The textual description of node ‘n{id}’ is ‘{desc}’. Please summarize the information provided above and re-describe node ‘n{id}’ based on the results of the summary in 200 words:
    InstagramThe textual description of the social network centered on node ‘n{id}’ is shown above. Each node in the graph signifys user, and each edge signifies following relationships. The textual description of node ‘n{id}’ is: ‘{desc}’. Please summarize the information provided above and re-describe the user represented by node ‘n{id}’ based on the results of the summary in 200 words:
    下载: 导出CSV

    表  4  轻度域偏移数据集上的节点分类任务准确率(%)

    Table  4  Accuracy for the node classification task on mild domain shift datasets(%)

    方法CoraCiteSeerWikiCSInstagramEle-PhotoEle-ComputersBooks-History平均值
    BERT[58]19.56 $\pm$ 0.9833.26 $\pm$ 2.3529.37 $\pm$ 0.0057.02 $\pm$ 0.5721.80 $\pm$ 0.1413.88 $\pm$ 0.299.95 $\pm$ 0.4226.41
    SBERT[59]54.35 $\pm$ 1.2650.47 $\pm$ 0.9048.16 $\pm$ 0.0048.34 $\pm$ 1.2335.96 $\pm$ 0.4441.82 $\pm$ 0.2230.45 $\pm$ 0.1944.22
    DeBERTa[60]16.42 $\pm$ 1.2616.42 $\pm$ 1.2615.29 $\pm$ 0.0039.81 $\pm$ 0.5812.38 $\pm$ 0.2610.62 $\pm$ 0.159.70 $\pm$ 0.2617.23
    E5[61]44.65 $\pm$ 0.8242.57 $\pm$ 0.5431.49 $\pm$ 0.0061.28 $\pm$ 0.9735.14 $\pm$ 0.2816.54 $\pm$ 0.1412.92 $\pm$ 0.4834.94
    Qwen2-7B-Instruct[62]61.44 $\pm$ 1.2953.57 $\pm$ 0.8658.72 $\pm$ 0.2539.13 $\pm$ 0.7845.55 $\pm$ 0.1259.18 $\pm$ 0.2023.79 $\pm$ 0.3448.77
    Qwen2-72B-Instruct[62]62.18 $\pm$ 0.9860.97 $\pm$ 0.8760.91 $\pm$ 0.0847.70 $\pm$ 0.3152.41 $\pm$ 0.3960.88 $\pm$ 0.3053.56 $\pm$ 0.6456.94
    LLaMA3.1-8B-Instruct[11]57.75 $\pm$ 1.2153.54 $\pm$ 1.7158.32 $\pm$ 0.2139.37 $\pm$ 1.1434.38 $\pm$ 0.2546.98 $\pm$ 0.2122.28 $\pm$ 0.1844.66
    LLaMA3.1-70B-Instruct[11]65.72 $\pm$ 1.2462.79 $\pm$ 1.2462.82 $\pm$ 0.0443.68 $\pm$ 0.5251.26 $\pm$ 0.5361.62 $\pm$ 0.4253.33 $\pm$ 0.5557.32
    OFA[12]37.25 $\pm$ 1.3829.64 $\pm$ 0.1945.52 $\pm$ 1.0632.71 $\pm$ 0.1633.03 $\pm$ 0.6422.09 $\pm$ 0.3916.87 $\pm$ 0.9331.02
    ZeroG[13]62.32 $\pm$ 1.9152.55 $\pm$ 1.2354.93 $\pm$ 0.0648.97 $\pm$ 0.7845.12 $\pm$ 0.6556.20 $\pm$ 0.3540.74 $\pm$ 0.6551.55
    GraphGPT[14]23.25 $\pm$ 1.4518.04 $\pm$ 1.456.30 $\pm$ 0.2645.12 $\pm$ 1.167.62 $\pm$ 0.2229.71 $\pm$ 0.8315.92 $\pm$ 0.1420.85
    LLaGA[15]21.44 $\pm$ 0.6516.07 $\pm$ 1.152.65 $\pm$ 0.7241.12 $\pm$ 0.946.50 $\pm$ 0.5323.10 $\pm$ 0.3311.17 $\pm$ 0.5817.44
    DGI[63]24.03 $\pm$ 1.4018.71 $\pm$ 1.2218.86 $\pm$ 0.2561.42 $\pm$ 1.1213.96 $\pm$ 0.1727.12 $\pm$ 0.0315.77 $\pm$ 0.0225.70
    GRACE[64]13.69 $\pm$ 1.2722.88 $\pm$ 1.4916.07 $\pm$ 0.3262.23 $\pm$ 0.9310.16 $\pm$ 0.1310.94 $\pm$ 0.1232.39 $\pm$ 0.1124.05
    BGRL[65]31.99 $\pm$ 1.0626.50 $\pm$ 1.2218.35 $\pm$ 0.2261.45 $\pm$ 0.825.21 $\pm$ 0.2224.12 $\pm$ 0.2216.28 $\pm$ 0.3526.27
    GraphMAE[66]23.25 $\pm$ 1.0720.75 $\pm$ 0.8812.14 $\pm$ 0.2062.39 $\pm$ 0.8412.53 $\pm$ 0.088.36 $\pm$ 0.0621.76 $\pm$ 0.1723.03
    G2P2[67]41.51 $\pm$ 0.7851.02 $\pm$ 0.6231.92 $\pm$ 0.1552.87 $\pm$ 0.7822.21 $\pm$ 0.1232.52 $\pm$ 0.1326.18 $\pm$ 0.2536.89
    GraphCLIP[19]67.31 $\pm$ 1.7663.13 $\pm$ 1.1370.19 $\pm$ 0.1064.05 $\pm$ 0.3453.40 $\pm$ 0.6462.04 $\pm$ 0.2153.88 $\pm$ 0.3562.00
    DORA70.29 $\pm$ 0.5467.82 $\pm$ 0.5272.42 $\pm$ 0.6764.83 $\pm$ 0.2554.93 $\pm$ 0.4263.25 $\pm$ 0.5054.69 $\pm$ 0.4364.03
    下载: 导出CSV

    表  5  不同测试时自适应方法在轻度域偏移数据集上的节点分类任务准确率(%)

    Table  5  Accuracy for the node classification task on mild domain shift datasets with different TTA methods(%)

    方法CoraCiteSeerWikiCSInstagramEle-PhotoEle-ComputersBooks-History平均值
    Tent[21]64.27 $\pm$ 1.3563.06 $\pm$ 2.4957.27 $\pm$ 0.8350.56 $\pm$ 0.3944.90 $\pm$ 0.1449.35 $\pm$ 0.2024.99 $\pm$ 0.4850.63
    GTrans[24]69.37 $\pm$ 0.6066.98 $\pm$ 1.1271.89 $\pm$ 0.7764.02 $\pm$ 0.1954.83 $\pm$ 0.2961.16 $\pm$ 0.3750.92 $\pm$ 0.2862.74
    Matcha[22]69.49 $\pm$ 1.1366.78 $\pm$ 1.3972.82 $\pm$ 0.8964.02 $\pm$ 0.5051.34 $\pm$ 0.7456.06 $\pm$ 0.3045.34 $\pm$ 1.3560.84
    DORA70.29 $\pm$ 0.5467.82 $\pm$ 0.5272.42 $\pm$ 0.6764.83 $\pm$ 0.2554.93 $\pm$ 0.4263.25 $\pm$ 0.5054.69 $\pm$ 0.4364.03
    下载: 导出CSV

    表  6  消融实验结果(%)

    Table  6  The results of the ablation experiment (%)

    RFCI D&C-TTA Cora WikiCS Instagram
    RAS DFCI
    $\times$ $\times$ $\times$ 67.31 $\pm$ 1.76 70.19 $\pm$ 0.10 64.05 $\pm$ 0.34
    $\times$ $ \checkmark$ $ \checkmark$ 69.13 $\pm$ 1.23 71.39 $\pm$ 0.74 64.21 $\pm$ 0.33
    $ \checkmark$ $\times$ $ \checkmark$ 70.23 $\pm$ 0.57 72.16 $\pm$ 0.68 64.60 $\pm$ 0.31
    $ \checkmark$ $ \checkmark$ $\times$ 70.05 $\pm$ 0.46 71.41 $\pm$ 1.35 64.80 $\pm$ 0.28
    $ \checkmark$ $ \checkmark$ $ \checkmark$ 70.29 $\pm$ 0.54 72.42 $\pm$ 0.67 64.83 $\pm$ 0.25
    下载: 导出CSV
  • [1] Rozemberczki B, Allen C, Sarkar R. Multi-scale attributed node embedding. Journal Of Complex Networks, 2021, 9(2): cnab014 doi: 10.1093/comnet/cnab014
    [2] Hu W, Fey M, Zitnik M, Dong Y, Ren H, Liu B, et al. Open graph benchmark: Datasets for machine learning on graphs. Advances In Neural Information Processing Systems, 2020, 33: 22118−22133
    [3] Pareja A, Domeniconi G, Chen J, Ma T, Suzumura T, Kanezashi H, et al. Evolvegcn: Evolving graph convolutional networks for dynamic graphs. Proceedings Of The AAAI Conference On Artificial Intelligence, 2020, 34: 5363−5370 doi: 10.1609/aaai.v34i04.5984
    [4] 王振东, 徐振宇, 李大海, 王俊岭. 面向入侵检测的元图神经网络构建与分析. 自动化学报, 2023, 49(7): 1530−1548

    Wang Zhen-Dong, Xu Zhen-Yu, Li Da-Hai, Wang Jun-Ling. Construction and Analysis of Meta Graph Neural Network for Intrusion Detection. Acta Automatica Sinica, 2023, 49(7): 1530−1548
    [5] 陈露, 尚家兴, 刘大江, 张玉芳, 倪晚成. 基于异构图神经网络的可解释兵棋态势预测方法. 自动化学报, 2025, 51(6): 1248−1260 doi: 10.16383/j.aas.c240468

    Chen Lu, Shang Jia-Xing, Liu Da-Jiang, Zhang Yu-Fang, Ni Wan-Cheng. An interpretable wargame situation prediction method based on heterogeneous graph neural networks. Acta Automatica Sinica, 2025, 51(6): 1248−1260 doi: 10.16383/j.aas.c240468
    [6] Li Y, Hooi B. Prompt-Based Zero- and Few-Shot Node Classification: A Multimodal Approach. arXiv preprint arXiv: 2307.11572, 2023.
    [7] Tang Y, Qiu R, Liu Y, Li X, Huang, Z. CaseGNN: Graph neural networks for legal case retrieval with text-attributed graphs. European Conference On Information Retrieval. Cham: Springer Nature Switzerland, 2024: 80-95.
    [8] He X, Tian Y, Sun Y, Chawla N, Laurent T, LeCun Y, et al. G-retriever: Retrieval-augmented generation for textual graph understanding and question answering. Advances In Neural Information Processing Systems, 2024, 37: 132876−132907 doi: 10.52202/079017-4224
    [9] 徐正斐, 辛欣. 基于大语言模型的中文实体链接实证研究. 自动化学报, 2025, 51(2): 327−342 doi: 10.16383/j.aas.c240069

    Xu Zheng-Fei, Xin Xin. An empirical study of Chinese entity linking based on large language model. Acta Automatica Sinica, 2025, 51(2): 327−342 doi: 10.16383/j.aas.c240069
    [10] 秦龙, 武万森, 刘丹, 胡越, 尹全军, 阳东升, 王飞跃. 基于大语言模型的复杂任务自主规划处理框架. 自动化学报, 2024, 50(4): 862−872 doi: 10.16383/j.aas.c240088

    Qin Long, Wu Wan-Sen, Liu Dan, Hu Yue, Yin Quan-Jun, Yang Dong-Sheng, Wang Fei-Yue. Autonomous planning and processing framework for complex tasks based on large language models. Acta Automatica Sinica, 2024, 50(4): 862−872 doi: 10.16383/j.aas.c240088
    [11] Vavekanand R, Sam K. Llama 3.1: An in-depth analysis of the next-generation large language model. Preprint, July, 2024.
    [12] Liu H, Feng J, Kong L, Liang N, Tao D, Chen Y, et al. One for all: Towards training one graph model for all classification tasks. arXiv preprint arXiv: 2310.00149, 2023.
    [13] Li Y, Wang P, Li Z, Yu J, Li J. Zerog: Investigating cross-dataset zero-shot transferability in graphs. Proceedings Of The 30th ACM SIGKDD Conference On Knowledge Discovery And Data Mining, 20241725−1735
    [14] Tang J, Yang Y, Wei W, Shi L, Su L, Cheng S, et al. Graphgpt: Graph instruction tuning for large language models. Proceedings Of The 47th International ACM SIGIR Conference On Research And Development In Information Retrieval, 2024491−500
    [15] Chen R, Zhao T, Jaiswal A, Shah N, Wang Z. Llaga: Large language and graph assistant. arXiv preprint arXiv: 2402.08170, 2024.
    [16] Rosenfeld J. Scaling Laws for Deep Learning. arXiv preprint arXiv: 2108.07686, 2021.
    [17] Hernandez D, Kaplan J, Henighan T, McCandlish S. Scaling Laws for Transfer. arXiv preprint arXiv: 2102.01293, 2021.
    [18] Radford A, Kim J, Hallacy C, Ramesh A, Goh G, Agarwal S, et al. Learning Transferable Visual Models From Natural Language Supervision. Proceedings Of The 38th International Conference On Machine Learning, ICML 2021, 18-24 July 2021, Virtual Event, 2021, 139: 8748−8763
    [19] Zhu Y, Shi H, Wang X, Liu Y, Wang Y, Peng B, et al. GraphCLIP: Enhancing Transferability in Graph Foundation Models for Text-Attributed Graphs. Proceedings Of The ACM On Web Conference 2025, 20252183−2197
    [20] Han Z, Gui X, Sun H, Yin Y, Li S. Towards accurate and robust domain adaptation under multiple noisy environments. IEEE Transactions On Pattern Analysis And Machine Intelligence, 2022, 45(5): 6460−6479
    [21] Wang D, Shelhamer E, Liu S, Olshausen B, Darrell T. Tent: Fully test-time adaptation by entropy minimization. arXiv preprint arXiv: 2006.10726, 2020.
    [22] Bao W, Zeng Z, Liu Z, Tong H, He J. Matcha: Mitigating Graph Structure Shifts with Test-Time Adaptation. arXiv preprint arXiv: 2410.06976, 2024.
    [23] Ju M, Zhao T, Yu W, Shah N, Ye Y. Graphpatcher: Mitigating degree bias for graph neural networks via test-time augmentation. Advances In Neural Information Processing Systems, 2023, 36: 55785−55801 doi: 10.52202/075280-2434
    [24] Jin W, Zhao T, Ding J, Liu Y, Tang J, Shah N. Empowering graph representation learning with test-time graph transformation. arXiv preprint arXiv: 2210.03561, 2022.
    [25] Chatterjee S, Diaconis P. The sample size required in importance sampling. The Annals Of Applied Probability, 2018, 28: 1099−1135
    [26] McAllester D, Stratos K. Formal limitations on the measurement of mutual information. International Conference On Artificial Intelligence And Statistics, 2020875−884
    [27] Su G, Wang H, Wang J, et al. Large Language Models Meet Text-Attributed Graphs: A Survey of Integration Frameworks and Applications. arXiv preprint arXiv: 2510.21131, 2025.
    [28] Beiranvand A, Vahidipour S M. Integrating Structural and Semantic Signals in Text-Attributed Graphs with BiGTex. arXiv preprint arXiv: 2504.12474, 2025.
    [29] Khoshraftar S, Abedini N, Hajian A. GraphiT: Efficient Node Classification on Text-Attributed Graphs with Prompt Optimized LLMs. Companion Proceedings of the ACM on Web Conference 2025, 20251824−1829
    [30] Zhang Q, Bian Y, Kong X, et al. COME: Test-time Adaption by Conservatively Minimizing Entropy. The Thirteenth International Conference on Learning Representations. 2025.
    [31] Lee J, Jung D, Lee S, Park J, Shin J, Hwang U, et al. Entropy is not Enough for Test-Time Adaptation: From the Perspective of Disentangled Factors. arXiv preprint arXiv: 2403.07366, 2024.
    [32] Hu Y, Qiao C, Geng X, et al. Selective Label Enhancement Learning for Test-Time Adaptation. The Thirteenth International Conference on Learning Representations. 2025.
    [33] Chen G, Zhang J, Xiao X, Li Y. Graphtta: Test time adaptation on graph neural networks. arXiv preprint arXiv: 2208.09126, 2022.
    [34] Wang Y, Li C, Jin W, Li R, Zhao J, Tang J, et al. Test-time training for graph neural networks. arXiv preprint arXiv: 2210.08813, 2022.
    [35] Mao H, Du L, Zheng Y, Fu Q, Li Z, Chen X, et al. Source free graph unsupervised domain adaptation. Proceedings Of The 17th ACM International Conference On Web Search And Data Mining, 2024520−528
    [36] Zheng X, Huang W, Zhou C, et al. Test-Time Graph Neural Dataset Search With Generative Projection. Forty-second International Conference on Machine Learning. 2025.
    [37] Zhao Y, Zhang Q, Luo X, et al. Test-time Adaptation on Graphs via Adaptive Subgraph-based Selection and Regularized Prototypes. Forty-second International Conference on Machine Learning. 2025.
    [38] Gadermayr M, Eschweiler D, Klinkhammer B M, et al. Gradual domain adaptation for segmenting whole slide images showing pathological variability. International conference on image and signal processing, 2018461−469
    [39] Kumar A, Ma T, Liang P. Understanding self-training for gradual domain adaptation. International conference on machine learning, 20205468−5479
    [40] Chen H Y, Chao W L. Gradual domain adaptation without indexed intermediate domains. Advances in neural information processing systems, 2021, 34: 8201−8214
    [41] Lei P I, Chen X, Sheng Y, et al. Gradual domain adaptation for graph learning. arXiv preprint arXiv: 2501.17443, 2025.
    [42] Zeng Z, Qiu R, Bao W, et al. Pave your own path: Graph gradual domain adaptation on fused gromov-wasserstein geodesics[J]. arXiv preprint arXiv: 2505.12709, 2025.
    [43] Rampášek L, Galkin M, Dwivedi V, Luu A, Wolf G, Beaini D. Recipe for a general, powerful, scalable graph transformer. Advances In Neural Information Processing Systems, 2022, 35: 14501−14515 doi: 10.52202/068431-1054
    [44] 胡正平, 孟鹏权. 全局孤立性和局部同质性图表示的随机游走显著目标检测算法. 自动化学报, 2011, 37(10): 1279−1284 doi: 10.3724/SP.J.1004.2011.01279

    HU Zheng-Ping, MENG Peng-Quan. Graph Presentation Random Walk Salient Object Detection Algorithm Based on Global Isolation and Local Homogeneity. ACTA AUTOMATICA SINICA, 2011, 37(10): 1279−1284 doi: 10.3724/SP.J.1004.2011.01279
    [45] Bienstock D, Goemans M, Simchi-Levi D, Williamson D. A note on the prize collecting traveling salesman problem. Mathematical Programming, 1993, 59(1): 413−420
    [46] Han Z, Zhang C, Fu H, Zhou J. Trusted multi-view classification with dynamic evidential fusion. IEEE Transactions On Pattern Analysis And Machine Intelligence, 2022, 45: 2551−2566
    [47] Liu W, Wang X, Owens J, Li Y. Energy-based out-of-distribution detection. Advances In Neural Information Processing Systems, 2020, 33: 21464−21475 doi: 10.1109/ijcnn55064.2022.9892318
    [48] Vinutha H, Poornima B, Sagar B. Detection of outliers using interquartile range technique from intrusion dataset. Information and decision sciences: Proceedings of the 6th international conference on ficta. Singapore: Springer Singapore, 2018511−518
    [49] Niu S, Wu J, Zhang Y, Chen Y, Zheng S, Zhao P, et al. Efficient test-time model adaptation without forgetting. International Conference On Machine Learning, 202216888−16905
    [50] Sen P, Namata G, Bilgic M, Getoor L, Galligher B, Eliassi-Rad T. Collective classification in network data. AI Magazine, 2008, 29(3): 93−93 doi: 10.1609/aimag.v29i3.2157
    [51] Giles C, Bollacker K, Lawrence S. CiteSeer: An automatic citation indexing system. Proceedings Of The Third ACM Conference On Digital Libraries, 199889−98
    [52] Yan H, Li C, Long R, Yan C, Zhao J, Zhuang W, et al. A Comprehensive Study on Text-attributed Graphs: Benchmarking and Rethinking. Advances in Neural Information Processing Systems, 2023, 36: 17238−17264 doi: 10.52202/075280-0755
    [53] Ni J, Li J, McAuley J. Justifying Recommendations using Distantly-Labeled Reviews and Fine-Grained Aspects. Proceedings Of The 2019 Conference On Empirical Methods In Natural Language Processing And The 9th International Joint Conference On Natural Language Processing, EMNLP-IJCNLP 2019, Hong Kong, China, November 3-7, 2019. 2019: 188-197.
    [54] Mernyei P, Cangea C. Wiki-cs: A wikipedia-based benchmark for graph neural networks. arXiv preprint arXiv: 2007.02901, 2020.
    [55] Huang X, Han K, Yang Y, Bao D, Tao Q, Chai Z, et al. Can GNN be Good Adapter for LLMs?. Proceedings of the ACM Web Conference 2024, 2024893−904
    [56] Reimers N, Gurevych I. Making monolingual sentence embeddings multilingual using knowledge distillation. arXiv preprint arXiv: 2004.09813, 2020.
    [57] Vinutha H, Poornima B, Sagar B. Detection of outliers using interquartile range technique from intrusion dataset. Information And Decision Sciences: Proceedings Of The 6th International Conference On Ficta, 2018511−518
    [58] Devlin J, Chang M, Lee K, Toutanova K. Bert: Pre-training of deep bidirectional transformers for language understanding. Proceedings Of The 2019 Conference Of The North American Chapter Of The Association For Computational Linguistics: Human Language Technologies, Volume 1 (long And Short Papers), 20194171−4186
    [59] Reimers N, Gurevych I. Sentence-bert: Sentence embeddings using siamese bert-networks. arXiv preprint arXiv: 1908.10084, 2019.
    [60] He P, Liu X, Gao J, Chen W. Deberta: Decoding-enhanced bert with disentangled attention. arXiv preprint arXiv: 2006.03654, 2020.
    [61] Wang L, Yang N, Huang X, Jiao B, Yang L, Jiang D, et al. Text embeddings by weakly-supervised contrastive pre-training. arXiv preprint arXiv: 2212.03533, 2022.
    [62] Yang A, Yang B, Zhang B, Hui B, Zheng B, Yu B, et al. Qwen2. 5 technical report. arXiv preprint arXiv: 2412.15115, 2024.
    [63] Velickovic P, Fedus W, Hamilton W, Liò P, Bengio Y, Hjelm R. Deep graph infomax. arXiv preprint arXiv: 1809.10341, 2018.
    [64] Zhu Y, Xu Y, Yu F, Liu Q, Wu S, Wang L. Deep graph contrastive representation learning. arXiv preprint arXiv: 2006.04131, 2020.
    [65] Thakoor S, Tallec C, Azar M, Munos R, Veličković P, Valko M. Bootstrapped representation learning on graphs. ICLR 2021 Workshop On Geometrical And Topological Representation Learning. 2021.
    [66] Hou Z, Liu X, Cen Y, Dong Y, Yang H, Wang C, et al. Graphmae: Self-supervised masked graph autoencoders. Proceedings Of The 28th ACM SIGKDD Conference On Knowledge Discovery And Data Mining, 2022594−604
    [67] Wen Z, Fang Y. Augmenting low-resource text classification with graph-grounded pre-training and prompting. Proceedings Of The 46th International ACM SIGIR Conference On Research And Development In Information Retrieval, 2023506−516
    [68] Maaten L, Hinton G. Visualizing data using t-SNE. Journal Of Machine Learning Research, 2008, 9(Nov): 2579−2605
  • 加载中
计量
  • 文章访问数:  6
  • HTML全文浏览量:  2
  • 被引次数: 0
出版历程
  • 收稿日期:  2025-09-30
  • 录用日期:  2026-03-04
  • 网络出版日期:  2026-06-18

目录

    /

    返回文章
    返回