论文标题

跨导向线性探测:用于几个射线节点分类的新型框架

Transductive Linear Probing: A Novel Framework for Few-Shot Node Classification

论文作者

Tan, Zhen, Wang, Song, Ding, Kaize, Li, Jundong, Liu, Huan

论文摘要

几乎没有弹性节点分类的任务是为只有几个代表性标记的节点的新类别提供的节点提供准确的预测。这个问题引起了人们对现实世界应用程序的预测的极大关注,例如在电子商务平台上新添加的商品类别的产品分类,具有稀缺的记录或患者相似性图上罕见疾病的诊断。为了解决非欧国人图形领域中这种挑战性的标签稀缺问题,元学习已成为成功且主要的范式。最近,受到图表自我监督学习的发展的启发,将预审预学的节点嵌入以进行几个射线分类可能是元学习的有前途的替代方法,但仍会暴露。在这项工作中,我们从经验上证明了替代框架\ textIt {thresductive Linarear探测}的潜力,这些框架转移了预验证的节点嵌入,这是从图形对比度学习方法中学到的。我们进一步将几丝节点分类的设置从完全监督的标准分类扩展到更现实的自我监管设置,在这种情况下,由于培训课程的监督短缺,因此无法轻松部署元学习方法。令人惊讶的是,即使没有任何地面真相标签,在同一协议下,具有自我监管的图形截面的跨传感线性探测也可以超越最先进的基于元学习的方法。我们希望这项工作能为几个弹跳分类问题提供新的启示,并促进未来关于从图表上几乎没有标记实例学习的研究。

Few-shot node classification is tasked to provide accurate predictions for nodes from novel classes with only few representative labeled nodes. This problem has drawn tremendous attention for its projection to prevailing real-world applications, such as product categorization for newly added commodity categories on an E-commerce platform with scarce records or diagnoses for rare diseases on a patient similarity graph. To tackle such challenging label scarcity issues in the non-Euclidean graph domain, meta-learning has become a successful and predominant paradigm. More recently, inspired by the development of graph self-supervised learning, transferring pretrained node embeddings for few-shot node classification could be a promising alternative to meta-learning but remains unexposed. In this work, we empirically demonstrate the potential of an alternative framework, \textit{Transductive Linear Probing}, that transfers pretrained node embeddings, which are learned from graph contrastive learning methods. We further extend the setting of few-shot node classification from standard fully supervised to a more realistic self-supervised setting, where meta-learning methods cannot be easily deployed due to the shortage of supervision from training classes. Surprisingly, even without any ground-truth labels, transductive linear probing with self-supervised graph contrastive pretraining can outperform the state-of-the-art fully supervised meta-learning based methods under the same protocol. We hope this work can shed new light on few-shot node classification problems and foster future research on learning from scarcely labeled instances on graphs.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源