Dual Expert Distillation Network for Generalized Zero-Shot Learning

  • 2024-04-25 06:59:42
  • Zhijie Rao, Jingcai Guo, Xiaocheng Lu, Jingming Liang, Jie Zhang, Haozhao Wang, Kang Wei, Xiaofeng Cao
  • 0

Abstract

Zero-shot learning has consistently yielded remarkable progress via modelingnuanced one-to-one visual-attribute correlation. Existing studies resort torefining a uniform mapping function to align and correlate the sample regionsand subattributes, ignoring two crucial issues: 1) the inherent asymmetry ofattributes; and 2) the unutilized channel information. This paper addressesthese issues by introducing a simple yet effective approach, dubbed Dual ExpertDistillation Network (DEDN), where two experts are dedicated to coarse- andfine-grained visual-attribute modeling, respectively. Concretely, one coarseexpert, namely cExp, has a complete perceptual scope to coordinatevisual-attribute similarity metrics across dimensions, and moreover, anotherfine expert, namely fExp, consists of multiple specialized subnetworks, eachcorresponds to an exclusive set of attributes. Two experts cooperativelydistill from each other to reach a mutual agreement during training. Meanwhile,we further equip DEDN with a newly designed backbone network, i.e., DualAttention Network (DAN), which incorporates both region and channel attentioninformation to fully exploit and leverage visual semantic knowledge.Experiments on various benchmark datasets indicate a new state-of-the-art.

 

Quick Read (beta)

loading the full paper ...