E. Congruence Equation solution { i ∗ a i % p b , i < p − 1 , ( t − k ) ∗ a t % p b , i ≥ p − 1 , i ( p − 1 ) k t . \begin{cases} i*a^i\%pb,i<p-1, \\(t-k)*a^{t}\%pb,i≥p-1,i…
Paper: Correlation Congruence for Knowledge Distillation 1, Motivation:
通常情况下KD的teacher模型的特征空间没考虑类内类间的分布,student模型也将缺少我们期望的类内类间的分布特性。
Usually, the embedding space of teacher possesses the characteristic that …