no code implementations • 4 Oct 2023 • Sayantan Chowdhury, Ben Liang, Ali Tizghadam, Ilijc Albanese
The teacher in KD is a black-box model, imparting knowledge to the student only through its predictions.
no code implementations • 30 Apr 2021 • Sayantan Chowdhury, Ben Liang, Ali Tizghadam, Ilijc Albanese
At a network router, the packets need to be processed with minimum delay, so the classifier cannot wait until the end of the flow to make a decision.