I known that we usually run KD with float models. But now my teacher is float model and my student is QAT model (from tfmot). Can I run KD with these teacher and student as usually?
Related topics
Topic | Replies | Views | Activity | |
---|---|---|---|---|
QAT to TFLite failed with ValueError | 2 | 294 | February 9, 2024 | |
How to quantize a custom model(not of tf.keras.Model type)? | 1 | 909 | March 6, 2023 | |
Why PQT is better than QAT? | 2 | 277 | March 23, 2024 | |
QAT Accuracy is always the same after evaluation | 1 | 210 | February 28, 2024 | |
Quantisation Aware Training | 2 | 647 | July 21, 2021 |