How can i run TFLite model using GPU support on Jetson Nano?

TensorFlow General Discussion
, ,
1

Hi, I would like to run a .tflite model on my Jetson Nano using GPU support. I tried to follow these instructions Quickstart for Linux-based devices with Python  |  TensorFlow Lite but seems that there’s no matching distribution for tflite-runtime. I also tried to follow 为 ARM 开发板构建 TensorFlow Lite but when i do import tensorflow in the code seems there’s no module named tensorflow. How can i do to run these models?

Thanks.

3

You can run TF/TFLite with this docker container: strong textNVIDIA L4T TensorFlow | NVIDIA NGC

There is also this small package that includes the TFLITE Interpreter without having to install the entire TF library (pip3 install --extra-index-url Coral PEP-503 Repository tflite_runtime)