Performance measurement TensorFlow

TensorFlow General Discussion
,
1

Hi,

i have some trained Models on TF2 and i want to measure the performance while executing the inference. I have seen that there is something like that for TensorFlow Lite, where you can measure

Initialization time
Inference time of warmup state
Inference time of steady state
Memory usage during initialization time
Overall memory usage

Is there something for normal TensorFlow?
I use the Python API on Jetson Platform (Linux aarch64)

Thank you very much

3

Have you seen TensorFlow Profiler: Profile model performance  |  TensorBoard?

1 Like
4

Check also benchmarks/perfzero at master · tensorflow/benchmarks · GitHub

1 Like