Neural Network Benchmarking

TensorFlow General Discussion
1

How can I calculate number of MACs and flops for a particular NN architecture ?

1 Like
2

We already have a thread at:

https://tensorflow-prod.ospodiscourse.com/t/calculate-flops-in-tensorflow-and-pytorch-are-not-equal/941

/cc @markdaoust @thea

1 Like
3

I specifically looking for MACs. There seems to be nothing about this.

1 Like
4

https://tensorflow-prod.ospodiscourse.com/t/calculate-flops-in-tensorflow-and-pytorch-are-not-equal/941/8?u=bhack

1 Like
5

Hi Bhack,

Yes, that’s the basic idea, but if you look at softmax activation function. It contains the calculations for e to the power x.
So, that will be counted as FLOPS not MACs.
My understanding is one cannot divide FLOPS/2 to get MACs.
Please correct me if I am wrong.

1 Like