Faster Text Generation with TensorFlow and XLA

Bhack July 28, 2022, 2:24pm 1

Text Generation on transformers using TensorFlow can now be compiled with XLA. It is up to 100x faster than before, and even faster than PyTorch

1 Like

Topic		Replies	Views
How Hugging Face improved Text Generation performance with XLA Show and Tell transformers , xla , keras	1	971	June 8, 2023
Tensorflow-Transformers 2.0 ( for NLP, CV, Audio ) Show and Tell release , nlp	0	1298	April 8, 2022
Any benchmark to compare tensorflow code with XLA and without XLA to compare the performance difference between them? General Discussion xla	1	343	June 7, 2023
TF2XLA Conversion Failed General Discussion nlp , xla	0	540	November 27, 2023
Implementing Fastformer: Additive Attention Can Be All You Need Show and Tell education , keras	2	1370	September 6, 2021