How to use tf.distribute.Strategy to distribute training?

[grandell1234]

Some people have received this error, which might have the fix you are looking for:

WARNING:tensorflow:Using MirroredStrategy eagerly has significant overhead
currently. We will be working on improving this in the future, but for now
please wrap `call_for_each_replica` or `experimental_run` or `run` inside a
tf.function to get the best performance.

Distribute Strategy with Keras Custom Loops

I posted this question on Stack Overflow last week, but it didn’t get any engagement, so I’m hoping that posting here will help me connect with someone who can answer my questions. I am working with distribute strategy scopes using custom training loops with Keras models. Consider this script which closely follows this tutorial: Custom training with tf.distribute.Strategy  |  TensorFlow Core import os import numpy as np import tensorflow as tf print(tf.__version__) fashion_mnist = tf.keras…