This (unanswered) post accurately summarizes the question: python - Writing TFRecords in batches - Stack Overflow
I want to speed up a multi-thread script, so I wanted to look to append multiple tf.train.Example
in a single list and then write them to the serial TFRecord
. How can I accomplish that?
Writing thousands of TFRecords
with the conventional method seems a bad idea for my dataset, potentially slowing down data reading and creating a bottleneck.
Cheers,
N