张量流中检查点之间的间隔

问题描述

如何在 tensorflow 中指定 2 个连续检查点之间的间隔?tf.train.Saver 中没有选项来指定.每次，我使用不同数量的全局步骤运行模型时，我都会在检查点之间获得一个新的间隔

How can I specify the interval between 2 consecutive checkpoints in tensorflow? There are no options in tf.train.Saver to specify that. Every time, I run the model with a different number of global steps, I get a new interval between checkpoints

推荐答案

tf.train.Saver 是一个用于编写检查点的被动"实用程序，它仅在其他代码调用其 .save() 方法.因此，写入检查点的速度取决于您用于训练模型的框架:

The tf.train.Saver is a "passive" utility for writing checkpoints, and it only writes a checkpoint when some other code calls its .save() method. Therefore, the rate at which checkpoints are written depends on what framework you are using to train your model:

如果您使用低级 TensorFlow API (tf.Session) 并编写自己的训练循环，则只需插入对 Saver.save()<的调用/code> 在您自己的代码中.一种常见的方法是根据迭代次数来执行此操作:

If you are using the low-level TensorFlow API (tf.Session) and writing your own training loop, you can simply insert calls to Saver.save() in your own code. A common approach is to do this based on the iteration count:

for i in range(NUM_ITERATIONS):
  sess.run(train_op)
  # ...
  if i % 1000 == 0:
    saver.save(sess, ...)  # Write a checkpoint every 1000 steps.

with tf.train.MonitoredTrainingSession(..., save_checkpoint_secs=60):
  # ...