Apparently feeding data using feedable iterator will not hurt speed that much according to an answer in TensorFlow GitHub posting
Reference
https://stackoverflow.com/questions/46111072/how-to-use-feedable-iterator-from-tensorflow-dataset-api-along-with-monitoredtra
https://github.com/tensorflow/tensorflow/issues/15448