Welcome to ShenZhenJia Knowledge Sharing Community for programmer and developer-Open, Learning and Share
menu search
person
Welcome To Ask or Share your Answers For Others

Categories

Official document TensorFlow SavedModel Warmup says:

The TensorFlow runtime has components that are lazily initialized, which can cause high latency for the first request/s sent to a model after it is loaded. This latency can be several orders of magnitude higher than that of a single inference request.

In my opinion, since a prediction process could warmups a model, components that are lazily initialized couldn't be the init_op of the graph, because init_op only depends on parameters saved in SavedModel, and TFS will call the restore_op to do the initializations.

If I'm right with this, then what is the components that are lazily initialized ?

question from:https://stackoverflow.com/questions/65932699/what-does-the-tensorflow-runtime-has-components-that-are-lazily-initialized-me

与恶龙缠斗过久,自身亦成为恶龙;凝视深渊过久,深渊将回以凝视…
thumb_up_alt 0 like thumb_down_alt 0 dislike
1.5k views
Welcome To Ask or Share your Answers For Others

1 Answer

Waitting for answers

与恶龙缠斗过久,自身亦成为恶龙;凝视深渊过久,深渊将回以凝视…
thumb_up_alt 0 like thumb_down_alt 0 dislike
Welcome to ShenZhenJia Knowledge Sharing Community for programmer and developer-Open, Learning and Share
...