TensorFlow serving on docker

Lars_UK · November 2, 2023, 1:51pm

Hi all,

I am working on a prototype and want to deploy a model on TF Serving on docker.
My model is built and saved. I have dowloaded the docker serving images but it seems to not run properly on Mac M1. So I built a new container.
It looks like my image is built, and starting.
I can see my model has been saved in it. However, when I try to access it on port 8501, nothing. I get a “Can’t open the page” message. there is nothing in Docker log…
Also, it seems to be running 100% of CPU… (left it running for about 20mns and cpu usage didn’t decrease…

Any idea what could be the issue or what I can check?

Thanks

Kiran_Sai_Ramineni · November 6, 2023, 9:38am

Hi @Lars_UK, At present Tensorflow serving on docker is not supported on M1. The team is already working to bring tensorflow serving docker support on Macs. Please refer to this github issue for further updates.Thank You.

Topic		Replies	Views
Tf serving docker not working General Discussion models , serving , help_request	7	3034	April 4, 2022
Automated TensorFlow model serving Show and Tell tfx , google-cloud , tf-serving , deployment	1	1508	September 28, 2022
Build Serving Image with Multiple Models General Discussion models , serving , tfx , help_request	5	2953	October 4, 2021
Docker container build fails on tensorflow-intel General Discussion docker , tf216	1	89	May 28, 2024
About get tensorflow serving image General Discussion serving , install , help_request	3	1196	November 24, 2021

TensorFlow serving on docker

Related topics