🚀 The feature, motivation and pitch
Set the inference server port based on SAGEMAKER_BIND_TO_PORT environment variable, to support multi-container endpoints and inference pipelines.
If the container needs to listen on a second port, choose a port in the range specified by the SAGEMAKER_SAFE_PORT_RANGE environment variable.
Reference:
https://docs.aws.amazon.com/sagemaker/latest/dg/multi-container-troubleshooting.html#multi-container-missing-accept
Use case description
No response
Alternatives
No response
Additional context
No response