SageMaker Inference Toolkit Files

Serve machine learning models within a Docker container

This is an exact mirror of the SageMaker Inference Toolkit project, hosted at https://github.com/aws/sagemaker-inference-toolkit. SourceForge is not affiliated with SageMaker Inference Toolkit. For more information, see the SourceForge Open Source Mirror Directory.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
Parent folder
README.md	2023-04-04	84 Bytes	0
v1.9.2.tar.gz	2023-04-04	316.6 kB	0
v1.9.2.zip	2023-04-04	344.6 kB	0
Totals: 3 Items		661.3 kB	0

Bug Fixes and Other Changes

handle max_request_size param set by SM platofrm

Source: README.md, updated 2023-04-04

Other Useful Business Software

Level Up Your Cyber Defense with External Threat Management

See every risk before it hits. From exposed data to dark web chatter. All in one unified view.

Move beyond alerts. Gain full visibility, context, and control over your external attack surface to stay ahead of every threat.

Try for Free

Get the most trusted enterprise browser

Advanced built-in security helps IT prevent breaches before they happen

Defend against security incidents with Chrome Enterprise. Create customizable controls, manage extensions and set proactive alerts to keep your data and employees protected without slowing down productivity.

Download Chrome

Recommended Projects

SageMaker Scikit-Learn Extension
A library of additional estimators and SageMaker tools based on scikit-learn. This project contains standalone scikit-learn estimators and additional tools to support SageMaker Autopilot. Many of the additional estimators are based on existing scikit-learn estimators. SageMaker Scikit-Learn...
AWS Deep Learning Containers
AWS Deep Learning Containers (DLCs) are a set of Docker images for training and serving models in TensorFlow, TensorFlow 2, PyTorch, and MXNet. Deep Learning Containers provide optimized environments with TensorFlow and MXNet, Nvidia CUDA (for GPU instances), and Intel MKL (for CPU instances)...
Mosec
Mosec is a high-performance and flexible model-serving framework for building ML model-enabled backend and microservices. It bridges the gap between any machine learning models you just trained and the efficient online service API.
Feast
Feast (Feature Store) is an open source feature store for machine learning. Feast is the fastest path to manage existing infrastructure to productionize analytic data for model training and online inference. Make features consistently available for training and serving by managing an offline...
MMDeploy
MMDeploy is an open-source deep learning model deployment toolset. It is a part of the OpenMMLab project. Models can be exported and run in several backends, and more will be compatible. All kinds of modules in the SDK can be extended, such as Transform for image processing, Net for Neural...

SageMaker Inference Toolkit Files

Serve machine learning models within a Docker container

Get an email when there's a new version of SageMaker Inference Toolkit

Bug Fixes and Other Changes