Category: AWS Inferentia

As AI governance becomes a pressing necessity, Domino Data Lab, in partnership with AWS, is bridging the gap between abstract policies and actionable practices. Domino’s Enterprise AI Platform on AWS empowers organizations to innovate confidently and responsibly by seamlessly integrating effective governance throughout the AI lifecycle, mitigating risks while driving business value.

Darwinbox wanted to reduce the time to infer resumes against job descriptions using PyTorch models. AWS Premier Partner Minfy helped them leverage Amazon SageMaker and AWS Inferentia to compile models with Neuron SDK and deploy them, achieving 87% faster inference without retraining. Key steps were compiling models with the Neuron SDK, extending SageMaker containers, using Inference Recommender to optimize configurations, and sending requests in mini-batches.