MLOps Work Load Orchestration (AWS Recommended)

In partnership with

Good day. It's Wednesday, Aug. 21, and in this issue, we're covering:

  • MLOps Work Load Orchestration (AWS Recommended)

  • Introducing AutoMQ: a cloud-native replacement of Apache Kafka

  • AWS Lambda introduces recursive loop detection APIs

  • Introducing Automatic SSL/TLS: securing and simplifying origin connectivity

  • How to Manage Terraform State with GitLab [Tutorial]

  • Azure Quickstart Templates

You share. We listen. As always, send us feedback at [email protected]

Before moving ahead....a great news  

We partnered with Growth School to bring you this FREE offering.

FREE AI & ChatGPT Masterclass to automate 50% of your workflow

More than 300 Million people use AI across the globe, but just the top 1% know the right ones for the right use-cases.

Join this free masterclass on AI tools that will teach you the 25 most useful AI tools on the internet – that too for $0 (they have 100 free seats only!)

This masterclass will teach you how to:

  • Build business strategies & solve problems like a pro

  • Write content for emails, socials & more in minutes

  • Build AI assistants & custom bots in minutes

  • Research 10x faster, do more in less time & make your life easier

You’ll wish you knew about this FREE AI masterclass sooner 😉

Use Case

MLOps Work Load Orchestration (AWS Recommended)

MLOps is the most happening topic in AI, seamlessly merging data science with IT operations to streamline and scale machine learning in production.

This illustration will help simplify the understanding of MLOps workload orchestration on AWS.

Ref: AWS White Paper

The MLOps load orchestration can be broken down into the following steps:

  1. The Orchestrator (solution owner or DevOps engineer) starts the solution in the AWS account, selecting options like Amazon SageMaker model registry or an existing S3 bucket.

  2. The Orchestrator uploads necessary assets (model artifacts, training data, etc.) to the S3 bucket. If using SageMaker model registry, they register the model.

  3. The solution creates an AWS CodePipeline by either triggering an API call to API Gateway or pushing the mlops-config.json to Git. The AWS Lambda function packages the CloudFormation template using the provided configurations.

  4. The DeployPipeline stage uses the packaged CloudFormation template to deploy the pipeline in the account.

  5. Once deployed, users access the pipeline's features, and an Amazon SNS notification is sent to the specified email.

Remember, successful MLOps requires careful orchestration—overlooking would lead to missteps, mishaps, and missed opportunities.

p.s. if you think someone else you know may like this newsletter, share with them to join here

Tool Of The Day

Prowler is an Open Source Security tool for AWS, Azure, GCP and Kubernetes to do security assessments, audits, incident response, compliance, continuous monitoring, hardening and forensics readiness.

Trends & Updates

Resources & Tutorials

Picture Of The Day

07 Apr 2005: Very first commit Linus Torvalds made on git.

Did someone forward this email to you? Sign up here

Interested in reaching smart techies?

Our newsletter puts your products and services in front of the right people - engineering leaders and senior engineers - who make important tech decisions and big purchases.