Create model on Sagemaker

Create model on Sagemaker AI

  1. Access Sagemaker AI
    • Select Inference
    • Select Models
    • Select Create Model

Create VPC

  1. Fill in the model configurations
    • Model name distilbert-sst2
    • IAM role: abcxyz (create an IAM role with sufficient permissions)

Create VPC

  1. Continue scrolling down and fill in

    • Location of inference code image
    763104351884.dkr.ecr.ap-southeast-1.amazonaws.com/huggingface-pytorch-inference:1.13.1-transformers4.26.0-cpu-py39-ubuntu20.04
    
    • Location of model artifacts
    s3://glutisify-datalake/models/distilbert-sst2/model.tar.gz
    
    • Environment variables in the model:
    KeyValue
    HF_TASKtext-classification
    SAGEMAKER_PROGRAMinference.py
    SAGEMAKER_SUBMIT_DIRECTORY/opt/ml/model/code
    SAGEMAKER_CONTAINER_LOG_LEVEL20
    SAGEMAKER_REGIONap-southeast-1

Create VPC

  1. Scroll to the bottom
    • Leave the remaining configurations as default
    • Select Create

Create VPC