How can I import mxnet model into SageMaker for inference only?

Jiyang · February 26, 2020, 5:09am

I have two questions on bring-your-own-mxnet model for inference only.
I followed the mxnet_mnist_byom example:

Why do we need mnist.py as the entry_point while importing the model into SageMaker?

from sagemaker.mxnet.model import MXNetModel
sagemaker_model = MXNetModel(model_data = 's3://' + sagemaker_session.default_bucket() + '/model/model.tar.gz',
                                  role = role,
                                  entry_point = 'mnist.py')

In the mnist.py, I find there are only training related code blocks.

github.com

awslabs/amazon-sagemaker-examples/blob/master/advanced_functionality/mxnet_mnist_byom/mnist.py

import logging

import gzip
import mxnet as mx
import numpy as np
import os
import struct


def find_file(root_path, file_name):
    for root, dirs, files in os.walk(root_path):
        if file_name in files:
            return os.path.join(root, file_name)

def build_graph():
    data = mx.sym.var('data')
    data = mx.sym.flatten(data=data)
    fc1 = mx.sym.FullyConnected(data=data, num_hidden=128)
    act1 = mx.sym.Activation(data=fc1, act_type="relu")
    fc2 = mx.sym.FullyConnected(data=act1, num_hidden=64)

This file has been truncated. show original

Which part of mnist.py is essential for inference?

Will it work with .params only tar.gz?
I find the non-hybrid model cannot export a .json architecture file.

Can a params only model.tar.gz in s3 bucket be imported for inference into SageMaker?

Thanks in advance.

Topic		Replies	Views
Load Amazon Sagemaker NTM model locally for inference Discussion	0	339	September 30, 2020
MXNET load resnet50 model Object Detection python , symbol , how-to , keras-mxnet	2	1700	March 12, 2019
Deploy trained Sagemaker Mxnet object detection model locally?	1	451	May 2, 2019
Deploy Sagemaker trained model locally	2	2561	February 25, 2020
MXNet terminated by ImageRecordIter augmentations Gluon	2	600	December 14, 2018

How can I import mxnet model into SageMaker for inference only?

Related Topics