This folder contains codes for clients.

• client_inference.py: In each iteration, send an inferece request, wait for the reply and record the latency without switching.
• client_switching.py: In each iteration, send a training request, then send an inference request to record the latency with switching.

You need to add the path to the repo to PYTHONPATH.

python client_inference.py [model_name] [batch_size]

model_name can be resnet152, inception_v3 or bert_base.

Example:

python client_inference.py resnet152 8

python client_switching.py [model_name] [batch_size]

model_name can be resnet152, inception_v3 or bert_base.

Example:

python client_switching.py resnet152 8