[Azure] test_cancel_azure failed due to error of resnet user program

[Michaelvll]

By running the command in test: sky launch -c t-cancel-azure-08 examples/resnet_app.yaml --cloud azure -y

We got the following error

(resnet-app, pid=4711)   File "/home/azureuser/miniconda3/envs/resnet/lib/python3.7/site-packages/tensorflow/python/keras/engine/base_layer_v1.py", line 1722, in apply                                                                      [15/924]
(resnet-app, pid=4711)     return self.__call__(inputs, *args, **kwargs)
(resnet-app, pid=4711)   File "/home/azureuser/miniconda3/envs/resnet/lib/python3.7/site-packages/tensorflow/python/keras/legacy_tf_layers/base.py", line 551, in __call__
(resnet-app, pid=4711)     outputs = super(Layer, self).__call__(inputs, *args, **kwargs)
(resnet-app, pid=4711)   File "/home/azureuser/miniconda3/envs/resnet/lib/python3.7/site-packages/tensorflow/python/keras/engine/base_layer_v1.py", line 786, in __call__
(resnet-app, pid=4711)     outputs = call_fn(cast_inputs, *args, **kwargs)
(resnet-app, pid=4711)   File "/home/azureuser/miniconda3/envs/resnet/lib/python3.7/site-packages/tensorflow/python/keras/layers/pooling.py", line 300, in call
(resnet-app, pid=4711)     data_format=conv_utils.convert_data_format(self.data_format, 4))
(resnet-app, pid=4711)   File "/home/azureuser/miniconda3/envs/resnet/lib/python3.7/site-packages/tensorflow/python/util/dispatch.py", line 201, in wrapper
(resnet-app, pid=4711)     return target(*args, **kwargs)
(resnet-app, pid=4711)   File "/home/azureuser/miniconda3/envs/resnet/lib/python3.7/site-packages/tensorflow/python/ops/nn_ops.py", line 4613, in max_pool
(resnet-app, pid=4711)     name=name)
(resnet-app, pid=4711)   File "/home/azureuser/miniconda3/envs/resnet/lib/python3.7/site-packages/tensorflow/python/ops/gen_nn_ops.py", line 5330, in max_pool
(resnet-app, pid=4711)     data_format=data_format, name=name)
(resnet-app, pid=4711)   File "/home/azureuser/miniconda3/envs/resnet/lib/python3.7/site-packages/tensorflow/python/framework/op_def_library.py", line 750, in _apply_op_helper
(resnet-app, pid=4711)     attrs=attr_protos, op_def=op_def)
(resnet-app, pid=4711)   File "/home/azureuser/miniconda3/envs/resnet/lib/python3.7/site-packages/tensorflow/python/framework/ops.py", line 3536, in _create_op_internal
(resnet-app, pid=4711)     op_def=op_def)
(resnet-app, pid=4711)   File "/home/azureuser/miniconda3/envs/resnet/lib/python3.7/site-packages/tensorflow/python/framework/ops.py", line 1990, in __init__
(resnet-app, pid=4711)     self._traceback = tf_stack.extract_stack()
(resnet-app, pid=4711)
ERROR: Job 1 failed with return code list: [1]

Version & Commit info:

• sky -v: PLEASE_FILL_IN
• sky -c: PLEASE_FILL_IN