Evaluation on Certified Accuracy and Standard Accuracy

[chauminhnguyen]

I am interested in your work and I have a question to ask you. How can I evaluate the model using certified accuracy and standard accuracy like in your paper? Thank you.

[damon-demon]

Hi. Thanks for your interest. You can check the AE_DS_certify.py file. The following is the command example:

python3 AE_DS_certify.py --dataset cifar10 --arch cifar_dncnn --encoder_arch cifar_encoder_192_24 --decoder_arch cifar_decoder_192_24 --base_classifier $pretrained_base_classifier --pretrained_denoiser $pretrained_denoiser  --pretrained-encoder $pretrained_encoder --pretrained-decoder $pretrained_decoder --sigma 0.25 --outfile ZO_AE_DS_lr-3_q192_Coord_NoSkip_CF_result/sigma_0.25 --batch 400 --N 10000 --skip 1 --l2radius 0.25

[chauminhnguyen]

Thank you for your response; I ran that command and it just shows the STA. Sorry if I misunderstood the metrics, but could you help show me how to compute them?