How to save the GPU memory without accuracy drop for CNN?

I have tried several common practise. 1. Moving all 5*5 and 7*7 conv filters to 3*3 or 1*1. 2. Try float16 instead of float32 (I used NVIDIA apex package). Do your guys have any other suggestions?

01 January 1970 8,407 4 View