that's what I do all the time, I've configured one of my wacom pen's keys to "right click" - so whenever I want to get rid of the marching ants (selection outline) or stencils, I just click the button on my pen and "move" the canvas a lil bit - ants and stencils disappear!
why not? any error messages?