i actually lie, i had the nut probably 1- .5mm from being flush with the stub axle

use a brass drift if your super worried.

ive removed a dozen this way