Yeah I'm the same but I normally get a four on the sides. Depending on the barbers skill sometimes it has to be a three.
Also do any of you hate getting that super straight short trimming on the neck. I swear whiteboys like me should only get a natural taper, my neck gets itchy as fuck when they razor that shit.