And yet, I have no signs of skin irritation from shaving, nor do I get the same reaction to sweat when I do a heavy exfoliating routine with a loofa or pumice.

Both shaving stones and alcohol are astringents. Both will strip oils out of your skin. Both prevent the burning sensation from the salt in sweat.