It is bad to lightly scrub my ( face ) with a [ pumice stone ]?

Yes...I haven't done it myself, but a friend of mine has and she told me it made her look like a meth head for a little while.