Going to work unshaven

If you don't have a full blown beard, is it acceptable to come to work (office environment, casual business attire, non-customer facing) unshaven? I ask because I overheard a snide remark about all the young men going to work with stubble on their face.

I personally don't think it matters, as long as you are presentable. But some people are old-fashioned, and expect you to shave daily.

Some people can pull it off, some cant