Is a vitamin supplement causing my dog's bad breath?

Probably just that he is teething. To keep his teeth nice and healthy throughout his life, feed him raw bones or chicken necks, very good for cleaning their teeth and they love them.