Using soaps that contain harsh chemicals, such as fragrance, may cause dry skin on the penis ... seek medical advice. A doctor may recommend using a corticosteroid cream. Gentle cleansers and ...