Shaving every day can irritate the skin, especially sensitive skin under the armpits. Stop shaving for about a week and try to remove ingrown hairs. After a week, you can restart shaving bump-free, though you'll probably want to shave every third day instead of every day to avoid recurrence.