Shaving can also cause armpit cysts, according to the National Library of Medicine, as can antiperspirant (but deodorant shouldn't), per Mount Sinai. Many cases of underarm bumps clear up on their own ...