How do I get rid of razor bumps in the vaginal area?

The first step is avoiding them in the first place with proper shaving technique. This includes using a fresh, sharp razor every time, using a soap or other skin barrier while shaving, shaving in the direction that hair grows (not against it) and moisturizing afterward to replenish any natural moisture you shaved off.

However, some people are just more prone to razor burn. If this is you, it is totally safe to use a low-dose steroid (like a 1% hydrocortisone ointment) twice daily for a couple of days to calm down the itch and the redness. When low doses of steroid creams are used for short periods of time there is no risk for skin thinning or withdrawal when you stop using it.