I think you should invest in a condenser mic, it will help eliminate ambient noises outside of your voice
Granted I don't know where and what you are using for recording but just a thought.
You could also chop the sections of "empty" space in the vocal clip and save yourself some money 🤑