I really appreciate all of the responses, there has been a lot of helpful information here! When I sit back and look at my knives, there are definitely things that stand out that need some work:
Handle pins drilled more accurately? Absolutely
Less time spent finishing? Yes
Less money spent on abrasives? Also yes
Being more efficient at cutting blanks? very yes
As well as some other little things. Although I do feel like some of my issues will come to be fixed in time with experience. For the time being though, I do think that I'll get the drill press next. On top of all of the advice here and the overwhelming vote for the press, I've thought about some other uses for it too outside of just pinhole making and such, like being able to make a new bevel jig with holes that line up! Thank you all again for all of your advice!