OK, I am going to be brutally honest here. Don't take this is as an insult, I do the same thing all the time. If you work on this, your work will improve overnight.
You aren't done filing. I do the same thing all the time, and I always need to tell myself that I am not done and just to keep working. Take your file, find an angle that is about the same as your current bevel angle, and then file that angle until everything is reasonable flat. Then get some mild steel barstock, about 9 inches of 3/16ths, and file about a chisel grind about 2 inches wide in the middle down to about 1/16th of an inch. Take a sheet of sandpaper and wrap it around the ground part, and then go after the bevel until it is an even 120. HT it, and then clean it up after.
Also, clean up the profile. Remember, after heat treat, everything will be harder to do. filing will be a struggle and sanding will be much more of a pain. Just stick with it. It will be worth the effort.
I am not picking on you. I have this same problem myself, and I still have not overcome it.