In a perfect world with a pure iron/carbon system that temperature would be around 1335F, but…
Almost every steel we work with has some sort of elements other than carbon which moves that temperature around, so each steel will have its own unique temperature that will fall near that range. In an average shop without equipment able to read exact temps for the given steel the magnet will suffice for ballpark figures. If the magnet quits sticking you have definitely began making new crystals, but not necessarily moving the carbon around as you may need for other heat treating operations. The new crystalline phase opens the pathways for the carbon to move it then requires time or temperature for that to happen, but in stress relieving and annealing this is not as critical.
Simple spheroidization involves keeping things below recrystallization so the magnet should not stop sticking during the process. It may be easier just to think of this type of spheroidizing as very high temperature tempering, and is effective enough for very simple steels to make very fine spheroidal carbides that will allow grinding and some machining.
Steel above .8% carbon will have excess carbide that will get into mischief on you if you allow it to with a slow cool from solution. As mete pointed out it will naturally want to go for the grain boundaries where it will not only burn up your mills and drills, but it will also cause embrittlement issues if not removed from those grain boundaries. But even without grain boundary cementite (I threw that big word in for mete

, for the other folks – iron carbide), coarse pearlite (banded iron carbide) will offer a tougher machining material than spheroidized (think of shoveling a pile of shingles versus a pile of marbles).
1084 is right on the borderline to where you would really need spheroidizing and if the most you may do is drill it, then the extra effort of spheroidizing may not be necessary. The old standard anneal among bladesmiths and blacksmiths is to heat to nonmagnetic and then stuff it into wood ash or vermiculate for a long slow cool, this is known as a “full anneal” or more precisely as a “lamellar anneal” due to the lamellar pearlite it forms.
Spheroidizing on the other hand does not rely on the cooling but instead on the temperature at which it is held (red but still magnetic) to do all of the work.
After forging reheat the steel as evenly as possible (evenly is the key word in normalizing, evenly heated and evenly cooled) to a nice orange heat, (1600- 1700F). This will, evenly redistribute the carbon and equalize the grain size (uneven grain size is actually worse and a little larger grain size) and undo much of the havoc you inflicted in the forging process (hand hammer faces have a hard time moving steel perfectly even). Allow to air cool evenly (put the tang in a vice don’t’ lay the blade flat on anything). Follow this up with a heat just beyond magnetic to refine the even structures you now have. This can also be followed by another heat a hair lower or even another heat to nonmagnetic and a quench to room temp to really refine things and set it up for the last normalizing heat which can actually double as spheroidizing as long as you stay below nonmagnetic, and if attempting to spheroidize you should try to hover in that magnetic red range for a little while by cycling it in and out of the forge.
The full anneal would then be as described above with heating to above nonmagnetic (kind of undoing any grain refinement accomplished in normalizing) and burying in an insulating medium. But if you follow the above normalizing steps you should be able to move on to grinding without the full anneal with 1084.