The cutting can be done in any way you want. As long as you do it the same way each time you can get informative comparisions. Doing a draw (slice) towards you is common. Fowler does it that way as do a lot of other custom makers, Wilson, Goddard etc., Busse does straight push cuts. If you are slicing the more aggressive the edge (coarse), the better (to a point, extremely coarse edges [40 grit ZO] tend to lower the performance), for push cuts, the more polished the better. The hardest part is deciding when to stop as it isn't trivial to judge when a blade has blunted to a certain level. Goddard used a scale to do the cutting so he could judge when to stop by the force getting too high, but even that doesn't make it a trivial matter as blunting isn't a linear process. Experience is key.
As for the rope, I have gone through over a dozen rolls of hemp and they were all identical to the first roll which I kept for comparison purposes to make sure this wasn't a problem. It isn't easy to make the cuts in a consistent manner so you can expect some variance as you do it the first few times and work the bugs out. The way in which you draw the blade across the rope has a vast influence. This includes the angle at which you hold it (tilted to one side or the other), or the angle at which it ramps over the rope. So for example holding the blade at say a 20 degree angle, is different than drawing it across the rope with the edge flat to the cutting board. Even the way in which you hold the rope with your off hand can influence the results, for example grasp it very tightly close to where you are cutting compared to loosly further away. Repeating the cutting as Ed noted is very critical, as it allows you to judge just how consistent you can be which will make the results more meaningful.
-Cliff