You CAN do a V-grind on a belt grinder just fine. The difference will be that you do the sharpening on the platen (the vertical support piece behind the belt near the table) instead of in the slack. You will always end up with the same slight convexity that you will on a freehand-sharpened knife, since no matter how careful you are, each pass across the abrasive (belt or freehand stone) will inevitably have SOME degree of variation in it. Practice will reduce the amount of that, and let you approach a perfect v-bevel more closely, just as with working on freehand stones.
Honestly, I prefer a large-radius convex myself, that is to say, to sharpen in the slack about a half-inch above the platen. That serves two purposes. First, it gives a mildly convex edge, which seems for ME anyway (YMMV) to be a bit more robust than a plain V-bevel. Second, the slight convexity is more forgiving to sharpen, since the belt tends to slightly contour itself to the edge and reduce pass-to-pass variation.