If you buy ivory, you take the risk of shrinkage. A maker with a long time reputation of handling in ivory, taking care to not let it get too hot, to keep it properly maintained, aging it or using very old ivory, will help your odds. Also being aware of the climate it was made in versus the climate it will be stored in.
Among vintage knife collectors it is easy to pick a knife collection out that has been stored in Florida, as it will often have a lot of rust specks from the environment. Same way with ivory.
I visited Lloyd McConnell's shop in Odessa, Texas a few years ago. I was heading west to the Great Western Show and stopped in to have lunch with him, showed him a knife of his I had, and he wasn't happy with how it was locking, so at his insistence I followed him back to his shop so he could rework it while I waited. This was impressive in itself, as was the cleanest shop I've ever seen. He had his hand material, including ivory, oiled and wrapped in saran wrap. I venture that Lloyd's ivory handled knives will stand the test.
I've rarely had problems with stag. Horn knives for me, especially folders, tend to pull and warp rather than crack. And I've had several pieces of buffalo horn handled knives get bugs in them and eat themselves away.
But climate and humidity expansion and contraction does not confine itself to just handle material. I once owned a D. E. Henry ivory folder button lock that had been made on tolerances so close that it worked well in the Texas area where it was assembled, and would stick at home here in Tennessee. I ended up selling it in Texas.
I love ivory on knife handles, I love the look, and the feel. But I also tell people that an ivory handled knife is a lot like an unfaithful wife, she may be nice to look at and touch--but there is a good chance the b---ch is gonna break your heart sooner or later. Just the risk you run for the pleasure involved.