That depends upon if you can live without camera movements and what your largest print size is. It also depends upon if you like a square format. If you crop for a rectangle you end up shooting 645 which may or may not be ok with you for enlargements.
I own both 4x5 and 8x10 cameras plus a Hasselblad 500cm. If I had to give up one format it would be the 6x6 Hasselblad but that is me and only you can determine the right choice for you.