From AMD's slides and the ISA doc's diagrams of the memory system, it's not clear if the Infinity Fabric is near any of the disabled features. The GPU's cache system appears to be its own domain, with the fabric between the L2 and memory controllers. That simplified arrangement, and the fact that the fabric is based on a mature protocol, doesn't seem to leave much room for it to cause problems. As a hardware fabric, it should be mostly invisible to software.
Koduri stated that Vega's fabric is optimized for servers, but I'm not sure what would be limiting it other than perhaps some additional overhead for items like generally unused error correction or expanded addressing. In fact, I'm not sure what "server-optimized" really adds if all the fabric is doing is sitting between memory, GPU, and standard IO.
There's the flash controller and I think the IO for that, though its impact should be modest.