Not having that option of at least a few 4090 would be a detriment, the changes is so small people would barely notice it. But GPU compatability would be a factor for sure. Who's to say the 5080 won't be as big as a 4090 today?
Go bigger, change is not noticeable, but lack of GPU options will be.