The top binned 7700K from Silicon Lottery was 5.2 @ 1.450 volts, I clocked mine at 5.4 @ 1.456 volts using a water chiller
I don't know how many chips Silicon Lottery binned but it is more than most people could possibly test so it's pretty safe to say 5.2 is about all anyone could do without extreme cooling.
If it locks up you probably need more voltage, if it hits thermal protection just booting like Scone says your re-lid may not be perfect and cooling not good enough for anything above 5.2 Ghz even if the chip is capable
You have reached the top binned speed for 7700K already my friend, anything above that requires $$$$ in cooling and a very good chip.
Disabling protections in the bios is not recommended and a sure fire way to kill your chip, I say that from personal experience