OK, well I'm not sure what the problem is, but my money would be on the PSU at this stage... could be something else, but the PSU is certainly cheaper and easier to swap out than the motherboard, so that would be my strategy (unless you can borrow a PSU for testing which would be best, obviously).
I'm also a little suspicious about the GPU, because you say it seems to POST when that's removed. Sorry that I don't have an answer, just a case of elimination I think.
Z690 Hero, 12900K, BIOS 4001, MEI 2433.6.3.0, ME Firmware 16.1.35.2557, 7000X Case, RM1000x PSU, ASUS TUF OC 3090TI, 2 x 16GB Corsair RAM @ 5200MHz, Windows 11 Pro 23H2, Corsair H150i Elite AIO, 4x Corsair RGB fans, 3x M.2 NVME drives, 2x SATA SSDs, 2x SATA HDs.