Fortnite keeps crashing on AMD RX 6650 XT

These past few months Fortnite has been consistently crashing for me. Usually it crashes halfway through the game and the severity of the crash is different each time. Sometimes it'll crash normally with the Unreal Engine crash handler popup, other times there won't be a popup and at worst it'll shut down my whole PC.

I've only had issues with Fortnite, no other game has been crashing.

I've tried latest drivers (24.10.1) and rolling back to what Fortnite recommended (24.8.1) as well as (24.7.1) but to no avail

It has been worse since the Chapter 2 Remix update, and now it seems to crash pretty much every round, I can't finish a match without it crashing.

I'm using DirectX 12 because both DirectX 11 and Performance mode don't perform well on AMD graphics.

If it means anything, the crash minidump reason seems to be:

ERROR_CODE: (NTSTATUS) 0xc0000005 - The instruction at 0x%p referenced memory at 0x%p. The memory could not be %s.

Not sure what to do, please help

Specs:

Intel Core i7-11700K

2x16GB DDR4-2666

Gigabyte Z590 Gaming X

Gigabyte AMD Radeon RX 6650 XT