Stuttering like hell

Anyone else stuttering like crazy? My game keeps micro freezing, I've tried different ingame settings to no avail, updated drivers and all the usual stuff. My spec: Ryzen 9 5900X, 32 Gigs of ram, Radeon RX 6600 EAGLE 8GB

Edit1: Seems to be related to the shaders or Network, the bar is spiking when the stutters happen, still not sure how to fix it.

Edit2: Meddling with different CPU/GPU options did not help at all (reinstalling drivers, deleting amd adrenaline which is known to cause some issues in certain games, various PoE 1 fixes like changing CPU C-State) some people report that after restarting the game and downloading small few mb patch their stutters magically disappeared so we just might to sit tight and wait for some patch to drop and fix the different CPU/GPU combos, it is beta after all. I cannot wrap my head around this issue, FPS is stable, VRAM and RAM usage is low, it makes me think that patience is the only way here.