Artefacts appearing when using refraction for a glass material

Godot 4.3

Wanted to make a glass material to make windows. Went about doing that by creating a material with 0 alpha, a roughness texture with some scratch marks and such and turning on refraction. I tried turning the refraction scale down but the artefacts still appear. Im using a voxelgi node for lighting in the scene, volumetric fog is on and a few of the other settings. I will be properly going over the world environment settings to suit my needs once the scene is laid out. Im not sure if its anything to do with that. Im not sure what else to try at the moment to make the glass material work other than messing with render settings and world environment settings just wondering if anyone has encountered this before and knows what the issue is.
image

The pillar that’s in the middle left of the image that doesn’t follow uniform is the one that is generated by the refraction


another image
for context the only window here that has glass is the one that is generating the artefact