Button lagging behind mouse

I have a button following my mouse with

if button_pressed:
	position = get_viewport().get_mouse_position() - Vector2(4, 4);

but when I move my mouse, the button always seems to lag slightly behind my mouse, how do I fix this?

This is similar to this issue