My solution if anyone finds this useful:
I was adjusting the position of the parallax background by transforming the position of the individual parallax layers. This is incorrect!
You need to set the transform position of the individual layers to 0, 0 (default), and instead do any position transformations via its parent Parallax Background.