So the issue here was me assigning the material to the Mesh and not the MultiMeshInstance2D. After doing that, it works.