Input detection problem on CollisionPolygon3d through Viewport (and orthogonal camera)

Godot Version

Godot 4.7

Question

I am creating a mainly 2d game with Viewports to visualize 3d dices. I want to add a face selection feature by clicking on the dice faces. To simplify the face picking feature, I set the viewport camera as orthogonal :

I connected input signals on an Area3D, and it globally works for selecting faces by clicking on it.

However, there is a manual rotation system that can change the rotation of the dice, and in certain situations, the face detection becomes incoherent.

For example, in this situation, the area I can click to select the face 5 is way too small, and the rest selects the 6 or 3 :

Here are the properties of the CollisionPolygon3D for the faces and the properties of the CollisionFaces Area3D :

I don’t know if the problem comes from the Viewport or my 3d objects, have you ideas of what could be the cause of this behavior ?