In conclusion, If I have a cube like in the last picture; 4 faces will show lighting correctly, one face will be totally black (always the same direction), one face will receive partial lighting (always the same direction). Top/bottom faces are OK.
What is also strange is that when I put a light inside the mesh, the face that would otherwise be black will receive lighting. As if it thinks the inside of a face is the outside if that makes sense.