It is unlikely that someone would describe an object as "the dog next to the tree in front of the garage" in a situation in which "the dog in front of the garage" would suffice.
in general, there is no a priori reason to assume that our scene representations will be planar.