I had exactly the same feeling with my newbie S4. I thought "ahh great, finally a sunglasses holder" (old A4 did not have one). Tried my Serengeti's and it wasn't even close to a mind bending spacial test....it was never going to work from the moment they designed that enclosure.
2014 (B8.5) S4 Avant, Sepang Blue, Sports Diff, 7 S-tronic, 19" Rotor Titanium look, Adaptive Dampers, Dynamic Steering, B&O, Carbon Atlas inlays, Black Nappa, Black Headlining
2005 (B7) A4 2.0TFSI Quattro S-Line Sedan Graphite 6MT
1997 (B5) A4 1.8 Sedan 5MT - some silver colour