I searched in stores for a shower caddy with screws oriented horizontally, but unfortunately, I couldn't find one anywhere, and the previous one broke. There was no other solution, so I 3D printed one.

Update:

I uploaded a new version for thicker showers.