You might think that the accessible underground of Jerusalem is limited to the tunnels of the Western Wall. It's not so at all. Completely legal, without violating anything rules, you can go into a lot of other places...
I forgot to say that these vaults are here for a reason - these are the arches of the ancient bridge across the Terapion ravine, which once connected the Upper City of Jerusalem with the Temple Mount.