The name recalls the main customs office (‘Zollamt’) that once stood here.
The street (‘hintere’ = rear) was named in 1862 after the main customs building put up in 1840–1844 to plans by Paul Sprenger. It was almost completely destroyed in the Second World War and later demolished; an office building for the federal computing centre was built on the site in 1969–1974.