Metro Central Heights at Elephant & Castle has been declared a listed building by culture minister Ed Vaizey.
The office development designed by Erno Goldfinger was built between 1959 and 1967 as Alexander Fleming House.
For many years it was occupied by the Department of Health and Social Security.
In 2002 it was converted into flats and renamed Metro Central Heights.
Now it has been added to the statutory list of buildings of special architectural or historic interest.
"Goldfinger considered this to be his most significant work," said Ed Vaizey MP.
"Acclaimed when it was first built, it subsequently divided opinion but has now – 25 years after first being put forward for listing – clearly passed the test of time. I am pleased now to be able to give it the recognition it deserves."
Simon Thurley, chief executive of English Heritage, added: "Built by distinguished architect Erno Goldfinger, Metro Central Heights is an excellent example of high calibre post-war architecture.
"An accomplished building, it has proved highly influential for designs which followed. We are pleased that the heritage minister agrees with our advice and has listed it at grade II."
Goldfinger also designed the adjacent Odeon cinema which was demolished in 1988. A plaque recording the cinema history of the site was unveiled by Denis Norden in 2008.
For the latest local news and events direct to your inbox every Monday, you need our weekly email newsletter SE1 Direct.
7,000+ locals read it every week. Can you afford to miss out?
Read the latest issue before signing up