Miklós Zichy commenced to build the mansion in 1745. It is separated from its surroundings by massive fortress-like walls. The side and central portions of this elongated, rectangular, two-storey building, face the Danube River. The central portion features a tympanum.
The mansion was enlarged with the addition of new buildings at the end of the 18th century. The resultant mansion-complex is the only one to be found within the inner-city precincts; almost the entire complex has remained intact. It currently houses offices, a theatre and exhibition halls (the Vasarely Museum, the Kassák Museum, and the Budapest Art Studio Foundation), within its walls.