St Patrick's, as the building was originally known, was the first catholic school in Australia to be built from private subscription. The Catholic Church acquired the land from Mary Shiel. It had a gabled hall of plastered brick. The veranda across the front was added later, as were the urns on the round-topped pilaster-buttresses. It was built in 1840 and opened on St Patrick's Day.

It remained in use as a school until 1914 when Father James Dunne opened St John's Primary School in Lindsay Street. It was then sold to Mrs Keihone who had it converted to a dwelling, and wishing to give it a truly Australian title, renamed it Quondong. It appears to be named after a Kurrajong tree at the front which was mistakenly believed to be a native Quandong tree.

Mrs Keihone sold it to her nephew William Thomas Bourke who resided there till the 1950's, after which, Cyril Segal of Wilton owned it till 1991.