Parker emigrated to Christchurch in 1869 becoming organist and choirmaster at the Church of St John the Baptist .[1] In 1878 he moved first to Nelson and then to Wellington where he became organist and choirmaster at St Paul's Cathedral.[1]
In Wellington he became active in a range of musical activities. He was conductor of the Wellington Orchestral Society, the Wellington Choral Society, Wellington Musical Union, and the Wellington Liedertafel.[1] He lectured at the Wellington Teachers College, examined music for the Department of Education and University of New Zealand and chaired the Music Teachers' Association of New Zealand and the Music Teachers' Registration Board.[1]