I have learned to stop making assumptions. I overlooked the Duffy Guard in Manhattan because the family didn't live there, but OF COURSE THEY DID. Part of the family was in Rochester, part in Manhattan.
The Duffy Guard formed c1851 of men mostly from the 1st Ward Manhattan and names after Peter Duffy of that Ward. John W, his brother Thomas C and their sister Ellen, along with a cousin Mary Burns, were all living in lower Manhattan/Staten Island during that time.