You may be able to find these answers in the census reports. As you undoubtedly know, there isn't a very person name given until the 1850 census. Before then it is just the head of household and the number of males and females of whatever ages.
However, Ancestry.com shows:
John D Colf Ashford, Cattaraugus, NY, born abt 1827 in New York, in the 1850 census, and
Name: John Colf
Estimated Birth Year: abt 1784
Birth Place: New York
Home in 1850(City,County,State): Ashford, Cattaraugus, New York
Delivan Colf 16
Eda Colf 56
Hial Colf 21
John Colf 66
also in Ashford.
Try checking the 1830 census of to see if there is a John Colf with 2 young sons...
You may also want to try finding the 1855 NY state census of that county - available on film thru the FHC system of libraries.