Hmmm . . James married Catharine Garnet.
Married: 30 Aug 1822, Rockbridge Co. VA
Source: VA Marriages 1785-1940
It is difficult to find anyone born before 1850. Birth records don't exist.
I'd look for their newspaper announcement of their marriage and both sets of parents might be listed.
I didn't find James on a Census in Rockbridge County, VA nor in Pike Co., KY. I'd look at the tax and land records in those counties to find any other record about him.
You can also contact the genealogical and historical societies in those counties too. Successful Searching!