James grew up in Ider. He graduated from Ider High School and enrolled at the University of Montevallo where he earned a BS with majors in biology and math. He later earned a Masters Degree from the University of Montevallo. He returned to Ider where he taught until his retirement. He is an avid fisherman. In 1984 James set 36 International Game Fishing Association (IGFA) line-class world records. He established three other IGFA world records in 1985, two in 1986, and another in 1987. He has a total of 42 IGFA line-class world records.
