He was the son of German immigrants who first settled near Beardstown. His older brother, Frederick W. Ginder, enrolled in the 101st IL Inf in 1862, citing Concord, IL, as his residence. James cited Arenzville as his residence when he entered service.