Jasper W. Lambert was the youngest of 8 children born to William Lafayette "Billy Fate" Lambert and Martha Ann "Mattie" (Johnson) Lambert. He married Rosy E. Williams on June 6, 1953. Their five children are: Wanda Killough, Gwen Day, JoAnn Young, Don Lambert, and Jeanette "Jan" Harper.