Audrey grew up in Geraldine. She graduated from Geraldine High School and Jacksonville State College. She was a star basketball player at Geraldine starting in 1926 and later at Jacksonville State. Her teams at Geraldine went to four state tournaments. She played on all four teams, and was all-state guard for three years (1927, 1928 and 1929). She received a basketball scholarship to the University of Mississippi but went to Jacksonville State instead. At Jacksonville State her team won all their games and she was nominated for the All-Century team as well as the Hall of Fame for JSU as a teacher.