Dudley Joseph Thompson was born in Panama on January 19, 1917, to Daniel and Ruby Thompson. He had seven siblings. His father, a teacher and his mother, a seamstress, were part of masses Jamaicans who went to Panama and helped to build the Panama Canal. The family returned to Jamaica to settle in Darliston, Westmoreland in the late 1920s.