Fleming's Royal Navy duties brought him to Jamaica for the first time in July 1943, and he swore then he would come back to live here as much as his career would allow. Even then he told friend Ivar Bryce he would write the "spy story to end all spy stories" from this place.

In January 1946 Fleming did come back and bought land that was then a donkey racecourse. He drew up some simple architectural drawings and for 2,000 pounds sterling the plans became a home, standing largely unchanged today.