In the Seafaring days of the past, Sailors would sail South to utilize favorable wind patterns when travelling long distances across the oceans.
My ASL Dictionary features a Cartoon of a 16th-century Explorer with Silver hair and an Elizabethan collar, a Compass Rose behind him, showing the ASL hand sign for SOUTH.