She was both female and a slave. No matter where he was, or wasn't, on the spectrum, Jefferson would never have seen Sally as having agency. We don't know whether or not Jefferson couldn't hang on to a lasting romantic relationship. We know that his wife died young, and after having been mistreated by a stepmother, had Jefferson promise that he would never again marry for fear that her daughters might be mistreated by a stepmother.