Tom Mitford, the Mitford family's only son, had a tumultuous and adventurous life, marked by bisexual relationships and connections with notable figures of his time.
If that is the only issue you have here, I suggest you fall back and let him do his thing. Leon is bi, so it should not be earth-shattering when he does bi things, even if it wasn't explicitly telegraphed before.