I don't know if there is something generational or maybe a UK-US difference about this. I grew up when invitations to armed forces all ranks events would say "officers and their ladies, NCOs and their wives, other ranks and their women". Because of this, "women" has always had a slightly derogatory connotation to me. And I know other people of my generation (men and women) feel the same. To us, female does NOT have that connotation. Having said that, I know I have to move with the times so I do try to use woman / women, but sometimes I slip.