Marian, you say that you are a bit socially inept in real life. I wonder if you may be misinterpreting the comments as criticism, when in fact the comments may be hints that there is something the speaker wants to say.
This is probably beyond obvious, and I apologize if it is, but I find that it is quite common when leaving a visit with close family for there to be an exchange like this:
“That visit went so fast. I can’t believe we didn’t get a chance to really talk.”
“I know, I miss you so much. I miss the long talks we used to have.”
Most of the time it ends there, but then sometimes there’s another round like this:
“I know, but I was really hoping that we would get a chance to talk on this visit.”
That’s basically a hint that the person has something specific on their mind to discuss.
If you respond defensively, with something like: “What do you mean?! We talked all weekend?!”, you are likely to get a hurt and possibly mean response because your defensiveness could be perceived as a lack of empathy, since the person was trying to hint that there’s something bothering him/ her.
If, instead, you respond by saying: “Oh, is something going on? Is there anything I can do?”, the person might open up with whatever’s on their mind.
Again, sorry if this is obvious, but the main point I’m trying to make is that you may be misinterpreting what they are trying to say.