I don’t know whether I am too pessimistic or not by saying this:
It is my experience that, unless the person (relative, or even “friend”) is not worse in any way than you (their own education achievement or their children’s education achievement, their family’s financial status, etc.), it is not easy to have or maintain a smooth relation. Just my subjective opinion here.
My wife at one time said this: She could lose a “friend” of hers if the (only) child of one of her friends does not “do well enough” in the college application cycle. It is neither her friend’s fault nor her fault. No side is malicious. She wished her friend’s kid would do well. Luckily, that kid did well in the end.
Several years ago, a (previous) coworker of mine told me this:
When he went home everyday, just a glance at his wife would immediately tell him whether or not his wife had visited a particular friend of them on that day. Their own child did not “do well” in the college application cycle a few years back according to their “expectation”, so it would be hurtful for his wife to visit and interact with a family whose child did “better” in college application. You could say they are “shallow” and put too much emphasis on something that is really not that important. But his wife’s hurtful feeling is real and she was unable to get rid of this upset feeling easily.
Re: a loss of the job:
Unless I am very close to the person I visit, if I knew in advance that he just lost a job, I would postpone my visit to him.
When I almost lost my job several decades ago (it turns out OK in the end because another deep pocket company bought us and “saved” all of us – it means all employees in that company, except for the few executives who would rather choose their golden parachutes and moved on), my immediate family members visited us and we were expected to arrange their fun trips (visa, etc.) And we did do it dutifully to avoid the family feud. The last thing we could afford at that time was a family feud.
I do not mean to imply OP did the same. I just say that, like some animal (e.g., a lion) would hide when it is hurt badly and would not come out till it heals, a person may need some time and space to “heal” in absence of others under some situation.