It was the original owner and one of the family members at the same time. Say Austin and G are my family members. I could play the game any time I wanted no matter what. If Austin was also playing, then G couldn't. However, as soon as Austin stopped playing that particular game, G could then start playing.

The part where you gave a game away and never got it back was the game trading they were going to do, the family sharing thing was different.