According to Jim: Season 5, Episode 21
When Andy stars playing chess with Ryan on a regular basis, Jim is convinced that he is losing his best friend.