I'd been troubled by not able to find a suitable terminology for associate in Chinese.
In the condition of one working together with others, but does not mean one associates with them (viz. A German Christian soldier who does not associate with Hitler but yet obeyed almost all of his commands), 合伙 seems the best choice.
The usual translation： 结交, 交往, etc. are sometimes elusive. Because under this circumstance, one is a member of the pertaining group, and not completely isolated from it.
Thus, 我与他们聚会，并不等于我与他们合伙。
I still like the English phrase better: I meet with them, but I do not associate myself with them.
I feel I am still missing a better term. So I shall put this under question category.
Google translator gives me: 我不赞同 (I do not associate myself with them)