I think Pitch did at some point. And they were probably a bit quick on the whole rejection thing, and now he wants to ruin what they love.

I don't know. It's a guess. It's kinda how I felt, except I didn't want this kid I knew to get hurt, and helping him meant helping the Guardians. But I also hadn't gotten to hating them, but I could have. If things had been different....