Freedom loving individuals are just that -- individuals. They have lives. They pursue their individual goals. For the most part they loath organizations and resist being herded into any kind of collective. That makes defending liberty and freedom problematic and difficult.
Statists on the other hand have only their ideology. They escape personal emptiness only by organizing to further collectivism. With no other purpose in their lives they constantly are plotting and working full time to force everyone into the universal collective that is their goal.