If swaproles is enabled and you join a server in the second half, people who were playing in the first half will have their scores transferred over. Therefore it appears as though the scores are screwy when they're really not.
I need some help reproducing this kick. It doesn't happen on the test server. Are you sure it's kicking you or is it timing out when it tries to swap teams? Or does it finally load and you are now on the other team?