Because the act has reduced many of our basic human rights and is being abused to cover incidents clearly unrelated to terrorism.
It has become a catch-all excuse for the police to cite when they act in a heavy handed way and goes against the ethos of a democracy. For one recent example, google 'the romford incident'