Why everyone thought that Toby was like a "dangerous guy"?

because he had a bunch of reason to kill alison like when she blinded toby;s sister in episode one.

Also because Alison led them to believe he was a perv that watched them undress. As of now i dont think its known why she did that.
But i agree hes soo cute<3