Robert Pattinson has a hard time adjusting to his new fame and has recently admitted to being terrified of the female fans.

The New York Daily News talked with a set insider from Pattinson's current project 'Remember Me' and the source said, "Robert is dying to get back home. He's so over everything. He's overwhelmed by all the girls - they terrify him! He says girls grab his neck and clothing all of the time, and he's not used to that... Robert doesn't understand why everyone is going so crazy over him."

Pattinson has been forced to stay in two different hotels over the period of four days just to escape the madness. Security is advising him not to encourage the crowd - which is why Pattinson doesn't even look up any more when making his way through crowds of fans.