Twitter's robots.txt question:

[Hema]

Twitter's robots.txt, It shows everything is disallowed, but surprisingly search engines are crawling and indexing everybody's profiles pages, Why?

[stevemack]

interesting and technical question too. If it is blocked in robots.txt, it is not possible to be their in search / index. waiting for the same to know.

[Hilarious]

I think that they have not one robots.txt file

[silverf0x]

I think you saw the fake or secondary robot.txt

[mikeb]

I have never thought about this. But something must be there.

[WHUK]

Presently search engines work very fast they try to search such profile who provide quick and updated content to the viewer. These few kind of information who are work with such kind feel which is one of the important data for search engine. So search engine do index profile who add such kind of information to there accounts.