Spidering/Web Crawl...
 
Notifications
Clear all

Spidering/Web Crawling Social Networking Sites

4 Posts
3 Users
0 Likes
359 Views
 IanF
(@ianf)
Posts: 55
Trusted Member
Topic starter
 

All,

Does anyone have any tools/scripts in their arsenal which would be useful in either spidering or crawling certain common social networking sites for specific search terms or usernames ?

Thanks.

 
Posted : 25/02/2010 9:18 pm
(@bithead)
Posts: 1206
Noble Member
 

dtSearch. Desktop with Spider. Single seat $199 US

 
Posted : 25/02/2010 10:12 pm
 IanF
(@ianf)
Posts: 55
Trusted Member
Topic starter
 

Thanks for the pointer BitHead.

I've downloaded an eval copy of dtSearch Desktop with Spider and it looks great as a general spidering and indexing tool but maybe I'm reading it wrong in relation to passing search terms through it into Facebook for example and just indexing all of the search results that return. I don't see that it is specific enough for this type of searching.

I have however only been looking at for the past couple of hours.

I appreciate that it will probably work great on a particular start point (eg a users home page).

Any usage pointers ?

Ta.

 
Posted : 26/02/2010 3:28 am
(@fuzed)
Posts: 93
Trusted Member
 

I would google facebook forensics, theres some guidance out there on this, although I do not off hand know exactly how FB creates users profiles and information under that sub profile, maybe worth experimenting on your own profile if you have one?

If you tried to spider the whole of FB youd probably be there a very long time - dependant on what information came back…

 
Posted : 26/02/2010 4:30 pm
Share: