How to get bot list dynamic or I need services get bot list for check view without bot crawler.
Like that : Detecting honest web crawlers, however I want to get dynamic bot list (latest bots).
Thanks for support, TuanTH
How to get bot list dynamic or I need services get bot list for check view without bot crawler.
Like that : Detecting honest web crawlers, however I want to get dynamic bot list (latest bots).
Thanks for support, TuanTH
You can update your crawler list from an XML source like http://www.user-agents.org/