[kwlug-disc] Scraping Facebook

[Khalid Baheyeldin]

Spot on Darcy!

I have done scraping in cases where a web site is updated regularly, but
provide no email alerts. For example in the old days when The Record had
classified ads (in the pre-Kijiji era), I used to search them for certain
keywords that way.

All of what you said is true.

In addition to that, after the cat and mouse because of HTML redesign (it
happens quite regularly), and before the law suits, there is another step:
they detect that you are effectively a 'bot' and block you.

So, all in all, scraping is not a sustainable solution.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://kwlug.org/pipermail/kwlug-disc_kwlug.org/attachments/20171205/20b692f7/attachment.htm>