5+ years experience in web scraping, I'm working for a reputed NASDAQ BPO company where I work as a Senior SE, I have worked with many scraping projects such as automobiles, mobile, real estate. Have work with managing blocking, managing sync downloading if exe blocked or exit..
I'm using C# .net and web technologies to grab data from given url, maintaining xml based navigation files to continuous downloading, I recently joined freelancer.com and I have competed one successful scraping. Only fact is I can program to run in proxy environment but proxy should be manage by pc where app runs..
I can manage any xml based automation, xslt, psd automation, pdf to text, office based any automation, win word automation etc... Have worked extensively with ItexSharp and interop win dlls..
I can share my comments ideas with you,
Thanks
Ashan Rodrigo