Find Jobs
Hire Freelancers

Scrape Forum URL onto txt file (3 options).

£10-70 GBP

In Progress
Posted almost 8 years ago

£10-70 GBP

Paid on delivery
Website I need just URL scraped from: [login to view URL] You can view more information here: [login to view URL] I already have a program which does most of what I want. However the exact scraps and how it's done aren't correct. You'll need to create a similar program. --- Option 1: Entire Forum URL ([login to view URL]) links need to be scraped. Option 2: Should just take the sub forum (including all threads) and all the sub forums (including all threads) within it. Example: - [login to view URL] -- [login to view URL] -- [login to view URL] --- [login to view URL] Option 3: Should just take the sub forum (including all threads) but not the sub forums within. Example: [login to view URL] Don't worry about Option 4 in the program I uploaded. That works as intended. ----- Run the program yourself. The program I have uploaded need to be changed so: - [login to view URL] -> It only does it one at a time. I want it to do all 3 log files at the same time, when necessary. - [login to view URL] The original thread url, without any page number it currently doesn't log. - This type of link is also missing (without a page number): [login to view URL] - It doesn't do sub forums with more than one page. Example: [login to view URL] [login to view URL] etc... ---- I may also need the program to start/stop. Right now it only start/pause. This project will probably require a lot of back and forth communication. So I need somebody extremely active and ready to constantly provide example logs. Example link used in my program: [login to view URL] Input screenshot: [login to view URL] Result: All 3 txt files attached in this post. Note 1: I will only put a milestone, if you can send me txt files demonstrating you understand the project for option 3 (relevant logged links). Note 2: I expect to see the program running via your PC (teamviewer/skype) OR you can send me the program (don't send source code) and I'll test myself to see if it works or not.
Project ID: 11208504

About the project

9 proposals
Remote project
Active 8 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
9 freelancers are bidding on average £62 GBP for this job
User Avatar
CodeBlu is an experienced and passionate group of graphic designers and web developers. Every client we work with becomes a part of the team. Together we face the challenges and celebrate the victories. Message us and let's start your work! We are recently Awarded by freelancer for our quality of Service
£210 GBP in 4 days
5.0 (2 reviews)
4.4
4.4
User Avatar
A proposal has not yet been provided
£44 GBP in 2 days
4.9 (16 reviews)
4.5
4.5
User Avatar
Hi sir I am Hasan Jack and I have more than 5 years of experience in Web scraping. As because of my prior experience I really feel I can be best choice for this job. Looking forward to hear from you. Regards, Hasan Jack
£70 GBP in 1 day
4.7 (10 reviews)
4.3
4.3
User Avatar
A proposal has not yet been provided
£33 GBP in 1 day
5.0 (6 reviews)
3.2
3.2
User Avatar
Will do this one for a good review! Professional work, in time, with ZERO errors, for sure! We aim to be your one stop solution for ALL IT needs, and provide a 100% SATISFACTION GUARANTEE. We do not charge you, if you are unsatisfied, due to any reason, with our work. Will accept the lowest amount, you think fair. Please do give me a shot. Awaiting your response. Thanks!
£40 GBP in 2 days
5.0 (2 reviews)
1.0
1.0
User Avatar
Hi, this is Vikas . I love scraping, crawling and getting data from various dom structures. I have 6 yrs of experience in scraping, crawling, processing and mining data. My previous projects include- 1. Automated Crawling of Google for SEO Keywords 2. E-Commerce Crawling. Crawling websites like Amazon, Ebay,Alibaba etc. 3. E-mail list scraping and phone number scraping for targeted users 4. Scraping Data from within Android Apps 5. Dynamic Data crawling through JS Manipulation 6. Automated Form Filling and Scraping 7. Proxy Emulation and Authentication in order to prevent server blocking 8. Mobile Site emulation and crawling mobile site specifically 9. Scraping data from Desktop Apps, PDFs etc. 10. Artificial Intelligence to emulate human behaviour while crawling and scraping sites Programming Languages I can use - Python, PHP, NodeJS, Jquery and Rails. Frameworks I have been using - Python Scrapy, Apache Nutch, Selenium, DOM Manipulation using Chrome Extensions, URLLib2, Python Requests, PHP Syphony etc. Data Can be exported to- Excel Files, MySQL, MongoDB, CouchDB, Cassendra, Redis, Docx. File, Amazon s3, HDFS, Oracle, MSSQL etc. I have read your project description and I think I would be the right person to do your project. I will ensure great communication throughout the project with timely updates about the progress of the project. I would like to have a chat with you about the project and discuss more about how I will be approaching this task. Ping me and lets get started. Thanks :)
£13 GBP in 3 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hi, I am Jitendra Basena provide service from last 15 years with my Experience team. I used the strategy that "EVERYTHING IS IMPOSSIBLE". Every challenging task are my favorite, I do whatever to get success on that. I always steady ready for the small and big jobs. I charge very flexible Sometime on client demand. I provide a Data Entry, Internet Research, Conversion, Processing, Forms Processing, Virtual Assistance, Broker Opinion Price (BPO Comparables), Link Building, Order accepting manually, Fresh Foreclosure leads, Real Estate listings, MLS Listing search, Data Entry into software Program and application, Data mining and Back Office support etc. Thanks
£38 GBP in 1 day
0.0 (0 reviews)
0.0
0.0

About the client

Flag of UNITED KINGDOM
Wembley, United Kingdom
5.0
2
Payment method verified
Member since Dec 5, 2015

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.