Web scraping into database jobs

I'm looking for an experienced developer to help with real-time text data scraping via API and management using BeautifulSoup. This project is primarily focused on retrieving text data and storing it in a database. Key Responsibilities: - Implement an API scraper to continuously retrieve text data in real-time - Utilize BeautifulSoup for data extraction and management - Develop a robust database to store all the scraped text data The ideal candidate should have: - Proficiency in Python programming language - Strong experience with API scraping and BeautifulSoup - Previous work involving real-time data scraping - A good understanding of database management It is important that the data scraping runs seamlessly and accurately in real...

I have 11 simple digital imags that I need converted to an .STL file so I can have it 3D printed. The design contains basic geometric shapes and lacks complex curves or textures. Key Requirements: - Convert a simple digital image into an .STL file for 3D printing - Ensure the file is optimized for 3D printing to avoid any issues during the printing process. Ideal Skills and Experience: - Proficiency in CAD software - Experience in 3D modeling, particularly converting images into .STL files - Understanding of 3D printing requirements and how to optimize files for this purpose.

I want someone who can create a database in MS Access for Invoices Log (tracking for already processed invoices) with the following features. 1- A list of all invoices (Master List) with the field names I will provide. 2- A list of all Contracts with the field names I will provide. 3- A list of all Purchase Orders. 4- A list of Approvers who is approving the invoices. 5- A list of Accounts. 5- All of these list should be linked with each other. The database should have a login page. After Login, there should be a a Main Page, with link to the above mentioned list pages plus, Add Invoice, Search Invoice, Search Approver, Search Contract, Search PO, Search Account and Reports pages. For Add New Invoice page, I should be able to add an invoice details in it, and if it's...

Introduction We are seeking proposals from experienced web scraping and data analysis firms to conduct a comprehensive data collection and analysis project. The purpose of this project is to gather detailed information on menu items, pricing, customer ratings, promotions, and deals from various food delivery mobile apps operating within our city. The goal is to mine this data for actionable insights to inform our advertising, promotional strategies, and competitive benchmarking. 2. Project Scope The selected vendor will be responsible for developing and implementing a solution to: • Subscribe to and navigate through multiple food delivery mobile apps. • Collect data on menu items including descriptions, pricing, customer ratings, and associated promotions or deals....

...required data and compile it into an Excel file with separate sheets for doctors' information and disease descriptions. Requirements: Programming Language: Preferably Python. Libraries: Experience with web scraping libraries like BeautifulSoup, Selenium, and data processing libraries like Pandas. Output Format: Ability to export data into an Excel file using Pandas or similar libraries. Error Handling: Robust error handling to manage failed requests and parsing errors. Compliance: Adherence to the websites' terms of service and rate limits to avoid being blocked. Project Scope: Input: A list of CRM numbers and a list of CID numbers. Process: Automate the lookup and data extraction process. Output: An Excel file with the compiled data. Skills Requir...

...person within each company. This could be anywhere between 10 to 30 people per company. - The information should be accurate and up to date. - If you have a strategy for obtaining this data, please share it in your bid. Skills/Experience: - Strong research skills - Data entry and data mining expertise - Proficient in Saudi Arabian business landscape - Attention to detail and accuracy - Web scraping - Web search - Leads Results should be in an excel sheet format, outlining the name, position, email address for each contact. Contacts for each company should be grouped together, end file should be in 1 sheet, not separate sheets. Send me: 1- Your strategy in finding those companies and collecting names and emails of relevant employees, 2- Total number of expected V...

I'm in need of converting a short story of roughly 180 words into Universal Networking Language (UNL). This conversion is for linguistic research purposes. You'd ideally also provide a recommendation on how to use UNLarium, or any other websits, to verify the accuracy of the UNL rendition. Suitable freelancers would have: - Intermediate fluency in UNL - Familiarity with UNLarium and UNL system - Proven accuracy in their work Please note the quality of the conversion is important for my project. I'm looking forward to fruitful collaborations!

Please Sign Up or Login to see details.

Job Title: Copywriter Needed for Transcribing Storybook into Word Document Description: We are seeking a skilled copywriter to transcribe a storybook into a Word document. The job involves typing out the entire content of a storybook into a digital format. The storybook is approximately 100 pages long and contains a mix of text and illustrations. Responsibilities: - Type out the entire content of the storybook into a Word document. - Ensure accurate transcription of text, including proper formatting and punctuation. - Maintain consistency with the original text and illustrations. - Complete the task within the specified deadline of 1 day. Requirements: - Proficiency in English language and grammar. - Excellent typing speed and accuracy. - Experience in copywr...

I require an advanced database to streamline church operations. It must include: - Member management: This involves recording personal details of each member, tracking attendance, and allocating to the right departments. Each member's record should also include household and family details, with specific fields for spouse and children. - Functionalities: Capacity to sort data based on each individual (organize by member). It should also capture other input fields like gender, age, membership status, notes, and whether they serve as workers or ministers. - Financial management: The platform should have capabilities for recording and tracking financial contributions. Ideal freelancers will have experience in building similar database systems, with a keen understanding ...

I need a professional to scrape names and email addresses from specific public websites. I'm looking to populate a database with details from a range of public websites. This data will be used for lead generation and market research purposes. Ideal skills and experience: - Proficient in web scraping - Familiar with public data extraction - Able to structure data effectively

I am looking for someone to Add Products to our laced store.

I'm in need of a professional who can convert both scanned documents and photos into simple data in Excel format (language is not in English workable when one can use translate and understand the few terms that are there). The ideal candidate will have the following skills and experience: - Proficient with MS office - Expert in handling MS Excel - Ability to follow a specific Excel template provided - Attention to detail to ensure accurate data entry ***The task is very simple and just requires attention to detail. I need mainly 4 Data Rows: 1. Date 2. Payor/Payee 3. Amount 4. Short Description of Transaction (if given in the doc) Please message me to talk about the project and the realistic bid price per Job. Your responsibility would be to ensure that the scanned fil...

I need to Extract followers of group members of the link I will provide

I am looking for a web-scraping expert to retrieve both images and text from a specific website for research purposes. The text data will need to be structured and saved in a CSV file, including paths to saved images. Key details to consider: - Knowledge of web scraping tools and techniques is essential to accomplish this task. - Quality control to ensure accurate data extraction and image quality is critical. - Structure page information and freeform descriptions should be made available in a CSV file. - The images should be saved in their original resolution and quality settings. Please provide any relevant experience you have in web scraping, including free and paid services you have used before to help with your work. I would like the proj...

I need a professional who can help me with scraping data API from a specific website or platform. I'm looking to extract specific data points or information and potentially set up a regular scraping process. Key Requirements: - Proficiency in Web Scraping: I need someone who has experience with web scraping tools and techniques. - Data Mining Skills: The ability to identify and extract the specific data points I require is crucial. - Automation Expertise: If you have experience setting up automated scraping processes, that would be a huge advantage.

Want to extract a list of profiles including name, country, city, email, phone numbers, link to profile for a list of followers for total output should be around 100K profiles that will be used to feed meta audience (customer list)

Job Title: Copywriter Needed for Transcribing Storybook into Word Document Description: We are seeking a skilled copywriter to transcribe a storybook into a Word document. The job involves typing out the entire content of a storybook into a digital format. The storybook is approximately 100 pages long and contains a mix of text and illustrations. Responsibilities: - Type out the entire content of the storybook into a Word document. - Ensure accurate transcription of text, including proper formatting and punctuation. - Maintain consistency with the original text and illustrations. - Complete the task within the specified deadline of 1 day. Requirements: - Proficiency in English language and grammar. - Excellent typing speed and accuracy. - Experience in copywr...

I am looking for a skilled Elasticsearch expert to help with data indexing and analysis for a large dataset. The data to be indexed is primarily textual and it is sourced from database entries. Experience with database management and textual data analysis is a crucial requirement for this project. The primary tasks include: - Analyzing and indexing a large dataset from database entries - Setting up Elasticsearch for efficient data analysis - Implementing indexing strategies for textual data Proficiency in Elasticsearch, data indexing, and database management is benefit for this project. Familiarity with handling large datasets and textual data is a must.

I'm seeking a data entry specialist with a knack for precision to type data from PDFs into an online database. Key Requirements: - As a data entry specialist, you will be responsible for the accurate and timely entry of data from PDFs into our online database. - The data format should match the original PDFs, with no specific validation rules needed. - The ideal candidate will be detail-oriented, with a proven track record of data entry. If you're someone who enjoys working with data and has an eye for detail, this could be an ideal project for you.

...but it's not functioning as expected. I need a developer to address these issues, described below. - **Issue Description**: The script is crashing when scraping certain Telegram groups, which is likely due to the fact that it's not respecting selections. The error presented is “ AttributeError: 'MessageMediaWebPage' object has no attribute 'document'” I can provide the script if you want to check how it’s working. I am open to a whole new script being made. So long as it functions in a similar way. If not familiar you can view telethon api - **Expected Behavior**: The scraping script is supposed to collect data that matches specific regex patterns. This means that it's not just supposed to collect all messages or o...

I ...need the below mentioned details of first 100 apps shown in the search result. Key Project Details: - I require the script to scrape app names, descriptions, emails, download counts, and URL of the app. - The scraped data should be compiled into an Excel spreadsheet format for my review and analysis. - deploy the script into my server The Ideal Freelancer: - Proficient in web scraping tools and techniques - Experience working with Google Play store data - Competent in automating data extraction and processing - Ability to deliver a reliable, daily scraping solution - python experts, node.js experts If you think you're the right person for this job, please get in touch with your relevant experience and a brief overview of your proposed approa...

We are seeking a talented and experienced UI/UX designer to help us seamlessly integrate our brand identity into a pre-existing website template we have purchased. This project involves implementing our brand colors, fonts, and visual elements to create a cohesive and compelling design. Project Overview: • Objective: To incorporate our brand identity into an existing website template with minimal changes, ensuring a simple and efficient development process. • Scope: The project will include updating page colors, fonts, and images to reflect our brand. The template will remain largely unchanged to maintain development simplicity. • Deliverables: A visually appealing website that aligns with our brand identity, using both vector and image overlays where appropri...

I'm on the hunt for a skillful coder proficient in web scraping, specifically for Website A. The goal of this project is for obtaining valuable and significant data for analysis, competitive intelligence, and price comparison. While there's no explicit mention of the type of data to be scraped, I anticipate that a capable offering will cater to a variety of needs such as: - Text content - Image content - Metadata Ideal Experience and Skills: - Proven experience with web scraping - High proficiency in handling large data sets - Comfort in navigating Website A - Ability to collect comprehensive data categories Looking forward to a potential collaboration to achieve this goal!

I need a developer to help me create an automated web scraper. - This scraper should be able to operate on multiple websites. The ideal candidate should have experience in web scraping, data extraction, and automation. The ability to adapt to different types of data and websites is essential. Thank you

We are seeking a skilled developer or development team to create a comprehensive web crawler system. This system should scrape, structure, and update information from web pages, handle large projects, and be accessible via a powerful API. The system should offer user-friendly features for both individuals and businesses and include flexible user management for both customers and employees. Project Requirements 1. Web Crawling and Data Extraction -Develop a system capable of scraping entire websites and extracting data from each page. -The system should divide the scraped information into sections to facilitate easy reading and understanding. -For e-commerce sites, the system should identify and structure the following information: --Product category (inc...

Build an ISO for a raspberry pi (with cellular notecard) to scan for unique cell phones in a specific range and log the unique phone ID and timestamps/ping (distance) from the raspberry pi and store in mysql database using cellular adapter.

Hi, I need the following scraped. You can use scraping software or script. YellowPages might be the easiest - law firms and lawyers - only name and email - Colorado, USA

I need historical stock prices and income statement data, deliver python script to collect this data for an arbitrary stock from google finance.

Hello, This is a $20 project. Looking for a freelancer to develop a python script to retrieve restaurant data from Google Maps using the Maps/Places API. The script should target restaurants that have a phone number and *do not* have a website. The inputs I need to enter are: - Location (latitude and longitude) - Search Radius (in meters) - Ensure the business/place is a restaurant, bakery, etc. Key Data to Retrieve, output in a .CSV: - Business Name - Address - Phone Number - Google Maps URL Thank you, trooper501

I'm in need of a skilled professional to help me create a data mining script. The task involves mining emails, data from a certain website and delivering the data in...and delivering the data in a raw text file format. Key Requirements: - Develop a data miner script that can effectively scrape email data from websites. - Ensure the script can handle multiple sources and is scalable for future needs. - Deliver the mined data in a raw text file format. Ideal Skills: - Proficiency in web scraping and data mining techniques. - Experience with developing scripts for text data mining. - Strong knowledge of scripting languages suitable for scraping like Python/BeautifulSoup, R, etc. Please provide samples of your previous similar projects or portfolio that demonstra...

I'm looking for an Indian Python developer to create a script that can retrieve specific data from Telegram. Key Points: - The script should be able to fetch phone numbers and migration of users from Telegram. The ideal candidate should: - Have a strong background in Python development - Be familiar with working with API's - Have experience in web scraping - Have a good understanding of data privacy and security - Be able to deliver the project on a monthly basis. Looking forward to hearing from Python developers with relevant experience.

...complete but due to some error while connecting to the database some code is missing and the connection is not completed. You have to find out where the problem is and fix it properly. I will help you in everything ******* I'm seeking a skilled PHP developer to assist with a project that involves fixing a PHP file and combining a Php ,MySQL database. The main tasks for this project include: - Resolving a database connection issue in the PHP file. - Combining the MySQL database in the backend of the PHP file. Your role will be crucial in ensuring that the database is correctly integrated into the PHP file and that the database connection is stable and error-free. The PHP file should be able to successfully communicate with the ...

I am looking for a developer who can build me a SaaS app that will transform AI-generated text into undetectable AI text. The app should include three modules: AI Humanizer, AI Detector, and AI Generator. AI Humanizer: This module will convert AI-generated text to undetectable AI text that can bypass AI detectors like Originality AI, Undetectable AI, GPTZero, ZeroGPT, and Turnitin. It would also ensure that the transformed text maintains the original meaning and context while appearing human-written. AI Detector: This module will detect if the text given by the user is AI generated or not. AI Generator: This module will be used by user to produce high-quality, undetectable AI-generated content, such as essays and articles. Please bid only if you have extensive knowledge of Larg...

I'm looking for someone who can...for someone who can create a WordPress plugin for scraping manga websites. Plugin Requirements: 1. Grab per chapter by link. 2. Grab full chapter by link. 3. Grab new manga by link. 4. Compatible with various manga themes. 5. Images from the scraped content should be uploaded to s3 storage. 6. Must have 10 sources for scraping (with a guarantee that if one source fails or the website goes down, it can switch to another source). Usage Flow: 1. I create a manga post and fill in the manga link in the metabox. 2. The plugin will automatically fill in the chapter links, scrape HTML images, and create posts. It will also automatically fill in the chapter number and the manga post ID number based on the manga link. Note: Speed during sc...

...creating an ER diagram, relational schema, database dump, SQL files, and queries for a library database system. Requirements: - ER Diagram: An ER diagram is required with rationalities similar to the example provided in this link: - Relational Schema: Develop a relational schema that effectively models the database. - Database Dump: Provide a database dump for the system. - SQL Files and Queries: The project should include a set of SQL files and queries that effectively interact with the database. - Managerial Queries: Develop a minimum of 20 managerial queries that will be used to analyze and manage the library database. Deadline: This project must be completed by Monday. Ideal Skills: - Proficiency in database design and SQ...

...complex backend development and database integration tasks and run code as offline. Key Responsibilities: Develop, test, and maintain robust, scalable, high-quality software solutions. Design and implement new features and functionality. Write clean, maintainable, and efficient code. Develop RESTful APIs to support front-end functionality. Integrate user-facing elements developed by front-end developers with server-side logic. - In-depth understanding and experience of backend operations using Python Django. - Managing and integration of the database with the application. - Maintenance and improvement of existing codebase for optimal functionality. Desirable Skills: - Proven experience in Python Django for backend development. - Hands-on experience in database ...

I'm in need of a professional who can consistently extract data from a specific website on a daily basis. Key Requirements: - Data Extraction: Extracting various forms of data from a website. - Ongoing basis: This is not a one-time job. I'm looking for long-term cooperation, with the extraction ideally happening on a daily schedule. Ideal Skills and Experience: - Web Scraping: Proficiency in web scraping tools and techniques is a must. - Automation: Experience with automating the extraction process to make it efficient. - Consistency: Ability to maintain a daily extraction schedule accurately is crucial. Please include in your bid how you plan to approach this sort of ongoing data extraction.

I've compiled a comprehensive global leads database with 8 million entries. The database includes a variety of details such as name, email, contact number, website, profession, and even Instagram username. - **Purpose**: This database is specifically designed for sales leads generation. It's meant to help businesses and organizations reach out to potential customers and grow their sales. - **Categorization**: The leads are not just categorized by one specific filter. Instead, they're a mix of different categories from various industries, countries, and professions. This eclectic mix provides a wide range of opportunities for potential buyers. - **Delivery Method**: I'm looking to sell this database through a CSV file, online access to the...

I need a professional who can extract data from a website on a daily basis. Key Responsibilities: - Extracting data from a specified website - Ensuring the data is accurate and up to date - Delivering the data in a specified format Skills and Experience: - Proficient in web scraping and data extraction - Experience in automating data extraction processes - Ability to maintain data accuracy and consistency - Knowledge of relevant data formats for delivery - Strong attention to detail and reliability This is an ongoing project, and I need someone who can commit to daily extractions. Be sure to include relevant experience in your bid.

Commercial real estate agency database of GCC

About Plesk hosting upgrading the database from MariaDB 10.1 to 10.3 i would like to upgrade the database from MariaDB 10.1 to 10.3 for my hosting however, my hosting have a lot of client website in it, just would like to know if this upgrade will not affect the existing database thanks

...that the software is designed to run on Windows OS. Website Accessibility: - Restricted access: Websites that require restricted access or login should be identified and reported separately. The software should skip such pages and indicate them as inaccessible. Ideal candidates should possess: - Proficiency in software development and experience in creating similar tools. - Familiarity with web scraping, data extraction, and bulk processing. - Prior experience in creating Windows-compatible software. - Strong attention to detail and the ability to accurately handle and report inaccessible URLs. As the client, I am open to the choice of programming language(s), as the final product is more important to me. The primary goal is to have a reliable and efficient tool that c...

Self Managed Home Care Providers Database

...of organizations. The ideal freelancer for this project should have: - Experience in web scraping, particularly with LinkedIn data - Ability to extract data at scale - Proficiency in organizing and structuring data for clear analysis - Strong attention to detail to ensure data accuracy The project involves: - Using the provided list of target companies to source employees' data - Identifying individuals who have previously worked at the provided specific companies - Compiling the data in a spreadsheet format for delivery The successful applicant should not only have the required technical skills but also the capability to deliver quality and timely results. Please showcase your experience in web scraping and the relevant tools you intend to use to ens...

I'm seeking a data entry specialist with a knack for precision to type data from PDFs into an online database. Key Requirements: - As a data entry specialist, you will be responsible for the accurate and timely entry of data from PDFs into our online database. - The data format should match the original PDFs, with no specific validation rules needed. - The ideal candidate will be detail-oriented, with a proven track record of data entry. If you're someone who enjoys working with data and has an eye for detail, this could be an ideal project for you.

I'm looking to create a comprehensive database of self-managed home care providers in Queensland and Australia to facilitate networking within the industry. Key requirements: - The database should include the provider's: - Name - Address - Email - Prime contact Ideal skills for this project: - Proficiency in data collection and database creation - Familiarity with the home care industry in Queensland and Australia - Organizational skills, to categorize the data by region - Excellent attention to detail, ensuring accuracy in information provided The data should be organized by region for easier networking. I may also require the database to be updated periodically. The collected information should be reliable, up-to-date, and include a diver...

I am in need of someone who can help me gather email addresses, websites, and phone numbers from the links in the attached spreadsheet. It's crucial that the information you provide is accurate and up-to-date. The test of accuracy will be me sending emails and verifying the company. Any wrong details will need to be collected again unless it is beyond your control (e.g. company has closed down etc.) Automated collection will be erroneous as the data needs to be collected in the following way. use the company names or links from the attached spreadsheet. 2. To copy and paste the company name + UK in the Google search box. The company's operation must be based in the UK as similar names may exist in US as well. 3. Or to click company logo and collect its email addresses, websit...

I need a Python developer to create a bot that scrapes data from APIs on an hourly basis. - The bot's primary function is to scrape data - The data will be sourced from APIs - The bot needs to run on an hourly basis Ideal candidate: - Proficient in Python and API data scraping - Familiarity with creating bots - Able to ensure smooth hourly operation, possibly using a scheduling library such as APScheduler

Description: We are seeking a skilled freelancer to integrate social media login functionality into our WordPress website for users, utilizing the PeepSo theme with integrated plugins. The task involves creating developer accounts, obtaining API access, and remotely installing keys and APIs. Please note that admin access will not be provided; all installation must be performed remotely. Deliverables: - Developer accounts created & validated on selected social media platforms. - API access keys and tokens securely generated and stored. - Integrated social media login functionality on the WordPress website. Additional Information: The freelancer will be required to have expertise in WordPress development, PHP, and API integration. Familiarity with PeepSo theme and social med...