Data scraping linuxpekerjaan

I'm seeking a professional who can develop a web scraping tool with the following specifications: - The tool should be able to scrape text content from a specific website. - It will need to log in to the website in order to access the data. - The data should be extracted in real-time, meaning that the scraping should be continuous and up-to-date. Ideal candidates should have: - Proficiency in web scraping tools and techniques - Experience in developing real-time data extraction tools - Familiarity with log-in processes in web scrapers - Ability to work efficiently and deliver on time If you have the skills and experience required for this project, please get in touch. Thank you.

I am in need of a networking expert proficient in Squid Proxy and Linux. The task involves creating a script that automatically turns a vps with a subnet into a residential proxy pool It's an ideal project for a developer who's well acquainted with Squid Proxy, understands network firewall setup, and has experience in dealing with Linux-based VPS. Running networking diagnostics would also come in handy as the task may involve troubleshooting any potential connectivity issues that may arise during setup.

I'm in need of a professional to help generate a list of highly accurate and verified telephone numbers for marketing purposes. The ideal freelancer will have experience with web scraping and be able to deliver a high volume of numbers with high accuracy. Key deliverables: - Extracting telephone numbers from websites of businesses in the UK which could be open to a new website - Ensuring the numbers are accurate and verified for marketing purposes. Ideal freelancer skills: - Proficient in web scraping - Strong attention to detail - Experience with marketing data Please only bid if you can provide concrete evidence of similar past work.

I need a proficient Linux systems administrator to help install and configure LibreNMS on my Linux system primarily for Network Monitoring. Key Requirements: - Install LibreNMS on a Linux platform - Configure LibreNMS for optimal Network Monitoring - Set up monitoring of Virtual Machines Important Skills: - Expertise in Linux system administration - Familiarity with LibreNMS and its Network Monitoring functionality - Experience with monitoring Virtual Machines.

I am in need of an individual with strong data collection skills, particularly in the area of web scraping. The job entails extracting text data from a certain selection of websites for me. My key focus is the content of various articles present on these sites. Ideal candidates should: - Have experience in web scraping for article content - Be meticulous in collecting data to ensure no valuable information is missed - Have a strong attention to detail to maintain the quality of collected data - Be capable of maintaining the confidentiality and integrity of the information collected To jumpstart, please provide your experience with similar projects and your available start date.

...to deliver a solution capable of scraping specific data from websites like and Makemytrip. The chief aim is to collate the room type and rates, along with rates applicable for specific dates. Ideal Skills and Experience: - Extensive Python programming skills, particularly in web scraping - Prior experience with data extraction from travel or hotel booking websites - Familiarity with various data extraction techniques and handling dynamic web content Your role will involve programming a robust and efficient scraper that can collect and deliver the desired data in a structured format. Familiarity with and adherence to legal and ethical aspects of data scraping is necessary. Efficiency in output delivery and importantly, minimal...

Scraping : - mets tout les images dans un fihier .zip - scrap le contenu du site comme dans le fichier csv

I'm in need of an experienced email marketing and web scraping professional to help me generate quality leads through email campaigns. - The primary goal of this project is to generate leads for my business. - The ideal candidate should have a track record of successful lead generation through email campaigns. - Additionally, I need someone who can scrape the web to find relevant email addresses of potential leads. You must have Good English and most importantly manage the whole process from start to finish outside of us reply to leads generated. This will mean you need to be able to scrape websites in Ireland like directories/maps etc and Linkedln. Generate marketing lists of each niche and setup emails to contact relevant niche. You must have or recommend bulk sending p...

I'm seeking a skilled server administrator to help with the general maintenance and smooth operation of my Linux server (CPanel). Key Tasks: - Server Security: This is a top priority. I need the freelancer to ensure that the server is secure, and all necessary security measures are in place. - Monitoring and Backups: Regular monitoring of the server's performance and creating a backup plan. - Software Installations and Updates: Installing necessary software and ensuring that everything is up-to-date. - Migrations - Accounts setup and transfer - Reports: Providing regular reports on the server's health and performance. The ideal candidate should have: - Proficient experience with Linux server administration. - Strong background in server security. - Expert...

I need a proficient data miner to help me extract student leads from the following websites - , college , , , mbauniverse.com. Key Information to Extract: - Student contact numbers As I require this data urgently, a prompt turnaround time is essential. Freelancers should possess the following skills and experience: - Expertise in web scraping - Familiarity with the aforementioned websites - Can deliver a high level of accuracy - Can ensure data is categorized correctly. Applications from freelancers who can demonstrate past experience in similar projects will be looked upon favorably. Immediate availability is preferred due to the urgent nature of this project.

...proficient freelancer with a strong background in data scraping from LinkedIn, various social media platforms, and websites. The objective of this project involves harvesting old leads interested in job-oriented training courses in areas such as programming, digital marketing, business, and finance. The skillset and experience required include: - Excellent knowledge of data scraping techniques - Familiarity with LinkedIn, and other social media platforms for data extraction - A good understanding of programming courses, digital marketing, business, and finance topics The targeted audience for these training courses are students, working professionals, and entrepreneurs. I am expecting high-quality leads, so experience in targeted scraping is a...

I am in need of a proficient freelancer who can scrape image data effectively. This project involves: - Scraping image content efficiently from various types of websites. - No particular specification was given about the type of websites to scrape from, so flexibility in handling different sites is essential. - The timeline for project completion was not specified, suggesting flexibility in delivery time, although efficiency and promptness are always appreciated. Ideal Skills: - Proficiency in data scraping - Ability to handle varying website formats - Strong work ethic and punctuality in project completion - Attention to detail when scraping images.

...is experienced in installing and configuring CKAN on a Linux operating system. Specifically, expertise is needed in the following areas: - CKAN installation on AWS Linux - CKAN , datastore and datapusher and other plugins configuration, focussed on data storage features - Provision of necessary documentation to guide me through maintenance Please note that while this project does not require ongoing post-installation support, the hired professional should ensure smooth functioning of the system and resolve any issues promptly during the initial setup. Ideal candidates should have: - Strong background in working with python and CKAN - Proven experience with configuring CKAN for data storage - Excellent troubleshooting skills in a Linux environment ...

Hi, The task is to scrape a pdf that is downloaded on website. Steps: 1. Go to website 2. Enter code in search and click search. (We provide list code) 3. On the results page Click on pdf document and open or download it 4. Extract 14 pieces of data from the PDF and export into excel sheet. There are about 150.000. Some codes do not have any data then skip. I have attached a word document with pictures and flow for you to review. Thanks!

I'm looking for a skilled developer to build me a web scraper for the Kumon UK website. The scraping needs to be able to: - Extract the names of tutors - Retrieve their addresses - Fetch contact information like phone numbers or email addresses The scraping process should be set to run just once, and must be accurate and reliable. The data should be presented in a structured format, ideally a XLSX file. Please provide an overview of your experience with web scraping and any similar projects you've worked on.

Hey everyone, i search someone who can do a task for my existing Wordpress Website. Actually i scrap every morning the data from soccer results from a website with WINHTTRACK and upload this to my website. Now i need automation. - Data Scraping from other website to my website - Data Refresh every Day 7 o'clock - 1:1 Copy with Design and my login - Only 3 Site ! I provide wordpress test access. On This access u can build a scraping automation. I can migrate myself. THANKS :)

...preferably with recognized companies. Proficiency with various cybersecurity tools and programming languages. Expertise in identifying and mitigating risks, threats, and vulnerabilities. Technical Skills: Hands-on experience with Security Information and Event Management (SIEM) tools. Proficiency in Python, Linux, and SQL. Knowledge of CIA Triad, governance, risk analysis, compliance, and business continuity planning. Familiarity with Linux and Windows server configuration, Active Directory, network architecture, operations, and security. Experience in areas such as Wireshark, email security, wireless security, cryptography, port scanning, cloud security, and virtualization. Proficiency with tools like Splunk, Burp Suite, Metasp...

I'm looking for a tool or app to scrape specific data from car rental websites. Key Features & Requirements: - Targeted Websites: Avis, Budget, Sixt - Data to Scrape: - Pricing information - Car specifications - Add-on options - Total after tax and fees - Maximum rental period 330 days for Avis/Budget (Sixt 365 days) Additional Info: - The tool should be capable of automating the scraping process at regular intervals. - Data should be well-organized and easily exportable for further analysis. - The goal is to find deals and or pricing errors for specific vehicles Ideal Freelancer: - Prior experience working on web scraping projects is a must. - Proficiency in data analysis and presentation. - Strong understanding of car ...

I'm in need of a skilled website scraper to collect pricing information from various technology product websites. The specific websites aren't yet defined, providing opportunity f...scraper to collect pricing information from various technology product websites. The specific websites aren't yet defined, providing opportunity for shared direction and collaboration. Key Tasks & Experience Required: - Data scraping expertise - Familiarity with technology product websites - Proficient in data extraction tools - Experience in data cleansing and categorization - Expertise in populating website with extracted information Your role will be central in aiding price comparison capabilities, making this an ideal project for those experienced in intell...

Scrape license data from the FL DBPR website and deliver into an excel spreadsheet. Two counties: Osceola and Polk. Two license types: Vacation Rental - Dwelling and Vacation Rental - Condo. In the attached spreadsheet the required fields to identify the license type and county are shown in screenshots and the second tab as an example. The extracted data is then to put into tabs for each county and license type. Multiple rental locations for a primary name should have multiple entries (rows) with the license details repeated and only the rental location being different each row. There maybe some dynamic features in the website that complicates data extraction. Website:

I am in need of a skilled Linux and Bash Script expert to help me with my current project. Although I haven't specified exact tasks or goals, I am seeking assistance in the following areas: - Linux installation and configuration - Bash scripting and automation - Troubleshooting and debugging I expect the successful freelancer to have a deep understanding of Linux systems and be proficient in Bash scripting. Your past work and experience in similar projects will be valuable. Please detail how you can assist and your approach in your application. Thank you.

I need an experienced data scraper to extract specific financial information from the NASDAQ and HKEX stock markets. Your task will be to focus on: - Stock prices - Company financials - Last 5 Years ROE - Last 5 Years EPS - NAV - P/E Ratio - P/B Ratio -Net Cash Flow Other economic indicators(US & HK) -Interest rate -Unemployment rate -Inflation rate The ideal freelancer for this job should have experience in data scraping and familiarity with financial data. The requirements involve pulling data from the past five years. All data should be delivered in a CSV file format. The ability to achieve high-accuracy and precision in data extraction is critical for this role.

...Freelancers with no rating need not apply. Generic copy-paste responses will be marked as spam. Your past freelance feedback should clearly show that you have completed similar tasks. I require a specialist in web scraping to extract the body text from articles on Google News. The information will be earmarked for natural language processing, hence, accuracy of extraction and correct formatting into an excel file is of utmost importance. Key responsibilities and skills: - Experience in web scraping, specifically from news websites. - Knowledge of creating Python or PHP scraping scripts or using API. - Ability to deliver results fast, as the project needs to be completed ASAP. Please note that the sole requirement is to extract the body of the news articles with...

...skilled Linux server administrator to help with the following issues: - **MySQL Configuration**: I'm encountering error messages related to MySQL. The freelancer must be able to diagnose the issue and provide an effective solution. - **SSH Troubleshooting**: There are connection issues with SSH. The hired professional should be able to identify the root cause and resolve it promptly. - **cPanel Account Missing**: Currently, some cPanel accounts are not showing. The task involves investigating and rectifying the issue. - **Service Stoppage**: Some important services have stopped working. The ideal candidate should have experience with Linux administration and be able to troubleshoot and restart these services effectively. Ideal skills and experience include: - Pr...

I need an Excel 365 PowerQuery script that can fetch daily market data and handle potential data source interruptions or changes. I will be providing a URL that contains the market data, and you'll need to replicate the Google Sheets function =INDEX(IMPORTXML("" & C31, "//span[@class='mod-ui-data-list__value']"), 1, 1). This function provides real-time data from the specified URL. Please note that the data is structured using HTML tags. Key requirements: - The PowerQuery should be able to be refreshed with the google sheet. - It needs to include robust error handling. If the data source is unavailable or the structure changes, the PowerQuery should not break but continue to function, ideally providing...

I'm in need of a Node.js developer with a solid background in web scraping. If you've got experience in this area, I'd like to hear from you to discuss the specifics of the job. Key Requirements: - Proficient in Node.js - Experienced in web scraping - Ability to understand and implement scraping requirements - Good communicator Looking forward to hearing from you.

I'm seeking a skilled professional to migrate an existing Odoo 13 instance from a Linux server to a virtual environment while maintaining the same Odoo version.

hi I'd need you again for a scraping job, please reply soon thanks

I'm in need of a skilled Nginx expert to help me configure a server for my applicati...key details about the project are as follows: - I'm looking to implement Load Balancing and SSL termination for my TCP traffic. - On the UDP side, I would like to have the server configured for Streaming Media and DNS Resolving. In addition, the Nginx should be set up on a Linux-based operating system. Ideal skills for this project include: - Proficiency in Nginx configuration and management - Strong understanding of TCP and UDP protocols - Experience with Load Balancing, SSL, Streaming Media and DNS - Linux server administration I'm open to suggestions for the best approach in setting up these features, so good communication and problem-solving skills are a plus. L...

I am in need of an expert developer to build a website capable of performing malware scans. While considering its functionality, I haven't yet decided how the scanner should operate, i.e., if it w...the scanner should operate, i.e., if it will scan files upon upload, on-demand, or conduct regular scheduled scans. However, this can be discussed further as we progress. I need you to give a basic guide and idea how it can work. Ideal skills for this project include: - Experience with building secure computing platforms - Knowledge of modern malware threats - Familiarity with Windows, Mac and Linux systems - Proficiency in web development Please note, I am looking to have this project completed as soon as possible. Therefore, applicants must be ready to commit to a rapid develo...

Tengo un servidor Linux, al enviar correos me indica, requiero mantenimiento SMTP Error (452): Failed to set sender "mymail" (4.3.1 Insufficient system storage).

I'm looking for a professional to scrape website content for market research purposes. Key Responsibilities: - Scrape content from specific websites Ideal Candidate: - Experience with web scraping tools - Proficient in data extraction and analysis - Able to deliver a detailed data set suitable for market research The project requires a one-time scrape and the data extracted should be relevant and comprehensive for market research purposes.

I am in need of expert help to scrape text data from specified websites. After the data has been collected, the next step is to clean the data, ensuring that it is in the appropriate format for use. The final output should be managed and stored in a Database Management System. The ideal freelancer for this project should have: - Proven experience in web scraping, specifically text data from websites - Advanced skills in data cleaning to ensure the data is usable and well-structured - Capabilities to manage and store the cleaned data into a Database Management System Please provide any relevant examples of previous work in web scraping and data cleaning and provide details about how you plan to carry out this project.

I need a web scraping expert to help me get data from a third-party search site. The project is urgent and needs to be completed ASAP. Key Requirements: - Skilled in web scraping techniques - Proficient with tools for scraping - Able to work under tight deadlines - Excellent communication skills Please note that the specific search site is not mentioned, but the task involves scraping information from it. If you have the experience and can work quickly, please reach out.

I require a freelancer who can unite a Django project with AWS Code Deploy on an EC2 instance operating under Linux. • This project involves AWS RDS management for our app's database. • This Django project configuration is based on multiple environments (Development, Staging, and Production), which must all be managed effectively. Ideal skills: - Proficient understanding of AWS services, specifically EC2 and RDS. - Strong experience with Github actions. - Extensive knowledge in Django project deployment in a multi-environment setup. This job demands effective coordination of Github actions with the AWS Code Deploy. Therefore, a background in similar projects will be beneficial.

I'm in need of a skilled professional to set up a multi-node GitLab environment on my Linux system. Key Points: - The project requires comprehensive experience with GitLab configuration and deployment on Linux. - The setup should be able to handle Continuous Integration/Continuous Deployment (CI/CD) and Source Code Management (SCM) efficiently. Ideal Skills: - Proven expertise in GitLab setup, particularly in multi-node scenarios. - Strong understanding of Linux systems and their configuration. Your successful completion of this project will enable me to streamline my development processes, manage code efficiently, and automate deployment pipelines. Please share your relevant experience when bidding.

Specification: Facebook-Web-Scraping and Web-Crawling Write Swift Code that prompts the user to give username and password This information is used to login to facebook and scrape facebook for facebook friends and extract the following information: - Name - Birthday and month and if available year - Gender This information should be made available in a JSON or XML format. The code will be embedded in an app. It is important that this web-scraping activity can run in the background of the app invisible to the user.

We are an innovative tech company embarking on the creation of SnipeOS, a custom Linux operating system designed to revolutionize user interaction and productivity through a tailored user experience. Project Overview: We are trying to build a custom Linux operating system. The desktop should be almost exactly as follows: , except the background image and start menu logo will need to be changed. We will use the XFCE desktop environment using Devil Luna. The start menu icon should, in fact, be the Snipe logo. We will provide relevant artwork. This setup will be the basis for how any user will experience the system. Its splash screen should state "SnipeOS" with our logo, replacing the typical Ubuntu splash screen, and should

I need an experienced PowerShell developer to create a script that logs me into , downloads today's menu, and displays it on a window. Requirements: - The script should log in to bosch.aramark.cz. - After logging in...download today's menu. - The menu should be displayed in a window. - The menu display should be in the format: "Number of menu : Text of menu" with each number on a separate line and menu text following it. - The menu number should be displayed before the text. Ideal Skillset: - Proficient in PowerShell scripting. - Familiarity with web scraping is preferred. - Good understanding of GUI development. - Experience in parsing and displaying structured data is a plus. Please ensure the script is user-friendly and efficient. A clean, simple in...

I'm searching for a skilled Python Django developer with proficiency in deploying websites on a shared hosting environment with cPanel. The main purpose of this website is to provide a platform for user interactions. Skills and Experience: - Proficient in Python Django for w...websites on a shared hosting environment with cPanel. The main purpose of this website is to provide a platform for user interactions. Skills and Experience: - Proficient in Python Django for website development - Experience in deploying websites on shared hosting with cPanel - Familiarity with Linux terminal is not necessary - Prior experience in projects involving user interaction platforms Key Task: - Deployment of a Django website on a shared hosting environment with cPanel, without the use of a ...

I'm in search of an experienced graphic designer to design a l...graphic designer to design a logo that fully encapsulates the identity of my data mining and scraping company, squrl.io. This project will require creativity to align the logo with the brand's modern tech essence. Your tasks will involve: - Creating a unique, eye-catching logo design - Ensuring the design matches with the identity of a technology startup in the data realm - Providing files suitable for websites, social media platforms, and databases Ideal skills and experience: - Proficiency in graphic design software - Previous experience in logo design - Knowledge about tech startup aesthetics and branding - The ability to align the logo with the purpose and spirit of , reflecting its dat...

It’s Urgent! We need to write a shell script It’s too simple and not more than 2-3 hours job if candidate is good at shell script. It’s a small project but if we are satisfied we will give you more project in future . You thave to automate these task , Now i am doing this manually ---------------------------------------------------------------------------------------------------------- have to accept the subdomain as input and from backup Activate 2. change the name of to 3. add the alias domain 4. Add the prt for and cname record for @ cloudfare , now i do manually 5. create the ssl for and have to do some sql sql command to change the Admin name , Instance name -- now i do manually 7. env file need to be updated 50% mile stone will be ...

I'm seeking a professional with deep experience in MySQL and Linux OS to carry out an installation. * Desired Proficiency and Experience: - Linux Operating System: You need to be familiar with Linux as the installation has to happen on this platform. - MySQl 5.7: The installation is specifically for MySQL 5.7 and you should have experience with this exact version. * Task Overview: - Install MySQL 5.7 on my Linux machine following the Development Machine Settings. * Configuration: - MySQL should be configured to run optimally on a development machine setting. - Your skills should extend to understanding the unique configuration needs of a development system and apply those effectively. Looking forward to your bids, please feel free to ask ...

I require an expert in Asterisk and FreeSWITCH development, along with experienced system engineering skills. Specifically, I need help with: - Asterisk and FreeSWITCH development - Integrating VoIP - Setting up Call routing and IVR (Int...experienced system engineering skills. Specifically, I need help with: - Asterisk and FreeSWITCH development - Integrating VoIP - Setting up Call routing and IVR (Interactive Voice Response) - CTI - Skill group base call routing to agents. Apart from these, the implementation of Asterisk and FreeSWITCH clustering as well as Call Center Reporting is required. The technology stack should be Linux, PHP, MySQL along with postgresql and API knowledge. The freelancer should have considerable experience in these to meet the project's specifi...

I need a thorough and capable freelancer to assist in data entry tasks. This project revolves around seeking out the contact details of companies provided by me. Key tasks will include: - Google each company name I provide - Gather relevant contact details such as phone numbers, email addresses, and the company's website As I am seeking information from a range of different companies without specific criteria, being detail-oriented and accurate will be crucial. Experience in data cleaning, analysis, and transcription would be advantageous. Understanding and utilization of web scraping techniques would also be beneficial.

...me with a data-oriented task. The project has two main aspects: - **Data Collection from Customer File**: The task involves searching for specific data (names and contact information, demographic information, purchase history) of customers on a sample customer file. The collected information will then be organized by customer name. - **Website Data Scraping**: In addition, the freelancer will be responsible for scraping data from a website. The main focus here will be customer data who use online payment methods. The specific data we're looking to extract is the 'Payment method'. This information will then be organized by customer name. **Ideal Skills and Experience:** - Strong data collection exper...

It’s Urgent! We need to write a shell script It’s too simple and not more than 2-3 hours job if candidate is good at shell script. It’s a small project but if we are satisfied we will give you more project in future . You thave to automate these task , Now i am doing this manually ---------------------------------------------------------------------------------------------------------- have to accept the subdomain as input and from backup Activate 2. change the name of to 3. add the alias domain 4. Add the prt for and cname record for @ cloudfare , now i do manually 5. create the ssl for and have to do some sql sql command to change the Admin name , Instance name -- now i do manually 7. env file need to be updated 50% mile stone will be ...

I require a professional data scraper, ideally with experience in handling image retrieval. The task will involve sourcing and scraping image data from various undisclosed sources. The type of images to be scraped has not been specified, providing an open spectrum for data collection. However, previous experience dealing with diverse image types is highly beneficial. The deadline for this project has not been outlined, indicating flexibility on the completion date. Ideal Skills: - Expertise in data scraping - Strong experience handling image data - Ability to source from various platforms - Flexibility with time management.

I need a Python code developed for vehicle route optimization. - The code should include 3 algorithms for route optimization. - Successful freelancers should include past work in the application. Ideal Skills: - Proficiency in Python - Experience in developing route optimization algorithms - Strong background in data analysis, web scraping, and machine learning, as these functionalities will be required in the project.

Hi, i need help in scraping an e-commerce website dropdown menu urls using jawa visual scraper. The e-commerce website: then i will be using puppeteer to scrape the menu urls for education propose. Only people with experience in this field will be accepted. Thank you.