Web scraping python projects githubpekerjaan

I am looking for a skilled developer or team to create a Python program designed for the efficient detection of surface defects on railway tracks. This tool is essential for ensuring the safety and operational efficiency of rail network covering high-speed and freight tracks. The program needs to be robust, capable of real-time defect detection and analysis, and capable of generating maintenance recommendations. Requirements: - Develop a Python program capable of converting video to images and image enhancement through filter and noise reduction. - It should capable of labeling of images and recognizing various surface defects including cracks, wear, corrosion, fractures, head-checks, wheel burns, rolling contact fatigue (RCF) defects, spells, squats, shelling, and flaking....

I am in need of a well-versed Python expert to assist in managing a Linux server. This project is task oriented and requires specific skills including: • Working with server data analysis • Implementing web scraping techniques • Establishing automation processes The role also demands a comprehensive understanding of Linux operations and the ability to print headers. A background in server security, setting up database servers and performance optimization would be ideal, but the focus is primarily on Linux server management via Python. Proficiency in Python, Linux, server data analysis and web scraping are must-haves. Experience in automation and server management will highly be appreciated. Looking forward to your knowledg...

I'm looking for a skilled professional to help me install the eBay API on my existing Ubuntu 22.04 server for the primary purpose of showing orders on webpage. here is the sdk - Key Responsibilities: - Installation of the eBay API on the Ubuntu 22.04 server. - Ensuring the API is correctly set up to show orders on webpage. Ideal Skills and Experience: - Proficiency in working with Ubuntu servers, particularly version 22.04. - Prior experience installing and configuring the eBay API. - Ability to implement API functionalities for showing orders on webpage. If you have a good understanding of eBay's API and are experienced in working with Ubuntu servers, I'd be interested in hearing from you. Please share your relevant experience and explain how

Input:- You will get an excel file as input. Step1- Sort the Excel file by site name and place data in sheet 1 Step2- Sort the Excel file by site address and place the data in sheet 2 Step3- Sort the Excel file by latlong and place the data in sheet 3. After Sorting and creating 3 different sheet, we need to apply the logic to find exact duplicate and high match. Example - means in sort by site name we will find exact duplicate and high match site(75%) match and print exact duplicate/ partial match. Then for exact duplicate and partially match we are going to compare all row and need to print what is matching like site city, site state, site country etc

...application for my AI-based predictive models. The primary task involves developing models for network bandwidth prediction and fault predictions. Key Features: - The GUI has to be web based. - The interface should be capable of efficiently managing input data, which will include historical synthesized network data & data that can be generated through Python's mockeries or any other similar library. The Ideal Candidate: - Profound experience in GUI development . - Strong understanding of predictive modeling control systems. - Familiarity with using historical network data and network fault data for AI models. - Python experience, specifically with DASH and Flask framework or any other, will be a significant plus. This project provides an excellent opportun...

I need a Terraform configuration to provision my EC2 resources on AWS. This configuration should allow me to deploy the EC2 instances and also bring-down when needed. Key Requirements: An EC2 instan...direct traffic allowed to the instance. A Bastion/jump server for SSH to EC2. EC2 connects to the internet using NAT-gateway. WAF to be integrated with ALB, and ALB only listens on HTTPS. Security groups are restricted with limited access. Allocate and associate an elastic IP to the instance. The EC2 instance will run Ubuntu and serve as application server. I can provide AMI image of the web-app. It is a Python FastAPI/Nginx app. No other service is needed like RDS or S3 etc. Docker or Kubernetes are not needed, and the app is not using any Databases. It is a Single Region Dep...

I'm looking for a Python script that uses PyAutoGUI to control keyboard inputs, with a specific focus on interacting with a Firefox web page. I would do it myself as its simple python. However, it needs to branch into two different output. 1 clicking certain buttons and then a Then a final enter button to refresh the webpage and get a new list of buttons to select. 2. The second branch does the same thing except that it pushes different bottons so the tab order is different. Having two outcomes makes the python code to difficult for me so that i why I need help. I will also have to fine tune the number of tabs after you give me the code. So branch one will have different tabs frequency than the other branch. The UI should reflect that. 3. Maybe ...

Sila Dafter atau Log masuk untuk melihat butiran.

LinkedIn profile matching and scraping

I'm looking to build a Flask Python serverless application. The main functionality of this app would revolve around API integration, specifically with social media platforms. The primary aim here is to fetch user data from these platforms. The ideal candidate for this job should have: - Profound experience with Flask Python - Prior experience in serverless architecture, particularly using AWS services such as API Gateway and Lambda - A strong understanding of social media API integration Please note that a comprehensive understanding of user data privacy and security is essential. The developer should be able to ensure that the data retrieved is used in accordance with the social media platforms' policies and regulations.

I'm looking for an experienced web scraper to access and download specific information and images from the Used Inventory section of the White Rock Honda website. Here are the specifics of what I need: - Car make and model - Year of the car - Price of the car For each car listing, I need ALL available images downloaded. Furthermore, I require the images in JPG format. Candidates applying should have successful experience in web scraping, data extraction, and handling myriad images. Efficiency and accuracy are critical for this project.

I'm currently seeking a skilled backend developer who has proven expertise in Python, Java, and Ruby. I need someone who can guide me through whether to use the current source code or start from scratch, a decision that we can make together as the project evolves. As our project's main responsibility is to handle authentication and server configuration, the perfect candidate should be experienced in: - Setting up, managing, and sustaining server configurations - Handling various authentication tasks - Expertise in Python, Java, and Ruby - Decision-making skills concerning source code development This project will be rewarding for someone who enjoys tackling unique challenges and has a flair for problem-solving. If you're up to the task, please don’t ...

Hello, I am currently looking for an excellent developer who is well versed in at least any one of the following fields: Java, C#, Golang, Rust, JavaScript, Python, solidity, web3, blockchain, web frontend and backend. Of course, he must be prepared to work with us long term, more than 40 hours per week. You must be geographically located in Europe or the Americas, be able to work at least 6 hours EST day time, and possess written/verbal English skills at an advanced level or higher. In order to select excellent talents, you will need to anticipate a 30-60 minute technical interview with a project manager in our team. Dont worry. We need at least 3 developers. Expected salary range is $15-$25/hr depends on experience. Please feel free to send us applications embroidered ...

I'm looking for an expert specialized in Computer Science (CS), Electrical Engineering (EE) and Mechanical Engineering (ME) to assist me with academic projects particularly focused on Power Systems with emphasis on Renewable Energy Integration. This will require: - Profound knowledge of Computer Science, Electrical and Mechanical Engineering concepts - Expertise in dealing with Power Systems, specifically Renewable Energy Integration into Power Systems - Tools Matlab, Python - Algorithms development Expect your assistance to be comprehensive, covering all bases to ensure outstanding outcomes. Your bid should demonstrate your expertise in these areas.

Looking for a skilled individual to undertake data scraping project. Key tasks will involve: - Focused on scraping 'Website 1' - Specific data requirement is 'price' - Data collection should be conducted periodically Ideal freelancers should be proficient in PHP, and have a track record in successful and ethical data scraping projects. Advise on suitable scraping schedule is appreciated. Efficiency and meticulous attention to detail are highly sought.

I am looking for a Python programmer with a math background (statistics) who can help calculate the optimal strategy and house edge for various permutations of a casino card game similar to blackjack.

...should contain data from the MySQL database, calculations or summaries of data, visualizations or charts, and be structured as a paginated report, using SQL language. The report should be designed to be accessed as a printable PDF document. It is not required to be interactive, as a static report is sufficient for my needs. Key Requirements: - Proficiency in Microsoft Access, MySQL, VBA, PDF, Python, and Excel - Competency in SQL language for data manipulation - Experience in designing paginated reports The ideal candidate should have a proven track record of creating similar reports, with the skills and knowledge necessary to work with the specified technologies. Your ability to deliver a professional, well-structured, and visually appealing report within the given framework...

I require a professional with a high level of expertise in web scraping and API integration to assist with a critical project. Here are the specifics of the project: - I need you to scrape data from , a website where we dropship our designer clothing products. - Specifically, I need the following details scraped: Product names, Product Colour, Product Sizes In Stock & Not in Stock, Product Prices (Only Black & Grey Pricing, not red sale price), and Search Key. - The scraped data should be automatically updated on a daily basis. - The scrapped data should be integrated into our Shopify store through an API bot. The ideal candidate should have a proven track record of working with similar projects and should be able to tailor the solution to our specific needs...

I need a python scraper that can copy ads from one classified ads website and post it to other website

...subject, and difficulty level: The extracted data should be categorized based on these parameters. This is crucial for our business as it will help us create a user-friendly interface for our educational platform. - Be able to build an extractor that can be run in a google collab notebook, using whatever packages required, even if large language models are needed. Ideal Skills: - Proficiency in Python - Familiarity with Large Language models for data extraction - Proficiency in data extraction from PDF files. - Strong understanding of JSON formats and data organization. - Attention to detail to ensure accurate categorization of content. This project is key for our business, and we're looking for a freelancer who can deliver high-quality, structured data extractor. If you h...

...work on anydesk/github for adding functions 2. INR 2000/project for rebranding+testing+fixing 2 Apps systems of codecanyon like professional apps. 3. INR3000/project for rebranding+testing+fixing 3 Apps system of codecanyon like food and grocery. 4. We work from 6PM till 4AM in the morning in IST, so devs can join us after their regular working hours. We are seeking professional, only individual devs (no teams, no groups, no companies, as we are already a company), who can speak and understand English and Hindi. All devs who join our team will get recurring projects from us depending on time available with them. Timely delivery for projects is very important, and hence pls do not join if you are already overloaded with existing work, to just waste time of our...

I need assistance in compiling a large, extensive database o...- Name and contact details - Education and qualifications - Current job title and company Interestingly, these professionals should spread across various industry sectors such as Technology and IT, Healthcare and Medicine, as well as Marketing and Advertising. Particular skills and experience that would set freelancers apart for this job include: - Proven experience in data mining and data scraping - Familiarity with the mentioned industry sectors - Ability to accurately cross-reference and verify data - Excellent attention to detail Freelancers with extensive experience in maintaining data integrity and confidentiality will be seriously considered. Successful completion of this project could lead to long-term coll...

...rifle range in NextJS which has 3 pages: 1. Home page 2. Contact page 3. Booking page The rifle range has 7 lanes, where users can book 1 lane at £20 per hour. Users can also hire a rifle for £5 and buy 100 pellets for £3.50. The colour scheme should use beige and dark green on a light background. The font should be Helvetica. The logo should be modelled after a simple rifle scope. It should use GitHub for version control and be deployable to Firebase for hosting. It should use Firestore if a database is required for anything. Preferably, it should be accessible, responsive, and use SEO. Analytics are not wanted and the website should be GDPR compliant. The home page should contain a Services section, Location section, and About section. Any content (such as...

...this project hasn't been specified, but the successful freelancer must be capable of performing high-quality data scrapings, potentially for lead generation, market research, or data analysis. As a dedicated data professional, you should have a strong background in web scraping, data extraction, and data analysis. Please be sure to include in your application: - Your previous experience and samples of past work - A detailed project proposal outlining your approach. Your proficiency in using software and tools for data scraping, knowledge of data protection laws, and understanding of various databases will make you a top contender for this project. Time management skills and meticulous attention to detail are also crucial. The goal is to efficiently and accura...

I'm looking for an experienced data scraper. I need someone with excellent knowledge and expertise in web scraping. I will need the following with regards to mid sized collectible stores around the world: Company Name City Country URL Contact person Email address. Ongoing work for the right candidate/s

I'm seeking a proven expert in Artificial Intelligence for an ambitious proj...Intelligence for an ambitious project. The primary goal is to develop a new AI-based solution focused on English speaking. Though technology or software experience wasn't specified, proficiency with prominent AI tech and software is anticipated. Ideal skills and experience: - Expertise in AI and software development - Experience in language processing AI - Proven success with similar AI projects - Familiarity with Python, TensorFlow, PyTorch etc. is desirable but not mandatory Your role will extend from ideation to implementation, ensuring optimal efficiency and innovating throughout the process. Results-driven, creative thinkers with a keen eye for detail are encouraged to bid. Let&#...

I am in need of a competent data engineer for a small-scale data analysis task. - The project primarily revolves around performing data analysis. - The ideal candidate should be proficient in data analysis techniques. - Prev...analysis task. - The project primarily revolves around performing data analysis. - The ideal candidate should be proficient in data analysis techniques. - Previous experience with data engineering will be a significant advantage. Your role will mainly involve performing data analysis tasks, so a deep understanding of data engineering and analysis is essential for this project. A strong background in Python, R, or SQL is highly preferred, though not mandatory. Please note that the project timeline is quite flexible, so you will have ample time to complete ...

I'm looking for a seasoned web developer to help me create a parent portal for a childcare booking system. This web-based application should effectively and efficiently allow parents to manage their bookings and communicate with the childcare staff. Key Features: - Online Booking: Parents should be able to make, alter, and cancel their bookings with ease. - Parent-Staff Communication: A communication portal that allows parents to directly liaise with the childcare staff. Skills and Experience: - Expertise in web-based application development. - A strong track record of creating user-friendly platforms. - Previous experience with booking systems or parent portal apps, a plus. --written in python

I am seeking an experienced Python professional to develop a system that can accurately detect fake invoices. The aim is to prevent financial losses and enhance security. Need to detect a submitted computer generated receipt in pdf if it is a tampered or real one. There are chances like in the computer generated bill some people can change the amount, name, address sections and submit. This model should able to detect all those tampered PDFs with minimum false positives. Do metadata analysis QR code reading in the receipt and validation Key Responsibilities: - Develop a fraud detection algorithm using Python. - Test and tune the model for maximum accuracy. Ideal Experience and Skills: - Proficient in Python programming. - Proven experience in creating algorithm...

I'm looking for a skilled Python and JavaScript developer to assist with front-end and back-end development for a website and web application I'm working on. Key Responsibilities: - Assist with the front-end development using JavaScript to create a user-friendly and interactive interface. - Work on the back-end development using Python to ensure seamless functionality and data processing. - Collaborate with me to achieve the overall goals of building a compelling website and web application. Ideal Skills: - Strong expertise in Python and JavaScript. - Experience in front-end development using JavaScript. - Proficient in back-end development using Python. - Ability to work collaboratively and communicate effectively.

I'm looking for a skilled Python developer with experience in natural language processing (NLP) and transformer models. The primary goal of this project is to guide a transformer model to generate code-mixed sentences. Specifically, we are targeting basic code-mixing complexity - inserting words from one language into another. Key Responsibilities: - Develop and fine-tune a transformer model for code-mixing at a basic level - Implement the model in a way that can generate code-mixed sentences effectively Ideal Skills and Experience: - Strong proficiency in Python programming - Proven experience with NLP and transformer models - Familiarity with code-mixing and its linguistic aspects would be a plus - Good understanding of basic code-mixing complexities - Ability to des...

I'm seeking a proven expert in Artificial Intelligence for an ambitious proj...Intelligence for an ambitious project. The primary goal is to develop a new AI-based solution focused on English speaking. Though technology or software experience wasn't specified, proficiency with prominent AI tech and software is anticipated. Ideal skills and experience: - Expertise in AI and software development - Experience in language processing AI - Proven success with similar AI projects - Familiarity with Python, TensorFlow, PyTorch etc. is desirable but not mandatory Your role will extend from ideation to implementation, ensuring optimal efficiency and innovating throughout the process. Results-driven, creative thinkers with a keen eye for detail are encouraged to bid. Let&#...

I am looking for a skilled programmer with experience in Odoo and Python to help me implement specific modules within the Odoo platform for a comprehensive ERP system. Your responsibilities will include: - Implementing features related to Sales and Purchase, Human Resources, Project Management, and Pre/After Calculations - Ensuring the modules are seamlessly integrated with one another - Customizing the modules to meet our business needs Ideal candidate will have: - Proven experience with Odoo and Python programming - A strong understanding of ERP systems and business processes - Ability to effectively communicate and collaborate with the team Please include samples of previous Odoo projects you have worked on, along with your proposal.

I'm looking for a Python expert who can assist me in building an algorithmic trading system. The focus is on trade execution, and I need the system to be compatible with Fyers and Kite trading platforms. Key Requirements: - Development of an algo trading system with a strong focus on execution - Integration with Fyers and Kite trading platforms - Ability to support both automated and manual trade execution Ideal Skills and Experience: - Proficiency in Python and relevant libraries for trading such as pandas, numpy, etc. - Previous experience in developing algo trading systems, particularly with a focus on trade execution - Familiarity with Fyers and Kite trading platforms - A solid understanding of both automated and manual trade execution in the context of algorithmi...

I need a skilled developer with extensive experience in Python and Solana to integrate my existing Python script with the Solana blockchain using Jito Validator. Key Tasks: - Integrating Solana with Python application - Using Jito Validator for the integration This is a time-sensitive project with an urgent deadline. I am looking for a professional who can dedicate their full attention to this task and deliver high-quality results within a short timeframe. Ideal Skills and Experience: - Extensive experience in Python - Proficiency in Solana blockchain development - Previous experience with Jito Validator, or the ability to quickly learn and adapt to it Please only apply if you have the necessary skills and are able to work on this project immediately. Than...

Generic replied will be rejected. You must have experience in Radix, Scraping Data and be able to create a script that will import directly into woocommerce. We need an experienced radix developer to perform data scraping tasks for our client. The fundamental requirements include: - Scraping data from a suppliers website - Data to be scraped includes textual content , pricing and metadata - Skilled in managing and maintaining the scraped data's quality and relevance This data then needs to be imported into a woocommerce site as a variable product. The ideal candidate should have: - Expertise in working with WooCommerce platform - Proficiency in radix software - Experience in data scraping and storing large volumes of data The scraped data should be ...

I need a Python expert to create a robust parser for extracting data from large JSON files, each exceeding 10 MB. Key Requirements: - Comprehensive knowledge of Python - Strong grasp of JSON data structures - Experience in handling and processing large data files - Familiarity with data extraction techniques The parser should be highly efficient and capable of managing substantial JSON files seamlessly, without compromising on the speed of execution. I value your expert advice on the most suitable Python libraries to use for optimal results.

Python Issue + Happy Hydro Vendor Collection

I need a developer experienced in AWS or Heroku and serverless architecture to deploy a web application from a public GitHub repo. My project requires: - In-depth understanding and hands-on experience with AWS, specifically in deploying web apps. - Strong skills and knowledge in serverless architecture. - Ability to handle code from a public GitHub repository and turn it into a functioning web app on AWS. - I need to take a public GitHub Repo and deploy it to integrate with a custom GPT. repo link : Your job is to ensure seamless deployment of the repo, maintaining its functionality throughout the process. Someone who has done this before and can show past work will be ideal.

I am in need of a proficient programmer with expertise in Python, Java, and JavaScript. The main goal of this project is to develop a mobile app pertaining to social networking. The perfect fit for this project will have the following expertise and experience: - Proficiency in Python, Java, and JavaScript - Extensive experience in mobile app development - Knowledge of the architectures, trends, and emerging technologies of social networking apps - Experience in building mobile apps with superb user experience and interface design The ultimate goal is creating a unique, user-friendly, interactive, and impressive social networking mobile app.

...project include: - Proficiency in Python: You will be working with a Python code base and dataset. Familiarity with Python is essential for this project. - Understanding of AST: You should be able to construct an AST tree based on the provided dataset and code base. - TensorFlow Experience: I would like the Autoencoder to be developed using TensorFlow, so prior experience with this framework is a must. - Output format: The desired output format for the Autoencoder is JSON, so you should be comfortable working with this format. This project is ideal for someone with a strong background in programming, machine learning, and deep learning, and it provides an opportunity to work on an interesting and challenging problem. Please provide examples of similar projects...

...Element Method (FEM) analysis on a non-linear structural model using Python. hi, there I have other project to work with its about FEM analysis(python)of the Implement a finite element procedure using 8-node trilinear element for three-dimensional linear elastic solid mechanics problem; Visualize the finite element simulation results for several example problems via the visualization toolkit Paraview; relevant results of the stress calculation , there are three problem parameters to solve. I can provide you detailed instruction and reference work as well if you are interested Key Points: - The project will primarily focus on analyzing stress distribution in a non-linear material setting. - You need to have experience with Python programming and specifically its li...

I'm currently facing some integration problems with my CI runner on GitHub. I'm looking for an experienced freelancer who can help me resolve this issue. Github Repository Push --> target is that runner push code to cloud linde automatically Key requirements: - Previous experience with GitHub CI runners and Linde Cloud Server. - Strong problem-solving skills in identifying and resolving integration issues. - Good understanding of continuous integration and deployment processes. - Ability to communicate effectively on the progress and steps taken towards resolving the issue. Please include similar project experiences in your application. Looking forward to working with a competent professional who can get this resolved quickly.

Posting by python on facebook grps.

This project focuses on creating a Python-based machine learning model with the purpose of analyzing historical stock price data and intraday data to predicting future values. The overall goal is to be able to evaluate investment opportunities better. Ideal Skills & Experience: - Familiarity with Python is a must, as this will be the primary language used - Proficiency in regression models, LSTM , as the chosen Machine Learning model - Experience working with stock price data analysis and forecasting - A proven record in Machine Learning project Project Requirements: - Develop a python software that can ingest and analyze historical stock price data - Apply regression models to draw predictive insights about future stock prices - Prioritize accuracy in the predi...

I'm having trouble with the CSS of my Flask/Python application that's running on a WSGI server like Gunicorn or uWSGI. Despite having configured the server correctly to serve static files, the application's CSS is not displaying as anticipated. Specifics needed: - Experience working with Flask/Python applications - Understanding of CSS, HTML and image handling - Knowledgeable about deploying applications on WSGI servers - Ability to diagnose and resolve rendering issues Your task will be to troubleshoot where the issue is coming from and provide a solution. Your application proposals should be detailed with the steps you will take to rectify this issue, as well as any prior experience you have with similar projects.

I'm quietly on the hunt for a skilled professional to design an Instagram bot that can perform a series of tasks on...search of basic or hyper-detailed, but I'm aiming for moderate customization. While I don't want a merely plug-and-play tool, I do want one which allows me to adjust some settings to suit my preferences. The bot should focus its engagement on two types of accounts: - The ones I manually specify - Accounts within particular niches I'm interested in Having knowledge in Instagram bot programming, web scraping and understanding of Instagram API will play a vital role in this project. A sense of culture around cybersecurity and Instagram's guidelines is also key to ensuring the bot operates ethically and within boundaries. Let's wor...

I need a skilled developer to create an automation bot for Telegram Channels. This bot will have the essential functions of: - Auto-joining channels - Extracting basic channel information including the description and links I want the bot to be able to extract the following specific...and links I want the bot to be able to extract the following specific information from the channels it joins: - Channel Name - Channel Description - Channel Links - Member Count The frequency of this extraction should be set to a weekly basis. Ideal skills and experience for this job would include proficiency in Python or a similar programming language, previous experience with Telegram's API, and prior experience creating chatbots or automation bots. Expertise in web scraping...

I am currently in need of a professional with exceptional forecasting and analytic skills. My focus is primarily on three sports: Football, Basketball, and Tennis. You required to either provide the following. 1.) Prediction strategies 2.) Web/App 3.) Python model Budget: 20$ N/B: I need a ready made solution ( not to build from scratch)

I need an experienced Python developer with solid skills in webscraping to gather data from the Premier League's stats page (). The required task involves capturing all available statistics and organizing them into rows and columns within a single CSV file: every season is a row, with different statistics as columns. Applicants should be able to provide the following: - Evidence of past work, particularly related to webscraping. - Their robust experience in Python language and relevant industries. - Detailed project proposals outlining strategy and timeline. Given specified needs, Python is the preferred programming language for this project. Previous experience in similar webscraping projects is desirable, demonstrating your ability to