Youtube search result scraper & aggregator (No API usage) -- 2

Ditutup Disiarkan 9 bulan lepas Dibayar semasa penghantaran
Ditutup Dibayar semasa penghantaran

Hey folks!

I need an app with a simple GUI that scrapes and collects Youtube search results. In detail:

Input:

- Multiple Youtube search result URLs + Option to remove or add more lines with more URLs as needed

- Refresh time for each URL

- Minimum video length to be scraped

- Delay time option field between actions (opening URL, scrolling down to load all results, saving and finish scrape for URL 1, start URL 2....). For example "wait X seconds between each action"

Examples: (youtube com....)

/results?search_query=news&sp=CAISAggB

/results?search_query=let%27s+play&sp=CAISBAgBEAE%253D

/results?search_query=sport

Result: Scrapes the search result pages and collects all results in one big HTML file while filtering out all duplicates. Repeats process every few minutes

> Example file of how the result HTML could look is added as attachment. Feel free to copy the layout

> Example GUI layout added as attachment

Condition: Must be able to run on Windows 10. Does not use Google API or other paid services.

-------------------

-------------------

Function:

1.) The program accesses the URLs at intervals that can be set (Every X seconds/minutes)

2.) Scrolls down to load all search results available and then saves all results, thumbnails, and links (links to video and channel) on the local hard drive (in a defined folder) and creates an HTML file for opening the list in the browser at a later time. One file for each input link. The HTML file has the option to sort the list content by video length, channel etc.

3) Waits a user-defined number of seconds to avoid the IP getting flagged as a bot, repeats the steps for the next URL until all URLs are scraped.

4.) Refreshes pages after a set number of minutes (which can be adjusted by the user for each link)

5.) Automatically repeats steps 1-4 and adds new results to the previous local file. (Does not save duplicates.)

6.) The local file should look like a long search result list if opened. Links should be clickable, same as on Youtube and sortable by video length. See attachment example

Needed data:

- Video Thumbnail (Largest available size. static image file)

- Video length

- Channel name & Link

- Video name & Link

- Video description (Optional)

Features:

- Being able to sort the list after opening it in the browser by: Video length, Video title, Channel title, Time added

- Channel URL link is changed to the videos pages by adding "/videos" to the end. See the attached file for example.

- An option to define minimum video length for being added. (Example: "Add no videos shorter than 5 seconds")

- An option to set wait times between scraping of each URL to prevent being IP banned for accessing results too fast

- Wait time between scraping actions so it works fine on slow PCs

- Important: An auto-skip function in case of internet disconnects. "If scrape for URL 1 has not finished after 10 minutes, skip this time, start URL 2"

Requirements:

- Must work on Windows 10

- Does not use Google API

- Has sorting arrows in the HTML file for video length, channel name, video title, and time added (Please look at the attachment files blue arrows.)

- The final result must be .html so a browser can open it. (Not .csv or similar.)

- The result looks similar to the attachment file, please make the thumbnail as the maximum size youtube provides it as.

Please tell me what you would charge for creating this software :)

Web Scraping PHP Python Kejuruteraan Perisian JavaScript

ID Projek: #37084255

Tentang projek

26 cadangan Projek jarak jauh Aktif 7 bulan lepas

26 pekerja bebas membida secara purata $250 untuk pekerjaan ini

techplusintl

Hi there, ★★★ Scrapping / Python / Selenium Expert ★★★ 10+ Years of Experience ★★★ I've read requirements and ready to build GUI that scrapes and collects Youtube search results. Some major works we do: ✔️ Product Web Lagi

$750 USD dalam 7 hari
(356 Ulasan)
8.2
chirgeo

Hello, I'm George, a web crawler expert. I have extensive experience with creating custom web scraping tools and scrapers for data extraction from websites in various industries. I understand that you need an app wit Lagi

$500 USD dalam 3 hari
(166 Ulasan)
8.1
uumarkhalid31

Hello! You need an app with a simple GUI that scrapes and collects Youtube search results. What kind of data do you want to collect? If you are interested, let us discuss this project further and do your job. Thank you Lagi

$120 USD dalam 4 hari
(263 Ulasan)
7.3
datascientist90

I'm a senior Python & ML developer and owner & founder of Dedeoglu Dev Company. Kindly send me a message to get in touch with me, Thanks, Yusuf

$750 USD dalam 7 hari
(27 Ulasan)
6.6
simonklemp

Hello Markus, I hope this message finds you well. I will be able to help you with your project. I read through the description and it sounds like I am just the right person for it. I have the right ski Lagi

$200 USD dalam 3 hari
(25 Ulasan)
6.0
josanta

Hello, I'm excited about the opportunity to develop the YouTube search results scraper app with the specified functionalities and features. Your detailed outline provides a clear understanding of the project scope. M Lagi

$250 USD dalam sehari
(55 Ulasan)
5.9
dataspro

Nice to meet you Lea1234, It is a pleasure to communicate with you. My name is Anthony Muñoz, I am the lead engineer for DSPro IT agency and I would like to offer you my professional services. I have more than 10 yea Lagi

$452 USD dalam 7 hari
(8 Ulasan)
5.9
kaantepeli

Hello. I am fullstack web developer and python developer. Also I am web scrapper expert. I am developing international projects for a while time. I was inspect your request and If we can discuss further details I can Lagi

$250 USD dalam 7 hari
(11 Ulasan)
4.3
image611

Hello there Markus K., Good afternoon! Your very project "Youtube search result scraper & aggregator (No API usage) -- 2" just caught my Attention. You'll be glad to know that I have already helped a lot of entrepren Lagi

$30 USD dalam 3 hari
(15 Ulasan)
4.0
freelanceferif

⭐ hello, dear client ⭐ I am a professional php/javascript/python developer. My main specializations are automation, web scrapers and web extension development. I have written many(200+) scripts(scraper/extension) inc Lagi

$200 USD dalam 7 hari
(9 Ulasan)
3.3
softnosol

Hello, good day to you I am owais. I have checked your job post. You require a Youtube search result scraper & aggregator (No API usage) . I can assist in it. I feel 100% confident in accomplishing this job in time, wi Lagi

$140 USD dalam 7 hari
(4 Ulasan)
2.2
maxota940601

Hi . I do same project not along time ago. I'm do YouTube search with a telegram bot . It's not using Google api . I'm confident that my experience and skillset make me the best fit for this project. If you have any Lagi

$30 USD dalam 2 hari
(1 Ulasan)
1.5
fivezeroinfo

Hey there! I've got the perfect solution for your Youtube search result scraping and aggregation needs. I'll develop a quirky app with a user-friendly GUI that will scrape and collect all those search results for you, Lagi

$120 USD dalam sehari
(0 Ulasan)
0.0
ValeShmit

Hi, Client Scraping expert here! I have carefully reviewed your job description and I am confident to complete your project perfectly. Please leave a message here for the best results. Thanks, Valerii

$150 USD dalam 2 hari
(0 Ulasan)
0.0
imumermalik

Dear valued client, I hope this message finds you well. I have carefully reviewed your requirements for the app that scrapes and collects YouTube search results, and I am confident that I can provide you with an excel Lagi

$225 USD dalam 5 hari
(0 Ulasan)
0.0
andreistalbe

Dear customer, My name is Andrei Stalbe and I am an experienced web crawler expert (Python, Scrapy, Selenium). I've read your job description and seen that you need a program to scrape and collect Youtube search res Lagi

$500 USD dalam 3 hari
(0 Ulasan)
0.0
techindia999

Hi Greetings! We are team of software developers. We have developers working on almost all the technologies. We will assign you a project manager who will assist you during entire process of project completion. We wil Lagi

$250 USD dalam 7 hari
(0 Ulasan)
0.0
alimuhtashim

Hello, my name is Ali, and I am a software engineer with four years of experience. My portfolio can be found here: www.freelancer.com/u/alimuhtashim. I understand that you require an app with a simple GUI for scraping Lagi

$250 USD dalam 20 hari
(0 Ulasan)
0.0