Ditutup

Web scraping: monitor changes to a table and web-whatsapp changes to me

In this website [login to view URL] are pages of several members, eg

[login to view URL]

[login to view URL]

[login to view URL]

In each of them, there are 2 tables titled:

> [Open Trades] and

> [History (9999) ]

They hold new trades opened by a member and closed, respectively. I want a web scrapping program to monitor these 2 tables for changes. When new lines occur in either of them, inform me via web-whatsapp to my mobile no.

Requirements for programme:

> to be written in open source or freeware development platform/kit eg python or javascript

> to be executed by interpreter and not needed to be compiled to binaries eg no java pls

> allow me specify and monitor up 12 member pages for monitoring at any time

> best to capture changes by event; otherwise, allowing me to specify a polling time (eg 5min, 8min, 15min etc) will also do

> consume low bandwidth; I am going to run it in a VPS; with network quota, programme is to scrimp by downloading only the tables instead of entire webpage inclusive of graphics

> treats a change to mean new record lines newly appearing in a table; a line where only column values changes does not count

> when change is detected, compose a simple message and web-whatsapp ([login to view URL]) ONCE only it to a mobile no., latter to be specified

> message to compose is simply

<member page>

<table name>

<all fields of a newly detected record>

Example of a simple message:

Let's say changes were detected in member page [[login to view URL]]:

[Open Trades]

vagabond/tricky-twister-ea/2378434

11.01.2018 05:44; NZDCAD; Sell; 0.01; 0.8634; -; 119.00; -16.77; -234.00; -0.29; -0.54%

[History]

vagabond/tricky-twister-ea/2378434

10.25.2018 16:13; 10.26.2018 07:43; NZDCAD; Sell; 0.01; -; 60.00; 0.85540; 0.84940; 60.0; 4.50; 15h 30m; 0.12%

Kemahiran: Javascript, Python, Pengikisan Web

Lihat lagi: ai web scraping, web crawler and scraper, docker web scraper, python web scraping library, how to use web crawlers, open source web scraping tools, spider web scraping, web scraping api, web scraping visual basic, include table web page php mysql, web scraping flash sites, serving access table web page, table web style, getafreelancercom grab web data mysql table, web scraping jobs, google base web scraping, table web template free, grab table web page, remote web cam monitor, data mining web scraping

Tentang Majikan:
( 0 ulasan ) Singapore, Singapore

ID Projek: #18113461

4 pekerja bebas membida secara purata $134 untuk pekerjaan ini

hershkat

I've had lots of experience web scraping, in both freelancer and in my career. I can definitely do what you have specified!

$155 SGD dalam 7 hari
(1 Ulasan)
3.5
BrandonCardillo

I am very interested in your project. I have made many web scrappers in the past and i have worked with market data such as the one you have here in the past. connecting this data to a whatsapp api will be simple. Cont Lagi

$144 SGD dalam 7 hari
(0 Ulasan)
0.0
rajivebecax86

Hey there friend! I believe my skill-set is perfect for this project. I built various scraping tools with python that have low network usage and if server up-time is also a factor I am also able to implement a polling Lagi

$138 SGD dalam sehari
(0 Ulasan)
0.0
codingllama

I am going to use Python's requests and BeautifulSoup libraries to solve the problem. Also to send messages I'll take a look at WhatsApp API, it's pretty simple. I am going for a command line interface, if it's fine fo Lagi

$100 SGD dalam 3 hari
(0 Ulasan)
0.0