Web scraping: monitor changes to a table and web-whatsapp changes to me
$12-30 SGD
Closed
Posted over 5 years ago
$12-30 SGD
Paid on delivery
In this website [login to view URL] are pages of several members, eg
[login to view URL]
[login to view URL]
[login to view URL]
In each of them, there are 2 tables titled:
> [Open Trades] and
> [History (9999) ]
They hold new trades opened by a member and closed, respectively. I want a web scrapping program to monitor these 2 tables for changes. When new lines occur in either of them, inform me via web-whatsapp to my mobile no.
Requirements for programme:
> to be written in open source or freeware development platform/kit eg python or javascript
> to be executed by interpreter and not needed to be compiled to binaries eg no java pls
> allow me specify and monitor up 12 member pages for monitoring at any time
> best to capture changes by event; otherwise, allowing me to specify a polling time (eg 5min, 8min, 15min etc) will also do
> consume low bandwidth; I am going to run it in a VPS; with network quota, programme is to scrimp by downloading only the tables instead of entire webpage inclusive of graphics
> treats a change to mean new record lines newly appearing in a table; a line where only column values changes does not count
> when change is detected, compose a simple message and web-whatsapp ([login to view URL]) ONCE only it to a mobile no., latter to be specified
> message to compose is simply
<member page>
<table name>
<all fields of a newly detected record>
Example of a simple message:
Let's say changes were detected in member page [[login to view URL]]:
[Open Trades]
vagabond/tricky-twister-ea/2378434
11.01.2018 05:44; NZDCAD; Sell; 0.01; 0.8634; -; 119.00; -16.77; -234.00; -0.29; -0.54%
[History]
vagabond/tricky-twister-ea/2378434
10.25.2018 16:13; 10.26.2018 07:43; NZDCAD; Sell; 0.01; -; 60.00; 0.85540; 0.84940; 60.0; 4.50; 15h 30m; 0.12%
I am very interested in your project. I have made many web scrappers in the past and i have worked with market data such as the one you have here in the past. connecting this data to a whatsapp api will be simple. Contact me to get the job done.
I am going to use Python's requests and BeautifulSoup libraries to solve the problem. Also to send messages I'll take a look at WhatsApp API, it's pretty simple. I am going for a command line interface, if it's fine for you. Otherwise I can get you a simple GUI. Your price is to high for such a project, though.