Finance website Data aggregation -- 2

Experts provide stock recommendations every day through various channels (TV, Twitter, Print media etc) We need a solution which will gather all the recommendations from websites on a daily basis.


[login to view URL]

[login to view URL]

[login to view URL]

[login to view URL]

we need to gather the following information from websites like above :

1. Stock name / ticker symbol

2. Recommendation date and stock price when it was recommended

3. Name of provider: this could be an individual expert for the firm

4. Target price

5. Buy / Sell - Is the recommendation to buy or sell

6. Stop loss price

7. Any other usefull information.

The project is :

1. Check the 4 websites / webpages mentioned above. There are trade recommendations on these webpages. The project is to get stock recommendations from the websites in the above specified format

2. Build a platform which gets this information on a daily basis - This should take care of the data sources already visited and not process them again. it should be easy to add more data sources and schedule their data collection too. For eg: if you can make a crawl plan/data conversion plan for each of the websites then adding new website is easy.

3. Run the platform to get this information and store it in a database.

4. Data collection should be legal and ethical - there should be limits on how many times API is called or a data source is visited. all data collected should be with name of place/person from which it was collected so that we can reference it accordingly.

Java, AWS, Google Could, Python for scrapping or any other technologies which you are comfortable with can be used.

Code which you submit will be checked by our developers for design quality and functional correctness.

Frequently Asked Questions about the project.

Q Is it must to use the above 4 webpages which you mentioned?

Answer: No, you can choose webpages of your choice which give stock recommendations by popular analysts on a daily basis. If these is a RSS feed / API which gets this data, you can use them also.

Q Will we need to crawl and scrape the information from the webpages

Answer: Yes, the platform / your code will need to crawl/scrape the required information. Once obtained it will need to store it in a database. Schema of the table is as below:

1. stock_ticker: Eg. INFY / SBIN

2. recommendation_date

3. expert_name

4. target_price

5. transaction_type : Eg Buy/Sell

6. stop_loss_price

Q. Is it legal to crawl

Ans: Yes it is legal to crawl if the traffic which you increase is not beyond 1% of the website's total traffic.

Q. Can I use python/Java/Perl libraries or platforms

Ans: Yes, you can use anything you want untill the license is open and free for us to use


Kemahiran: API, Pasaran Kewangan, HTML, Web Crawling, Pengikisan Web

Lihat lagi: yodlee breach, top data aggregators, consumer data aggregators, financial data aggregation companies, financial data aggregation api, data aggregation service security, fintech aggregators, finicity pricing, offline website data, cheap website data entry, website data entry script, create website data submission, website data extractor, seo finance website, yahoo finance historical data developer, download website data vb5, finance department data entry, finance website links, website data sugarcrm, display website data

Tentang Majikan:
( 0 ulasan ) Hyderabad, India

ID Projek: #18653935

4 pekerja bebas membida secara purata ₹19250 untuk pekerjaan ini


Hi there Hope you are doing well !!! Best products: POS [login to view URL] nitisharora(at)[login to view URL] lss123456 = IMS [login to view URL] admin/admin Lagi

₹27777 INR dalam 3 hari
(10 Ulasan)

Dennislabs are a dedicated UI/UX design company. With over 8+ years of experience, we design functionally beautiful digital and brand experiences that engage today’s consumer. Through inspired design, we build meanin Lagi

₹7000 INR dalam 8 hari
(0 Ulasan)

We have scrapers and crawlers available for all the leading newspapers, twitter, facebook etc. We can get the data that you need and store it according to your specifications. You will also get a complimentary access t Lagi

₹33333 INR dalam 12 hari
(0 Ulasan)

Hi, I am a perl developer. I have experience of 4 years in perl, linux, mysql. I have designed crawler before. I can make a crawler in a week.

₹8888 INR dalam 5 hari
(0 Ulasan)