Data deluxe- mother of all data downloaders suggestions required
- Thread starter mrkanitkar
- Start date
- Status
Macro can be posted, but I do not have the time and inclination to explain how to make it work for you(there are number of steps involved). It will be better if you research and find out how the process should work and what you will need to make it work ( AB format file, etc) only after that will you be able to use the excel macro code.
Heartfelt KUDOS!!! Quite an all encompassing philanthropic quest!!!:clapping:
A couple of suggestions
1. Symbol List Uniformity - Symbol mapping may be incorporated in a manner to facilitate that the (Equity) tickers should be as per NSE/ BSE tickerlist (as applicable) and are (system) synchronized with the pertinent ticker symbol for the choice of data source e.g yahoo, google, trade terminal etc.
2. Trade Terminal - Would strongly recommend the addition of client trade terminal 'FLIP' of Geojit, if feasible. This feature would be a unique value addition which is presently not available in any other such tool.
3. Had a look at the main window of EOD section. IMHO, the design is not very streamlined. If I may suggest, the window may be split into sections for NSE, BSE, MCX, NCDEX and Mutual Funds. These sections can then contain user selectable choices for pertinent indices, F&O, OI/ Delivery volumes & reports (FII/ DII, Highs-Lows etc) etc. I do not envisage the need for the choice of downloading EOD data from google or yahoo as it would ideally be desirable to use the pertinent exchange bhavcopies for the purpose. However yahoo/ google Fundamentals and yahoo/ google IEOD can be presented as user selectable choices for the sections concerned.
4. In the RT data section, the provision for pivot and S&R calculator output to be included in the pop up RT window (during RT streaming) for the selected tickerlist, may be thought of.
5. I presume the RT streaming would be multithreaded to make optimal use of the processing power. Would suggest software capability for handling of at least 200 tickers (as a bare minimum) for RT data streaming purposes.
6. The inclusion/ integration of a newsfeed is a fairly simple affair and is, nowadays, available in quite a few tools of this nature. This may be included, if feasible.
Thank you for all the selfless effort on behalf of the 'Little Guys', I hope that you may find these suggestions to be of some use for your eventual system design considerations.
Regards,
A couple of suggestions
1. Symbol List Uniformity - Symbol mapping may be incorporated in a manner to facilitate that the (Equity) tickers should be as per NSE/ BSE tickerlist (as applicable) and are (system) synchronized with the pertinent ticker symbol for the choice of data source e.g yahoo, google, trade terminal etc.
2. Trade Terminal - Would strongly recommend the addition of client trade terminal 'FLIP' of Geojit, if feasible. This feature would be a unique value addition which is presently not available in any other such tool.
3. Had a look at the main window of EOD section. IMHO, the design is not very streamlined. If I may suggest, the window may be split into sections for NSE, BSE, MCX, NCDEX and Mutual Funds. These sections can then contain user selectable choices for pertinent indices, F&O, OI/ Delivery volumes & reports (FII/ DII, Highs-Lows etc) etc. I do not envisage the need for the choice of downloading EOD data from google or yahoo as it would ideally be desirable to use the pertinent exchange bhavcopies for the purpose. However yahoo/ google Fundamentals and yahoo/ google IEOD can be presented as user selectable choices for the sections concerned.
4. In the RT data section, the provision for pivot and S&R calculator output to be included in the pop up RT window (during RT streaming) for the selected tickerlist, may be thought of.
5. I presume the RT streaming would be multithreaded to make optimal use of the processing power. Would suggest software capability for handling of at least 200 tickers (as a bare minimum) for RT data streaming purposes.
6. The inclusion/ integration of a newsfeed is a fairly simple affair and is, nowadays, available in quite a few tools of this nature. This may be included, if feasible.
Thank you for all the selfless effort on behalf of the 'Little Guys', I hope that you may find these suggestions to be of some use for your eventual system design considerations.
Regards,
Last edited:
-------
PSB answers
----
Thanks for detail review.
--------
A couple of suggestions
1. Symbol List Uniformity - Symbol mapping may be incorporated in a manner to facilitate that the (Equity) tickers should be as per NSE/ BSE tickerlist (as applicable) and are (system) synchronized with the pertinent ticker symbol for the choice of data source e.g yahoo, google, trade terminal etc.
MK- Since we will provide just data in different formats and user defined data frequency (1d, 1m,1h,tick) we will not have direct control on mapping. We have added Name field for all symbols which shows same company name for all data. It will help.
2. Trade Terminal - Would strongly recommend the addition of client trade terminal 'FLIP' of Geojit, if feasible. This feature would be a unique value addition which is presently not available in any other such tool.
Mk- There is very small market share (less traders use it) by Geojit and secondly none of our team member is Geojit customer but we will findout if we can have Geojit terminal.
3. Had a look at the main window of EOD section. IMHO, the design is not very streamlined. If I may suggest, the window may be split into sections for NSE, BSE, MCX, NCDEX and Mutual Funds. These sections can then contain user selectable choices for pertinent indices, F&O, OI/ Delivery volumes & reports (FII/ DII, Highs-Lows etc) etc. I do not envisage the need for the choice of downloading EOD data from google or yahoo as it would ideally be desirable to use the pertinent exchange bhavcopies for the purpose. However yahoo/ google Fundamentals and yahoo/ google IEOD can be presented as user selectable choices for the sections concerned.
MK- Very good analysis. Thank you. We are planning to make one column per exchange but then there are certain exchanges like National spot exchange and USE need to come in one last column. We are thinking to have O/I delivery volume as default for cash and remove check box for it. We also think to remove option of selecting I,II,III for future and make it default in product. As if people go for forex futures, it will be XII, so will better make mandatory for all (equity fno, commodity, forex). FII/DII reports are collection against all exchanges means, you will get same figures from NSE, BSE, MCX (when it starts). Sebi does not give seperate figures per exchange. As many people need EOD data of world indices which is not available from exchange Bhavcopies so, we need to provide it from yahoo, google. Since yahoo / google IEOD code can download data based on yahoo/google symbols, we have kept one file each for yahoo/google and people can add any symbol to it for downloaded eod or Ieod data. Since yahoo/google provide data for 70+ exchanges worldwide, user have choice to add any symbol with exchange in file. We also process Options data, user should import it in seperate db and delete every month as prices of Options can not merge every month. If merged it will be useless for technical analysis.
4. In the RT data section, the provision for pivot and S&R calculator output to be included in the pop up RT window (during RT streaming) for the selected tickerlist, may be thought of.
Mk- Hmm, this is completely new idea. Thank you. Actually charting apps have default settings for S&R and pivot and there are many AFL and similar tools/ plugins available in other tools. Let me look in to this.
5. I presume the RT streaming would be multithreaded to make optimal use of the processing power. Would suggest software capability for handling of at least 200 tickers (as a bare minimum) for RT data streaming purposes.
MK- Yes, it will be multithreaded. Many broker terminals restrict script to 55 or 30. At software side, we will keep ability in place.
6. The inclusion/ integration of a newsfeed is a fairly simple affair and is, nowadays, available in quite a few tools of this nature. This may be included, if feasible.
Mk- yes can be, will provide option of adding rss feed, use can add his own. We may do this in next release.
Thank you for all the selfless effort on behalf of the 'Little Guys', I hope that you may find these suggestions to be of some use for your eventual system design considerations.
Mk- We are trying automate few basic things which will make life easy. This utility will help you download & process all data which will be legitimate and in public domain for free.
PSB answers
----
Thanks for detail review.
--------
A couple of suggestions
1. Symbol List Uniformity - Symbol mapping may be incorporated in a manner to facilitate that the (Equity) tickers should be as per NSE/ BSE tickerlist (as applicable) and are (system) synchronized with the pertinent ticker symbol for the choice of data source e.g yahoo, google, trade terminal etc.
MK- Since we will provide just data in different formats and user defined data frequency (1d, 1m,1h,tick) we will not have direct control on mapping. We have added Name field for all symbols which shows same company name for all data. It will help.
2. Trade Terminal - Would strongly recommend the addition of client trade terminal 'FLIP' of Geojit, if feasible. This feature would be a unique value addition which is presently not available in any other such tool.
Mk- There is very small market share (less traders use it) by Geojit and secondly none of our team member is Geojit customer but we will findout if we can have Geojit terminal.
3. Had a look at the main window of EOD section. IMHO, the design is not very streamlined. If I may suggest, the window may be split into sections for NSE, BSE, MCX, NCDEX and Mutual Funds. These sections can then contain user selectable choices for pertinent indices, F&O, OI/ Delivery volumes & reports (FII/ DII, Highs-Lows etc) etc. I do not envisage the need for the choice of downloading EOD data from google or yahoo as it would ideally be desirable to use the pertinent exchange bhavcopies for the purpose. However yahoo/ google Fundamentals and yahoo/ google IEOD can be presented as user selectable choices for the sections concerned.
MK- Very good analysis. Thank you. We are planning to make one column per exchange but then there are certain exchanges like National spot exchange and USE need to come in one last column. We are thinking to have O/I delivery volume as default for cash and remove check box for it. We also think to remove option of selecting I,II,III for future and make it default in product. As if people go for forex futures, it will be XII, so will better make mandatory for all (equity fno, commodity, forex). FII/DII reports are collection against all exchanges means, you will get same figures from NSE, BSE, MCX (when it starts). Sebi does not give seperate figures per exchange. As many people need EOD data of world indices which is not available from exchange Bhavcopies so, we need to provide it from yahoo, google. Since yahoo / google IEOD code can download data based on yahoo/google symbols, we have kept one file each for yahoo/google and people can add any symbol to it for downloaded eod or Ieod data. Since yahoo/google provide data for 70+ exchanges worldwide, user have choice to add any symbol with exchange in file. We also process Options data, user should import it in seperate db and delete every month as prices of Options can not merge every month. If merged it will be useless for technical analysis.
4. In the RT data section, the provision for pivot and S&R calculator output to be included in the pop up RT window (during RT streaming) for the selected tickerlist, may be thought of.
Mk- Hmm, this is completely new idea. Thank you. Actually charting apps have default settings for S&R and pivot and there are many AFL and similar tools/ plugins available in other tools. Let me look in to this.
5. I presume the RT streaming would be multithreaded to make optimal use of the processing power. Would suggest software capability for handling of at least 200 tickers (as a bare minimum) for RT data streaming purposes.
MK- Yes, it will be multithreaded. Many broker terminals restrict script to 55 or 30. At software side, we will keep ability in place.
6. The inclusion/ integration of a newsfeed is a fairly simple affair and is, nowadays, available in quite a few tools of this nature. This may be included, if feasible.
Mk- yes can be, will provide option of adding rss feed, use can add his own. We may do this in next release.
Thank you for all the selfless effort on behalf of the 'Little Guys', I hope that you may find these suggestions to be of some use for your eventual system design considerations.
Mk- We are trying automate few basic things which will make life easy. This utility will help you download & process all data which will be legitimate and in public domain for free.
- Status
Similar threads
-
-
Dollar stabilizes&Safe-haven Demand Cools, Gold Retreats to $2320, Focus Shifts to US Jobs Data
- Started by Veteran123
- Replies: 0
-
Gold Records Largest Weekly Decline in Five and a Half Months, Focus on Two Key Data Releases This Week
- Started by Veteran123
- Replies: 0
-
-