EOD Download/ Convert from NSE and BSE
- Thread starter pkjha30
- Start date
HI rajneesh
This is to tell you that I just completed testing of downloading all indices for intraday data. Total number of scrips presently stored in database was 5084. Total download time was approx 20 minutes.After download I found approximately 220630 records for 28.12.2007.
It was not freezing the computer and cpu utilisation was less.
However, sensex consists of 30 scrips and main other important list is BSE500. rest are sectoral indices.
I am sure most of the other scrips might not even be traded. Software would have ignored such stocks where data being downloaded some error conditions.
I feel that it is better to keep a limit of say 500.
Another thing is that sometime bse site shows error which is due to their scripts(ASP). This can only be set to skip as no data is downloaded. I such a situation one can try to download another time.
As for NSE it might take some time.
I will now consolidate all changes and tie up loose ends before next version is out.
(For all members also to comment)
Also just wanted to ask if automatic downloads are needed. That is to say if software is running at specific time it will start download and convert the files. But for that internet connection should be working and also I need to check if data is successfully downloaded. So if unattended download is required then please let me know.
pankaj
This is to tell you that I just completed testing of downloading all indices for intraday data. Total number of scrips presently stored in database was 5084. Total download time was approx 20 minutes.After download I found approximately 220630 records for 28.12.2007.
It was not freezing the computer and cpu utilisation was less.
However, sensex consists of 30 scrips and main other important list is BSE500. rest are sectoral indices.
I am sure most of the other scrips might not even be traded. Software would have ignored such stocks where data being downloaded some error conditions.
I feel that it is better to keep a limit of say 500.
Another thing is that sometime bse site shows error which is due to their scripts(ASP). This can only be set to skip as no data is downloaded. I such a situation one can try to download another time.
As for NSE it might take some time.
I will now consolidate all changes and tie up loose ends before next version is out.
(For all members also to comment)
Also just wanted to ask if automatic downloads are needed. That is to say if software is running at specific time it will start download and convert the files. But for that internet connection should be working and also I need to check if data is successfully downloaded. So if unattended download is required then please let me know.
pankaj
Last edited:
Hi fawaz
please read thread from the beginning to really understand this. But in simple language you can click convert option on the Menu bar at the top which will show converter page. Check your choices and click on convert. It will give output in ascii format. Defaults are well suited for metastock. but do go through choices carefully. Once you make it , it will be remembered. But if you change at a later date them it will damage the output file unless you rebuild the data. All downloaded data is backed up in backup folder so you don't have to re download it. Just copy all files to respective data folder and convert again.
Once you have converted to ascii file, open metastock and use data import option to import all converted files into metastock .
There is a commercial dll file which directly updated metastock folders without opening it. But that is quite costly. This being freeware it is beyond its scope.
For that purpose you can use satya's softwares which gives such a functionality.
pankaj
please read thread from the beginning to really understand this. But in simple language you can click convert option on the Menu bar at the top which will show converter page. Check your choices and click on convert. It will give output in ascii format. Defaults are well suited for metastock. but do go through choices carefully. Once you make it , it will be remembered. But if you change at a later date them it will damage the output file unless you rebuild the data. All downloaded data is backed up in backup folder so you don't have to re download it. Just copy all files to respective data folder and convert again.
Once you have converted to ascii file, open metastock and use data import option to import all converted files into metastock .
There is a commercial dll file which directly updated metastock folders without opening it. But that is quite costly. This being freeware it is beyond its scope.
For that purpose you can use satya's softwares which gives such a functionality.
pankaj
With current version some limitation in watchlist is there.
But it downloads eod bhav copy of BSE (first radio button option) which contains all scrips. BSE Bhavcopy is available only from April 2004 or 2005. So if one is interested in downloading historical records of BSE (say upto 10 years) then one needs to go by watchlist.
This limitation is removed in new version which will come out shortly.
Pankaj
But it downloads eod bhav copy of BSE (first radio button option) which contains all scrips. BSE Bhavcopy is available only from April 2004 or 2005. So if one is interested in downloading historical records of BSE (say upto 10 years) then one needs to go by watchlist.
This limitation is removed in new version which will come out shortly.
Pankaj
This is just a sneak peek into what will be in the New version of EODDownloadConvert
1.Download both NSE and BSE data ( Bhav Copies)
2.Download Futures and Options Data
3.Download PR.ZIP file from NSE automatically, once NSE Bhavcopy is downloaded.It will be stored in PR folder
4.Download Delivery Details from NSE
5.Download Indices Data from NSE
6.Do symbol change on the fly. No need to bother if NSE changes the Symbols. It will update all symbols and rebuild the files for which symbols are changed.
7.Converted ASCII file will include Indices data with turnover and delivery volume/percent
Problem of EQ and BE in case of Same ScripSymbol is solved.
When option ALlL is selected and if ScripSymbol for BE and EQ series is same it will take EQ series.So charting problem will be eliminated.
As usual I am not going to adjust the data for split or bonus but a file will be generated if there is possibility of bonus/split is there.
Stock can be screened based on some basic criteria.
Data errors are indicated via Data error file and can be checked for consistency and correction later.
There is no change in data obtained from BSE and NSE.
as this is not yet meant to do that.
Technical Softwares are well advanced to do that once data is imported.
8. Watch list for BSE, Intraday, historical EOD(daily weekly and monthly)
as well as indices data will be for 300 stocks. You will be able to mark BSE stocks for Portfolio.
8. BSE Indices data will be included in Converted file. Data will be sorted on date.
9.There will be provision to take printouts for data from tables based on custom sql command.
10.Automatic Back up of data and one click restore function.
11. in case of corrupted files Total rebuild option for conversion will be available.
there are other currently unspecified changes.
But main focus is to see that compatibility is maintained as well as current interface.Most operations will be either one click or transparent to users.
Still in the process of testing and checking each functionality for possible optimization and tight integration. Anticipating user action and building for that is most important. Error Handling is one of the main aspect which will help in improving it further if so required by users.
Due to my other obligations and work load it is progressing slowly but will try to complete by 31st Jan , at least for testing.
pankaj
1.Download both NSE and BSE data ( Bhav Copies)
2.Download Futures and Options Data
3.Download PR.ZIP file from NSE automatically, once NSE Bhavcopy is downloaded.It will be stored in PR folder
4.Download Delivery Details from NSE
5.Download Indices Data from NSE
6.Do symbol change on the fly. No need to bother if NSE changes the Symbols. It will update all symbols and rebuild the files for which symbols are changed.
7.Converted ASCII file will include Indices data with turnover and delivery volume/percent
Problem of EQ and BE in case of Same ScripSymbol is solved.
When option ALlL is selected and if ScripSymbol for BE and EQ series is same it will take EQ series.So charting problem will be eliminated.
As usual I am not going to adjust the data for split or bonus but a file will be generated if there is possibility of bonus/split is there.
Stock can be screened based on some basic criteria.
Data errors are indicated via Data error file and can be checked for consistency and correction later.
There is no change in data obtained from BSE and NSE.
as this is not yet meant to do that.
Technical Softwares are well advanced to do that once data is imported.
8. Watch list for BSE, Intraday, historical EOD(daily weekly and monthly)
as well as indices data will be for 300 stocks. You will be able to mark BSE stocks for Portfolio.
8. BSE Indices data will be included in Converted file. Data will be sorted on date.
9.There will be provision to take printouts for data from tables based on custom sql command.
10.Automatic Back up of data and one click restore function.
11. in case of corrupted files Total rebuild option for conversion will be available.
there are other currently unspecified changes.
But main focus is to see that compatibility is maintained as well as current interface.Most operations will be either one click or transparent to users.
Still in the process of testing and checking each functionality for possible optimization and tight integration. Anticipating user action and building for that is most important. Error Handling is one of the main aspect which will help in improving it further if so required by users.
Due to my other obligations and work load it is progressing slowly but will try to complete by 31st Jan , at least for testing.
pankaj
| Thread starter | Similar threads | Forum | Replies | Date |
|---|---|---|---|---|
| P | DOWNLOAD NSE_FO EOD | Data Feeds | 0 | |
| V | StockD - Another NSE EOD Data Downloader | Software | 112 | |
| R | DQuotes - NSE and BSE and F&O EOD Bhavcopy and Indices downloader | End of Day | 236 | |
| S | Download New Version- NSE Intraday,EOD quote downloader/convertor Metastock/Amibroker | Software | 78 | |
| A | Run-time error while running EOD-Download converter | Software Issues | 1 |
Similar threads
-
-
-
DQuotes - NSE and BSE and F&O EOD Bhavcopy and Indices downloader
- Started by rpc
- Replies: 236
-
Download New Version- NSE Intraday,EOD quote downloader/convertor Metastock/Amibroker
- Started by Stokist
- Replies: 78
-