EOD Download/ Convert from NSE and BSE

[kkseal]

Hi DJ

This is with reference to your problem with NCDEX download.
I was checking today again to make sure if it is working or giving some trouble, I found that NCDEX website has changed the code and incorporated some new values. So with existing version NCDEX will not be downloaded. this is from21.06.2008 as I was able to download upto 20.06.2008

It is being corrected.

As for MCX, it still appears to be fine.

BSE/NSE indices and delivery data has been made as per suggestions of some users.

There was some problem with Indices constituents in NSE so volume calculation was off the mark. Reason being New scrip Reliance Infra was not added to Master databse. Presently it will give correct figure as reported by NSE website.

kkseal, I may be able to incorporate your idea of different constituent scrips for index for different date range, solution will be simple and visual.

pk

Great Pankaj, if it can be done. However, a simple interface for (preferably batch) alterations of index constituent list (i.e. replacing one or more of the index constituents with other stock/s) would suffice for me. (the original Master can be backed up manually). What is important is that the volume, at the time of data download, gets calculated according to the index constituent list at that time.

Btw, have you uploaded the new version (with error fixes & other added features)? If so, could you post the d/l link once more please.

Regards,
Kalyan.

 

[pkjha30]

Hi


I have just uploaded New version of EODDlc
Version No 2.2.2

I have attended to problems reported in earlier version.
Added BSE Indices Download and Delivery Data Seperately as in NSE.
Other EOD Daily,Weekly etc downloads of BSE is kept as it is part of Portfolio download.
The difference between Bhav copy download and these portfolio download is that Bhav copy is available only from 24.3 2006
Whereas EOD daily etc is available for Longer periods.
BSE Intrday is only for one day and not available once BSE file is updated for subsequent date.

Although NSE Indices constituents can be updated by going through Options Menu>>Stock Functions>>Update Indices List

you can change the list by going through
Options>>Database Admin>>Edit Indices Constituents
This works for Both BSE and NSE.
(this is based on kkseal's request)

This should be done before downloading indices for the period so as to calculate volumes delivery volumes and % correctly.

Thos who have downloaded data earlier but not delivery data may download again and then update indices by downloading again. it will update volumes,Del data and %



There were some issues with NSE Indices data download due to URl changes and also in NCDEX . While checking I found that they were not working. Similar issues have cropped up with other softwares as posted in forum. These have been taken care of and it will work.

Interface for download is slightly modified.

Those who have downloaded last patch can download latest patch .Place sqlUpdate.sql in BIN folder and Run Critical updates. It will patch database.
eoddownloadconvert.exe should be copied to Program folder.
Links for Patch

skydrive folder

http://cid-cf8290b687b3435f.skydrive.live.com/self.aspx/eoddownloader/EODDownloadConvert|_patch.zip

rediff Briefcase
http://f1mail.rediff.com/bn/br/pjhapondy///Shared/EODDownloadConvert_patch.zip?d=0

Setup file for fresh Installations

Skydrive folder for setup with MDAC_Type (used in databse)

http://cid-cf8290b687b3435f.skydrive.live.com/self.aspx/eoddownloader/EODDlc.exe

Rediff Briefcase Without MDAC_Type ( Needs seperate installation.XP already has it I think)

http://f1mail.rediff.com/bn/br/pjhapondy///Shared/EODDlcsetup.exe?d=0


I am open to suggestions and bugs reports till next friday.Please post it here with error.log file or screen shots or just copy last few lines of Error log where error appears. Database related errors are not an issue as Database is not supposed to allow any duplicates even though you can download same data again and again.

Hopefully this version will meet expectations.
Feature addition may not take place for some time.

It appears that due to evolving websites of Exchanges download URLS keep changing.As this software relies on publicly posted links on exchanges, often it may become necessary to monitor changes. Therefore Users may immediately report any function which is not working Corrections will be posted as critical updates to avoid disruptions. But surely support is subject to avilability of time and my knowledge.

pk

 

[kkseal]

Thanks a ton pk. And a special thanks from my side for accommodating my request regarding database modifications (To be honest i hadn't reckoned you could do it so fast!)

Will certainly post feedback.

Warm regards,
Kalyan.

 

[rpc]

hi Pankaj
Thks for upgradation/modifications.I have dnlded the patch, will try tomorrow and report.
Many many thks once again
with best wishes
rpc

 

[rpc]

hi Pankaj
Tried to dnld BSE indices but nothing happened and no indices were dnlded.I also tried dnldg using WL_DAILY option, it dnlded one yrs data (in fact last line was for 20081206) eventhough I had given date from 27/6/08 to 27/6/08.
Pls look into the matter
with best wises
rpc

 

[chintan786]

hi Pankaj
Tried to dnld BSE indices but nothing happened and no indices were dnlded.I also tried dnldg using WL_DAILY option, it dnlded one yrs data (in fact last line was for 20081206) eventhough I had given date from 27/6/08 to 27/6/08.
Pls look into the matter
with best wises
rpc

Same here, i had tried to download Bse Indices data but nothing get loaded..... i created Indices folder also in DATA>>BSE... but nothing...

chintan

 

[pkjha30]

Hi

Thanks for feedback ,rpc and chintan

I downloaded programme on another computer patched exe and tried to run so as to know the problem in running without source code.

First thing I had to do was to go to Options>>Settings and click Regenerate Application INI
This makes all files and folders required uptodate.
Then I downloaded EOD,Delivery Data and Indices data in that order.
EOD-Fine
Delivery-Fine
Indices data I had to click twice or thrice before it downloaded. So something is interfering but it did download Indices

Indices data were not written to Indices Folder. So I checked if it is in Database. It was available in database. so I converted using database.

On relevant dates data files were created. I searched for indices data. It was included in EOD files, but not grouped at top ,although not required to group.So if you import Converted EOD Indices data will get imported.
sample
BRILLSEC,20080623,127.2,144,127.2,137.55,5771,
BRITANNIA,20080623,1402.95,1440,1400,1406.7,463,
BROADCAST,20080623,32,32.5,29.55,29.8,67469,
BRUSHMAN,20080623,116,123.7,116,121.2,514982,
BSE100,20080623,7643.26,7668.72,7466.14,7520.18,8621597,
BSE200,20080623,1793.21,1796.56,1748.72,1760.8,3680085,
BSE30,20080623,14423.05,14510.55,14163.45,14293.32,0,
BSE500,20080623,5699.37,5704.26,5550.95,5587.61,10193361,
BSECD,20080623,3832.07,3832.07,3715.35,3774.19,0,
BSECG,20080623,11279.54,11279.54,10759.96,10797.01,0,
BSEHC,20080623,4303.8,4303.8,4183.55,4220.24,487068,
BSEIT,20080623,4182.51,4273.85,4154.41,4233.42,1706124,
BSELINFO,20080623,37,38.35,35.5,35.95,44899,
BSEPSU,20080623,6323.57,6339.78,6154.79,6214.11,2886397,
BSL,20080623,20,21.25,18,18.75,467,
BSTCR,20080623,27.7,27.7,25.4,25.4,2275,
BURNPUR,20080623,19,19.4,18.1,18.55,188864,
BVCL,20080623,32.1,32.5,31.5,31.5,6605,
BWPL,20080623,8.5,8.5,8.35,8.35,303,

Downloading with EOD_Daily was as usual.However I could not find any date as 20081206 in my download.. Must be something to do with date setting of individual computer. It could mean yyyymmdd or yyyyddmm. So need more feedback on that
BSE30.txt in Converted/Stockwise folder
<ticker>,<date>.,<open>,<high>,<low>,<close>,<vol>,
BSE30,20080623,14423.05,14510.55,14163.45,14293.32,0,
BSE30,20080624,14313.33,14432.9,13991.31,14106.58,0,
BSE30,20080625,13856.07,14248.65,13731.54,14220.07,0,
BSE30,20080626,14300.72,14449.81,14196.68,14421.82,0,
BSE30,20080627,14127.76,14127.76,13760.24,13802.22,0,

As for Downloading one year data for Indices, since it uses Chart data for EOD which come in for one year from the last date indicated only thing I can do is to filter out the records.

So two issues for me
1. Checking why it needs multiple clicks before downloading Indices data.
2.Why it has not written data to folder while database was updated.

This will be rectified when I reach home and patch uploaded

User needs to use Options>>Settings and click Regenerate Application INI

and also run critical sql updates.

pk

 

[SUMOGAN]

EODdlc User Documenation

Hi,
Mr Pankaj and other best optimal users of EODdlc.

Now the application becomes more featured one with the efforts of Mr Pankaj mean while causing non-tech savvy peoples to understand the way it should be used for optimal utilisation to the best efforts anticipated by Mr Pankaj.

So I would like to request either Mr Pankaj or the the optimal users of this application to develope a Documentation and keep updated with the updates and post it in Sticky. I would request other senior memebers or optimal users to develop the basic documentation and Mr Pankaj could spare his least time to read and fix up the documentation.

Thanks in Advance
SuMogan

 

[pkjha30]

Hi rpc and chintan


It took a while to figure out as there was no error in code. The problem was in Database Master Table LISTEDEQUITY_BSE.

I gave one sqlUpdate.sql file to patch database while forgetting to update this table to provide for another field which contains user specified names for Scrips and indices.

So while data was downloaded it was not written to file.

I have uploaded EODownLoadConvert.zip file which contains updated Exe Core Version 2.2.5 and sqlUpdate.sql which should be placed in BIN folder and then Run critical update to patch database.This assuems that earlier sqlUpdate.sql was already run( for safety after run it gets deleted so you won't have a copu in BIN folder. While copying new sqlUpdate.sql if you get message if you want to overwrite existing file select no. Run Critical update and then copy new sqlUpdate.sql file to BIN and run critical update again.)

Those who don't want to Patch database can download data.zip which is Skeleton databse with master tables and unzip it to DATA folder.


This New Exe Version contains rpc feedback about downlading one year data despite selecting only one or two days.

Please read instructions twice before executing it.
SkyDrive Links
Data.zip for Skeleton Database file( For recently Installed and very less EOD data)
http://cid-cf8290b687b3435f.skydrive.live.com/self.aspx/eoddownloader/DATA.zip

Recommended Download:Updated Exe core version 2.2.5 ( if you want new core and patch only DB,retains existing data)
http://cid-cf8290b687b3435f.skydrive.live.com/self.aspx/eoddownloader/EODDownloadConvert.zip

SqlUpdate Only ( Download this if you have large amt data in DB)
http://cid-cf8290b687b3435f.skydrive.live.com/self.aspx/eoddownloader/sqlUpdate.zip

Rediff Briefcase Links

SqlUpdate ( Download this if you have large amt data in DB)
http://f1mail.rediff.com/bn/br/pjhapondy///Shared/sqlUpdate.zip?d=0

Data only( For recently Installed and very less EOD data)
http://f1mail.rediff.com/bn/br/pjhapondy///Shared/DATA.zip?d=0

Recommended Download:-Exe core Version 2.2.5 ( if you want new core and patch only DB,retains existing data)
http://f1mail.rediff.com/bn/br/pjhapondy///Shared/EODDownloadConvert.zip?d=0

[Added Remarks :-Checked up on other computer and it worked. Ver 2.2.5 will output 00.00 if you don't download delivery data. Previous version gave it as "." i.e. only a dot in place of Delivery percent value.]

Main Setup links will be updated in next post [setup link with updated core and DB]

I also read SUMOGAn's post with interest. As one can understand that lot of time goes into running through codes. It is difficult to find time for Help file though I intend to do it now that eoddlc has more functions which needs explanation.

Mostly I depend on your feedback to know if anything is to be corrected.Hence they are much eagerly awaited. And if someone has doubt about software then first post should be read which was quite sometime ago.

pk

 

[pkjha30]

Links for Updated Main Setup file

Version 2.2.5 Incremental only

Feedback by rpc ,Chintan

Contains fully patched databse
Modified core Exe

SkyDrive Link (With MDAC_Typ )
http://cid-cf8290b687b3435f.skydrive.live.com/self.aspx/eoddownloader/EODDlc.exe

Rediff Briefcase Link (Without MDAC_Typ )
http://f1mail.rediff.com/bn/br/pjhapondy///Shared/EODDlcsetup.exe?d=0

pk

ps I hope traderji doesn't mind as I post links more than probably the limit. But then these are not spam links to any website or public storage for file sharing.