EOD Download/ Convert from NSE and BSE

pkjha30

Well-Known Member
Hi

I have checked up.
The original data is as follows
AEGISCHEM EQ 130.05 134.5 130.05 130.8 130.4 129.25 5794 768666.25 17-May-07
AFL BE 60 61 59.6 59.75 59.6 60 9758 588447.95 17-May-07
AFTEK EQ 73 75.7 72.2 72.65 72.4 72.85 1203042 88851733.15 17-May-07

Converted data is
AEGISCHEM EQ 130.05 134.5 130.05 130.8 130.4 129.25 5794 768666.25 17-May-07
AFTEK EQ 73 75.7 72.2 72.65 72.4 72.85 1203042 88851733.15 17-May-07

In the Series Options Check box on converter page

Default choice :- EQ series is selected.

If you select BE then only BE will be taken.

If you select Both then EQ and BE both will be taken.

I think you check choice named as Both check box.That will give you AFL also else AFL will be eliminated since it is BE series.

Hope I am clear on this.

Pankaj:)
 

pkjha30

Well-Known Member
thanks.

I think u r right.
Thanks for ur sincere attention.

BT
Hi

I am glad that now it is clear.It's better to give feedback as I can always respond to that. Since I am maintaining the code-base, only I can make changes in the program to reflect the requirement or to remove the bugs minor or major.

This program is for users only so their contribution is most vital.

Pankaj:)
 
Hi Traderji and all the Forum members

I am posting EODDwonloadConvert version 0.0.70 for forum members to

try and give their comments.Feel free to use it and give feedback. No warranties.Code is optimisation under progress.

It needs unzip32.dll which can be obtained from
http://www.mirrorservice.org/sites/ftp.info-zip.org/pub/infozip/WIN32/unz552dN.zip

It need to be placed in \windows\system ditrctory and register it.Rightclick on it will register it else use "regsvr32.exe unzip32.dll" in Run dialog of Start Button. Ignore any error. The version is unzip32.dll 5.5.2.0. . Only dll is available in zipped file in my briefcase.

The programme is compiled using vb6(sp6) and needs runtime files.Normally these are available on almost all systems now but on some older system it may not be available and give errors.You can download runtime files from here if required.

http://www.microsoft.com/downloads/...61-7A9C-43E7-9117-F673077FFB3C&displaylang=en

Its 1.0 MB download.

you need IE 5.5 or above installed.

Dependency Script is attached for your use to verify if required files are present.I have tested it on Win98SE and WINXP system . it should not give much trouble. The zipped file EODDownloadConvert.zip(142.5kb) may be downloaded from my briefcase.
http://briefcase.rediff.com/bn/br/pjhapondy


The programme should be extracted to a seperate folder of your choice. It will create folder structure and required files on first run . Settings related files are in BIN folder. My BIN folder is also placed in the Briefcase in case you may like to download some files such as Favourites.txt,holiday.txt etc. Programme icon is in BIN\images folder.

I have to thank http://www.planetsourcecode.com , www.freevbcode.com

and www.programmersheaven.org and www.info-zip.com for their code

snnipets and dll files. All thanks to respective programmers.My part was limited to certain areas and ideas specific to downloading files from nse and bse website and assemblling it to make a workable solution for members of Traderji.com

I have to thank satya whose dataextractor gave some inspiration for

this and his idea of thread to share software. My code will be freely available once it reaches version 1.0.0 and after your feed back is also incorporated.The programme has its own lifetime and utility.It may stop functioning if there are changes in URL structure of NSE and BSE websites.If newer operating system do not support older programmes. In such a situation it would need to be ported to newer versions.

What it seeks to do:-

Download:

For a given range of dates it will download bhavcopy for nse. For BSE it will download current Bhavcopy which is in zipped format. Itwill unzip the same without user intervention.You have to enter dates from and to in the field and click ADDUrl.

All URLs will be displayed in the box below with save path. As of now use default options it should be ok. For other options if there is any problem please tell me.

On the top there is option for providing download urls if you know it. If it is from BSE or NSE it will be stored in default folders. Other wise it should be available in Others folder.

Convert:

Initially use only default options.

If files are available in default folders then it will be visible in Input Files Box. Defaults are ok i.e. csv and nse or bse. Delimiter is always "," i.e. comma. leave it unchanged. You will see the first two lines of records in Select output options. If first line is header record you can check it . You can leave all other options as it is. On clicking Convert button it will convert all available file in NSE or BSE equities folder One folder will contain date wise EOD data for each date for all stocks, the other folder will contain
individual stock data for all dates available.

Datewise format is symbol,o,h,l,c,v,date
Stockwise format is o,h,l,c,v,date

First line is header line.

Perhaps these files can be used by members for importing into their :)
programmes. if any error is given I would like to know.

If you have downloaded many files you need to sort these records in the output files. Use sort button for this. It needs to be used for once only. thereafter if you are running your program after 5.30 or whatever time bse/nse post their latest data you dont need to sort.
I understand that bhavcopy is posted after 5.30 pm.

You can exclude any date by editing the holiday.txt file either directly. All dates are posted below respective month. Same pattern needs to be followed. the program will indicate if their is a failure of Download for whatever reason mostly URL is not available i.e. file is not found. It is trapped and failure.log is generated.

You can verify if URL exixts or not by using some other downloader.Error.log file wil keep records of two days errors and may be used for feed back.

Browser:

You can use this to browse your favourit websites wihtout overhead of IE. But you need IE 5.5 or above installed.

Some of the Links will give you direct access to nes/bse html files without going to home page. Loading will be faster. You can add favourites First input is for title and secon input is for URL. If you omit URL title can act as section header.

You can directly edit Favourites in your text editor. Odd lines will be titles and even lines should be URLs.

You can also check if your computer is connected to internet and if NSE website is up and running. Buttons are on Download page.

If this programme works it will be free and once it is optimised it will be given in source code form for maitainance by members if desired.

Future Wishlist

To optimise code.

To incorporate charts and other indicators based on the data collected on daily basis. Chart code and form is included but made invisible as further development is required.

To incorporate multi threaded downloading capability.

To take print( Presently you can print file in one go)

The name given to the executable is only tentative and members are invited to suggest better name. We may vote for name and whichever name gets highest vote will be made as programme name.


thanks are in order for Satya, joymitali,Saint, AmitBE,AMITKR murthymsr and otherboard members for inspiraton.

I dedicate this programme to the enterprising spirit of Traderji.com

and Moderator traderji.

With kind regards
Pankaj
What about the splits, bonus, and right issue. How are u planning to make those adjustments automatically? Doing those adjustments manually is really a big pain.
 

pkjha30

Well-Known Member
What about the splits, bonus, and right issue. How are u planning to make those adjustments automatically? Doing those adjustments manually is really a big pain.
I am given to understand that in AMI as well as Metastock you can do this manually once split or bonus ratios are given. And data adjustment is for technical chart softwares. I am sure they would be providing these facilities.
Pankaj:)
 

pkjha30

Well-Known Member
nse fno data to be merge in metastock
I think if you convert FNO data by this program that can be merged with metastock and amibroker. You have to follow same prefix for symbol generation.

that is near, next ,far or 1,2,3 . This will generate common symbols for the stocks in FNO trade and maintain data continuity.

Pankaj:)
 

pkjha30

Well-Known Member
Hi,
Can you please narrate me how to Download BSE Indices form EODDwonloadConvert.

I can download NSE data & Indices but I want same form BSE.

Dhaval
You have to select BSE option from download page and first choice "EODBhavCopy" should be selected.
Give 'from date' and 'to date' if you want to download historical data otherwise current date is always default.
Then click download. It should download bse bhav copies and unzip in the folder under /DATA/BSE/EQUITIES.

On converter page if you select BSE , downloaded files should be visible.

Pankaj:)
 
You have to select BSE option from download page and first choice "EODBhavCopy" should be selected.
Give 'from date' and 'to date' if you want to download historical data otherwise current date is always default.
Then click download. It should download bse bhav copies and unzip in the folder under /DATA/BSE/EQUITIES.

On converter page if you select BSE , downloaded files should be visible.

Pankaj:)
Hi Pankaj,

Thanks for your quick reply.
I thing what you mention gives me BhavCopy for BSE.
But I am looking for Indices like BSE30, BSE100.

Did this procedure mention here gives me Indices ?
Please correct me if wrong.

Dhaval
 

Similar threads