Yahoo Backfill Downloader

[Laksh]

Friends,
Those of you who are facing the runtime error 5 problem may try the following solution. Probably you have written the wrong yahoo scrip symbol in the text file. Yahoo does not support symbols more than 12 characters, of which 3 are taken up by ".NS"or ".BO". Therefore, any symbol having more than 9 characters to the left of .NS will give error no. 5. So trim the excess characters to the right of the symbol and before .NS or .BO.E.g INFOSYSTCH is the symbol for Infosys in nse. It has 10 characters. Cut the last C and add .NS to get nse infosys symbol from yahoo. Similarly BHARTIARTL would be BHARTIART.NS, HINDUNILVR will be HINDUNILV.NS etc.

I hope this solves your problem. It has solved mine.

Laksh

 

[jdm]

hi folks,
i revamped the application. the same can be found at the first post in this thread.

hope fellow boarders will find it useful and more user-friendly to use.

cheers,
jdm.

 

[uasish]

This is an immense help to the trader/investor community.
A true spirit of sharing in sync with this forum's theme.

 

[soumya_b]

Thanx Joy'da .....

 

[abcdgetright]

Hi

thanks for upgrade the your yahoo backfill application. kindly suggest solution for the following error :

When i'm downloading files i'm getting an error message :"index out of range" and the application is quitting. What to do for this?

If possible one suggestion to your application :

When we are downloading the yahoo symbols - when there is no symbol - the program will asking check the symbol message - in that case the user interaction is needed.

Can u modify this to without user interaction? My idea is keep going downloading the symbols whether it is exist or not after completion of the symbols the program will generate one *.txt file containg errors or non-downloaded symbols list. I think this is very useful to users.

Sorry for the inconvienence.

Thanks....

 

[jdm]

thanks asishda & soumya.

thanks abcd for your feedback.

except for the worng symbol, the app do not have any error handler built in it. it uses the default as provided by .net framework. it would be kind of you if you could copy paste the error. go to "details" in the error message and do the same.

yeah your suggestion is a good one. added in my wishlist.

cheers,
jdm.

 

[abcdgetright]

Hi JDM

Herewith i'm attaching error logs in *.txt format file. Kindly see the errors. When that occurred - if we click exit - the program will exit - that's ok. When we click continue the program will not continue after that symbol.

Is it possible to add an option to download eod bse symbols (BSE website). (not bhavcopy). If you require i will send all traded BSE symbols (scrip id for BSE).

You have put a very good download utility for nse bhavcopy - it is downloading not only a bhavcopy - adv/declines also. Like that one more suggestion from my side. When we download nse index there is no volume figures. When we see a file gross delivery percentage file (at nse site) - in that there is nse volume figures. So is it possible to incorporate that nse volume figures into your market breadth file?

Thank you...have a nice day.......

 

[jdm]

Hi JDM

Herewith i'm attaching error logs in *.txt format file. Kindly see the errors. When that occurred - if we click exit - the program will exit - that's ok. When we click continue the program will not continue after that symbol.

i couldnt figure the first error, will look into it later.

the second error file - its due to a bad/static net connection .... requst time out .... of that sort, or yahoo server was down.

Is it possible to add an option to download eod bse symbols (BSE website). (not bhavcopy). If you require i will send all traded BSE symbols (scrip id for BSE).

well cant promise, but two things you can do. long time back i have built a excel macro which downloads bse eod files. just search the software section. else you can try Meta-All (built by another esteemed member).

You have put a very good download utility for nse bhavcopy - it is downloading not only a bhavcopy - adv/declines also.

well, i never found a good bhavcopy downloader. every one has some issue or other, corrupting the whole database. thats why i build one.

the adv/decline is calculated by the app.

Like that one more suggestion from my side. When we download nse index there is no volume figures. When we see a file gross delivery percentage file (at nse site) - in that there is nse volume figures. So is it possible to incorporate that nse volume figures into your market breadth file?

delivery volumes are not nse volume figures. indexes do not have volume. often the total turnover is treated as nifties volume. since bhavcopy do consists the traded volume in value, the same can be incorporated. and by the way, the bhavcopy do not consists the values of the indexes.

Thank you...have a nice day.......

thanks for trying out the app. and for your feedback. have a happy and prosperous new year.

cheers,
jdm.

 

[E.Haque]

Does any one knows how to extract OHCL data from txt file and update into all CSV file at once in Amibroker?. Thanks

 

[abcdgetright]

pib data convert help

Happy new year..............

Hi jdm

Could you help me to convert pib data into txt file using your backfill. I tried but i couldn't get correct order data into txt file. i'm pasting the example txt file details for your suggestion. 1st it is started at 1004 am again it has taken 95600 a.m. kindly see the txt file end also, again it is taken from 95500 a.m. Kindly suggest how to do this conversion? If pib disconnected approximately 15 mts. then what is the consequences to convert data. is it able to get updated that disconnected time period after reconnect the pib.

<TICKER>,<PER>,<DATE>,<TIME>,<OPEN>,<HIGH>,<LOW>,<CLOSE>,<VOLUME>
ZEETELE.NS,0,20080101,100414,327.9,327.9,327.9,327.9,117
ZEETELE.NS,0,20080101,100431,327.5,327.5,327.5,327.5,127
ZEETELE.NS,0,20080101,95600,331,331,331,331,600
ZEETELE.NS,0,20080101,95651,329.95,329.95,329.95,329.95,60
ZEETELE.NS,0,20080101,95933,326.55,326.55,326.55,326.55,156
ZEETELE.NS,0,20080101,100157,328.7,328.7,328.7,328.7,549
ZEETELE.NS,0,20080101,100331,328.55,328.55,328.55,328.55,325
ZEETELE.NS,0,20080101,100431,327.5,327.5,327.5,327.5,127
ZEETELE.NS,0,20080101,100232,328.6,328.6,328.6,328.6,260
ZEETELE.NS,0,20080101,100041,328,328,328,328,1910
ZEETELE.NS,0,20080101,100306,328.8,328.8,328.8,328.8,380
ZEETELE.NS,0,20080101,100406,328,328,328,328,632
ZEETELE.NS,0,20080101,100132,328.5,328.5,328.5,328.5,627
ZEETELE.NS,0,20080101,100206,329.05,329.05,329.05,329.05,356
ZEETELE.NS,0,20080101,100340,328.5,328.5,328.5,328.5,25
ZEETELE.NS,0,20080101,100050,328,328,328,328,1158
ZEETELE.NS,0,20080101,100240,328.8,328.8,328.8,328.8,550
ZEETELE.NS,0,20080101,100314,328.6,328.6,328.6,328.6,530
ZEETELE.NS,0,20080101,100058,328,328,328,328,4678
ZEETELE.NS,0,20080101,100140,328.55,328.55,328.55,328.55,1759
ZEETELE.NS,0,20080101,100414,327.9,327.9,327.9,327.9,117
ZEETELE.NS,0,20080101,100106,328,328,328,328,883
ZEETELE.NS,0,20080101,100215,329.05,329.05,329.05,329.05,120
ZEETELE.NS,0,20080101,100249,328.8,328.8,328.8,328.8,85
ZEETELE.NS,0,20080101,100348,328.15,328.15,328.15,328.15,39
ZEETELE.NS,0,20080101,100323,328.8,328.8,328.8,328.8,74
ZEETELE.NS,0,20080101,100356,328.15,328.15,328.15,328.15,60
ZEETELE.NS,0,20080101,100115,328,328,328,328,444
ZEETELE.NS,0,20080101,100149,328.55,328.55,328.55,328.55,1261
ZEETELE.NS,0,20080101,95509,328.45,328.45,328.45,328.45,0
ZEETELE.NS,0,20080101,95609,330.05,330.05,330.05,330.05,800
ZEETELE.NS,0,20080101,95700,329.9,329.9,329.9,329.9,509
ZEETELE.NS,0,20080101,95750,329,329,329,329,727
ZEETELE.NS,0,20080101,95850,327,327,327,327,273
ZEETELE.NS,0,20080101,95941,326.55,326.55,326.55,326.55,709
ZEETELE.NS,0,20080101,95617,330,330,330,330,935
ZEETELE.NS,0,20080101,95708,329.95,329.95,329.95,329.95,1050
ZEETELE.NS,0,20080101,95859,327,327,327,327,616


Thank you