NSE DataExtractor for FCharts

shan2611 said:
Hi ragh_ash,
Thanks for your suggestion.Please clear my doubt.
After downloading EOD data using this tool,do I have to just change the heading of "Total Trd Qty" into " Volume " and then import this file with changed heading into FCharts?

If yes, how to alter the already imported file?( is there any way to delete the already imported data?)
Thanks

Shan
hi shan,
"After downloading EOD data using this tool,do I have to just change the heading of "Total Trd Qty" into " Volume " and then import this file with changed heading into FCharts?"
that's right. easiest way is to use a MS wordpad file and save it . Fcharts can accept *.txt,*.csv formats among others.
hope this is in line with u r requirement.
 

murthymsr

Well-Known Member
pkjha's suggestion : quote:
HTTP 404 - File not found
You need to trap such errors and skip file go to next date.
In this way one need not remember special trading dates.
unquote

if implemented, will give lot of relief.

murthymsr
 
pkjha30 said:
Hi satya

You need not give any option as the program is downloading from a webserver. If file is not found for any date it will give you error message no 404.

HTTP 404 - File not found

You need to trap such errors and skip file go to next date.
In this way one need not remember special trading dates.

Hope this helps.

Almost all versions are working as the basic functionality is rock solid. I will again suggest you to come out with DataExtractor-1.0.0-rc1
DataExtractor-1.0.0-rc(final)
DataExtractor-1.0.0 (stable)
DataExtractor-1.0.1 (For incemental changes only)
DataExtrator-1.1.0 (For major changes)

This is only suggestive.

You can give installer for win98,win2000/xp so as to avoid file dependency problems. Installers are large but megaupload.com seems to allow it free. otherwise i will put it in my shared briefcase if it is within 25 mb.

I will later suggest you a good versioning software.

regards
Pankaj
Pankaj,

thanks very much for your suggestions. actually the program checks for a date and if no data is found it automatically goes for the next date. so, the process of fetching multiple dates is not terminates abruptly.

actually this is first time i am working handling file operations, generally this is unknown area for most programmers, who are busy developing business applications.

so, sort of imporving my skills. also, i found couple of disadvantages with using some vb related controls and compatibility problems with Win 98.

I will release a final version which shall be compatible with Win98 / 2K / XP.

just give me enough time.

Satya
 

pkjha30

Well-Known Member
ragh_ash said:
hi pankaj,
do u use Fcharts SE .
do u have a better option,
pl tell me.
regards
ragh_ash
Hi Ragh_ash

No I dont use FCharts SE. Basically I invest in stock. trade is out of bounds for me. I do use Amibroker.

I have some interest in software and programming. Wherever possible I try to give ideas or solutions.

Now, by better options you mean alternative software or easy procedure to covert data to Amibroker???
If you clarify perhaps I can help. In any case DataExtractor will mature very soon to give you customised options. Satya is really talented in concepts and programming.

thanks
Pankaj
 
Friends,

The file which i am attaching (Data Extractor ver 2.0) now should work on both Win 98 / 2K / XP machines.

Also, it needs a dll "msstdfmt.dll", it should be present in your windows\system32 directory. In case it is missing, please install it. I am attaching it with the zip file here.

coming to the features: This new version is slightly different from other versions by

1. there is no selection of Fcharts, MetaStock etc etc.
2. It creates a standard output file. the contents are
Symbol, YMD(YearMonthDay), Open, High, Low, Close , Volume.
3. This outputed file can be used as input to most of the softwares like FCharts, MetaStock, AmiBroker ( I tested it with all these softwares).

4. It displays, whether a file is downloaded or not.

5. It has 2 buttons, one is Process to download file from NSE and convert to convert the NSE file to text file.


Let me know your comments and any problems you facing while trying this.

Note: Murthy, please try this on your machine and let me know please.

Satya
 
Last edited:
pkjha30 said:
Hi Ragh_ash

No I dont use FCharts SE. Basically I invest in stock. trade is out of bounds for me. I do use Amibroker.

I have some interest in software and programming. Wherever possible I try to give ideas or solutions.

Now, by better options you mean alternative software or easy procedure to covert data to Amibroker???
If you clarify perhaps I can help. In any case DataExtractor will mature very soon to give you customised options. Satya is really talented in concepts and programming.

thanks
Pankaj
hi pankaj,
Amibroker is software i also use. but it is is a free version. therefore does not save data in itself. so i used Fcharts to enter my EOd and then export to output and then import to Amibroker.
otherwise i find it very difficult to import EOD for last i year every time i start up Amibroker.
Plus is Amibroker available in India and if yes is it reasonably priced?
your views please.
regards
ragh_ash
 

murthymsr

Well-Known Member
Dear Satya,
It's very nice that the next version of data extractor is released.
I gone through it and have run it.

I know it is easier to give comments/ requests than to implement. Whatever you consider it worthwhile and possible within the limitations of your program design, you may think of implementing them.

My observations are given below.

1) version info: zip & exe files may contain this info.
zip file may be named de2_0.zip . The exe file may be named as de2_0.exe

2) Uninstalling the old version: No uninstaller was supplied with the old version. Also add/ remove programs did not contain DataExtractor. So I deleted the DataExtractor program folder and the start-up folder. On running RegCleaner, an orphan file reference was found with the following details.
Root: HKEY_USERS
EntryName: Select2
Value d:\Programs\DataExtractor (Location where DataExtractor was installed on my machine.)

The same was deleted and my system continued to be stable. I have mentioned this just with the view that it may be of some help in preparing the detailed help file at a later date or while providing support to users.

3) MS Standard Data Formatting Object (msstdfmt.dll):
this file is located in windows\system and not in windows\system32 (OS=98)
However the version came along-with 98 is 6.00.8804, same as contained in the zip file.

4) The button labeled "Process" only downloads the file and names it. It may be labelled "Download" to bring more clarity.

5) The downloaded bhav copies are named by date, wherein the leading zero's are suppressed. If leading zeros are not suppressed, it will help to find out the missing dates, if any. they are in the MonthDateYear format (American). If they follow the YearMonthDate format, missing files location is very easy.

6) If internet connectivity was not there or was lost during download, the program still continues to run (?). A timeout error notification will avoid confusion and the 'system hung' feeling. Users may be allowed to change the setting to suit the speed of their connection, but 60 Secs. is more than adequate in most of the situations.

7) The program downloads the "EQ" & "BE" series of stocks only, which is reasonable. If further users may be given the option to exclude "BE" stocks and select only "EQ". They my be allowed to choose a lower limit on the traded value. Typical statistics are given below.
Total stocks on a day = around 900
Series "EQ" stocks = around 760
"EQ" stocks with traded value > 10 lakhs = 650
"EQ" stocks with traded value > 100 lakhs = 380

I would personally prefer the last option. This would include all active stocks, without missing any opportunities. This would save lot of disk space, Processing time and RAM utilization.

8) We had to enter the destination folder every time. If saved into INI file along with entries at 6) & 7) above, to be loaded in next use, will help the user a lot.


Because of loss of connectivity to NSE site, the rest of the observations will be posted later.

I congratulate you on the development of this software, which is very close to perfection and has a small foot-print. This is comparable to any commercially available one.

I wish the best in your endeavors here and elsewhere.

murthymsr
 

pkjha30

Well-Known Member
Hi Staya

Just downloaded de2_0. I tried and it gave message that file doesnt exist for any date range .

Source I selected was nse.

1. Download--

First, I gave non existent folder name still the same message.

Second, I gave existent folder name, after creating one, still the same message.

Thirdly, it doesnt seem to download anything though Internet connection is up and running.

I am enclosing image of the program running with erro message of file not found.

Will you tell me if I have missed something. Old version seems to work.

The dll file, which I have, is a newer verion.

2. Conversion

I tried to convert eod file downloaded earlier. It gave runtime error no 13 i.e. type mismatch and exited.. downloaded file in the selected folder was named pr301205.csv . Giving file name in the source folder gave error no 76 i.e. path not found.

3. I still suggest that you check for folder or create a default folder while installing or create the folder in the program directory with the name provided.

4. Change the name of process to Download which is more descriptive.

5. Indians follow ddmmyyyy. If possible follow the same convention for now. Later you can give choice for date format which is easy to implement.

6. Keep the converted file in another folder of choice or in default folder which should be different from downloaded eod data folder.

7. It is nice to see that you trapped the date errors.

8. It is really good thinking to create text file in a standard format from which data could be easily imported by other programs, a facility which is given in all programs I have checked up so far.

9. Interface is nice and uncluttered. May be you can break the monotony by providing some colours.

10. Help file is needed. If you send a write up to me I will compile a chm file or faq and send it back to you for incorporating in your program.

Hope this helps

Regards
Pankaj
 
Last edited:

murthymsr

Well-Known Member
hi pkjha,

Since the last 4 hours I am not getting NSE site. This happened while I was testing Satya's DataExtractor. Of course the two are not linked, surely. Rest of the world I could access. On reading your test report, I thought, I should share this with you. Is NSE site alone is down for some reason?
thanks for your time.

murthymsr
 

pkjha30

Well-Known Member
indiabulls said:
from where new version can be downloaded
Dear Indiabulls

Please read through messages in this thread.
However link is posted here for you benefit--http://www.traderji.com/attachments/software/937-nse-dataextractor-fcharts-de.zip?d=1136836928

regards
pankaj
 
Last edited: