Forex
Google

Go Back   Forex Trading > Discussion Areas > Metatrader 4
Forex Forum Register FAQ Members List Calendar Search Today's Posts Mark Forums Read


Register in Forex TSD!
Trading Systems Leaders in this forum (automated trading systems) are winning more than 3000 pips in a month (30000$ investing one lot every time).
Click here to register and get more information

Reply
 
LinkBack (5) Thread Tools Display Modes
  5 links from elsewhere to this Post. Click to view. #1 (permalink)  
Old 06-20-2007, 04:20 PM
winters winters is offline
Member
 
Join Date: Jun 2006
Posts: 28
winters is on a distinguished road
Lightbulb Where to get Historical Data

Hi,
Could you please recommend where I can get a historical data starting from year 2000 ? I know Alpari provides history starting from 2004, but I could not find any.
Thanking you in advance,
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #2 (permalink)  
Old 06-20-2007, 04:36 PM
newdigital newdigital is offline
Administrator
 
Join Date: Sep 2005
Posts: 15,174
newdigital has much to be proud ofnewdigital has much to be proud ofnewdigital has much to be proud ofnewdigital has much to be proud ofnewdigital has much to be proud ofnewdigital has much to be proud ofnewdigital has much to be proud ofnewdigital has much to be proud of
Backtesting/Optimization: Backtesting/Optimization (you may find something).

Russian forum with data http://forum.viac.ru/viewtopic.php?t=2420

Alpari data is here now (new link) http://www.alpari-idc.ru/ru/quote-archives/
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #3 (permalink)  
Old 06-20-2007, 05:12 PM
winters winters is offline
Member
 
Join Date: Jun 2006
Posts: 28
winters is on a distinguished road
Smile

Thank you!
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #4 (permalink)  
Old 06-20-2007, 10:51 PM
zuijlen's Avatar
zuijlen zuijlen is offline
Member
 
Join Date: Jan 2006
Location: Arlington, VA, USA
Posts: 92
zuijlen is on a distinguished road
Alpari in English: http://www.alpari-idc.com/en/dc/databank.php

FXDD (from January 2006): http://www.fxdd.com/mt1m_data.html

I'll repeat something I posted on the IBFX forum:

Quote:
One thing to be aware of is that the time stamps of brokers may differ. For example, IBFX is at GMT and FXDD is GMT+3. You can compensate for that when importing.

Also, which was something I got hit with, make sure that your current M1 data goes at least as far back as the end of the imported data (e.g., the FXDD data ended at June 1 when I imported), otherwise you will end up with a data gap that will not get filled.

Finally, there are a few outliers in the FXDD data (sorry, I didn't keep a list) that need to be edited out. I noticed them when I used the M1 data to create data for longer timeframes. I believe the currency pairs were CHFJPY, GBPJPY, and GBPUSD.

Last edited by zuijlen : 06-20-2007 at 10:57 PM.
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #5 (permalink)  
Old 06-21-2007, 12:51 AM
MrWaltman MrWaltman is offline
Junior Member
 
Join Date: Jun 2007
Posts: 8
MrWaltman is on a distinguished road
Steer clear Alpari

Steer clear of Alpari if you wish to keep sanity. The data is corrupt and not to be relied on for anything more than chart viewing purposes.

A strategy test using live feed 'true' broker market data will yield grossly different results from Alpari.

Trust me.

WW
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #6 (permalink)  
Old 06-21-2007, 01:39 AM
zuijlen's Avatar
zuijlen zuijlen is offline
Member
 
Join Date: Jan 2006
Location: Arlington, VA, USA
Posts: 92
zuijlen is on a distinguished road
A few questions: where to get such data? And are the backtest results using such data more reliable and are they comparable with forward testing results?
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #7 (permalink)  
Old 06-21-2007, 02:07 AM
MrWaltman MrWaltman is offline
Junior Member
 
Join Date: Jun 2007
Posts: 8
MrWaltman is on a distinguished road
Data

Quote:
Originally Posted by zuijlen
A few questions: where to get such data? And are the backtest results using such data more reliable and are they comparable with forward testing results?
The best method of data is by direct import straight off the server rather than one big file dump that usuall has gaps etc. Gathering live is 'as it happened' tick by tick.

Where to get? I would go to FXDD (if they are not already your broker), open a demo, scroll back on all timeframes per currency until the chart data stops flowing (do this by either holding down the page up key or with wheel on mouse). Before doing this ensure you go tour MT4 tool bar and chose TOOLS, OPTIONS and then set max bars in histor and max bars in chart to 99999999999999. This will then default to the MT4 maximum nd ensure you grab ALL data that is available off the broker server.

Is the backtest as good as live/forward test? Answer - Some will say never and 98% I agree. It depends both on quality of data but mainly on what triggers your system. If you have a highly mechanical system that runs real time with non lag indicators the results can be very close to real. I know because I have done both. Built EA, run live, then a month later on a different MT4 station (to ensure no bias) run a backtest of same EA. The results mirrored the live almost to pip and minute with exception of few extra trades.

Getting back to Alpari. Data must be near 100% otherwise it is like trying to calibrate an engine with faulty measuring instruments. I optimized to alpari and then ran backtest on real data. The results were thousands $ difference (or not profitable at all). In the end I knew to believe broker data because results ended up same as forward test.

Hope this helps

WW
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #8 (permalink)  
Old 06-21-2007, 02:17 AM
zuijlen's Avatar
zuijlen zuijlen is offline
Member
 
Join Date: Jan 2006
Location: Arlington, VA, USA
Posts: 92
zuijlen is on a distinguished road
Thanks, that was helpful. I know about the trick to get historical data as you describe. Unfortunately, 1-minute data usually doesn't go back that far, in my experience. Did you ever save the actual tick data and backtest from that?
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #9 (permalink)  
Old 06-21-2007, 02:50 AM
MrWaltman MrWaltman is offline
Junior Member
 
Join Date: Jun 2007
Posts: 8
MrWaltman is on a distinguished road
Data

M1 obviously does'ny go back far because the data is stored at broker per candle 'count'. Hence for example 10,000 M1 candles is only a short period but 10,000 H1 candles is nearly 1.5 years.

Scroll back as far as you can and then start collecting the additional data yourself. With the way time flies you will have enough M1 data to know what your system is looking like.

I believe FXDD does have a link where you can download about 1-2 years of their M1 data so go to site and hunt it down. I still dont like imports though.

IMPORTANT - It's a good idea to save your History file every week. On most occasions when MT4 updates to a new build it often deletes the old data files and you have to start all over again which is a pain if you collected nice M1 data.

WW
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #10 (permalink)  
Old 06-21-2007, 07:37 AM
winters winters is offline
Member
 
Join Date: Jun 2006
Posts: 28
winters is on a distinguished road
I use attached EA to download all rates from real account automatically. but before you start to use it it is good to download all rates manually by scrolling the chart. Use it on M30.
Attached Files
File Type: mq4 Download-All-Rates-EA.mq4 (6.9 KB, 170 views)
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Reply


Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On
Forum Jump

LinkBacks (?)
LinkBack to this Thread: http://www.forex-tsd.com/metatrader-4/8175-where-get-historical-data.html
Posted By For Type Date
OANDA FXMessage: FOREX HISTORICAL DATA This thread Refback 04-01-2008 02:22 PM
OANDA FXMessage: Historical prices This thread Refback 01-03-2008 08:52 PM
OANDA FXMessage: Historical prices This thread Refback 01-03-2008 05:20 PM
OANDA FXMessage: FOREX HISTORICAL DATA This thread Refback 12-17-2007 08:13 AM
OANDA FXMessage: FOREX HISTORICAL DATA This thread Refback 12-15-2007 10:15 PM

Similar Threads
Thread Thread Starter Forum Replies Last Post
I need historical data for testing resalin Setup Questions 1 05-07-2007 12:46 AM
Build 200 historical data ra300z Expert Advisors - Metatrader 4 4 01-04-2007 02:03 AM
Historical Data Narc Metatrader 4 2 09-09-2006 10:28 AM
Historical Data kokas Expert Advisors - Metatrader 4 3 06-18-2006 12:46 AM
Forex Historical Data european General Discussion 2 04-24-2006 07:08 PM


All times are GMT. The time now is 10:21 PM.