Bottom line: low volatility resulted in sub-optimal trading performance. However the whole week was again profitable.
We continued our forward testing of our automated trading on real-time prices provided by TrueFX. All test parameters were unchanged since our first test.
The first trading day of the week was the most successful. The strategy gained 160 pips in 24 hours.
The graph below shows the result from the beginning of the Auckland session on Sunday until the end of the US session on Monday.
The next two days were losing days. However, in absolute numbers, the losses during these 2 days were considerably less than the win during the first day.
The results for Tuesday are on the below picture. Note we used the newer build so the interface is slightly different.
We can see that losses are limited. In total, we are still nicely up. Trade log.
Wednesday was a very slow day. The results presented below.
Again, small loss but we are still up almost 100 pips for the week. Trade log.
Thursday-Friday results are below.
Thursday was a very successful day – we were gaining steadily and the result was over 100 pips – for volatility of only 86!
Friday was very slow day with volatility under 60 but still we were gaining about 20 pips in the middle of the US session. Though we failed to keep those gains and lost some pips in the end. Trade log.
Summing up, this week was not the best one. Half of the time the market was very slow with low volatility, especially on Friday. However, even in such conditions, our strategy managed to win – just shy of 200 pips, which is good for such trading conditions.
We already reported that in our comparative testing the machine with smaller RTT was showing better trading performance. We tried to explain the fact why faster connection and better hardware combination was losing. One of the ideas we had was that if we are sending the requests too fast, the quote server may start throttling.
In order to test this, we swapped the Internet connections. So, we connected the laptop to the router with a Gigabyte Ethernet cable and the desktop was connected via the 2.4 GHz WiFi link. Now, the laptop connection was almost 4 times faster (measured with Ookla speedtest).
Here are the results. First, the desktop. In 25 hours test it gained decent 72 pips.
Win ratio of 46% was a little bit less than we regularly observed, but still OK. Average RTT was 129 ms and we got nearly 274K ticks. Here is full trade log.
Now, the other test. High connection speed wasn’t a problem at all this time.
Lower average RTT and, correspondingly, 35K (or 13%) more ticks received seemed to help a lot. Profit more than doubled. Here’s full trade log.
So, our hypothesis was wrong – throttling was not at play here. We don’t yet know the real reason. It might be network drivers of antivirus software, among other factors. Again, this is not very important.
But it is important that we again got the confirmation that TrueFX data feed with lower RTT leads to steady good trading performance.
Apparently, RTT is one of the main important factors to pay attention to when using the software in copy trade mode.
Another week of testing with the same strategy and parameters. And – same observations: over 350 pips profit, over 50% win ratio with minimum drawdown.
This week we were conducting some other testing, and we couldn’t capture the entire week test in one picture. Here is the first 3 days of testing – started on Sunday from the Sydney session.
We can see that the test report again is in line with all our previous test results that you can find published on this blog.
Now, let’s take a look at Thursday’s result.
Very similar numbers that we have already got used to. Here is the trade log.
On Friday we had a small loss during low market volatility (~80 pip). Trade log.
Friday’s result is by no means negative. First of all, you just can’t win all the time in the markets – losses are part of the game. You need to minimize them. Which our strategy clearly did. In addition, we can be satisfied with both nearly 50% win ratio and small and smooth drawdown.
Bottom line: we observed that a mere 25% increase in the round-trip time (RTT) to the TrueFX quote server resulted in considerable deterioration of the trading performance – for the same software, the strategy and its parameters.
In our previous post, we came to the conclusion that the 15% loss of ticks on the machine where the Smart Forex Tester software was run from the IDE – compared with the reference test – was caused by lower performance of the IDE version in handling HTTP requests to the TrueFX quote server.
While it is a known fact that the software run from the IDE is less optimized, we found that there are other factors at play that may better explain the difference.
We repeated our previous test – this time using the release version on both computers. The idea was to eliminate the alleged performance gap and thus minimize the difference between the number of received ticks.
Both computers had similar hardware and the Internet connections on both machines were more than adequate for the purposes of the test.
Both machines were connected to the same router. The reference setup was connected via a 2.4GHz WiFi link (Ookla speedtest: 45/5 Mbps), and the other machine had a Gigabit Ethernet connection (Ookla speedtest: 180/5 Mbps).
The below graph presents the test results for the reference setup.
Despite a small loss, we can be satisfied with this result – which was achieved during low market volatility period. And overall, this loss was a drop in the bucket – the whole week remained solidly profitable. During the first four weekdays, our automated strategy gained just shy of 400 pips.
So, this Friday’s result is also coming in line with our previous observations that about 80% of trading sessions are profitable. Win ratio was also decent.
However, the other test went much worse than the reference one.
At first glance, this result defies all logic. After all, we were using the release software this time, not the IDE. And the machine we ran it on has slightly better hardware – plus 4 times faster wired Internet connection than the reference setup.
After a quick investigation, we noticed that for some – yet unknown – reason, average RTT to the quote server was 25% more than that on the reference setup. Check the values marked by arrows on the below graph.
For the reference setup, the RTT – averaged for this 14 hours test – was 115 ms. But for a more powerful machine with a much faster Internet connection RTT was 145 ms. Now, the test result suddenly started making a lot more sense.
We will have to investigate the reason why the RTT for a more powerful setup was actually worse. But this is not the most important here.
What really matters here is that our latest results actually confirmed the conclusions of our previous test: slightly less ticks – considerably less accurate signals.
So, it appears that to properly utilize the perfect (and free!) TrueFX live feed for live trading, we should consider implementing a 2-tier structure.
First, we have to make sure the software is run in the environment with the smallest possible RTT: less than 100ms should be good, and less than 50 – ideal. RTT this low will guarantee the best possible trading signals. Arranging a VPS physically close to the TrueFX server location is the way to achieve that.
Next, once a signal is generated, we can probably afford a reasonable (200-300 ms) delay for the trades’ execution: relying on the fact that in many cases, the market may see-saw a bit.
We already mentioned that our tests showed that our strategy is consistently profitable when tested on TrueFX live price feed. And we noticed that one reason for this is much higher tick data rate that TrueFX provides – compared to the feeds from all other brokers that we tested with.
Today we compared the trading performance for 2 different environments – and both were using the TrueFX live feed for GBPUSD.
The other setup was our development environment (IDE). So, it was less optimized than the release version. The IDE machine is a little bit more powerful than the laptop – this is the only thing we need to know hardware-wise. Both machines were connected to the same router.
We started both tests simultaneously about 40 minutes into Sydney trading session on November, 11 and kept it running for 18 hours – through all UK session and half of the US session on November, 12.
The graph below shows the results from the test run with the release version.
We can gladly notice that the performance was again (!) in line with the test results that we have been getting for last couple of month. Same healthy win ratio and low drawdown.
Now, let’s check the results of the test that was run from the IDE. The software in this test is essentially the same as the release. We did implement some improvements, but they don’t affect performance anyhow – while the trading strategy itself and all other trading related code remained unchanged.
We see that while the results are not bad at all in absolute terms, they pale in comparison with the reference test. Why do we have this difference?
What we observed was that before the European session started, in slow Asian trading the results match almost 100%. Thus additionally verifying the fact that both softwares works the same.
However, once the market started moving fast in the European session, the results started to differ. And we noticed that the IDE version received ~40K ticks (or 15%) less than the reference release version.
The reason for this difference is clear – less optimized code was not able to handle the same number of quote requests to the TrueFX server.
We can say that 40K is relatively big number. From our experience, from some brokers we could get even less than that – in total!
So, this test confirms our observation we did from the very beginning of testing. Namely, live price feed quality is essential for the success of the strategy.
And we now see that even for the feed that is known to work very well, we can get deteriorated trading performance if parts of ticks are not received.
During the week of November 1-6 we continued forward testing of our automated trading strategy on TrueFX GBPUSD live prices. We kept the parameters unchanged since our first test.
The results for the whole week are presented below.
In summary, the test passed with flying colors. The strategy delivered a solid gain of over 500 pips with 51% total win rate.
The test started 25 minutes into the Hong Kong session on Sunday, and was running uninterrupted in full-auto mode until the end of the New York session on Friday.
One important thing to note is small drawdown – you can see it visually on the profit chart. If you are interested to go in detail, here is the full trade report.
In the next report we will add the drawdown calculation to the report.
Bottom line – over 2 month of forward testing show that our strategy delivers stable profits week after week. Losing days are rare. High (over 50%) win rate is consistent as well.
So, our conclusion in the very first report is still the same. The strategy is ready for real trading (even though it is still a prototype!), but we need to find the way to reliable execute the trades. TrueFX provides excellent quality live prices but only institution can get access to trade them.
Trade copier is intended to use in live trading the winning trading signals achieved by our automated trader running on the TrueFX data feed.
We continued testing on GBPUSD, since this currency pair delivered good results in our previous testing. The reference test was using the inbuilt TrueFX data feed and inbuilt Autotrader strategy (version1).
We started both tests during London trading session on October 28, 2020.
We see that the result is overall positive, and in line with previous testing – though the win ratio was slightly lower that what we used to achieve.
The copier was placing the trades to the IG demo feed via the MT connector. We see the same number of trades but the results are worse.
Partly this was caused by requotes; some of which required up to 5 retries to complete the trade.
Below is a log snippet showing how the strategy attempted to close one BUY order. You can see it took nearly 1.5 s to close which resulted in the eventual closing price slippage of 3.7 pips.
2020.10.28 02:18:10 : elapsed 0 ms; order type: BUY; attempting to close at 1.29837 2020.10.28 02:18:10 : elapsed 390 ms; order closing failed for price: 1.29837 Error code: 138 2020.10.28 02:18:10 : elapsed 687 ms; order closing failed for price: 1.29822 Error code: 138 2020.10.28 02:18:11 : elapsed 1078 ms; order closing failed for price: 1.29811 Error code: 138 2020.10.28 02:18:11 : elapsed 1406 ms; order closing retries: 3 2020.10.28 02:18:11 : order close price: 1.298
On the one hand, the delay and pip loss from the requotes were not too big in absolute numbers. On the other hand, these delays confused the algorithm and spoiled next trade entries.
We repeated the copier test the next day. Our reference test was running non-stop. We started the Copier at about the same time into the London session as the day before.
Below is the reference test result. You can see that the performance was not ideal but still from the beginning of the Copier test it was profitable (~15 pips) and the total win ratio improved to 51%.
However, the Copier was less successful. And we again had a lot of retries – maximum number of retries was 8!
Bottom line. Our tests proved the copier idea is viable. We improved our MT connector and made it robust to trade errors. However, we will need to find a better feed to test the Copier on. Another lesson learned is that we need to make the automated trading strategy itself less dependent on such errors.
We continued testing our automated trading strategy during the week of October 26-30. We used TrueFX live data feed on GBPUSD. We kept the parameters unchanged since our first test.
Due to technical issues we lost the graphs for the first 2 days of the week. Here’s the summary: on Monday, the strategy delivered a small loss of about 50 pips, but on Tuesday was up twice as much.
The results for the rest of the week are presented below. Most important result was that the cumulative win ratio was in line with the previous tests: stable and reliably exceeded 50%.
Not less significant is the fact the the strategy was again profitable for the whole week – despite the 2 losing streaks Monday and Wednesday (Asian session + the beginning of the European session). Note that the dashed vertical lines denote date change.
We used the same parameters as described in 2 our previous reports and the test was running in full auto mode non-stop from the beginning of the London trading session.
The results are decent: 310 pips profit and 57% win ratio.
Of especial importance is a smooth equity curve with minimum drawdown.
It’s good to notice that we have been getting consistent results for the second month of tests.
This week (October 5-9) we tested the version1 of this strategy. We were running the test on the GBP/USD – the currency pair that showed amazing results in the monthly test, often scoring twice more pips in profit than the currency pair’s volatility.
The version1 of our automated strategy delivered similar results when tested on the same live price feed. We used exactly the same parameters an in the previous test.
The graph shows all the trading session from Tuesday London thru Friday NY.
The strategy was on all the time. We see the same pattern as in the previous tests: solid gains on volatile UK sessions (starting at dashed vertical lines) and small losses in slow trading between the NY and UK sessions.
On Thursday’s (as well as on not shown Monday’s) session the result was about zero. In Forex this is not a bad result at all.
In addition, note that the profit curve is smooth. Our 24/5 trading strategy is designed not to allow big single losses. Also you can see that the longest losing streaks happened during the quiet Asian sessions, so in absolute figures, the draw-down was small.
The overall win ratio was 50.2%, which means that on average we were winning much more than we lose. If we paused the strategy during the Asian sessions, the win ratio would have jumped considerably: as we discussed in the previous test report, our current strategy is more suitable for trending markets.
But since we want the strategy to be universal and be able to run 24/5, in the future versions we will add the mean reversal algorithm that will be activated both by time (for Asian session) and market action (e.g. when the volatility is low and the markets are threading water).
Don’t have the Smart Forex Tester Suite yet? Get it here.