Research Article
Modified Neural Network Algorithms for Predicting Trading Signals of Stock Market Indices
C. D. Tilakaratne,1 M. A. Mammadov,2 and S. A. Morris2
1Department of Statistics, University of Colombo, P.O. Box 1490, Colombo 3, Sri Lanka
2Graduate School of Information Technology and Mathematical Sciences, University of Ballarat, P.O. Box 663, Ballarat, Victoria 3353, Australia

Received 29 November 2008; Revised 17 February 2009; Accepted 8 April 2009

Academic Editor: Lean Yu

Copyright © 2009 C. D. Tilakaratne et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract
The aim of this paper is to present modified neural network algorithms to predict whether it is best to buy, hold, or sell shares (trading signals) of stock market indices. Most commonly used classification techniques are not successful in predicting trading signals when the distribution of the actual trading signals, among these three classes, is imbalanced. The modified network algorithms are based on the structure of feedforward neural networks and a modified Ordinary Least Squares (OLSs) error function. An adjustment relating to the contribution from the historical data used for training the networks and penalisation of incorrectly classified trading signals were accounted for, when modifying the OLS function. A global optimization algorithm was employed to train these networks. These algorithms were employed to predict the trading signals of the Australian All Ordinary Index. The algorithms with the modified error functions introduced by this study produced better predictions.

1. Introduction
A number of previous studies have attempted to predict the price levels of stock market indices [1–4]. However, in the last few decades, there have been a growing number of studies attempting to predict the direction or the trend movements of financial market indices [5–11]. Some studies have suggested that trading strategies guided by forecasts on the direction of price change may be more effective and may lead to higher profits [10]. Leung et al. [12] also found that the classification models based on the direction of stock return outperform those based on the level of stock return in terms of both predictability and profitability.

The most commonly used techniques to predict the trading signals of stock market indices are feedforward neural networks (FNNs) [9, 11, 13], probabilistic neural networks (PNNs) [7, 12], and support vector machines (SVMs) [5, 6]. FNN outputs the value of the stock market index (or a derivative), and subsequently this value is classified into classes (or direction). Unlike FNN, PNN and SVM directly output the corresponding class.

Almost all of the above mentioned studies considered only two classes: the upward and the downward trends of the stock market movement, which were considered as buy and sell signals [5–7, 9, 11]. It was noticed that the time series data used for these studies are approximately equally distributied among these two classes.

In practice, the traders do not participate in trading (either buy or sell shares) if there is no substantial change in the price level. Instead of buying/selling, they will hold the money/shares in hand. In such a case it is important to consider the additional class which represents a hold signal. For instance, the following criterion can be applied to define three trading signals, buy, hold, and sell.

Criterion A. (1.1) where is the relative return of the Close price of day of the stock market index of interest, while and are thresholds.

The values of and depend on the traders’ choice. There is no standard criterion found in the literature how to decide the values of and , and these values may vary from one stock index to another. A trader may decide the values for these thresholds according to his/her knowledge and experience.

The proper selection of the values for and could be done by performing a sensitivity analysis. The Australian All Ordinary Index (AORD) was selected as the target stock market index for this study. We experimented different pairs of values for and [14]. For different windows, different pairs gave better predictions. These values also varied according to the prediction algorithm used. However, for the definition of trading signals, these values needed to be fixed.

By examining the data distribution (during the study period, the minimum, maximum, and average for the relative returns of the Close price of the AORD are , 0.0573, and 0.0003, resp.), we chose for this study, assuming that 0.5% increase (or decrease) in Close price of day compared to that of day is reasonable enough to consider the corresponding movement as a buy (or sell) signal. It is unlikely that a change in the values of and would make a qualitative change in the prediction results obtained.

According to Criterion A with , one cannot expect a balanced distribution of data among the three classes (trading signals) because more data falls into the hold class while less data falls into the other two classes.

Due to the imbalance of data, the most classification techniques such as SVM and PNN produce less precise results [15–17]. FNN can be identified as a suitable alternative technique for classification when the data to be studied has an imbalanced distribution. However, a standard FNN itself shows some disadvantages: (a) use of local optimization methods which do not guarantee a deep local optimal solution; (b) because of (a), FNN needs to be trained many times with different initial weights and biases (multiple training results in more than one solution and having many solutions for network parameters prevent getting a clear picture about the influence of input variables); (c) use of the ordinary least squares (OLS; see (2.1) as an error function to be minimised may not be suitable for classification problems.

To overcome the problem of being stuck in a local minimum, finding a global solution to the error minimisation function is required. Several past studies attempted to find global solutions for the parameters of the FNNs, by developing new algorithms (e.g., [18–21]). Minghu et al. [19] proposed a hybrid algorithm of global optimization of dynamic learning rate for FNNs, and this algorithm shown to have global convergence for error backpropagation multilayer FNNs (MLFNNs). The study done by Ye and Lin [21] presented a new approach to supervised training of weights in MLFNNs. Their algorithm is based on a “subenergy tunneling function’’ to reject searching in unpromising regions and a “ripple-like’’ global search to avoid local minima. Jordanov [18] proposed an algorithm which makes use of a stochastic optimization technique based on the so-called low-discrepancy sequences to trained FNNs. Toh et al. [20] also proposed an iterative algorithm for global FNN learning.

This study aims at modifying neural network algorithms to predict whether it is best buy, hold, or sell the shares (trading signals) of a given stock market index. This trading system is designed for short-term traders to trade under normal conditions. It assumes stock market behaviour is normal and does not take unexceptional conditions such as bottlenecks into consideration.

When modifying algorithms, two matters were taken into account: (1) using a global optimization algorithm for network training and (2) modifying the ordinary least squares error function. By using a global optimization algorithm for network training, this study expected to find deep solutions to the error function. Also this study attempted to modify the OLS error function in a way suitable for the classification problem of interest.

Many previous studies [5–7, 9, 11] have used technical indicators of the local markets or economical variables to predict the stock market time series. The other novel idea of this study is the incorporation of the intermarket influence [22, 23] to predict the trading signals.

The organisation of the paper is as follows. Section 2 explains the modification of neural network algorithms. Section 3 describes the network training, quantification of intermarket influence, and the measures of evaluating the performance of the algorithms. Section 4 presents the results obtained from the proposed algorithms together with their interpretations. This section also compares the performance of the modified neural network algorithms with that of the standard FNN algorithm. The last section is the conclusion of the study.

2. Modified Neural Network Algorithms
In this paper, we used modified neural network algorithms for forecasting the trading signals of stock market indices. We used the standard FNN algorithm as the basis of these modified algorithms.

A standard FNN is a fully connected network with every node in the lower layer linked to every node in the next higher layer. These linkages are attached with some weights, , where is the number of all possible linkages. Given weight, , the network produces an output for each input vector. The output corresponding to the th input vector will be denoted by .

FNNs adopt the backpropagation learning that finds optimal weights by minimising an error between the network outputs and given targets [24]. The most commonly used error function is the Ordinary Least Squares function (OLS):

(2.1) where is the total number of observations in the training set, while and are the target and the output corresponding to the th observation in the training set.

2.1. Alternative Error Functions
As described in the Introduction (see Section 1), in financial applications, it is more important to predict the direction of a time series rather than its value. Therefore, the minimisation of the absolute errors between the target and the output may not produce the desired accuracy of predictions [24, 25]. Having this idea in mind, some past studies aimed to modify the error function associated with the FNNs (e.g., [24–27]). These studies incorporated factors which represent the direction of the prediction (e.g., [24–26]) and the contribution from the historical data that used as inputs (e.g., [24, 25, 27]).

The functions proposed in [24–26] penalised the incorrectly predicted directions more heavily, than the correct predictions. In other words, higher penalty was applied if the predicted value, , is negative when the target, , is positive or viceversa.

Caldwell [26] proposed the Weighted Directional Symmetry (WDS) function which is given as follows:

(2.2) where

(2.3) and is the total number of observations.

Yao and Tan [24, 25] argued that the weight associated with (i.e., ) should be heavily adjusted if a wrong direction is predicted for a larger change, while it should be slightly adjusted if a wrong direction is predicted for a smaller change and so on. Based on this argument, they proposed the Directional Profit adjustment factor:

(2.4) where , and is the standard deviation of the training data (including validation set). For the experiments authors used , and [24, 25]. By giving these weights, they tried to impose a higher penalty the predictions whose direction is wrong and the magnitude of the error is lager, than the other predictions.

Based on this Directional Profit adjustment factor (2.4), Yao and Tan [24, 25] proposed Directional Profit (DP) model [24, 25]:

(2.5) Refenes et al. [27] proposed Discounted Least Squares (LDSs) function by taking the contribution from the historical data into accounts as follows:

(2.6) where is an adjustment relating to the contribution of the th observation and is described by the following equation:

(2.7) Discount rate denotes the contribution from the historical data. Refenes et al. [27] suggested .

Yao and Tan [24, 25] proposed another error function, Time Dependent directional Profit (TDP) model, by incorporating the approach suggested by Refenes et al. [27] to their Directional Profit Model (2.5):

(2.8) where and are described by (2.4) and (2.7), respectively.

Note. Refenes et al. [27] and Yao and Tan [24, 25] used instead of in the formulas given by (2.5), (2.6), and (2.8).

2.2. Modified Error Functions
We are interested in classifying trading signals into three classes: buy, hold, and sell. The hold class includes both positive and negative values (see Criterion A in Section 1). Therefore, the least squares functions, in which the cases with incorrectly predicted directions (positive or negative) are penalised (e.g., the error functions given by (2.5) and (2.8), will not give the desired prediction accuracy. For example, suppose that and . In this case the predicted signal is correct, according to Criterion A. However, the algorithms used in [24, 25] try to minimise error function as (refer (2.8). In fact such a minimisation is not necessary, as the predicted signal is correct. Therefore, instead of the weighing schemes suggested by previous studies, we proposed a different scheme of weighing.

Unlike the weighing schemes suggested in [24, 25], which impose a higher penalty on the predictions whose sign (i.e., negative or positive) is incorrect, this novel scheme is based on the correctness of the classification of trading signals. If the predicted trading signal is correct, we assign a very small (close to zero) weight and, otherwise, assign a weight equal to 1. Therefore, the proposed weighing scheme is

(2.9) where is a very small value. The value of needs to be decided according to the distribution of data.

2.2.1. Proposed Error Function 1
The weighing scheme, , incorporated in the Directional Profit (DP) error function (2.5) considers only two classes, upward and downward trends (direction) which are corresponding to buy and sell signals. In order to deal with three classes, buy, hold, and sell, we modified this error function by replacing with the new weighing scheme (see (2.9). Hence, the new error function () is defined as

(2.10) When training backpropagation neural networks using (2.10) as the error minimisation function, the error is forced to take a smaller value, if the predicted trading signal is correct. On the other hand, the actual size of the error is considered in the cases of misclassifications.

2.2.2. Proposed Error Function 2
The contribution from the historical data also plays an important role in the prediction accuracy of financial time series. Therefore, Yao and Tan [24, 25] went further by combining DP error function (see (2.5) with DLS error function (see (2.6) and proposed Time Dependent Directional Profit (TDP) error function (see (2.8).

Following Yao and Tan [23, 24], this study also proposed a similar error function, ETCC, by combining first new error function () described by (2.10) with the DLS error function (). Hence the second proposed error function is

(2.11) where and are defined by (2.7) and (2.9), respectively.

The difference between the TDP error function (see (2.8) and this second new error function (2.11) is that is replaced by in order to deal with three classes: buy, hold, and sell.

2.3. Modified Neural Network Algorithms
Modifications to neural network algorithms were done by (i) using the OLS error function as well as the modified least squares error functions; (ii) employing a global optimization algorithm to train the networks.

The importance of using global optimization algorithms for the FNN training was discussed in Section 1. In this paper, we applied the global optimization algorithm, AGOP (introduced in [28, 29]), for training the proposed network algorithms.

As the error function to be minimised, we considered (see (2.1) and (see (2.6) together with the two modified error functions (see (2.10) and (see (2.11). Based on these four error functions, we proposed the following algorithms:

(i) —neural network algorithm based on the Ordinary Least Squares error function, (see (2.1);
(ii) —neural network algorithm based on the Discounted Least Squares error function, (see (2.6);
(iii) —neural network algorithm based on the newly proposed error function 1, (see (2.10);
(iv) —neural network algorithm based on the newly proposed error function 2, (see (2.11). The layers are connected in the same structure as the FNN (Section 2). A tan-sigmoid function was used as the transfer function between the input layer and the hidden layer, while the linear transformation function was employed between the hidden and the output layers.

Algorithm differs from the standard FNN algorithm since it employs a new global optimization algorithm for training. Similarly, also differs from the respective algorithm used in [24, 25] due to the same reason. In addition to the use of new training algorithm, and are based on two different modified error functions. The only way to examine whether these new modified neural network algorithms perform better than the existing ones (in the literature) is to conduct numerical experiments.

3. Network Training and Evaluation
The Australian All Ordinary Index (AORD) was selected as the stock market index whose trading signals are to be predicted. The previous studies done by the authors [22] suggested that the lagged Close prices of the US S∖&P 500 Index (GSPC), the UK FTSE 100 Index (FTSE), French CAC 40 Index (FCHI), and German DAX Index (GDAXI) as well as that of the AORD itself showed an impact on the direction of the Close price of day of the AORD. Also it was found that only the Close prices at lag 1 of these markets influence the Close price of the AORD [22, 23]. Therefore, this study considered the relative return of the Close prices at lag 1 of two combinations of stock market indices when forming input sets: (i) a combination which includes the GSPC, FTSE, FCHI, and the GDAXI; (ii) a combination which includes the AORD in addition to the markets included in (i).

The input sets were formed with and without incorporating the quantified intermarket influence [22, 23, 30] (see Section 3.1). By quantifying intermarket influence, this study tries to identify the influential patterns between the potential influential markets and the AORD. Training the network algorithms with preidentified patterns may enhance their learning. Therefore, it can be expected that the using quantified intermarket influence for training algorithms produces more accurate output.

The quantification of intermarket influence is described in Section 3.1, while Section 3.2 presents the input sets used for network training.

Daily relative returns of the Close prices of the selected stock market indices from 2nd July 1997 to 30th December 2005 were used for this study. If no trading took place on a particular day, the rate of change of price should be zero. Therefore, before calculating the relative returns, the missing values of the Close price were replaced by the corresponding Close price of the last trading day.

The minimum and the maximum values of the data (relative returns) used for network training are and 0.057, respectively. Therefore, we selected the value of (see Section 2.2) as 0.01. If the trading signals are correctly predicted, 0.01 is small enough to set the value of the proposed error functions (see (2.10) and (2.11) to approximately zero.

Since, influential patterns between markets are likely to vary with time [30], the whole study period was divided into a number of moving windows of a fixed length. Overlapping windows of length three trading years were considered (1 trading year 256 trading days) . A period of three trading years consists of enough data (768 daily relative returns) for neural network experiments. Also the chance that outdated data (which is not relevant for studying current behaviour of the market) being included in the training set is very low.

The most recent 10% of data (the last 76 trading days) in each window were accounted for out of sample predictions, while the remaining 90% of data were allocated for network training. We called the part of the window which allocated for training the training window. Different number of neurons for the hidden layer was tested when training the networks with each input set.

As described in Section 2.1, the error function, (see (2.6), consists of a parameter (discount rate) which decides the contribution from the historical data of the observations in the time series. Refenes et al. [27] fixed for their experiments. However, the discount rate may vary from one stock market index to another. Therefore, this study tested different values for when training network . Observing the results, the best value for was selected, and this best value was used as when training network .

3.1. Quantification of Intermarket Influences
Past studies [31–33] confirmed that the most of the world’s major stock markets are integrated. Hence, one integrated stock market can be considered as a part of a single global system. The influence from one integrated stock market on a dependent market includes the influence from one or more stock markets on the former.

If there is a set of influential markets to a given dependent market, it is not straightforward to separate influence from individual influential markets. Instead of measuring the individual influence from one influential market to a dependent market, the relative strength of the influence from this influential market to the dependent market can be measured compared to the influence from the other influential markets. This study used the approach proposed in [22, 23] to quantify intermarket influences. This approach estimates the combined influence of a set of influential markets and also the contribution from each influential market to the combined influence.

Quantification of intermarket influences on the AORD was carried out by finding the coefficients,    (see Section 3.1.1), which maximise the median rank correlation between the relative return of the Close of day of the AORD market and the sum of multiplied by the relative returns of the Close prices of day t of a combination of influential markets over a number of small nonoverlapping windows of a fixed size. The two combinations of markets, which are previously mentioned this section, were considered. measures the contribution from the th influential market to the combined influence which is estimated by the optimal correlation.

There is a possibility that the maximum value leads to a conclusion about a relationship which does not exist in reality. In contrast, the median is more conservative in this respect. Therefore, instead of selecting the maximum of the optimal rank correlation, the median was considered.

Spearman’s rank correlation coefficient was used as the rank correlation measure. For two variables and , Spearman’s rank correlation coefficient, , can be defined as

(3.1) where is the total number of bivariate observations of and is the difference between the rank of and the rank of in the th observation, and and are the number of tied observations of and , respectively.

The same six training windows employed for the network training were considered for the quantification of intermarket influence on the AORD. The correlation structure between stock markets also changes with time [31]. Therefore, each moving window was further divided into a number of small windows of length 22 days. 22 days of a stock market time series represent a trading month. Spearman’s rank correlation coefficients (see (3.1) were calculated for these smaller windows within each moving window.

The absolute value of the correlation coefficient was considered when finding the median optimal correlation. This is appropriate as the main concern is the strength rather than the direction of the correlation (i.e., either positively or negatively correlated).

The objective function to be maximised (see Section 3.1.1 given below) is defined by Spearman’s correlation coefficient, which uses ranks of data. Therefore, the objective function is discontinuous. Solving such a global optimization problem is extremely difficult because of the unavailability of gradients. We used the same global optimization algorithm, AGOP, which was used for training the proposed algorithms (see Section 2.3) to solve this optimization problem.

3.1.1. Optimization Problem
Let be the relative return of the Close price of a selected dependent market at time , and let be the relative return of the Close price of the th influential market at time . Define as

(3.2) where the coefficient measures the strength of influence from each influential market , while is the total number of influential markets.

The aim is to find the optimal values of the coefficients, , which maximise the rank correlation between and for a given window.

The correlation can be calculated for a window of a given size. This window can be defined as

(3.3) where is the starting date of the window, and is its size (in days). This study sets days.

Spearman’s correlation (see (3.1) between the variables , defined on the window , will be denoted as

(3.4) To define optimal values of the coefficients for a long time period, the following method is applied. Let be a given period (e.g., a large window). This period is divided into windows of size (we assume that is an integer) as follows:

(3.5) so that,

(3.6) The correlation coefficient between and defined on the window is denoted as (3.7) To define an objective function over the period , the median of the vector, , is used. Therefore, the optimization problem can be defined as

(3.8) The solution to (3.8) is a vector, , where denotes the strength of the influence from the th influential market.

In this paper, the quantity, , is called the quantified relative return corresponding to the th influential market.

3.2. Input Sets
The following six sets of inputs were used to train the modified network algorithms introduced in Section 2.3.

(1) Four input features of the relative returns of the Close prices of day of the market combination (i) (i.e., GSPC(), FTSE(), FCHI(), and GDAXI()—denoted by GFFG.
(2) Four input features of the quantified relative returns of the Close prices of day of the market combination (i) (i.e., GSPC(), FTSE(), FCHI(), and GDAXI()—denoted by GFFG-q.
(3) Single input feature consists of the sum of the quantified relative returns of the Close prices of day of the market combination (i) (i.e., GSPC() FTSE() FCHI() GDAXI()—denoted by GFFG-sq.
(4) Five input features of the relative returns of the Close prices of day of the market combination (ii) (i.e., GSPC(), FTSE(), FCHI(), GDAXI(), and AORD()—denoted by GFFGA.
(5) Five input features of the quantified relative returns of the Close prices of day of the market combination (ii) (i.e., GSPC(), FTSE(), FCHI(), GDAXI(), and AORD()—denoted by GFFGA-q.
(6) Single input feature consists of the sum of the quantified relative returns of the Close prices of day of the market combination (ii) (i.e., GSPC() + FTSE FCHI GDAXI AORD()—denoted by GFFGA-sq. () and (,) are solutions to (3.8) corresponding to the market combinations (i) and (ii), previously mentioned in Section 3. These solutions relating to the market combinations (i) and (ii) are shown in the Tables 1 and 2, respectively. We note that and are not necessarily be equal.

Table 1: Optimal values of quantification coefficients (ξ) and the median optimal Spearman’s correlations corresponding to market combination (i) for different training windows. Table 2: Optimal values of quantification coefficients (ξ) and the median optimal Spearman’s correlations corresponding to market combination (ii) for different training windows.
3.3. Evaluation Measures
The networks proposed in Section 2.3 output the th day relative returns of the Close price of the AORD. Subsequently, the output was classified into trading signals according to Criterion A (see Section 1).

The performance of the networks was evaluated by the overall classification rate () as well as by the overall misclassification rates ( and ) which are defined as follows:

(3.9) where and are the number of test cases with correct predictions and the total number of cases in the test sample, respectively, as follows:

(3.10) where is the number of test cases where a buy/sell signal is misclassified as a hold signals or vice versa. is the test cases where a sell signal is classified as a buy signal and vice versa.

From a trader’s point of view, the misclassification of a hold signal as a buy or sell signal is a more serious mistake than misclassifying a buy signal or a sell signal as a hold signal. The reason is in the former case a trader will loses the money by taking part in an unwise investment while in the later case he/she only lose the opportunity of making a profit, but no monetary loss. The most serious monetary loss occurs when a buy signal is misclassified as a sell signal and viceversa. Because of the seriousness of the mistake, plays a more important role in performance evaluation than .

4. Results Obtained from Network Training
As mentioned in Section 3, different values for the discount rate, , were tested. was considered when training . The prediction results improved with the value of up to 5. For the prediction results remained unchanged. Therefore, the value of was fixed at 5. As previously mentioned (see Section 3), was used as the discount rate also in algorithm.

We trained the four neural network algorithms by varying the structure of the network; that is by changing the number of hidden layers as well as the number of neurons per hidden layer. The best four prediction results corresponding to the four networks were obtained when the number of hidden layers equal to one is and, the number of neurons per hidden layer is equal to two (results are shown in Tables 12, 13, 14, 15). Therefore, only the results relevant to networks with two hidden neurons are presented in this section. Table 3 to Table 6 present the results relating to neural networks, , and , respectively.

Table 3: Results obtained from training neural network, NN OLS. The best prediction results are shown in bold colour.
The best prediction results from were obtained when the input set GFFG-q (see Section 3.2) was used as the input features (see Table 3). This input set consists of four inputs of the quantified relative returns of the Close price of day t of the GSPC and the three European stock indices.

yielded nonzero values for the more serious classification error, , when the multiple inputs (either quantified or not) were used as the input features (see Table 4). The best results were obtained when the networks were trained with the single input representing the sum of the quantified relative returns of the Close prices of day t of the GSPC, the European market indices, and the AORD (input set GFFGA-sq; see Section 3.2). When the networks were trained with the single inputs (input sets GFFG-sq and GFFGA-sq; see Section 3.2) the serious misclassifications were prevented.

Table 4: Results obtained from training neural network, NN DLS. The best prediction results are shown in bold colour.
The overall prediction results obtained from the seem to be better than those relating to , (see Tables 3 and 4).

Compared to the predictions obtained from , those relating to are better (see Tables 4 and 5). In this case the best prediction results were obtained when the relative returns of day t of the GSPC and the three European stock market indices (input set GFFG) were used as the input features (see Table 5). The classification rate was increased by 1.02% compared to that of the best prediction results produced by (see Tables 3 and 5).

Table 5: Results obtained from training neural network, NN CC. The best prediction results are shown in bold colour. Table 6: Results obtained from training neural network, NN TCC. The best prediction results are shown in bold colour.
Table 6 shows that also produced serious misclassifications. However, these networks produced high overall classification accuracy and also prevented serious misclassifications when the quantified relative returns of the Close prices of day t of the GSPC and the European stock market indices (input set GFFG-q) were used as the input features. The accuracy was the best among all four types of neural network algorithms considered in this study.

provided 1.34% increase in the overall classification rate compared to . When compared with the showed a 2.37% increase in the overall classification rate, and this can be considered as a good improvement in predicting trading signals.

4.1. Comparison of the Performance of Modified Algorithms with that of the Standard FNN Algorithm
Table 7 presents the average (over six windows) classification rates, and misclassification rates related to prediction results obtained by training the standard FNN algorithm which consists of one hidden layer with two neurons. In order to compare the prediction results with those of the modified neural network algorithms, the number of hidden layers was fixed as one, while the number of hidden neurons were fixed as two. These FNNs was trained for the same six windows (see Section 3) with the same six input sets (see Section 3.2). The transfer functions employed are same as those of the modified neural network algorithms (see Section 2.3).

Table 7: Results obtained from training standard FNN algorithms. The best prediction results are shown in bold colour.
When the overall classification and overall misclassification rates given in Table 7 are compared with the respective rates (see Tables 3 to 6) corresponding to the modified neural network algorithms, it is clear that the standard FNN algorithm shows poorer performance than those of all four modified neural network algorithms. Therefore, it can be suggested that all modified neural network algorithms perform better when predicting the trading signals of the AORD.

4.2. Comparison of the Performance of the Modified Algorithms
The best predictions obtained by each algorithm were compared by using classification and misclassification rates. The classification rate indicates the proportion of correctly classified signals to a particular class out of the total number of actual signals in that class whereas, the misclassification rate indicates the proportion of incorrectly classified signals from a particular class to another class out of the total number of actual signals in the former class.

4.2.1. Prediction Accuracy
The average (over six windows) classification and misclassification rates related to the best prediction results obtained from , and are shown in Tables 8 to 11, respectively.

Table 8: Average (over six windows) classification and misclassification rates of the best prediction results corresponding to NN OLS (trained with input set GFFG-q; refer Table 3). Table 9: Average (over six windows) classification and misclassification rates of the best prediction results corresponding to NN DLS (trained with input set GFFGA-sq; refer Table 4).
Among the best networks corresponding to the four algorithms considered, the best network of the algorithm based on the proposed error function 2 (see (2.11) showed the best classification accuracies relating to buy and sell signals (27% and 25%, resp.; see Tables 8 to 11). Also this network classified more than 89% of the hold signals accurately and it is the second best rate for the hold signal. The rate of misclassification from hold signals to buy is the lowest when this network was used for prediction. The rate of misclassification from hold class to sell class is also comparatively low (6.22%, which is the second lowest among the four best predictions).

The network corresponding to the algorithm based on the proposed error function 1 (see (2.10) produced the second best prediction results. This network accounted for the second best prediction accuracies relating to buy and sell signals while it produced the best predictions relating to hold signals (Table 10).

Table 10: Average (over six windows) classification and misclassification rates of the best prediction results corresponding to NN CC (trained with input set GFFG; refer Table 5). Table 11: Average (over six windows) classification and misclassification rates of the best prediction results corresponding to NN TCC (trained with input set GFFG-q; refer Table 6). Table 12: Results obtained from training neural network, with different number of hidden neurons. Table 13: Results obtained from training neural network, with different number of hidden neurons. Table 14: Results obtained from training neural network, with different number of hidden neurons. Table 15: Results obtained from training neural network, with different number of hidden neurons.
4.3. Comparisons of Results with Other Similar Studies
Most of the studies [8, 9, 11, 13, 22], which used FNN algorithms for predictions, are aimed at predicting the direction (up or down) of a stock market index. Only a few studies [14, 17], which used the AORD as the target market index, predicted whether to buy, hold or sell stocks. These studies employed the standard FNN algorithm (that is with OLS error function) for prediction. However, the comparison of results obtained from this study with the above mentioned two studies is impossible as they are not in the same form.

5. Conclusions
The results obtained from the experiments show that the modified neural network algorithms introduced by this study perform better than the standard FNN algorithm in predicting the trading signals of the AORD. Furthermore, the neural network algorithms, based on the modified OLS error functions introduced by this study (see (2.10) and (2.11), produced better predictions of trading signals of the AORD. Of these two algorithms, the one-based on (2.11) showed the better performance. This algorithm produced the best predictions when the network consisted of one hidden layer with two neurons. The quantified relative returns of the Close prices of the GSPC and the three European stock market indices were used as the input features. This network prevented serious misclassifications such as misclassification of buy signals to sell signals and viceversa and also predicted trading signals with a higher degree of accuracy.

Also it can be suggested that the quantified intermarket influence on the AORD can be effectively used to predict its trading signals.

The algorithms proposed in this paper can also be used to predict whether it is best to buy, hold, or sell shares of any company listed under a given sector of the Australian Stock Exchange. For this case, the potential influential variables will be the share price indices of the companies listed under the stock of interest.

Furthermore, the approach proposed by this study can be applied to predict trading signals of any other global stock market index. Such a research direction would be very interesting especially in a period of economic recession, as the stock indices of the world’s major economies are strongly correlated during such periods.

Another useful research direction can be found in the area of marketing research. That is the modification of the proposed prediction approach to predict whether market share of a certain product goes up or not. In this case market shares of the competitive brands could be considered as the influential variables.

References
B. Egeli, M. Ozturan, and B. Badur, “Stock market prediction using artificial neural networks,” in Proceedings of the 3rd Hawaii International Conference on Business, pp. 1–8, Honolulu, Hawaii, USA, June 2003.
R. Gençay and T. Stengos, “Moving average rules, volume and the predictability of security returns with feedforward networks,” Journal of Forecasting, vol. 17, no. 5-6, pp. 401–414, 1998.
M. Qi, “Nonlinear predictability of stock returns using financial and economic variables,” Journal of Business & Economic Statistics, vol. 17, no. 4, pp. 419–429, 1999.
M. Safer, “A comparison of two data mining techniques to predict abnormal stock market returns,” Intelligent Data Analysis, vol. 7, no. 1, pp. 3–13, 2003.
L. Cao and F. E. H. Tay, “Financial forecasting using support vector machines,” Neural Computing & Applications, vol. 10, no. 2, pp. 184–192, 2001.
W. Huang, Y. Nakamori, and S.-Y. Wang, “Forecasting stock market movement direction with support vector machine,” Computers and Operations Research, vol. 32, no. 10, pp. 2513–2522, 2005.
S. H. Kim and S. H. Chun, “Graded forecasting using an array of bipolar predictions: application of probabilistic neural networks to a stock market index,” International Journal of Forecasting, vol. 14, no. 3, pp. 323–337, 1998.
H. Pan, C. Tilakaratne, and J. Yearwood, “Predicting Australian stock market index using neural networks exploiting dynamical swings and intermarket influences,” Journal of Research and Practice in Information Technology, vol. 37, no. 1, pp. 43–54, 2005.
M. Qi and G. S. Maddala, “Economic factors and the stock market: a new perspective,” Journal of Forecasting, vol. 18, no. 3, pp. 151–166, 1999.
Y. Wu and H. Zhang, “Forward premiums as unbiased predictors of future currency depreciation: a non-parametric analysis,” Journal of International Money and Finance, vol. 16, no. 4, pp. 609–623, 1997.
J. Yao, C. L. Tan, and H. L. Poh, “Neural networks for technical analysis: a study on KLCI,” International Journal of Theoretical and Applied Finance, vol. 2, no. 2, pp. 221–241, 1999.
M. T. Leung, H. Daouk, and A.-S. Chen, “Forecasting stock indices: a comparison of classification and level estimation models,” International Journal of Forecasting, vol. 16, no. 2, pp. 173–190, 2000.
K. Kohara, Y. Fukuhara, and Y. Nakamura, “Selective presentation learning for neural network forecasting of stock markets,” Neural Computing & Applications, vol. 4, no. 3, pp. 143–148, 1996.
C. D. Tilakaratne, M. A. Mammadov, and S. A. Morris, “Effectiveness of using quantified intermarket influence for predicting trading signals of stock markets,” in Proceedings of the 6th Australasian Data Mining Conference (AusDM ‘07), vol. 70 of Conferences in Research and Practice in Information Technology, pp. 167–175, Gold Coast, Australia, December 2007.
R. Akbani, S. Kwek, and N. Japkowicz, “Applying support vector machines to imbalanced datasets,” in Proceedings of the 15th European Conference on Machine Learning (ECML ‘04), pp. 39–50, Springer, Pisa, Italy, September 2004.
N. V. Chawla, K. W. Bowyer, L. O. Hall, and W. P. Kegelmeyer, “SMOTE: synthetic minority over-sampling technique,” Journal of Artificial Intelligence Research, vol. 16, pp. 321–357, 2002.
C. D. Tilakaratne, S. A. Morris, M. A. Mammadov, and C. P. Hurst, “Predicting stock market index trading signals using neural networks,” in Proceedings of the 14th Annual Global Finance Conference (GFC ‘07), pp. 171–179, Melbourne, Australia, September 2007.
I. Jordanov, “Neural network training and stochastic global optimization,” in Proceedings of the 9th International Conference on Neural Information Processing (ICONIP ‘02), vol. 1, pp. 488–492, Singapore, November 2002.
J. Minghu, Z. Xiaoyan, Y. Baozong, et al., “A fast hybrid algorithm of global optimization for feedforward neural networks,” in Proceedings of the 5th International Conference on Signal Processing (WCCC-ICSP ‘00), vol. 3, pp. 1609–1612, Beijing, China, August 2000.
K. A. Toh, J. Lu, and W. Y. Yau, “Global feedforward neural network learning for classification and regression,” in Proceedings of the 3rd International Workshop on Energy Minimization Methods in Computer Vision and Pattern Recognition (EMMCVPR ‘01), pp. 407–422, Shophia Antipolis, France, September 2001.
H. Ye and Z. Lin, “Global optimization of neural network weights using subenergy tunneling function and ripple search,” in Proceedings of the IEEE International Symposium on Circuits and Systems (ISCAS ‘03), vol. 5, pp. 725–728, Bangkok, Thailand, May 2003.
C. D. Tilakaratne, M. A. Mammadov, and C. P. Hurst, “Quantification of intermarket influence based on the global optimization and its application for stock market prediction,” in Proceedings of the 1st International Workshop on Integrating AI and Data Mining (AIDM ‘06), pp. 42–49, Horbart, Australia, December 2006.
C. D. Tilakaratne, S. A. Morris, M. A. Mammadov, and C. P. Hurst, “Quantification of intermarket influence on the Australian all ordinary index based on optimization techniques,” The ANZIAM Journal, vol. 48, pp. C104–C118, 2007.
J. Yao and C. L. Tan, “A study on training criteria for financial time series forecasting,” in Proceedings of the International Conference on Neural Information Processing (ICONIP ‘01), pp. 1–5, Shanghai, China, November 2001.
J. Yao and C. L. Tan, “Time dependent directional profit model for financial time series forecasting,” in Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks (IJCNN ‘00), vol. 5, pp. 291–296, Como, Italy, July 2000.
R. B. Caldwell, “Performances metrics for neural network-based trading system development,” NeuroVe$t Journal, vol. 3, no. 2, pp. 22–26, 1995.
A. N. Refenes, Y. Bentz, D. W. Bunn, A. N. Burgess, and A. D. Zapranis, “Financial time series modelling with discounted least squares backpropagation,” Neurocomputing, vol. 14, no. 2, pp. 123–138, 1997.
M. A. Mammadov, “A new global optimization algorithm based on dynamical systems approach,” in Proceedings of the 6th International Conference on Optimization: Techniques and Applications (ICOTA ‘04), A. Rubinov and M. Sniedovich, Eds., Ballarat, Australia, December 2004.
M. Mammadov, A. Rubinov, and J. Yearwood, “Dynamical systems described by relational elasticities with applications,” in Continuous Optimization: Current Trends and Applications, V. Jeyakumar and A. Rubinov, Eds., vol. 99 of Applied Optimization, pp. 365–385, Springer, New York, NY, USA, 2005.
C. D. Tilakaratne, “A study of intermarket influence on the Australian all ordinary index at different time periods,” in Proceedings of the 2nd International Conference for the Australian Business and Behavioural Sciences Association (ABBSA ‘06), Adelaide, Australia, September 2006.
C. Wu and Y.-C. Su, “Dynamic relations among international stock markets,” International Review of Economics & Finance, vol. 7, no. 1, pp. 63–84, 1998.
J. Yang, M. M. Khan, and L. Pointer, “Increasing integration between the United States and other international stock markets? A recursive cointegration analysis,” Emerging Markets Finance and Trade, vol. 39, no. 6, pp. 39–53, 2003.
M. Bhattacharyya and A. Banerjee, “Integration of global capital markets: an empirical exploration,” International Journal of Theoretical and Applied Finance, vol. 7, no. 4, pp. 385–405, 2004.

To the families of soldiers injured and killed at Fort Hood,Texas: Unlike Secretary of Defense Robert Gates who I demand his resignation, I apologize such an incident could take place at Fort Hood,Texas in this 21st century. I am an expert on command and military control and I find it necessary to assume command as the new Secretary of Defense cabinet posission soon to be vacated by Mr. Robert Gates. Ladies and gentleman, “Heads are going to roll and this military is about to become second to known, long over due under my supervision!”
Robert E. McCullough B.A., Arch

Americans everywhere, look at the divorce rate, and the mental and physical abuse of ones spouse not to mention the corporal punishment of children by parents and relatives. What is it going to take to bring social, political, and compassionaite justice? I say, “November 13, 2009 is REVELATION”, to the global financial markets!

The lust for financial gain and greed and corruption at all costs has brought the financial judgement on November 13, 2009, by “YHWH” (Natures God) the ETERNAL RIGHTOUS ONE, the Father of the begotten son, “Jesus Christ”.

I suggest you all mend your ways with your spouce and children, family memebers and be go your selfish and demonic rebelous ways!

“Many are called, but I was chosen and I have just begun to fight YHWH’s battle plan!”
www.CaptainDemocracy.wordpress.com

Mon Nov 2, 2:30 am ET
BEIJING (AFP) – A moderate earthquake hit southwest China Monday, injuring 28 people, toppling more than 1,000 houses, and killing hundreds of livestock, local authorities reported.

The 4.9-magnitude quake hit Yunnan province early Monday morning not far from popular tourist destination Dali, striking at a depth of 35 kilometres (22 miles), the US Geological Survey said on its website.

Nearly 300,000 people were affected by the tremor, but no deaths were immediately reported, an official at the Dali civil affairs bureau surnamed Zhao told AFP.

Zhao said more than 400 livestock, including sheep, chicken and pigs, had been killed.

November 13, 2009 (Friday) is going to be a make or break financial phenomena that can and may verywell live in “Infamy”, says Captain Democracy.: I suggest prudent investment in “Oil Barrel futures, mixed with Gold and Silver” investment stradegy. I expect from the “winners” (Stock Market profits) 10% commission fee for my insight to the markets globally on November 13, 2009.

“As may be expected great financial gains and a fair 10% commission is not asking much for this insight to future markets. A rewarded group of market investment can be realized by my receiving fair financial compensation. I expect a loyal financial following after the fact on November 13, 2009. Gods speed and fair financial rewards to those who see the prudence in my words.
Thank you, and good luck on November 13, 2009.
Robert E. McCullough B.A., Arch.
Financial cash commission $ deposits to: ComericA Bank#5332-4802-1905-2380:

Beirut Barracks Attack Remembered
Oct. 23, 1983 Suicide Bombing Killed 241 Americans

A U.S. Marine, his leg severely damaged from the explosion that destroyed a Marine base command center, is carried by comrades for emergency medical treatment in Beirut, Lebanon, Oct. 23, 1983. (AP)

Photo

British soldiers help a bombing victim in rescue operations at the site of the destroyed U.S. Marine command center. (AP)
Previous slide Next slide 01
Interactive

Global Terror

Major terrorist organizations, the FBI’s most wanted and facts and photos from recent attacks.

Special Report

War On Terror

Complete coverage of the military’s battle against terrorism.

Fast Facts

Lebanon

Learn about the people, economy and history.
(CBS/AP) Quiet commemorations were planned Thursday for the 20th anniversary of the bombing of the U.S. Marine barracks in Beirut — the deadliest terrorist attack on Americans prior to Sept. 11.

A truck full of explosives ripped through the Marine barracks on October 23rd, 1983, killing 241 U.S. Marines, sailors and soldiers.

Services were being held at the national Beirut memorial at Camp Lejeune, N.C. Observances include a candlelight vigil and a wreath-laying ceremony, with the names of the Beirut victims read by family members and other veterans.

The Marines were in Lebanon as part of an international peacekeeping force trying to stabilize the country, which had been torn by a civil war between Christians — with their ally Israel — and Muslims.

A U.S. contingent entered Lebanon in July 1982 to oversee the departure of the Palestine Liberation Organization, which Israel had invaded to displace. That American detachment left in September 1982, but U.S. forces returned later that month when violence resumed.

In April 1983, the U.S. embassy in Beirut was struck by a 400-pound suicide truck bomb, which killed 63 people, including 17 Americans, and wiped out the CIA’s Middle East bureau.

On Oct. 23, 1983, terrorists hijacked a water delivery truck on its way to the Beirut International Airport Marine barracks and sent another truck, loaded with explosives, in its place.

Ismalal Ascari, an Iranian, drove the 19-ton truck over the barbed wire fence around the barracks, past two guard posts, and into the center of the compound, according to a federal court order issued earlier this year in a case brought by relatives of the victims.

“The resulting explosion was the largest non-nuclear explosion that had ever been detonated on the face of the Earth,” the court order read. It was equal in force to between 15,000 and 21,000 pounds of TNT.

“The force of its impact ripped locked doors from their doorjambs at the nearest building, which was 256 feet away,” read the ruling by U.S. District Court Judge Royce C. Lamberth. “Trees located 370 feet away were shredded and completely exfoliated.”

All the windows at the airport control tower, half a mile away, shattered. A crater eight feet deep was carved into the earth, and 15 feet of rubble was all that remained of the four-story Marine barracks.

“The force of the explosion ripped the building from its foundation. The building then imploded upon itself,” read a Defense Department report on the attack. “Almost all the occupants were crushed or trapped inside the wreckage.”

A U.S. investigation blamed lax security for allowing the bomber to get into the Marines’ compound.

Lamberth ruled in May than Iran was responsible for the attack because of its support for Hezbollah. “It is beyond question that Hezbollah and its agents received massive material and technical support from the Iranian government,” Lamberth wrote.

U.S. troops left Lebanon in February 1984. The Beirut barracks bombing was a major incident on October 23, 1983, during the Lebanese Civil WarLebanese Civil War
conflict=Lebanese Civil War |date=1984 – 1990|place=Lebanon|result=Taif Agreement|combatant1=|combatant2=|commander1=|commander2=|strength1=|strength2=…
. Two truck bombs struck separate buildings in Beirut that housed United StatesMilitary of the United States
The United States Armed Forces are the overall unified armed forces of the United States. The United States military was first formed by the second Second Continental Congress to defend the new nation against the British Empire in the American Revolutionary War….
and French military forcesMilitary of France
The Military of France encompasses an French Army, a French Navy, an French Air Force and a National Gendarmerie . The President of the French Republic heads the armed forces, with the title of “chef des arm?es” – “chief of the military forces”….
—members of the Multinational Force in LebanonMultinational Force in Lebanon
The Multinational Force in Lebanon was an international peacekeeping force created in 1982 and sent to Lebanon to oversee the withdrawal of the Palestine Liberation Organization….
—killing almost 300 servicemen, most of whom were U.S. MarinesUnited States Marine Corps
The United States Marine Corps is a branch of the United States Armed Forces responsible for providing Military power projection from the sea, using the mobility of the United States Navy to rapidly deliver Marine Air-Ground Task Force….
. The blasts led to the withdrawal of the international Peacekeeping, as defined by the United Nations, is “a way to help countries torn by conflict create conditions for sustainable peace.” It is distinguished from both peacebuilding and peacemaking….

Lebanon , officially the Republic of Lebanon or Lebanese Republic , is a country in Western Asia, on the eastern shore of the Mediterranean Sea….

Israel officially the State of Israel , is a country in the Middle East located on the eastern shore of the Mediterranean Sea. It borders Lebanon in the north, Syria in the northeast, Jordan in the east, and Egypt on the southwest, and contains geographically diverse features within its relatively small area….
i 1982 invasion of Lebanon.
The Islamic Jihad Organization was the name used by telephone callers demanding the departure of all United States from Lebanon and taking responsibility for a number of kidnappings and of bombings in Lebanon which killed several hundred people….
took responsibility for the bombing, but that organization is thought to have been a nom de guerre for HezbollahHezbollah
Hezbollah is a Shi’a Islamic political and paramilitary organisation based in Lebanon. It is a significant force in Politics of Lebanon, providing social services, which operate schools, hospitals, and agricultural services for thousands of Lebanese Shiites….
—- or a group that would later become Hezbollah —- receiving help from the Islamic Republic of IranIran
Iran , officially the Islamic Republic of Iran and formerly known internationally as Persian Empire until 1935, is a country in Central Eurasia, located on the northeastern shore of the Persian Gulf and the southern shore of the Caspian Sea….
.

round 6:20 a.m., a rainbow Mercedes-BenzMercedes-Benz
Mercedes-Benz is a German manufacturer of automobiles, buses, coach es, and trucks. It is currently a division of the parent company, Daimler AG , after previously being owned by Daimler-Benz….
truck drove to Beirut International Airport, where the 1st Battalion 8th Marines1st Battalion 8th Marines
1st Battalion, 8th Marines is an infantry battalion in the United States Marine Corps based out of Camp Lejeune, North Carolina consisting of approximately 800 Marines and Sailors….
under the 2nd Marine Division had set up its local headquarters.

The Belmont Park Roller Coaster in San Diego, California was under demolition threat in 1986 by former Mayor Rodger Hedgecock and the San Diego city council. The seated mayor (Hedgecock) and two city council members were removed from office for, “Conflict of interest”. The then President of The United States of America (Ronald Reagan) responded to a Western Union telegram sent from Robert E. McCullough B.A., Arch. asking the president to sign an executive order to bestow the Belmont Park Roller Coaster into a, “National Landmark” under the protections of the U.S. Congress and the Department of Interior.
Today the Belmont Park Roller Coaster (National Landmark) in San Diego is one of only two (2) wooden Roller Coasters in the United States of America that is fully constructed of wood. It also should be noted that Robert E. McCullough B.A., Arch. founded the Californians to Save Belmont Park and was successful in a voter ballot approval of 70% voters voting to save and preserve the Belmont Park Roller Coaster.
“This is where the start of World Democracy began, that is sweeping the world today, globally”.
Robert E. McCullough B.A., Arch.
“Captain Democracy”