Node: This page is always under construction.
What is Multilayer Perceptron?
A multilayer perceptron (MLP) is a kind of Too feed forward artificial neural network, which is a mathematical model inspired by the biological neural network. The multilayer perceptron can be used for various machine learning tasks such as classification and regression.
The basic component of a multilayer perceptron is the neuron. In a multilayer perceptron, the neurons are aligned in layers and in any two adjacent layers the neurons are connected in pairs with weighted edges. A practical multilayer perceptron consists of at least three layers of neurons, including one input layer, one or more hidden layers, and one output layer.
The size of input layer and output layer determines what kind of data a MLP can accept. Specifically, the number of neurons in the input layer determines the dimensions of the input feature, the number of neurons in the output layer determines the dimension of the output labels. Typically, the two-class classification and regression problem requires the size of output layer to be one, while the multi-class problem requires the size of output layer equals to the number of classes. As for hidden layer, the number of neurons is a design issue. If the neurons are too few, the model will not be able to learn complex decision boundaries. On the contrary, too many neurons will decrease the generalization of the model.
Here is an example MLP with 1 input layer, 1 hidden layer and 1 output layer:
https://docs.google.com/drawings/d/1DCsL5UiT6eqglZDaVS1Ur0uqQyNiXbZDAbDWtiSPWX8/pub?w=813&h=368
How Multilayer Perceptron works?
In general, people use the (already prepared) MLP by feeding the input features to the input layer and get the result from the output layer. The results are calculated in a feed-forward approach, from the input layer to the output layer.
One step of feed-forward is illustrated in the below figure.
https://docs.google.com/drawings/d/1hJ2glrKKIWokQOy6RI8iw1T8TmuZFcbaCwnzGoKc8gk/pub?w=586&h=302
For each layer except the input layer, the value of the current neuron is calculated by taking the linear combination of the values output by the neurons of the previous layer, where the weight determines the contribution of a neuron in the previous layer to current neuron (as equation (1) shown). Obtaining the linear combination result z, a non-linear squashing function is used to constrain the output into a restricted range (as equation (2) shown). Typically, sigmoid function or tanh function are used.
http://people.apache.org/~yxjiang/downloads/equ1.png
http://people.apache.org/~yxjiang/downloads/equ2.png
For each step of feed-forward, the calculated results are propagated one layer close to the output layer.
To be added...
How Multilayer Perceptron is trained in Hama?
To be added...
How to use Multilayer Perceptron in Hama?
To be added...
Two class learning problem
To be added...
Example: XOR problem
To be added...
Multi class learning problem
To be added...
Example:
To be added...
Regression problem
To be added...
Example: Predict the sunspot activity
To be added...
Advanced Topics
To be added...
Parameter setting
To be added...
Reference
[1] Tom Mitchell. Machine Learning. [McGraw] Hill, 1997.
[2] Stanford Unsupervised Feature Learning and Deep Learning tutorial. http://ufldl.stanford.edu/wiki/index.php/UFLDL_Tutorial
.
[3] Jiawei Han and Micheline Kamber. Data Mining Concept and Technology. The Morgan Kaufmann Series in Data Management Systems. 2011.
[4] Christopher M. Bishop. Neural Networks and Pattern Recognition. Oxford University Press. 1995.