## Sigmoid functionThe graphic on the left shows the sigmoid function for the units in the network. It is an exponential function which has as a most important characteristic the fact that, even if x assumes values next to the infinitely big or little, f(x) will assume a value between 0 and 1. This characteristic implies that the function translates values of x to a binary value, typically: f( x) > 0.9 : f(x) = 1 , f(x) < 0.1 : f(x) = 0. |

## Treshold functionAn alternative used in networks for the sigmoid function is the treshold function which is shown in the graphic on the left. The output assumes just two values: -1 or 1. Some treshold functions have a binary output: 0 or 1. This function is less complex to compute when a network is implemented on a digital computer than the sigmoid function, but it is not useful in a backpropagation algorhythm. |

## The PDP researchersThey are the ideators of the backpropagation algorhythm: Parallel distributed processing: Explorations in the microstructure of cognition, J.L. McLelland, D.E. Rumelhart and the PDP research group, MIT press/Bradford Books, 1986 |

Thomas Riga, University of Genoa, Italy |