Update CNN_Specification.md

Author: abilng

config_doc/CNN_Specification.md

@@ -15,14 +15,23 @@ Each one contain a json object.`cnn` describes convolution layer configuration a
 >> * `poolsize`    : Dimension for Max-pooling
 >> * `flatten`     : whether to flatten output or not(true for last layer else false)
 >> * `update`      : true if weight need to updated during training. 
+>> * `activation`  : Activation function used by this layer, if not present global activation fuction is used. 
 
-> * `activation` : Activation function used by layers 
+> * `activation` : Activation function used by layers (global)
 > * `use_fast` : if true program will use pylearn2 library for faster computation (Default Value = false)
 
 * `mlp` contains a json object with following parameters:
 
-> * `layers`     : An Array contain size of hidden layers.
-> * `activation` : Activation function used by layers
+> * `layers`        : An Array contain size of hidden layers.
+> * `adv_activation`: if maxout/pnorm is used. 
+>> * `method` : 'maxout','pnorm'. 
+>> In `maxout`, a pooling of neuron o/p is done based on poolsize. 
+>> But in `pnorm` output is normalized after pooling. 
+>> * `pool_size`: pool size
+>> * `pnorm_order`: order of normalization (in pnorm)
+
+> * `activation`    : Activation function used by layers. (if adv_activation is used, it sholud be either 'linear','relu' or 'cappedrelu')
+
 
 ___________________________________________________________________________________
 **Also See**