Thursday, June 26, 2014
cmix v3
I have released cmix version 3. This version is over twice as fast, uses less memory, and gets better compression ratio.
Sunday, June 15, 2014
Backpropagation
Today I derived backpropagation for a logistic activation function and a cross entropy loss function. This has been done before, but I couldn't find the full set of formulas for it online. I am using the variable notation from here: http://neuralnetworksanddeeplearning.com/chap2.html
![](https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEgHoDeC0TQQvtIOlO-4glS9xG2W0vvMtB3fBmHlebxNdnmhODFFnTHNeKIYxd3Dx231F_I2VGtAMDHjCZNq6UvoTGRFzUyjba34AeHgzs6gOIH404nvkOmMIBKLbVtcZI9wvyhc/s400/Screenshot+from+2014-06-15+15:50:56.png)
Subscribe to:
Posts (Atom)