He is talking about this

https://en.wikipedia.org/wiki/Backpropagation

I've written that kind of code before. It roughly looks right but the devil is in the details. My guess though there is...