One question that came up learning how artificial neural networks are working was how the brain can train its neural network?

When we say we have an artificial neural network, the problem behind it is a typical, but uncommon minimizing problem. The math behind it is logical and pretty easy. But it's math, so an computer can calculate it by doing millions of iterations. But the brain can't do that (I would be surprised)

So, how does the brain solve this task. Trial & Error, we don't know or is there an even more complex system behind it?

Thanks in advance. GA

  • 1
    $\begingroup$ I'm voting to close this question as off-topic because it belongs on Cognitive Sciences S.E. $\endgroup$ – AMR Jan 7 '16 at 21:45
  • 1
    $\begingroup$ @AMR - not more on topic there than here. Wouldn't migrate. Wouldn't close here either. $\endgroup$ – AliceD Jan 7 '16 at 22:06
  • $\begingroup$ @Christiaan This really isn't asking about a purely biological process. Sure you could talk about reinforcing neuronal connections through repeated usage and the underlying chemistry, but that doesn't get at the learning aspect, and I think that the mechanisms of learning are Cog Sci more than straight biology. $\endgroup$ – AMR Jan 7 '16 at 22:12
  • $\begingroup$ @AMR - good point. But CogSci often deals with it from a holistic perspective, while this question tends to aim at the network level. As such, given the low-level nature, it's ontopic on both ends from my pov $\endgroup$ – AliceD Jan 7 '16 at 22:14
  • 1
    $\begingroup$ @AMR a close vote based on too broad would be perfectly acceptable to me for sure. I just wouldn't like to see this migrated. $\endgroup$ – AliceD Jan 7 '16 at 22:20

The answer to this question is probably Hebbian Learning.

Hebbian learning can be nicely summarised with "Cells that fire together, wire together". So basically the synapses of neurons are strengthened if they fire in sync, and weakened otherwise.

One can easily see that a) this kind of local learning mechanism makes a lot more sense for the brain then some global method like gradient descent and b) this mechanism leads to stable representations of patterns.

In artificial neural networks this kind of learning is modelled in Hopfield networks and Restricted Boltzmann Machines.

Of course this simple rule barely scratches at the surface of what goes on in the human brain, when we are learning something. A complete picture would probably involve complex feedback mechanisms of inhibitory and excitatory connections between neurons, functional modules of neurons, and different parts of the brain.

But I fear these details are not yet well understood …

  • $\begingroup$ Oh. MY. GOD. I didn't through anybody would ever answer on this question anymore. :D Thx. $\endgroup$ – Georg Friedrich Mar 19 '16 at 3:20

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.