I was very pleasantly surprised that Robin had decided to make neural networks in Forth.
Forth is an interesting langauge - you can read about it here, and here - it is a small, efficient and fast language, with applicatiosn often close to the metal.
You can follow Robin's progress here: https://rforth.wordpress.com/