̽»¨¾«Ñ¡

Dear all, we hope your weekend turned out the best possible way.  Here are our plans for the coming week:

Lecture October 14, 2024

1. Building our own Feed-forward Neural Network and discussion of project 2

Readings and videos.

1. These lecture notes at 

2. For a more in depth discussion on neural networks we recommend Goodfellow et al chapters 6 and 7.

3. Neural Networks demystified at 

4. Building Neural Networks from scratch at 

5. Video on Neural Networks at 

6. Video on the back propagation algorithm at 

I also recommend Michael Nielsen's intuitive approach to the neural networks and the universal approximation theorem, see the slides at .

Material for the active learning sessions on Tuesday and Wednesday

• Exercise on starting to write a code for neural networks, feed forward part. We will also continue ur discussions of gradient descent methods from last week. If you have time, start considering the back-propagation part as well (exercises for next week).  The exercise set for this week are at 

• Discussion of project 2

Note: some of the codes will also be discussed next week in connection with the solution of differential equations.

Best wishes to you all,

Fahimeh, Ida, Karl Henrik, Mia, Morten, Odin and Sigurd