̽»¨¾«Ñ¡

Plans for week 40

• Work on project 1 and discussions on how to structure your report
• No weekly exercises for week 40, project work only
• A general guideline can be found at .
• Lecture October 5

• Stochastic Gradient descent with examples and automatic differentiation
• Neural Networks, setting up the basic steps, from the simple perceptron model to the multi-layer perceptron model.
• Readings and Videos:
  • These lecture notes
  • For a good discussion on gradient methods, we would like to recommend Goodfellow et al section 4.3-4.5 and sections 8.3-8.6. We will come back to the latter chapter in our discussion of Neural networks as well.
  • For neural networks we recommend Goodfellow et al chapter 6.