Course syllabus

Course PM

This page contains the program for the course. Other information, such as learning outcomes, teachers, literature, examination, and old exams is in a separate course PM.

Program

The schedule is in TimeEdit and in the table below. Lectures, on Mondays 15:15-17:00 and Wednesdays 10:00-11:45 in Pascal, will be traditional lectures, with students asking questions and some student activities. What to read before the lecture will be listed below, and overheads used will be available below (shortly) before each lecture. Wednesdays 8:00-9:45 in MVF33 will be exercise classes, with demonstrations and solutions of exercises in a list given below.

Study guide

The course PM contains a list of textbooks which you should use to prepare BEFORE each lecture. Rather than reading all of them, you should use material from the book or books that suit your background and style of learning. Murphy (denoted M below) is a quite advanced book, containing basically all material we go through and very much more. It may be useful as a reference. Bishop (B) is also advanced, but slightly easier to read. It also contains exercises, which Murphy does not. Albert (A) is an introductory book, with focus on practical Bayesian modelling and computation using R. It may be a useful learning tool for some. Robert & Casella (RC) and Särkää (S) may be referred to at some points, for specific material. 

The list of lectures below will contain, for each lecture, references to the relevant parts of the textbooks. It will also contain (posted shortly before the lecture) overheads and example code used. 

The lectures are not recorded. A few years back (mostly in connection with the pandemic) lectures were recorded. Here is a list of recordings from 2023; note however that the sequence of subjects has changed, even if the overall contents is mostly the same. 

Course work

To understand and learn the methods of this course, it is essential to work with examples on a computer, in addition to working with the study material and doing theoretical exercises. Our textbooks contain a large number of exercises, for both theoretical and computer solutions, and some exercises are listed below.

As an obligatory part of the course, each student must do 2 assignments. The deadlines for these are Tuesday 15 September at 23:59 and Friday 9 October at 23:59. Details about the assignments will be available from the links at the bottom of this page. Answers must be handed in via Canvas. It is important that you use the assignments to learn how to model and formulate computational solutions for practical problems. These skills will be tested in obligatory workshops after your solutions have been handed in. For each of the two assignments you will choose one of four possible times for a workshop to attend. There you will, without any aids, work in groups on questions related to the assignments, and present your results orally at the end. 

As much of the course material uses the R language for examples and illustrations, students should also use this language. Students who are not familiar with this language need to study it individually during the first weeks of the course. See, for example, the introductory chapters of our textbooks. 

If you have problems with getting started with the course, or for example getting started with R, please do not hesitate to contact me. I hope that we can have active communication during the course. In addition to contact at lectures and exercise sessions, you may contact me on canvas or by mail at mostad@chalmers.se. I usually answer within a day or so.

Back to the top

Schedule

Contents Study material / activity
Time and place
Lecture 1: The Bayesian paradigm. Course introduction. 

TBA

Monday 31/8, 15:15 - 17:00,  Pascal.
Exercise class (demonstration/discussion of exercises)

TBA

Wednesday 2/9, 8:00 - 9:45, MVF33.
Lecture 2: Using conjugacies in exponential families of distributions

TBA

Wednesday 2/9 10:00 - 11:45, Pascal.

Lecture 3: Graphical Networks. 

TBA

Monday 7/9, 15:15 - 17:00,  Pascal.
Exercise class (demonstration/discussion of exercises)

TBA

Wednesday 9/9, 8:00 - 9:45, MVF33.
Lecture 4: Basic Bayesian inference and modelling.  

TBA

Wednesday 9/9 10:00 - 11:45, Pascal.
Lecture 5: Information theory. Lecturer: André Lasses Armatowski

TBA

Monday 14/9, 15:15 - 17:00,  Pascal.
Deadline for first obligatory assignment

See below

Tuesday 15/9 23:59. 
Exercise class (demonstration/discussion of exercises)

TBA

Wednesday 16/9, 8:00 - 9:45, MVF33.
Lecture 6: Types of approximate inference. 

TBA

Wednesday 16/9 10:00 - 11:45, Pascal.
Obligatory workshop / project presentation

TBA

Choose one of 

Wednesday 16/9 13:15 - 15:00, MVF32

Thursday 17/9 8:00 - 9:45, MVF32

Thursday 17/9 10:00 - 11:45, MVF32

Friday 18/9 13:15 - 15:00, MVF32

Lecture 7: Point estimates. The EM algorithm. The Laplace approximation. Monte Carlo integration. 

TBA

Monday 21/9, 15:15 - 17:00,  Pascal.
Exercise class (demonstration/discussion of exercises)

TBA

Wednesday 23/9, 8:00 - 9:45, MVF33.
Lecture 8: Simulation methods. Markov chains. The Metropolis Hastings algorithm. 

TBA

Wednesday 23/9 10:00 - 11:45, Pascal.
Lecture 9: Markov chain Monte Carlo. Gibbs sampling. Slice sampling. 

TBA

Monday 28/9, 15:15 - 17:00,  Pascal.
Exercise class (demonstration/discussion of exercises)

TBA

Wednesday 30/9, 8:00 - 9:45, MVF33.
Lecture 10: Hamiltonian Monte Carlo. Lecturer: André Lasses Armatowski

TBA

Wednesday 30/9 10:00 - 11:45, Pascal.

Lecture 11:  State space models and Hidden Markov Models. Kalman filters. 

TBA

Monday 5/10, 15:15 - 17:00,  Pascal.
Exercise class (demonstration/discussion of exercises)

TBA

Wednesday 7/10, 8:00 - 9:45, MVF33.
Lecture 12: Kalman filters. Particle filters. Viterbi. 

TBA

Wednesday 7/10 10:00 - 11:45, Pascal.
Deadline for second obligatory assignment

See below

Friday 9/10 23:59 

Obligatory workshop / project presentation

TBA

Choose one of 

Monday 12/10 13:15 - 15:00, MVF32

Tuesday 13/10 10:00 - 11:45, MVF32

Wednesday 14/9 13:15 - 15:00, MVF32

Thursday 15/9 8:00 - 9:45, MVF32

Lecture 13: Variational Bayes. Lecturer: André Lasses Armatowski

TBA

Monday 12/10, 15:15 - 17:00,  Pascal.
Exercise class (demonstration/discussion of exercises)

TBA

Wednesday 14/10, 8:00 - 9:45, MVF33.
Lecture 14: Decision theory. ABC. 

TBA

Wednesday 14/10 10:00 - 11:45, Pascal.
Lecture 15: Review

Review

Monday 19/10, 15:15 - 17:00,  Pascal.
Exercise class (demonstration/discussion of exercises)

TBA

Wednesday 21/10, 8:00 - 9:45, MVF33. 
Reserve time

 

Wednesday 21/10, 10:00 - 11:45, Pascal. 
WRITTEN EXAM

Everything

TBA

Recommended study questions, in addition to those listed for exercise sessions.  

THIS TABLE IS PRELIMINARY AND WILL BE UPDATED. Each line contains exercises you should be able to do after studying the material for the lecture with the number at the beginning of the line. 

LECTURE OLD EXAMS Exercises from textbooks, or independently written
1

2024-01-05 q1. 2022-01-05 q1. 

2

2023-01-05 q1.2021-10-30 q1. 2020-10-29 q6. 

A2.9: 4,5; A3.9: 1,3 some solutions. 

Some exercises corresponding solutions

3 2023-10-28 q6 & q7. 2023-08-24 q4. 2023-01-05 q4 & q7. 2022-08-25 q4 & q5. 2022-01-05 q7. 2021-08-26 q4. 

A3.9: 4; solutionsSome exercises; corresponding solutions

4

2023-10-28 q1 & q2. 2023-08-24 q3. 2022-10-29 q1. 2022-08-25 q2. 2020-10-29 q2. 

A4.8 1,4,7. solutions

 

5

 

6

 

7

2022-10-29 q4 & q6. 2022-08-25 q7. 2021-08-26 q3. 

8

2024-01-05 q3. 2023-08-24 q2. 2022-10-29 q2. 2021-08-26 q2. 

RC 2.11, 2.12, 2.18, 2.22. some solutions

9

2024-01-05 q4 & q6. 2023-10-28 q3. 2023-10-05 q2. 2022-29 q3. 2022-08-25 q1. 2022-01-05 q2 & q4. 2021-10-30 q2 & q3. 2021-08-26 q6. 2021-01-05 q2 & q3. 2020-10-29 q3 & q4. 

A7.13: 1,2. 

A5.13: 1,5. A6.13: 1,2. solutions

A5.13: 2;  A6.13: 3;   A10.7: 6.  A9.7: 3,4; solutions 

A9.7: 6; A10.7: 5, 7. solutions

10

2023-01-05 q3. 2022-08-25 q3. 2021-10-30 q4. 2020-10-29 q5. 

11

2021-01-05 q5. 

12

2023-01-05 q6. 

13

2023-10-28 q5. 2023-08-24 q6. 2022-08-25 q6. 2022-01-05 q8. 

14

2021-08-26 q1. 2021-01-05 q7. 2020-10-29 q7. 

 

Back to the top

 

Course summary:

Course Summary
Date Details Due