MVE188 / MSA102 Computational methods for Bayesian statistics Autumn 2026
Course PM
This page contains the program for the course. Other information, such as learning outcomes, teachers, literature, examination, and old exams is in a separate course PM.
Program
The schedule is in TimeEdit and in the table below. Lectures, on Mondays 15:15-17:00 and Wednesdays 10:00-11:45 in Pascal, will be traditional lectures, with students asking questions and some student activities. What to read before the lecture will be listed below, and overheads used will be available below (shortly) before each lecture. Wednesdays 8:00-9:45 in MVF33 will be exercise classes, with demonstrations and solutions of exercises in a list given below.
Study guide
The course PM contains a list of textbooks which you should use to prepare BEFORE each lecture. Rather than reading all of them, you should use material from the book or books that suit your background and style of learning. Murphy (denoted M below) is a quite advanced book, containing basically all material we go through and very much more. It may be useful as a reference. Bishop (B) is also advanced, but slightly easier to read. It also contains exercises, which Murphy does not. Albert (A) is an introductory book, with focus on practical Bayesian modelling and computation using R. It may be a useful learning tool for some. Robert & Casella (RC) and Särkää (S) may be referred to at some points, for specific material.
The list of lectures below will contain, for each lecture, references to the relevant parts of the textbooks. It will also contain (posted shortly before the lecture) overheads and example code used.
The lectures are not recorded. A few years back (mostly in connection with the pandemic) lectures were recorded. Here is a list of recordings from 2023; note however that the sequence of subjects has changed, even if the overall contents is mostly the same.
Course work
To understand and learn the methods of this course, it is essential to work with examples on a computer, in addition to working with the study material and doing theoretical exercises. Our textbooks contain a large number of exercises, for both theoretical and computer solutions, and some exercises are listed below.
As an obligatory part of the course, each student must do 2 assignments. The deadlines for these are Tuesday 15 September at 23:59 and Friday 9 October at 23:59. Details about the assignments will be available from the links at the bottom of this page. Answers must be handed in via Canvas. It is important that you use the assignments to learn how to model and formulate computational solutions for practical problems. These skills will be tested in obligatory workshops after your solutions have been handed in. For each of the two assignments you will choose one of four possible times for a workshop to attend. There you will, without any aids, work in groups on questions related to the assignments, and present your results orally at the end.
As much of the course material uses the R language for examples and illustrations, students should also use this language. Students who are not familiar with this language need to study it individually during the first weeks of the course. See, for example, the introductory chapters of our textbooks.
If you have problems with getting started with the course, or for example getting started with R, please do not hesitate to contact me. I hope that we can have active communication during the course. In addition to contact at lectures and exercise sessions, you may contact me on canvas or by mail at mostad@chalmers.se. I usually answer within a day or so.
Schedule
| Contents | Study material / activity |
Time and place |
| Lecture 1: The Bayesian paradigm. Course introduction. |
TBA |
Monday 31/8, 15:15 - 17:00, Pascal. |
| Exercise class (demonstration/discussion of exercises) | Wednesday 2/9, 8:00 - 9:45, MVF33. | |
| Lecture 2: Using conjugacies in exponential families of distributions |
TBA |
Wednesday 2/9 10:00 - 11:45, Pascal. |
|
Lecture 3: Graphical Networks. |
TBA |
Monday 7/9, 15:15 - 17:00, Pascal. |
| Exercise class (demonstration/discussion of exercises) |
TBA |
Wednesday 9/9, 8:00 - 9:45, MVF33. |
| Lecture 4: Basic Bayesian inference and modelling. | Wednesday 9/9 10:00 - 11:45, Pascal. | |
| Lecture 5: Information theory. Lecturer: André Lasses Armatowski |
TBA |
Monday 14/9, 15:15 - 17:00, Pascal. |
| Deadline for first obligatory assignment |
See below |
Tuesday 15/9 23:59. |
| Exercise class (demonstration/discussion of exercises) |
TBA |
Wednesday 16/9, 8:00 - 9:45, MVF33. |
| Lecture 6: Types of approximate inference. |
TBA |
Wednesday 16/9 10:00 - 11:45, Pascal. |
| Obligatory workshop / project presentation |
TBA |
Choose one of Wednesday 16/9 13:15 - 15:00, MVF32 Thursday 17/9 8:00 - 9:45, MVF32 Thursday 17/9 10:00 - 11:45, MVF32 Friday 18/9 13:15 - 15:00, MVF32 |
| Lecture 7: Point estimates. The EM algorithm. The Laplace approximation. Monte Carlo integration. |
TBA |
Monday 21/9, 15:15 - 17:00, Pascal. |
| Exercise class (demonstration/discussion of exercises) |
TBA |
Wednesday 23/9, 8:00 - 9:45, MVF33. |
| Lecture 8: Simulation methods. Markov chains. The Metropolis Hastings algorithm. |
TBA |
Wednesday 23/9 10:00 - 11:45, Pascal. |
| Lecture 9: Markov chain Monte Carlo. Gibbs sampling. Slice sampling. |
TBA |
Monday 28/9, 15:15 - 17:00, Pascal. |
| Exercise class (demonstration/discussion of exercises) |
TBA |
Wednesday 30/9, 8:00 - 9:45, MVF33. |
| Lecture 10: Hamiltonian Monte Carlo. Lecturer: André Lasses Armatowski |
TBA |
Wednesday 30/9 10:00 - 11:45, Pascal. |
|
Lecture 11: State space models and Hidden Markov Models. Kalman filters. |
TBA |
Monday 5/10, 15:15 - 17:00, Pascal. |
| Exercise class (demonstration/discussion of exercises) |
TBA |
Wednesday 7/10, 8:00 - 9:45, MVF33. |
| Lecture 12: Kalman filters. Particle filters. Viterbi. |
TBA |
Wednesday 7/10 10:00 - 11:45, Pascal. |
| Deadline for second obligatory assignment |
See below |
Friday 9/10 23:59 |
| Obligatory workshop / project presentation |
TBA |
Choose one of Monday 12/10 13:15 - 15:00, MVF32 Tuesday 13/10 10:00 - 11:45, MVF32 Wednesday 14/9 13:15 - 15:00, MVF32 Thursday 15/9 8:00 - 9:45, MVF32 |
| Lecture 13: Variational Bayes. Lecturer: André Lasses Armatowski |
TBA |
Monday 12/10, 15:15 - 17:00, Pascal. |
| Exercise class (demonstration/discussion of exercises) |
TBA |
Wednesday 14/10, 8:00 - 9:45, MVF33. |
| Lecture 14: Decision theory. ABC. |
TBA |
Wednesday 14/10 10:00 - 11:45, Pascal. |
| Lecture 15: Review |
Review |
Monday 19/10, 15:15 - 17:00, Pascal. |
| Exercise class (demonstration/discussion of exercises) |
TBA |
Wednesday 21/10, 8:00 - 9:45, MVF33. |
| Reserve time |
|
Wednesday 21/10, 10:00 - 11:45, Pascal. |
| WRITTEN EXAM |
Everything |
TBA |
Recommended study questions, in addition to those listed for exercise sessions.
THIS TABLE IS PRELIMINARY AND WILL BE UPDATED. Each line contains exercises you should be able to do after studying the material for the lecture with the number at the beginning of the line.
| LECTURE | OLD EXAMS | Exercises from textbooks, or independently written |
| 1 |
2024-01-05 q1. 2022-01-05 q1. |
|
| 2 |
2023-01-05 q1.2021-10-30 q1. 2020-10-29 q6. |
A2.9: 4,5; A3.9: 1,3 some solutions. |
| 3 | 2023-10-28 q6 & q7. 2023-08-24 q4. 2023-01-05 q4 & q7. 2022-08-25 q4 & q5. 2022-01-05 q7. 2021-08-26 q4. |
A3.9: 4; solutions. Some exercises; corresponding solutions |
| 4 |
2023-10-28 q1 & q2. 2023-08-24 q3. 2022-10-29 q1. 2022-08-25 q2. 2020-10-29 q2. |
A4.8 1,4,7. solutions.
|
| 5 |
|
|
| 6 |
|
|
| 7 |
2022-10-29 q4 & q6. 2022-08-25 q7. 2021-08-26 q3. |
|
| 8 |
2024-01-05 q3. 2023-08-24 q2. 2022-10-29 q2. 2021-08-26 q2. |
RC 2.11, 2.12, 2.18, 2.22. some solutions. |
| 9 |
2024-01-05 q4 & q6. 2023-10-28 q3. 2023-10-05 q2. 2022-29 q3. 2022-08-25 q1. 2022-01-05 q2 & q4. 2021-10-30 q2 & q3. 2021-08-26 q6. 2021-01-05 q2 & q3. 2020-10-29 q3 & q4. |
A7.13: 1,2. A5.13: 1,5. A6.13: 1,2. solutions A5.13: 2; A6.13: 3; A10.7: 6. A9.7: 3,4; solutions A9.7: 6; A10.7: 5, 7. solutions |
| 10 |
2023-01-05 q3. 2022-08-25 q3. 2021-10-30 q4. 2020-10-29 q5. |
|
| 11 |
2021-01-05 q5. |
|
| 12 |
2023-01-05 q6. |
|
| 13 |
2023-10-28 q5. 2023-08-24 q6. 2022-08-25 q6. 2022-01-05 q8. |
|
| 14 |
2021-08-26 q1. 2021-01-05 q7. 2020-10-29 q7. |
Course summary:
| Date | Details | Due |
|---|---|---|