A PHY 451/551, I CSI 451/551, I INF 451/551
Bayesian Data Analysis and Signal Processing
Fall 2008
Tuesdays and Thursdays 1:15 – 2:35
Physics Building Room 225
Instructor: Dr. Kevin Knuth
Contact: kknuth@albany.edu PH 211, 442 - 4653
Office Hours: Wednesdays 10:30am - 12:00pm, PH 211
Teaching Assistant: Nabin Malakar, John Muckell
Differences in Graduate and Undergraduate Requirements:
Final Projects are required for Graduate Students. Undergraduates can choose to do a final project for extra credit as well as in place of a final homework set.
Course Description: Introduction to both the principles and practice of Bayesian and maximum entropy methods for data analysis, signal processing, and machine learning. This is a hands-on course that will introduce the use of the MATLAB computing language for software development. Students will learn to write their own Bayesian computer programs to solve problems relevant to physics, chemistry, biology, earth science, and signal processing, as well as hypothesis testing and error analysis. Optimization techniques to be covered include gradient ascent, fixed-point methods, and Markov chain Monte Carlo sampling techniques. 3 credits.
Prerequisite(s): A Mat 214 (or equivalent) and A Csi 101 or A Csi 201.
Written Homework:
Written homework assignments will be assigned approximately weekly. The solutions will be due 9 days after being assigned. All written homework assignments are expected to be completed and written in a neat and professional manner.
Programming Homework:
Programming homework will be assigned in conjunction with written homework. The due dates are listed above. Programs are expected to be written as Matlab m-file functions. In many cases, the instructor will provide the data to be analyzed, and the student is expected to turn in a computer generated solution along with a zip file containing the software. The instructor should be able to open the zip file, run the software successfully on his own machine, and obtain identical results.
Exams:
There will be two exams on Oct 18 and Nov 15, which will cover the material in the first half of the class. There will be no final exam.
Student Projects:
Final Projects are required for Graduate Students. Students can choose to work individually or in groups of two to propose, perform, and present a final project for the course. This project will be a project that uses methods taught in this course to solve a data analysis or signal processing problem. Project proposals are written proposals describing the problem and proposed solution. The proposals are due on Nov 1 st, and must be approved by the instructor. The projects must be completed by Dec 11 th when they will be presented to the class in a 10-15 minute presentation. Accompanying this will be a project report, which should follow the format of a short 4-8 page research paper including an abstract, introduction, method, results, conclusion, and references, along with the submission of a zip file containing the data and code.
Undergraduate Grading:
(students will choose by selecting whether to do a final project or an additional HW set)
Undergraduate Option I
Written HW 30%
Programming HW 30%
Exams 40%
Final Project: Optional Extra Credit
Undergraduate Option II
Written HW 20%
Programming HW 20%
Exams 30%
Final Project 30%
Graduate Grading:
Written HW 20%
Programming HW 20%
Exams 30%
Final Project 30%
|
|
|
|
|
| 2 |
Tues Sept 2 |
Introduction / Problem Solving |
|
|
| Thurs Sept 4 |
Lattice Theory |
|
|
| 3 |
Tues Sept 9 |
Matlab and Programming |
HW1p |
Sept 18 |
| Tues Sept 11 |
Measures, Valuations and Probability Theory |
HW1w |
Sept 18 |
| 4 |
Tues Sept 16 |
Probability Distributions / Change of Variables |
|
|
| Thurs Sept 18 |
Probability Distributions / Change of Variables |
|
|
| 5 |
Tues Sept 23 |
The Scientific Method / Signal Models |
HW2w |
Oct 2 |
| Thurs Sept 25 |
Parameter Estimation and Error Bars |
HW2p |
Oct 2 |
| 6 |
Tues Sept 30 |
No Class |
|
|
| Thurs Oct 2 |
Parameter Estimation and Error Bars |
|
|
| 7 |
Tues Oct 7 |
Parameter Estimation and Error Bars |
|
|
| Thurs Oct 9 |
No Class |
|
|
| 8 |
Tues Oct 14 |
Multidimensional Parameter Estimation |
HW3w |
Oct 21 |
| Thurs Oct 16 |
Covariance |
HW3p |
Oct 21 |
| 9 |
Tues Oct 21 |
Search Algorithms |
|
|
| Thurs Oct 23 |
EXAM I |
|
|
| 10 |
Tues Oct 28 |
Metropolis-Hastings |
|
|
| Thurs Oct 30 |
Gibbs Sampling |
|
|
| 11 |
Tues Nov 4 |
Stochastic Integration and Nested Sampling |
HW4p |
Nov 18 |
| Thurs Nov 6 |
Estimating Parameter Values |
HWEC |
Nov 18 |
| 12 |
Tues Nov 11 |
Search Algorithms |
|
|
| Thurs Nov 13 |
Assigning Probabilities |
|
|
| 13 |
Tues Nov 18 |
MCMC |
|
|
| Tues Nov 20 |
EXAM II |
|
|
| 14 |
Tues Nov 25 |
Applications: Image Analysis and Source Sep. |
|
|
| Thurs Nov 27 |
No Class |
|
|
| 15 |
Tues Dec 2 |
Questions and Inquiry |
|
|
| Thurs Dec 4 |
Applications: Robotics |
|
|
| 16 |
Tues Dec 9 |
Project Presentations |
Final Projects DUE |
|
| |
|
|
|
| |
FRI Dec 12 |
Project Presentations 10:30 - 12:30 |
|
|
| |
|
|
|
|