Instructor:
Shayan S. Garani
[Tuesday, Thursday 11:30 am – 1:00 pm, Class room #204]
Pre-requisities:
Digital signal processing at the undergrad level.
Course Syllabus:
- Review of basic signals, systems and signal space: Review of 1-D signals and systems, review of random signals, multi-dimensional signals, review of vector spaces, inner product spaces, orthogonal projections and related concepts.
- Basics of multi-rate signal processing: sampling, decimation and interpolation, sampling rate conversion (integer and rational sampling rates), oversampled processing (A/D and D/A conversion), and introduction to filter banks.
- Signal representation: Transform theory and methods (FT and variations, KLT), other transform methods.
- Wavelets: Characterization of wavelets, wavelet transform, multi-resolution analysis.
- Statistical signal modeling: The least squares method, Pade’s approximation, Prony’s method, Shanks’ method, iterative pre-filtering, all-pole modeling and linear prediction, autocorrelation and covariance methods, FIR least squares inverse filter design, applications and examples.
- Inverse problems (signal reconstruction): underdetermined least squares, pseudo-inverse (SVD), min-norm solutions, regularized methods, reconstruction from projections, iterative methods such as projection onto convex sets, expectation-maximization and simulated annealing.
Reference Books:
- Moon & Stirling, Mathematical Methods and Algorithms for Signal Processing, Prentice Hall, 2000.
- Monson Hayes, Statistical Digital Signal Processing and Modeling, John Wiley and Sons, 1996.
- A. Boggess & F. J. Narcowich, A First Course in Wavelets with Fourier Analysis, Prentice Hall, 2001.
- G. Strang, Introduction to Linear Algebra, 2016.
- H. Stark & J. W. Woods, Probability and Random Processes with Applications to Signal Processing, 2014.
- Class notes
Grading Policy:
- Homeworks : 25%
- Mid Term Exams : 25%
- Project : 25%
- Final Exam : 25%
Homeworks:
Exams:
Announcements:
- Project presentations: 11th June, 11:00-13:00, Online [Presentation – 15 minutes, Questions – 10 minutes, Demo – 5 minutes]
- Final Exam: Take home exam
- Part 1: Assigned on 11th June. To be submitted within 1 hour of opening the document.
- Part 2: Assigned on 11th June. To be submitted before end of 14th June.
Lecture Notes:
Topics Covered | Lecture Notes | |
Week 1 | Introduction to signal processing; Basics of signals and systems; Linear time-invariant systems; Modes in a linear system; Introduction to state space representation; State space representation; Non-uniqueness of state space representation; Introduction to vector space | MMTSP_Week_1 |
Week 2 | Linear independence and spanning set; Unique representation theorem; Basis and cardinality of basis; Norms and inner product spaces; Inner products and induced norm; Cauchy Schwartz inequality; Orthonormality | MMTSP_Week_2 |
Week 3 | Linear independence of orthogonal vectors; Hilbert space and linear transformation; Gram Schmidt orthonormalization; Linear approximation of signal space; Gram Schmidt orthogonalization of signals | MMTSP_Week_3 |
Week 4 | Basics of probability and random variables; Mean and variance of a random variable; Introduction to random process; Statistical specification of random processes; Stationarity of random processes | MMTSP_Week_4 |
Week 5 | Fourier transform of dirac comb sequence; Sampling theorem Basics of multirate systems; Frequency representation of expanders and decimators; Decimation and interpolation filters |
MMTSP_Week_5 |
Week 6 | Fractional sampling rate alterations; Digital filter banks; DFT as filter bank; Noble Identities; Polyphase representation; Efficient architectures for interpolation and decimation filters | MMTSP_Week_6 |
Week 7 | Efficient architecture for fractional decimator; Multistage filter design; Two-channel filter banks; Amplitude and phase distortion in signals | MMTSP_Week_7 |
Week 8 | Polyphase representation of 2-channel filter banks, signal flow graphs and perfect reconstruction; M-channel filter banks; Polyphase representation of M-channel filter bank; Perfect reconstruction of signals; Nyquist and half band filters; Special filter banks for perfect reconstruction | MMTSP_Week_8 |
Week 9 | Introduction to wavelets; Multiresolution analysis and properties; The Haar wavelet; Structure of subspaces in MRA; Haar decomposition – 1; Haar decomposition – 2 | MMTSP_Week_9 |
Week 10 | Wavelet Reconstruction; Haar wavelet and link to filter banks; Demo on wavelet decomposition; Problem on circular convolution; Time frequency localization; Basic analysis: Pointwise and uniform continuity of functions | MMTSP_Week_10 |
Week 11 | Basic Analysis : Convergence of sequence of functions; Fourier series and notions of convergence; Convergence of Fourier series at a point of continuity; Convergence of Fourier series for piecewise differentiable periodic functions; Uniform convergence of Fourier series of piecewise smooth periodic function | MMTSP_Week_11 |
Week 12 | Convergence in norm of Fourier series; Convergence of Fourier series for all square integrable periodic functions; Matrix Calculus; KL transform; Applications of KL transform; Demo on KL Transform | MMTSP_Week_12 |