LearnViz Math
Expert ▦ Linear Algebra Topic 101 of 104

Convolution and Circulant Matrices

Matrices diagonalised by the Fourier transform.

Key idea

Matrices diagonalised by the Fourier transform.

In depth

Convolution slides a kernel across a signal. For periodic signals it is multiplication by a circulant matrix, each row a cyclic shift of the one above. The Fourier basis diagonalises every circulant matrix.

Worked example

Convolving with kernel (1, 2) is multiplying by a matrix with 1 on the diagonal and 2 on the next diagonal.

Real-world uses

Common mistake

Forgetting that the kernel is flipped in true convolution.

How to learn this

  1. Read the key idea and say it in your own words.
  2. Work through the worked example, then try a similar problem.
  3. Use the interactive lesson’s visual and mini-quiz to check the pattern.

Frequently asked questions

What is Convolution and Circulant Matrices?

Matrices diagonalised by the Fourier transform. It is a topic at the expert level in Linear Algebra.

Where is Convolution and Circulant Matrices used in real life?

Real-world examples: Filtering audio and images with fast algorithms in signal processing.

What should I learn before Convolution and Circulant Matrices?

Make sure you are comfortable with Linear Algebra in Machine Learning, the previous topic in Linear Algebra.

What is a common mistake with Convolution and Circulant Matrices?

Forgetting that the kernel is flipped in true convolution.

How can I practise Convolution and Circulant Matrices?

Open the interactive lesson, play with the visual, then answer the three-question mini-quiz. Getting two right marks the topic complete.

What comes after Convolution and Circulant Matrices?

Move on to Discrete Fourier Transform next.

Related expert topics in Linear Algebra