A bit of a blast from my PhD studies past, I used to think a lot about the SVD and application to discrete integral operators.
FWIW, on the author's footnote: if anyone is interested truncated SVD and applications to low-rank approximations to convolutions, here's a very outdated paper of mine on exactly that! :)
If you want a truncated SVD, there’s a decent chance you will be happy with a randomized SVD.
The paper “Finding structure with randomness: Probabilistic algorithms for constructing approximate matrix decompositions” (Halko, Martinsson, and Tropp) is on arxiv. It is generally pretty accessible (although a little mathy), but also has great pseudocode for a number of common use-cases.
It seems that decreases error curve always has the same shape. Is there a name for this shape? I assume you could sample just a few points and have a good estimate of what the error will be for any truncation.
And, this makes me naively assume you could apply some reversible transformation to the image, before applying this, to reduce some of the "perceptual" error (even if at the expense of numeric error)?
Some years ago, I was dabbling with PCA and was reading up a bit on the internet forums.
As soon as I saw that animation in the blog post, I knew that was from the user “amoeba” in stats stack exchange. Quite random, but turned out my memory was accurate: https://stats.stackexchange.com/a/140579
Meaningful decompositions have got to be my favorite subject in linear algebra, and SVD is the king of these. Another location this pops up is "eigenfaces", an early form of compression (and correlation) of images of faces.
Years ago I did a write up of how the SVD relates to singularities of a robotic manipulator:
FWIW, on the author's footnote: if anyone is interested truncated SVD and applications to low-rank approximations to convolutions, here's a very outdated paper of mine on exactly that! :)
https://www.sciencedirect.com/science/article/abs/pii/S01689...
The paper “Finding structure with randomness: Probabilistic algorithms for constructing approximate matrix decompositions” (Halko, Martinsson, and Tropp) is on arxiv. It is generally pretty accessible (although a little mathy), but also has great pseudocode for a number of common use-cases.
And, this makes me naively assume you could apply some reversible transformation to the image, before applying this, to reduce some of the "perceptual" error (even if at the expense of numeric error)?
https://www.youtube.com/watch?v=ZGwVlnuuzt4
As soon as I saw that animation in the blog post, I knew that was from the user “amoeba” in stats stack exchange. Quite random, but turned out my memory was accurate: https://stats.stackexchange.com/a/140579
Years ago I did a write up of how the SVD relates to singularities of a robotic manipulator:
https://akintokinematics.com/notebooks/singular_value_decomp...