rHXN

Matrix Orthogonalization Improves Memory in Recurrent Models

https://ayushtambde.com/blog/matrix-orthogonalization-improves-memory-in-recurrent-models/
By: at2005
HN Link
BirbSingularity - 5 hours ago
I can't help but think of orthogonal frequency-division multiplexing and it's use in encoding data on multiple carrier frequencies, and it makes me wonder what other parallels we will discover between digital transmission technology for cross-domain stuff like this.
chimpanzee2 - 6 minutes ago
I have this strange sensation that I can't put into words that somehow we are on the brink of unveiling an entirely new paradigm of AIs or perhaps even of combining AI with classical algorithms in a way to rapidly iterate between each other (and sensor data) that will instantly 10x or 100x current capabilities.

Anyone else feel this?

dapperdrake - 4 hours ago
Not even cross-domain. (Nor cross-co-domain.)

Trigonometric polynomials are also polynomials. And linear spaces are all "the same". That is what the definition is for. Even the transpose-mapping is linear.

mv_d5339e31 - 2 hours ago
[dead]