Posts

How learned queries and cross-attention let LUNA decouple compute from electrode count, cutting FLOPs by 300× and GPU memory by 10× while still hitting state-of-the-art on TUAR.

An introduction to dilated causal convolutions and a look into how Temporal Convolutional Networks (TCN) function.

Finding the total number of multiply and accumulate operations in a LSTM layer, and looking at how many parameters there are in an LSTM cell.