The 1D CNN (sliding convolutions)
Slide a kernel across neighbouring tokens to extract local features, in full parallel.
Reference Kim, 2014 · WaveNet, 2016
Slide a kernel across neighbouring tokens to extract local features, in full parallel.
Reference Kim, 2014 · WaveNet, 2016