deeplay.components.transformer.pemb Module#

Functions#

sinusoidal_init_(tensor)

Initialize tensor with sinusoidal positional embeddings.

Classes#

DeeplayModule(*args, **kwargs)

A base class for creating configurable, extensible modules with dynamic initialization and argument management.

IndexedPositionalEmbedding(*args, **kwargs)

Layer(*args, **kwargs)

PositionalEmbedding(*args, **kwargs)