bitorch_engine.layers.qmha.binary.layer

Classes

BMHA(input_dim, hidden_dim, num_heads[, dtype])	Implements a binary version of multi-head attention (MHA) where the linear transformations are executed using binary operations to improve efficiency.
LearnableBias(out_chn)	A module that introduces a learnable bias term to the input tensor.