BatchMatMulActivation

class BatchMatMulActivation(batch, in_features, out_features, bias=True, nonlinear_mode='identity', **kwargs)

Batched matmul with activation(only relu supported), no transpose anywhere.