artificial based DeepSpeed implementation for bert vector.

Input

5073-dim embedding

Encoder

49 x MLP with 2 heads

Output

auc-roc projection