bert-base-12l-768h-110m

IN premise — entries/2026/06/21/wiki-BERT_language_model-chunk-1.md

Created 2026-06-21T09:50:09+00:00

BERT_BASE has 12 layers, 768 hidden size, and 110M parameters; BERT_LARGE has 24 layers, 1024 hidden size, and 340M parameters