Article 1 Emergent Semantics Beyond Token Embeddings: A GPT-like Transformer Learns with Frozen 16βD Binary Token-ID Embeddings (n_embed=16)
Emergent Semantics Beyond Token Embeddings Paper: 2507.04886 (TMLR, Oct 2025). 'Emergent Semantics Beyond Token Embeddings: Transformer LMs with Frozen Visual Unicode Representations' Bochkov/emergent-semantics-model-uni-glyph-335m Text Generation β’ Updated 21 days ago β’ 36 Bochkov/emergent-semantics-model-unfrozen-335m Text Generation β’ Updated 21 days ago β’ 19 Bochkov/emergent-semantics-model-16-bit-269m Text Generation β’ Updated 21 days ago β’ 36 β’ 1 Bochkov/emergent-semantics-model-64-bit-272m Text Generation β’ Updated 21 days ago β’ 25
Growing Transformers:Layer-wise Expansion Comparative Study Paper: 2507.07129 'Growing Transformers: Modular Composition and Layer-wise Expansion on a Frozen Substrate' (4.2.2, 5.2. βResults) Bochkov/growing-transformers-model-16-bit-1-9-181m Text Generation β’ Updated 19 days ago β’ 30 Bochkov/growing-transformers-model-unicode-1-9-247m Text Generation β’ Updated 24 days ago β’ 23 Bochkov/growing-transformers-model-unfrozen-1-9-247m Text Generation β’ Updated 19 days ago β’ 14 Bochkov/growing-transformers-model-frozen-16-bit-baseline-monolyth-181m Text Generation β’ Updated 19 days ago β’ 23
Bochkov/growing-transformers-model-frozen-16-bit-baseline-monolyth-181m Text Generation β’ Updated 19 days ago β’ 23
Emergent Semantics Beyond Token Embeddings Paper: 2507.04886 (TMLR, Oct 2025). 'Emergent Semantics Beyond Token Embeddings: Transformer LMs with Frozen Visual Unicode Representations' Bochkov/emergent-semantics-model-uni-glyph-335m Text Generation β’ Updated 21 days ago β’ 36 Bochkov/emergent-semantics-model-unfrozen-335m Text Generation β’ Updated 21 days ago β’ 19 Bochkov/emergent-semantics-model-16-bit-269m Text Generation β’ Updated 21 days ago β’ 36 β’ 1 Bochkov/emergent-semantics-model-64-bit-272m Text Generation β’ Updated 21 days ago β’ 25
Growing Transformers:Layer-wise Expansion Comparative Study Paper: 2507.07129 'Growing Transformers: Modular Composition and Layer-wise Expansion on a Frozen Substrate' (4.2.2, 5.2. βResults) Bochkov/growing-transformers-model-16-bit-1-9-181m Text Generation β’ Updated 19 days ago β’ 30 Bochkov/growing-transformers-model-unicode-1-9-247m Text Generation β’ Updated 24 days ago β’ 23 Bochkov/growing-transformers-model-unfrozen-1-9-247m Text Generation β’ Updated 19 days ago β’ 14 Bochkov/growing-transformers-model-frozen-16-bit-baseline-monolyth-181m Text Generation β’ Updated 19 days ago β’ 23
Bochkov/growing-transformers-model-frozen-16-bit-baseline-monolyth-181m Text Generation β’ Updated 19 days ago β’ 23
Bochkov/growing-transformers-model-frozen-16-bit-baseline-monolyth-181m Text Generation β’ Updated 19 days ago β’ 23
Bochkov/growing-transformers-model-unfrozen-baseline-monolyth-247m Text Generation β’ Updated 19 days ago β’ 14
Bochkov/growing-transformers-model-frozen-unicode-baseline-monolyth-247m Text Generation β’ Updated 19 days ago β’ 17