Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
wikilangs
/
dty
like
0
Follow
WikiLangs
4
Feature Extraction
omarkamali/wikipedia-monthly
Dotyali
wikilangs
nlp
tokenizer
embeddings
n-gram
markov
wikipedia
monolingual
family-indoaryan_central
License:
mit
Model card
Files
Files and versions
xet
Community
main
dty
/
visualizations
2.35 MB
1 contributor
History:
1 commit
omarkamali
Upload all models and assets for dty (20251201)
e51ded1
verified
3 days ago
embedding_isotropy.png
42.8 kB
Upload all models and assets for dty (20251201)
3 days ago
embedding_norms.png
34.8 kB
Upload all models and assets for dty (20251201)
3 days ago
embedding_similarity.png
138 kB
xet
Upload all models and assets for dty (20251201)
3 days ago
markov_branching.png
37.3 kB
Upload all models and assets for dty (20251201)
3 days ago
markov_contexts.png
30.5 kB
Upload all models and assets for dty (20251201)
3 days ago
markov_entropy.png
53.6 kB
Upload all models and assets for dty (20251201)
3 days ago
model_sizes.png
51.7 kB
Upload all models and assets for dty (20251201)
3 days ago
nearest_neighbors.png
65.5 kB
Upload all models and assets for dty (20251201)
3 days ago
ngram_coverage.png
70.8 kB
Upload all models and assets for dty (20251201)
3 days ago
ngram_entropy.png
40.2 kB
Upload all models and assets for dty (20251201)
3 days ago
ngram_perplexity.png
50.4 kB
Upload all models and assets for dty (20251201)
3 days ago
ngram_unique.png
36.2 kB
Upload all models and assets for dty (20251201)
3 days ago
performance_dashboard.png
260 kB
xet
Upload all models and assets for dty (20251201)
3 days ago
position_encoding_comparison.png
113 kB
xet
Upload all models and assets for dty (20251201)
3 days ago
tokenizer_compression.png
43.9 kB
Upload all models and assets for dty (20251201)
3 days ago
tokenizer_fertility.png
39.2 kB
Upload all models and assets for dty (20251201)
3 days ago
tokenizer_oov.png
51.1 kB
Upload all models and assets for dty (20251201)
3 days ago
tokenizer_total_tokens.png
46.3 kB
Upload all models and assets for dty (20251201)
3 days ago
top20_words.png
35.6 kB
Upload all models and assets for dty (20251201)
3 days ago
tsne_sentences.png
223 kB
xet
Upload all models and assets for dty (20251201)
3 days ago
tsne_words.png
662 kB
xet
Upload all models and assets for dty (20251201)
3 days ago
vocab_coverage.png
65.5 kB
Upload all models and assets for dty (20251201)
3 days ago
vocab_freq_dist.png
53 kB
Upload all models and assets for dty (20251201)
3 days ago
zipf_law.png
103 kB
xet
Upload all models and assets for dty (20251201)
3 days ago
