Linguistic Structure Induction from Language Models
Paper • 2403.09714 • Published
Model Card for omarmomen/babylm_bpe_tokenizer_16k
This model is part of the experiments in my master's thesis titled "Linguistic Structure Induction from Language Models" (https://arxiv.org/abs/2403.09714).
"omarmomen/babylm_bpe_tokenizer_16k" is a RobertaTokenizer pretrained on the BabyLM 10 Training dataset (cased) with 16K tokens.
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("omarmomen/babylm_bpe_tokenizer_16k", device_map="auto")