-
Attention Is All You Need
Paper • 1706.03762 • Published • 141 -
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Paper • 1810.04805 • Published • 33 -
RoBERTa: A Robustly Optimized BERT Pretraining Approach
Paper • 1907.11692 • Published • 10 -
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter
Paper • 1910.01108 • Published • 24
🏗️ Building on HF
Taufiq Dwi Purnomo
taufiqdp
AI & ML interests
SLM, VLM
Recent Activity
upvoted an article about 2 hours ago
NeoMME: an efficient Multimodal-native and Multilingual Encoder upvoted a paper 3 days ago
Repo-To-Skill: Distilling GitHub Repositories Into AI4AI Skills