# How is the "Auto Model For Sequence Classification" architecture?

**URL:** <https://discuss.huggingface.co/t/how-is-the-auto-model-for-sequence-classification-architecture/8440>\
**Category:** 🤗Transformers\
**Created:** [July 17, 2021, 2:21am UTC](https://discuss.huggingface.co/t/how-is-the-auto-model-for-sequence-classification-architecture/8440 "2021-07-17T02:21:04Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![celsofranssa](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/celsofranssa/32/27854_2.png) [@celsofranssa](https://discuss.huggingface.co/u/celsofranssa)\
**Post date:** [July 17, 2021, 2:21am UTC](https://discuss.huggingface.co/t/how-is-the-auto-model-for-sequence-classification-architecture/8440/1 "2021-07-17T02:21:04Z")

</div>

How is the architecture of `AutoModelForSequenceClassification`? I suppose it’s some pre-trained transformer with some dense layer for classification, however where could I see the forward details of this model?

---

<div class="post-metadata">

**Author:** ![sgugger](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/sgugger/32/2291_2.png) [@sgugger](https://discuss.huggingface.co/u/sgugger)\
**Post date:** [July 17, 2021, 8:04am UTC](https://discuss.huggingface.co/t/how-is-the-auto-model-for-sequence-classification-architecture/8440/2 "2021-07-17T08:04:23Z")

</div>

The auto classes are just abstractions that work for every architecture. You can see the actual forward passes in each modeling files. For instance, if you are using a BERT checkpoint, you will get a `BertForSequenceClassification` model, which forward pass is defined in [`transformers.models.bert.modeling\_bert](https://github.com/huggingface/transformers/blob/b4b562d83415d842c081f571e0ec325f40f276aa/src/transformers/models/bert/modeling_bert.py#L1482)

---

<div class="post-metadata">

**Author:** ![celsofranssa](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/celsofranssa/32/27854_2.png) [@celsofranssa](https://discuss.huggingface.co/u/celsofranssa)\
**Post date:** [July 18, 2021, 12:58am UTC](https://discuss.huggingface.co/t/how-is-the-auto-model-for-sequence-classification-architecture/8440/3 "2021-07-18T00:58:02Z")

</div>

Thank you @sgugger.