# Using decoder only part of pretrained MarianMT (Encoder-Decoder Translation model)

**URL:** <https://discuss.huggingface.co/t/using-decoder-only-part-of-pretrained-marianmt-encoder-decoder-translation-model/10373>\
**Category:** 🤗Transformers\
**Created:** [September 29, 2021, 4:18am UTC](https://discuss.huggingface.co/t/using-decoder-only-part-of-pretrained-marianmt-encoder-decoder-translation-model/10373 "2021-09-29T04:18:29Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![Ganga](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/ganga/32/2803_2.png) [@Ganga](https://discuss.huggingface.co/u/Ganga)\
**Post date:** [September 29, 2021, 4:18am UTC](https://discuss.huggingface.co/t/using-decoder-only-part-of-pretrained-marianmt-encoder-decoder-translation-model/10373/1 "2021-09-29T04:18:29Z")

</div>

Hi,

I’m trying to use the decoder only half of a pretrained MariantMT model. I could use the following to get the model loss for training the decoder only half while using my own encoder outputs:  
output = self.model(input\_ids=None, **encoder\_outputs=(encoded\_sequence,)**, labels=targets, output\_attentions=False, return\_dict=True)

This gives me the loss and logits. But I’m not sure how to integrate the **generate** function into this. Can someone please help me with the same?

---

<div class="post-metadata">

**Author:** ![imranq](https://avatars.discourse-cdn.com/v4/letter/i/8baadc/32.png) [@imranq](https://discuss.huggingface.co/u/imranq)\
**Post date:** [March 12, 2022, 5:23pm UTC](https://discuss.huggingface.co/t/using-decoder-only-part-of-pretrained-marianmt-encoder-decoder-translation-model/10373/2 "2022-03-12T17:23:40Z")

</div>

Also curious about this

---

<div class="post-metadata">

**Author:** ![bk073](https://avatars.discourse-cdn.com/v4/letter/b/8491ac/32.png) [@bk073](https://discuss.huggingface.co/u/bk073)\
**Post date:** [October 18, 2023, 1:37pm UTC](https://discuss.huggingface.co/t/using-decoder-only-part-of-pretrained-marianmt-encoder-decoder-translation-model/10373/3 "2023-10-18T13:37:24Z")

</div>

did you solve this?
