# Printing tokens array

**URL:** <https://discuss.huggingface.co/t/printing-tokens-array/81427>\
**Category:** 🤗Tokenizers\
**Created:** [April 12, 2024, 1:06pm UTC](https://discuss.huggingface.co/t/printing-tokens-array/81427 "2024-04-12T13:06:11Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![Mahmoodn](https://avatars.discourse-cdn.com/v4/letter/m/ce7236/32.png) [@Mahmoodn](https://discuss.huggingface.co/u/Mahmoodn)\
**Post date:** [April 12, 2024, 1:06pm UTC](https://discuss.huggingface.co/t/printing-tokens-array/81427/1 "2024-04-12T13:06:11Z")

</div>

Hi,  
How can I see the tokens with `tokenizer()`? In the example:

```auto
raw_inputs = [
    "I've been waiting for a HuggingFace course my whole life.",
    "I hate this so much!",
]
inputs = tokenizer(raw_inputs, padding=True, truncation=True, return_tensors="pt")
print(inputs)

```

The `inputs` contains the unique numbers. I would like to see the tokens. For example, I want to know if `['I've']` is the token or `['i',''','ve']` is the token.