Instructions to use VictorDCh/Llama-3-8B-Instruct-spider-4 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use VictorDCh/Llama-3-8B-Instruct-spider-4 with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("meta-llama/Meta-Llama-3-8B-Instruct") model = PeftModel.from_pretrained(base_model, "VictorDCh/Llama-3-8B-Instruct-spider-4") - Notebooks
- Google Colab
- Kaggle
Model save
Browse files
README.md
CHANGED
|
@@ -37,7 +37,7 @@ More information needed
|
|
| 37 |
### Training hyperparameters
|
| 38 |
|
| 39 |
The following hyperparameters were used during training:
|
| 40 |
-
- learning_rate:
|
| 41 |
- train_batch_size: 1
|
| 42 |
- eval_batch_size: 8
|
| 43 |
- seed: 42
|
|
|
|
| 37 |
### Training hyperparameters
|
| 38 |
|
| 39 |
The following hyperparameters were used during training:
|
| 40 |
+
- learning_rate: 0.0002
|
| 41 |
- train_batch_size: 1
|
| 42 |
- eval_batch_size: 8
|
| 43 |
- seed: 42
|