How to use ayanami-kitasan/code-pruner with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("token-classification", model="ayanami-kitasan/code-pruner")
# pip install -U transformers accelerate # Load model directly from transformers import SwePrunerForCodeCompression model = SwePrunerForCodeCompression.from_pretrained("ayanami-kitasan/code-pruner", device_map="auto")
https://huggingface.co/ayanami-kitasan/code-pruner/resolve/main/merges.txt
hf download hf://ayanami-kitasan/code-pruner/merges.txt
curl -L -o merges.txt https://huggingface.co/ayanami-kitasan/code-pruner/resolve/main/merges.txt
