# Saving Datasets vs Dataset Cache

**URL:** <https://discuss.huggingface.co/t/saving-datasets-vs-dataset-cache/72604>\
**Category:** 🤗Datasets\
**Created:** [February 10, 2024, 1:08am UTC](https://discuss.huggingface.co/t/saving-datasets-vs-dataset-cache/72604 "2024-02-10T01:08:01Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![priyammaz](https://avatars.discourse-cdn.com/v4/letter/p/a5b964/32.png) [@priyammaz](https://discuss.huggingface.co/u/priyammaz)\
**Post date:** [February 10, 2024, 1:08am UTC](https://discuss.huggingface.co/t/saving-datasets-vs-dataset-cache/72604/1 "2024-02-10T01:08:01Z")

</div>

I am working on the common voice dataset and am only interested in the samples that have a labeled accent, so I am filtering the dataset for that. I’m not sure though if it is better to just use the save\_to\_disk/load\_to\_disk method or just depend on the cache which loads it pretty quickly. I don’t have a ton of disk space, If I do save the filtered dataset can I just delete the full dataset sitting in the cache after? Just not really sure what to do based on the docs!

---

<div class="post-metadata">

**Author:** ![gugaio](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/gugaio/32/38244_2.png) [@gugaio](https://discuss.huggingface.co/u/gugaio)\
**Post date:** [February 10, 2024, 1:56am UTC](https://discuss.huggingface.co/t/saving-datasets-vs-dataset-cache/72604/2 "2024-02-10T01:56:40Z")

</div>

save\_to\_disk/load\_to\_disk method is common used to run in production or if you have a huge dataset with many GBs. Common voice is not huge so I believe you should use Dataset Cache. Simpler and fast.
