Just wanted to bring this to your attention as I saw some of the code comments about context limitations: https://huggingface.co/MaziyarPanahi/Llama-3-8B-Instruct-32k-v0.1-GGUF
Just wanted to bring this to your attention as I saw some of the code comments about context limitations:
https://huggingface.co/MaziyarPanahi/Llama-3-8B-Instruct-32k-v0.1-GGUF