Dependencies need to be updated to below to get it to load datasets properly (I think it was a version issue): !pip install --no-deps bitsandbytes accelerate xformers==0.0.29.post3 peft trl triton cut_cross_entropy unsloth_zoo !pip install sentencepiece protobuf "datasets>=3.4.1" huggingface_hub hf_transfer !pip install --no-deps unsloth !pip install comet-ml>=3.43.2