Chapter 0 - RuntimeError: chunk expects at least a 1-dimensional tensor #6
Description
Got RuntimeError: chunk expects at least a 1-dimensional tensor on trainer.train() in self-hosted Conda Jupyter environment:
absl-py 2.2.2 Abseil Python Common Libraries, se...
accelerate 1.1.1 Accelerate
aiohappyeyeballs 2.6.1 Happy Eyeballs for asyncio
aiohttp 3.11.16 Async http client/server framework...
aiosignal 1.3.2 aiosignal: a list of registered as...
annotated-types 0.7.0 Reusable constraint types to use w...
anyio 4.9.0 High level compatibility layer for...
argon2-cffi 23.1.0 Argon2 for Python
argon2-cffi-bindings 21.2.0 Low-level CFFI bindings for Argon2
arrow 1.3.0 Better dates & times for Python
asttokens 3.0.0 Annotate AST trees with source cod...
async-lru 2.0.5 Simple LRU cache for asyncio
async-timeout 5.0.1 Timeout context manager for asynci...
attrs 25.3.0 Classes Without Boilerplate
babel 2.17.0 Internationalization utilities
beautifulsoup4 4.13.3 Screen-scraping library
bitsandbytes 0.45.2 k-bit optimizers and matrix multip...
bleach 6.2.0 An easy safelist-based HTML-saniti...
certifi 2025.1.31 Python package for providing Mozil...
cffi 1.17.1 Foreign Function Interface for Pyt...
charset-normalizer 3.4.1 The Real First Universal Charset D...
click 8.1.8 Composable command line interface ...
comm 0.2.2 Jupyter Python Comm implementation...
contourpy 1.3.1 Python library for calculating con...
cut-cross-entropy 25.1.1 Code for cut cross entropy, a memo...
cycler 0.12.1 Composable style cycles
datasets 3.1.0 HuggingFace community-driven open-...
debugpy 1.8.14 An implementation of the Debug Ada...
decorator 5.2.1 Decorators for Humans
defusedxml 0.7.1 XML bomb protection for Python std...
dill 0.3.8 serialize all of Python
docstring-parser 0.16 Parse Python docstrings in reST, G...
exceptiongroup 1.2.2 Backport of PEP 654 (exception gro...
executing 2.2.0 Get the currently executing AST no...
fastjsonschema 2.21.1 Fastest Python implementation of J...
filelock 3.18.0 A platform independent file lock.
flake8 7.1.1 the modular source code checker: p...
fonttools 4.57.0 Tools to manipulate font files
fqdn 1.5.1 Validates fully-qualified domain n...
frozenlist 1.5.0 A list-like structure which implem...
fsspec 2024.9.0 File-system specification
gensim 4.3.3 Python framework for fast Vector S...
gguf 0.10.0 Read and write ML models in GGUF f...
graphviz 0.20.3 Simple Python interface for Graphviz
grpcio 1.71.0 HTTP/2-based RPC framework
h11 0.14.0 A pure-Python, bring-your-own-I/O ...
hf-transfer 0.1.9 Speed up file transfers with the H...
httpcore 1.0.8 A minimal low-level HTTP client.
httpx 0.27.2 The next generation HTTP client.
huggingface-hub 0.26.2 Client library to download and pub...
idna 3.10 Internationalized Domain Names in ...
ipykernel 6.29.5 IPython Kernel for Jupyter
ipython 8.35.0 IPython: Productive Interactive Co...
ipywidgets 8.1.5 Jupyter interactive widgets
isoduration 20.11.0 Operations with ISO 8601 durations
jedi 0.19.2 An autocompletion tool for Python ...
jinja2 3.1.6 A very fast and expressive templat...
joblib 1.4.2 Lightweight pipelining with Python...
json5 0.12.0 A Python implementation of the JSO...
jsonpointer 3.0.0 Identify specific nodes in a JSON ...
jsonschema 4.23.0 An implementation of JSON Schema v...
jsonschema-specifications 2024.10.1 The JSON Schema meta-schemas and v...
jupyter-client 8.6.3 Jupyter protocol implementation an...
jupyter-core 5.7.2 Jupyter core package. A base packa...
jupyter-events 0.12.0 Jupyter Event System library
jupyter-lsp 2.2.5 Multi-Language Server WebSocket pr...
jupyter-server 2.15.0 The backend—i.e. core services, AP...
jupyter-server-terminals 0.5.3 A Jupyter Server Extension Providi...
jupyterlab 4.3.5 JupyterLab computational environment
jupyterlab-pygments 0.3.0 Pygments theme using JupyterLab CS...
jupyterlab-server 2.27.3 A set of server components for Jup...
jupyterlab-widgets 3.0.14 Jupyter interactive widgets for Ju...
kiwisolver 1.4.8 A fast implementation of the Casso...
lightning 2.5.1 The Deep Learning framework to tra...
lightning-utilities 0.14.3 Lightning toolbox for across the o...
markdown 3.8 Python implementation of John Grub...
markdown-it-py 3.0.0 Python port of markdown-it. Markdo...
markupsafe 3.0.2 Safely add untrusted strings to HT...
matplotlib 3.8.4 Python plotting package
matplotlib-inline 0.1.7 Inline Matplotlib backend for Jupyter
mccabe 0.7.0 McCabe checker, plugin for flake8
mdurl 0.1.2 Markdown URL utilities
missingno 0.5.2 Missing data visualization module ...
mistune 3.1.3 A sane and fast Markdown parser wi...
mpmath 1.3.0 Python library for arbitrary-preci...
multidict 6.4.3 multidict implementation
multiprocess 0.70.16 better multiprocessing and multith...
nbclient 0.10.2 A client library for executing not...
nbconvert 7.16.6 Converting Jupyter Notebooks (.ipy...
nbformat 5.10.4 The Jupyter Notebook format
nest-asyncio 1.6.0 Patch asyncio to allow nested even...
networkx 3.4.2 Python package for creating and ma...
nltk 3.9.1 Natural Language Toolkit
notebook 7.3.2 Jupyter Notebook - A web-based not...
notebook-shim 0.2.4 A shim layer for notebook traits a...
numpy 1.26.4 Fundamental package for array comp...
nvidia-cublas-cu12 12.4.5.8 CUBLAS native runtime libraries
nvidia-cuda-cupti-cu12 12.4.127 CUDA profiling tools runtime libs.
nvidia-cuda-nvrtc-cu12 12.4.127 NVRTC native runtime libraries
nvidia-cuda-runtime-cu12 12.4.127 CUDA Runtime native Libraries
nvidia-cudnn-cu12 9.1.0.70 cuDNN runtime libraries
nvidia-cufft-cu12 11.2.1.3 CUFFT native runtime libraries
nvidia-curand-cu12 10.3.5.147 CURAND native runtime libraries
nvidia-cusolver-cu12 11.6.1.9 CUDA solver native runtime libraries
nvidia-cusparse-cu12 12.3.1.170 CUSPARSE native runtime libraries
nvidia-nccl-cu12 2.21.5 NVIDIA Collective Communication Li...
nvidia-nvjitlink-cu12 12.4.127 Nvidia JIT LTO Library
nvidia-nvtx-cu12 12.4.127 NVIDIA Tools Extension
ollama 0.4.0 The official Python client for Oll...
overrides 7.7.0 A decorator to automatically detec...
packaging 24.2 Core utilities for Python packages
pandas 2.2.2 Powerful data structures for data ...
pandocfilters 1.5.1 Utilities for writing pandoc filte...
parso 0.8.4 A Python Parser
patsy 1.0.1 A Python package for describing st...
peft 0.13.2 Parameter-Efficient Fine-Tuning (P...
pexpect 4.9.0 Pexpect allows easy control of int...
pillow 11.2.1 Python Imaging Library (Fork)
platformdirs 4.3.7 A small Python package for determi...
plotly 5.24.1 An open-source, interactive data v...
polars 1.17.1 Blazingly fast DataFrame library
prometheus-client 0.21.1 Python client for the Prometheus m...
prompt-toolkit 3.0.50 Library for building powerful inte...
propcache 0.3.1 Accelerated property cache
protobuf 3.20.3 Protocol Buffers
psutil 7.0.0 Cross-platform lib for process and...
ptyprocess 0.7.0 Run a subprocess in a pseudo terminal
pure-eval 0.2.3 Safely evaluate AST nodes without ...
pyarrow 19.0.1 Python library for Apache Arrow
pycodestyle 2.12.1 Python style guide checker
pycparser 2.22 C parser in Python
pydantic 2.11.3 Data validation using Python type ...
pydantic-core 2.33.1 Core functionality for Pydantic va...
pyflakes 3.2.0 passive checker of Python programs
pygments 2.19.1 Pygments is a syntax highlighting ...
pyparsing 3.2.3 pyparsing module - Classes and met...
python-dateutil 2.9.0.post0 Extensions to the standard Python ...
python-json-logger 3.3.0 JSON Log Formatter for the Python ...
pytorch-lightning 2.5.1 PyTorch Lightning is the lightweig...
pytz 2025.2 World timezone definitions, modern...
pyyaml 6.0.2 YAML parser and emitter for Python
pyzmq 26.4.0 Python bindings for 0MQ
referencing 0.36.2 JSON Referencing + Python
regex 2024.11.6 Alternative regular expression mod...
requests 2.32.3 Python HTTP for Humans.
rfc3339-validator 0.1.4 A pure python RFC3339 validator
rfc3986-validator 0.1.1 Pure python rfc3986 validator
rich 14.0.0 Render rich text, tables, progress...
rpds-py 0.24.0 Python bindings to Rust's persiste...
safetensors 0.4.5
scikit-learn 1.6.1 A set of python modules for machin...
scipy 1.13.1 Fundamental algorithms for scienti...
seaborn 0.13.2 Statistical data visualization
send2trash 1.8.3 Send file to trash natively under ...
sentencepiece 0.2.0 SentencePiece python wrapper
setuptools 78.1.0 Easily download, build, install, u...
shapely 2.0.6 Manipulation and analysis of geome...
shtab 1.7.2 Automagic shell tab completion for...
six 1.17.0 Python 2 and 3 compatibility utili...
smart-open 7.1.0 Utils for streaming large files (S...
sniffio 1.3.1 Sniff out which async library your...
soupsieve 2.6 A modern CSS selector implementati...
stack-data 0.6.3 Extract data from python stack fra...
statsmodels 0.14.4 Statistical computations and model...
sympy 1.13.1 Computer algebra system (CAS) in P...
tenacity 8.2.2 Retry code until it succeeds
tensorboard 2.17.0 TensorBoard lets you watch Tensors...
tensorboard-data-server 0.7.2 Fast data loading for TensorBoard
terminado 0.18.1 Tornado websocket backend for the ...
threadpoolctl 3.6.0 threadpoolctl
tinycss2 1.4.0 A tiny CSS parser
tokenizers 0.20.3
tomli 2.2.1 A lil' TOML parser
torch 2.5.1+cu124 Tensors and Dynamic neural network...
torchaudio 2.5.1+cu124 An audio package for PyTorch
torchdata 0.7.1 Composable data loading modules fo...
torchmetrics 1.7.1 PyTorch native Metrics
torchviz 0.0.3 A small package to create visualiz...
tornado 6.4.2 Tornado is a Python web framework ...
tqdm 4.66.3 Fast, Extensible Progress Meter
traitlets 5.14.3 Traitlets Python configuration system
transformers 4.46.2 State-of-the-art Machine Learning ...
triton 3.1.0 A language and compiler for custom...
trl 0.12.1 Train transformer language models ...
typeguard 4.4.2 Run-time type checker for Python
types-python-dateutil 2.9.0.20241206 Typing stubs for python-dateutil
typing-extensions 4.13.2 Backported and Experimental Type H...
typing-inspection 0.4.0 Runtime typing introspection tools
tyro 0.9.18 CLI interfaces & config objects, f...
tzdata 2025.2 Provider of IANA time zone data
unsloth 2024.11.9 2-5X faster LLM finetuning
unsloth-zoo 2025.3.17 Utils for Unsloth
uri-template 1.3.0 RFC 6570 URI Template Processor
urllib3 2.4.0 HTTP library with thread-safe conn...
wcwidth 0.2.13 Measures the displayed width of un...
webcolors 24.11.1 A library for working with the col...
webencodings 0.5.1 Character encoding aliases for leg...
websocket-client 1.8.0 WebSocket client for Python with l...
werkzeug 3.1.3 The comprehensive WSGI web applica...
wheel 0.45.1 A built-package format for Python
widgetsnbextension 4.0.14 Jupyter interactive widgets for Ju...
wrapt 1.17.2 Module for decorators, wrappers an...
xformers 0.0.28.post3 XFormers: A collection of composab...
xxhash 3.5.0 Python binding for xxHash
yarl 1.19.0 Yet another URL library
$ uname -a
Linux ma2-models01.pulse.prod 4.18.0-553.27.1.el8_10.x86_64 #1 SMP Wed Nov 6 14:29:02 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux