runtime error
Exit code: 1. Reason: | 62.9M/7.74G [00:01<02:05, 61.2MB/s][A model.safetensors: 2%|▏ | 126M/7.74G [00:02<02:44, 46.4MB/s] [A model.safetensors: 13%|█▎ | 1.02G/7.74G [00:03<00:18, 370MB/s][A model.safetensors: 19%|█▉ | 1.46G/7.74G [00:04<00:16, 391MB/s][A model.safetensors: 29%|██▊ | 2.21G/7.74G [00:05<00:10, 508MB/s][A model.safetensors: 36%|███▌ | 2.76G/7.74G [00:06<00:10, 498MB/s][A model.safetensors: 44%|████▎ | 3.39G/7.74G [00:07<00:08, 537MB/s][A model.safetensors: 53%|█████▎ | 4.13G/7.74G [00:08<00:06, 600MB/s][A model.safetensors: 61%|██████▏ | 4.75G/7.74G [00:09<00:04, 601MB/s][A model.safetensors: 69%|██████▉ | 5.38G/7.74G [00:10<00:03, 608MB/s][A model.safetensors: 77%|███████▋ | 6.00G/7.74G [00:11<00:02, 591MB/s][A model.safetensors: 86%|████████▌ | 6.64G/7.74G [00:12<00:01, 605MB/s][A model.safetensors: 97%|█████████▋| 7.48G/7.74G [00:13<00:00, 673MB/s][A model.safetensors: 100%|█████████▉| 7.74G/7.74G [00:14<00:00, 534MB/s] The `GPTNeoXSdpaAttention` class is deprecated in favor of simply modifying the `config._attn_implementation`attribute of the `GPTNeoXAttention` class! It will be removed in v4.48 Traceback (most recent call last): File "/home/user/app/app.py", line 7, in <module> model = AutoModelForCausalLM.from_pretrained( File "/usr/local/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py", line 564, in from_pretrained return model_class.from_pretrained( File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 4302, in from_pretrained dispatch_model(model, **device_map_kwargs) File "/usr/local/lib/python3.10/site-packages/accelerate/big_modeling.py", line 500, in dispatch_model raise ValueError( ValueError: You are trying to offload the whole model to the disk. Please use the `disk_offload` function instead.
Container logs:
Fetching error logs...