You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
docs: add two more cases to the troubleshooting guide (celestiaorg#2005)
* add two more cases to the troubleshooting guide
Signed-off-by: Long Zhang <[email protected]>
* chore: fix hook was ignored because it's not set as executable
Signed-off-by: Long Zhang <[email protected]>
* revert the permission change of the git hooks
it turns out that yarn lint:md will check all the .md files and it can contain lots of errors. I guess that's why the git
hooks are disabled for now.
Signed-off-by: Long Zhang <[email protected]>
* address the nitpick comments by the rabbit
Signed-off-by: Long Zhang <[email protected]>
---------
Signed-off-by: Long Zhang <[email protected]>
Copy file name to clipboardExpand all lines: how-to-guides/celestia-node-troubleshooting.md
+65Lines changed: 65 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -311,3 +311,68 @@ sudo systemctl daemon-reload
311
311
```bash
312
312
sudo systemctl restart celestia-bridge
313
313
```
314
+
315
+
## Error: "no space left on device"
316
+
317
+
When a bridge or full storage node runs on `ext4` file system, there will be errors like the following due to large folder size:
318
+
319
+
```bash
320
+
ERROR header/sync sync/sync.go:227 syncing headers {"from": 5074102, "to": 5161144, "err": "creating file: creating ODSQ4 file: creating Q4 file: creating Q4 file: open /root/.celestia-bridge-mocha-4/blocks/C9ADF6D9F862D92993D67977DE407D17ECF7F1DACE5FB7FE9A6845F4BD0172CE.q4: no space left on device"}
321
+
```
322
+
323
+
You may also observe similar errors from the `tar`command when extracting a snapshot of an archival bridge node.
324
+
325
+
There are two solutions to this problem:
326
+
327
+
#### Option 1: enable the large_dir feature for ext4
328
+
329
+
:::tip NOTE
330
+
If the Node Store is on the same partition as the OS, it is recommended to take Option 2.
331
+
:::
332
+
333
+
1. Stop the node
334
+
2. Unmount the device and run the following command:
335
+
336
+
```bash
337
+
# unmount the partition
338
+
# the value of <target> can be either the partition name (e.g., /dev/sdc1) or the mountpoint (e.g., /mnt/celestia)
339
+
sudo umount <target>
340
+
341
+
# enable the large_dir feature, use the partition name like /dev/sdc1 here
342
+
# if RAID is set, you can use the partition name like /dev/md0 for tune2fs
343
+
sudo tune2fs -O large_dir </dev/partition>
344
+
345
+
# perform a filesystem consistency check
346
+
sudo fsck -f </dev/yourpartition>
347
+
348
+
# mount the partition again
349
+
sudo mount </dev/yourpartition> <mountpoint>
350
+
```
351
+
3. Restart the node
352
+
353
+
#### Option 2: migrate to XFS/ZFS file system
354
+
355
+
Make sure you have your node id backed up so that you can import them later on.
356
+
357
+
## Error: "can't get key ...: too many failed passphrase attempts"
358
+
359
+
If you have initialized a bridge node with option `--keyring.backend file`, you will be asked to provide a keyring passphrase. Then a bridge node key `my_celes_key` is auto-generated by the `init` command. However, this does not work well with the systemd service setup because everytime when the bridge node is started, it asks for the passphrase. The systemd service will keep failing with the following error:
360
+
361
+
```bash
362
+
ERROR module/state state/keyring.go:23 can't get key: `my_celes_key` from the keystore: too many failed passphrase attempts
363
+
```
364
+
365
+
Usually a bridge node wallet does not need to be funded unless you plan to do`PayForBlob` through it. We suggest using the default keyring backend (`test`) in this case which does not require a passphrase.
366
+
367
+
If you don't want to init the node again, you can do the following steps:
368
+
369
+
```bash
370
+
# update the config.toml file in the home folder of the bridge node or adjust your systemd service definition
371
+
[State]
372
+
DefaultKeyName = "my_celes_key"
373
+
DefaultBackendName = "test"
374
+
375
+
# recover the key using `cel-key`
376
+
# add `--keyring-dir </service_home_folder/keys/>` if you are using a custom home folder for the node
0 commit comments