Troubleshooting
Start here when an upload, download, login, or background storage operation fails. Check health first, then narrow the problem by wallet, cache, task, or storage provider signals.
First Checks
curl http://127.0.0.1:9090/healthz
synaps3 admin status
synaps3 admin task statsExpected healthy baseline:
{"status":"ok"}If health is not ok, use the error text as the next branch.
Setup Mode
Health may return:
{"status":"setup"}This means SynapS3 is missing required settings. Review the configuration validation details before changing a value.
Check the reported fields:
synaps3 admin status
synaps3 admin settings getIf the wallet private key is missing, generate one:
synaps3 wallet generateIf the missing value is the wallet key, set the generated private key in SYNAPS3_FILECOIN_PRIVATE_KEY or filecoin.private_key in the config file. Restart SynapS3, check /healthz, and verify the effective settings.
Expected result: health changes from setup to ok after restart.
Unhealthy Background Tasks
Example:
{"status":"unhealthy","errors":["worker/uploader: not responding"]}Check task pressure:
synaps3 admin task stats
synaps3 admin task list --status running --limit 20After a restart, unfinished tasks become eligible to continue. If background task processing stays unhealthy, record the current task state, inspect logs, and then restart the service.
Wallet Funding or Deposit Fails
Check wallet status:
synaps3 admin statusFor Calibration, fund the wallet address again:
synaps3 wallet fund-testnet 0x...Then retry deposit and FWSS approval:
synaps3 wallet deposit 2 # 2 USDFC
synaps3 wallet approveIf faucet funding fails, claim manually from ChainSafe or Plumbline, then rerun synaps3 admin status.
Successful faucet claims print CalibnetUSDFC: <hash> and CalibnetFIL: <hash>. A confirmed deposit or approval prints Transaction: <hash> and Status: confirmed; an existing approval prints FWSS approval: already approved. If these results do not appear, verify RPC connectivity, wallet funds, and the reported error before retrying.
Cache Full
Upload endpoints can fail when cache capacity is exhausted. Check usage:
synaps3 admin status
synaps3 admin settings get cache.max_size_gbRecovery options:
- Confirm the host has free disk space, then increase
cache.max_size_gbif capacity allows. - Restore storage provider connectivity and background task progress so queued uploads can complete and cache eviction can run.
- Keep
cache.eviction_policy = "lru"if local cache cleanup should be queued after remote storage succeeds.
After changing the cache setting, restart SynapS3, check /healthz, and verify the effective value with synaps3 admin settings get cache.max_size_gb.
Exhausted Tasks
List exhausted work:
synaps3 admin task list --status exhausted --limit 100Retry only after RPC connectivity, storage provider availability, wallet funds, FWSS approval, and cache disk capacity are ready.
synaps3 admin task retry 42Provider or RPC Issues
Check provider health and Filecoin readiness in the dashboard, or inspect the Admin API:
curl -u admin http://127.0.0.1:9090/api/v1/filecoin/readiness
curl -u admin http://127.0.0.1:9090/api/v1/observability/providersEnter the Admin password at curl's no-echo prompt.
Recovery:
- Restore the configured
filecoin.rpc_url. - Confirm provider URLs are reachable from the SynapS3 host.
- Keep
filecoin.allow_private_networks = falseunless private provider URLs are expected and trusted.
S3 Client Cannot Upload
Check these in order:
- S3 client uses path-style addressing.
- Access key and secret came from
synaps3 admin s3-user create. - Endpoint is
http://localhost:8080for local evaluation or the correct HTTPS address for production. - Object size is between
127and1,065,353,216bytes, and the object key meets the S3 compatibility limits. - Dashboard task view shows whether Filecoin storage is queued, running, or exhausted.