Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cannot sync #3263

Open
syncprob opened this issue Nov 7, 2024 · 26 comments
Open

Cannot sync #3263

syncprob opened this issue Nov 7, 2024 · 26 comments
Assignees
Labels

Comments

@syncprob
Copy link

syncprob commented Nov 7, 2024

Topic Type

Cannot Synchronize

Detail of the issue

Have tried everything multiple times. Never a problem for more than a year. Have attempted sync with three different machines. Logs below. Please help. Thanks

neuron_debug_1730964241742.zip

bundled-ckb.log

No response

bundled-ckb-light-mainnet.log

No response

main.log

No response

status.log

No response

@Keith-CY
Copy link
Collaborator

Keith-CY commented Nov 7, 2024

Hi @quake in this case we can find the following log is repeating

2024-11-07 07:24:32.437 +00:00 BlockDownload INFO ckb_sync::synchronizer  best known header 4092817-Byte32(0x1563490fa646aea852290d7592f19cacf05e5fbecbc984d1a21d0c0b2a123a8e), CKB is syncing to latest Header to find the assume valid target: Byte32(0xca44ae8f7bc12ba8eab3224cbe3156c913e2284693e36dc1d01e4d30f362f3c2). Please wait. Need 9 minutes to sync to the latest Header.

The best known block stuck at
best known header 4092817-Byte32(0x1563490fa646aea852290d7592f19cacf05e5fbecbc984d1a21d0c0b2a123a8e)

Is it caused by the network connection?

@syncprob
Copy link
Author

syncprob commented Nov 7, 2024

Your attention is appreciated. I have not been able to determine if the network connection is the cause. Any guidance, suggestion, or otherwise, will be promptly deployed.

@Tony-ptech

This comment was marked as spam.

@syncprob
Copy link
Author

syncprob commented Nov 7, 2024

Tony, are you part of the ckb team?

@Tony-ptech

This comment was marked as spam.

@yanguoyu
Copy link
Collaborator

yanguoyu commented Nov 7, 2024

Tony, are you part of the ckb team?

Hi, @syncprob, don't connect with Tony-ptech. He is not a team support

@quake
Copy link
Member

quake commented Nov 8, 2024

Hi @quake in this case we can find the following log is repeating

2024-11-07 07:24:32.437 +00:00 BlockDownload INFO ckb_sync::synchronizer  best known header 4092817-Byte32(0x1563490fa646aea852290d7592f19cacf05e5fbecbc984d1a21d0c0b2a123a8e), CKB is syncing to latest Header to find the assume valid target: Byte32(0xca44ae8f7bc12ba8eab3224cbe3156c913e2284693e36dc1d01e4d30f362f3c2). Please wait. Need 9 minutes to sync to the latest Header.

The best known block stuck at best known header 4092817-Byte32(0x1563490fa646aea852290d7592f19cacf05e5fbecbc984d1a21d0c0b2a123a8e)

Is it caused by the network connection?

it looks like it's running a old version ckb (0.117.0) from log, could you upgrade to latest one (0.119.0) and restart it for running a longer time (around 1 hour) again?

@Keith-CY
Copy link
Collaborator

Keith-CY commented Nov 8, 2024

Hi @quake in this case we can find the following log is repeating

2024-11-07 07:24:32.437 +00:00 BlockDownload INFO ckb_sync::synchronizer  best known header 4092817-Byte32(0x1563490fa646aea852290d7592f19cacf05e5fbecbc984d1a21d0c0b2a123a8e), CKB is syncing to latest Header to find the assume valid target: Byte32(0xca44ae8f7bc12ba8eab3224cbe3156c913e2284693e36dc1d01e4d30f362f3c2). Please wait. Need 9 minutes to sync to the latest Header.

The best known block stuck at best known header 4092817-Byte32(0x1563490fa646aea852290d7592f19cacf05e5fbecbc984d1a21d0c0b2a123a8e)
Is it caused by the network connection?

it looks like it's running a old version ckb (0.117.0) from log, could you upgrade to latest one (0.119.0) and restart it for running a longer time (around 1 hour) again?

Specific steps for this

  1. turn Neuron off
  2. download the latest CKB executable from https://github.com/nervosnetwork/ckb/releases/download/v0.119.0/ckb_v0.119.0_x86_64-pc-windows-msvc.zip
  3. unzip it to Downloads/ckb_v0.119.0_x86_64-pc-windows-msvc
Pasted Graphic 5
  1. start a built-in program named Windows PowerShell
Windows
  1. type cd .\Downloads\ckb_v0.119.0_x86_64-pc-windows-msvc\ and hit Enter to run
Pasted Graphic 7
  1. type .\ckb init --chain mainnet and hit Enter
Pasted Graphic 8
  1. type .\ckb run and hit Enter to start the CKB node
Pasted Graphic 9

Keep it running for 1 hour

Hope it helps @syncprob

@DrakeBliss
Copy link

DrakeBliss commented Nov 9, 2024

SOLVED: Here is what I did to get my Neuron Wallet syncing to 100% and working again. I make sure I had my 12 word seed ready. I completely uninstalled the Neuron program using the Windows Uninstall control panel app. Then I deleted both "Neuron" Folders; one folder was in the "Program files" and the other folder in the "C:\Users\username\AppData\Roaming". You have to show the "Hidden" files in order to see the "AppData" folder. Then I reinstalled the "Neuron Wallet" with the latest release from this github page.

https://github.com/nervosnetwork/neuron/releases

The current version when I wrote this was 0.117.0 (2024-08-12). I scrolled down on the page and selected the package with the "EXE" version for my Windows 64 bit machine. I ran the installer, during install, I allowed the Firewall rule change. I chose the "Import Wallet Seeds" option, then I copied and pasted my seeds. You can now select all 12 seeds and then paste them into first seed box and it will populated all twelve seeds. Whoever made this feature "Way to go!", big time saver on getting the seeds into the boxes. Once I had the wallet opened, it started syncing. I went to Settings" option and selected the "Light Client Mainnet", it started syncing again.

I followed the steps shown in the video below to speed up the synch process. It shows you how to set a starting block for the sync. This video could use some narration on what is going on in the video. I had to watch it many times to see what they were doing. There was a section on the video where they changed the block address from #,###,### to #,##0,000. I suppose that made the starting block to sync begin on a block start, before the actual block they copied?

https://www.youtube.com/watch?v=Vl2LGRNqnvk

Even with it starting at a higher block, the sync still took over quite a while to fully sync, however, it kept syncing away to it finished. I have a fast Dell desktop with 16GB of RAM, i7 CPU, 1 TB SSD drive and a fast fiber internet. I never got a reply back on why I was getting the "SQLITE_BUSY: database is locked" messages. During the Client sync it got a couple of theses messages and I had to keep monitoring the sync process and clear them when it popped up. I never was able to sync the full node. and gave that up after several days of trying and did the above using the Light Client to get my wallet back working. Very happy to have my Neuron Wallet back up and syncing 100%

---------------- Original Post ----------------------
Using Windows 10 and v0.117.0 I can not get the Synch to complete, it get to 98.x% and get stuck. I started from a fresh install and it gets stuck about every 2 hours and stops synching. I get the attached message pop-up about (SQLITE_BUSY: database is locked) many times and that stops the synching as well. I have been trying for days to synch my wallet. I never had any issues like this until the latest version.
PXL_20241108_134239089

@syncprob
Copy link
Author

syncprob commented Nov 9, 2024

Hi,
Step #6 , above, resulted in the following:

PS C:\Users\carver> cd .\Downloads\ckb_v0.119.0_x86_64-pc-windows-msvc
PS C:\Users\carver\Downloads\ckb_v0.119.0_x86_64-pc-windows-msvc> .\ckb init --chain mainnet
.\ckb : The term '.\ckb' is not recognized as the name of a cmdlet, function, script file, or operable program. Check
the spelling of the name, or if a path was included, verify that the path is correct and try again.
At line:1 char:1

  • .\ckb init --chain mainnet
  •   + CategoryInfo          : ObjectNotFound: (.\ckb:String) [], CommandNotFoundException
      + FullyQualifiedErrorId : CommandNotFoundException
    
    

PS C:\Users\carver\Downloads\ckb_v0.119.0_x86_64-pc-windows-msvc>

@yanguoyu
Copy link
Collaborator

yanguoyu commented Nov 9, 2024

Hi, Step #6 , above, resulted in the following:

PS C:\Users\carver> cd .\Downloads\ckb_v0.119.0_x86_64-pc-windows-msvc PS C:\Users\carver\Downloads\ckb_v0.119.0_x86_64-pc-windows-msvc> .\ckb init --chain mainnet .\ckb : The term '.\ckb' is not recognized as the name of a cmdlet, function, script file, or operable program. Check the spelling of the name, or if a path was included, verify that the path is correct and try again. At line:1 char:1

  • .\ckb init --chain mainnet
  •   + CategoryInfo          : ObjectNotFound: (.\ckb:String) [], CommandNotFoundException
      + FullyQualifiedErrorId : CommandNotFoundException
    

PS C:\Users\carver\Downloads\ckb_v0.119.0_x86_64-pc-windows-msvc>

Hi, where do you unzip the ckb_v0.119.0_x86_64-pc-windows-msvc.zip? If the ckb_v0.119.0_x86_64-pc-windows-msvc directory is not at the C:\Users\carver\Downloads, move it to C:\Users\carver\Downloads and try again.

@syncprob
Copy link
Author

I believe the ckb_v0.119.0_x86_64-pc-windows-msvc directory was unzipped at C:\Users\carver\Downloads. Please see below:

neu1

git2

@Keith-CY
Copy link
Collaborator

I believe the ckb_v0.119.0_x86_64-pc-windows-msvc directory was unzipped at C:\Users\carver\Downloads. Please see below:

neu1

git2

Hi @syncprob please type ls and execute it when PowerShell is in ckb_v0.119.0_x86_64-pc-windows-msvc and check if it looks like this
image

Especially check if ckb.exe is there

@syncprob
Copy link
Author

Your efforts thus far are appreciated. Here is the result:
git3

@Keith-CY
Copy link
Collaborator

Keith-CY commented Nov 10, 2024

Your efforts thus far are appreciated. Here is the result:

git3

Hi @syncprob
The files have been uncompressed into a nested folder so the program is in "ckb_v0.119.0_x86_64-pc-windows-msvc/ckb_v0.119.0_x86_64-pc-windows-msvc" but not "ckb_v0.119.0_x86_64-pc-windows-msvc"

Please run "cd ./ckb_v0.119.0_x86_64-pc-windows-msvc" one more time before running "./ckb init --chain mainnet"


We can run "ls" before running "./ckb" to check if PwerShell is in the correct folder

@syncprob
Copy link
Author

Currently running:

git4

@Keith-CY
Copy link
Collaborator

Keith-CY commented Nov 11, 2024

Currently running:

git4

Is the [email protected] working properly or does it also halt on a specific block number?


If it works well, we can sync Neuron with [email protected] by the following steps:

  1. Go to Neuron's Settings to add a new network
    image
  2. Add a new network as
    image
  3. Switch to the Local Node option

@syncprob
Copy link
Author

Keith-Cy, and others, thank you.

The last thing I did was to start "./ckb init --chain mainnet".
It continues to run and is somewhere around block 3,400,000 after maybe two days.

Still trying to access Neuron Wallet, I opened it and a dialogue box appears "Detected External Node"

I have used Neuron for years on multiple devices without issue.

I have attempted to access my wallet on 3 different machines.

What can I do to access the contents of my Neuron wallet? Thanks

@Keith-CY
Copy link
Collaborator

Keith-Cy, and others, thank you.

The last thing I did was to start "./ckb init --chain mainnet". It continues to run and is somewhere around block 3,400,000 after maybe two days.

Still trying to access Neuron Wallet, I opened it and a dialogue box appears "Detected External Node"

I have used Neuron for years on multiple devices without issue.

I have attempted to access my wallet on 3 different machines.

What can I do to access the contents of my Neuron wallet? Thanks

Hi @syncprob
Showing a message of Detected External Node is expected because we've run a CKB node outside the Neuron.

But stuck at 3,400,000 block number is not an exceptional case. That means both the built-in and external nodes cannot reach the latest block.

Could you paste the latest 200 lines of the PowerShell here so we can check why the sync is halted?
Also cc @quake for any other suggestion.

@syncprob
Copy link
Author

I apologize for poorly communicating. "./ckb init --chain mainnet" continues to run slowly but surely.

To be clear, it is not stuck. Does that mean that I can't open the wallet until it completes in 10 days or so?

@Keith-CY
Copy link
Collaborator

I apologize for poorly communicating. "./ckb init --chain mainnet" continues to run slowly but surely.

To be clear, it is not stuck. Does that mean that I can't open the wallet until it completes in 10 days or so?

You can keep Neuron on while the outside Node is working. Neuron will always catch up with the latest block of the outside Node.

But only when the outside Node reaches the global latest block(14,541,924 at the moment), will Neuron be ready for transactions.

@syncprob
Copy link
Author

So do I "Ignore external mode" or "Add Network"? If add network is selected, can you please point me to the instructions.
Thanks

@syncprob
Copy link
Author

correction: "Ignore external [n]ode"

@Keith-CY
Copy link
Collaborator

Keith-CY commented Nov 12, 2024

So do I "Ignore external mode" or "Add Network"? If add network is selected, can you please point me to the instructions. Thanks

Hi @syncprob There are roughly 2 steps to connect to the external node, as illustrated at #3263 (comment), while details are as follows,

  1. Make sure Neuron is off, check the task manager and there's no program named 'Neuron', 'Neuron Helper' or 'ckb' is running
  2. Start the External Node
  3. Start Neuron and go to the Settings
  4. Click Add Network in the Network section
  5. Add a network, type is Full Node, RPC address is http://127.0.0.1:8114 or http://localhost:8114 and network name is Local Node
  6. Once the network option is added, switch to it

Then Neuron is expected to connect to the external node.


add.new.network.mov

@syncprob
Copy link
Author

Still waiting to view and access Neuron Wallet contents.

I have successfully synced Neuron wallet with the chain many times on a number of different devices. That is starting fresh. The longest it has taken in the past was roughly 7-8 hours. Approaching 4 days now and it is approx 4,100,000 blocks.
Is that to be expected when dealing with typical residential speeds and hardware?

@Keith-CY
Copy link
Collaborator

Still waiting to view and access Neuron Wallet contents.

I have successfully synced Neuron wallet with the chain many times on a number of different devices. That is starting fresh. The longest it has taken in the past was roughly 7-8 hours. Approaching 4 days now and it is approx 4,100,000 blocks.

Is that to be expected when dealing with typical residential speeds and hardware?

It's usually determined by the network quality but shouldn't be slow as this.

Now the external node is still working but the block number grew so slowly that it only reached 4,100,000, am I right?

If so, please share the last 200 line of the PowerShell then we can see if there is any problem with the external node.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

6 participants