In reply to @tina23:matrix.org
Hi! One of our nodes is degraded and status details are IC_Networking_StateSyncLoop. We can ping it fine and all other nodes in this DC are working fine. What could this status indicate?

In reply to @ritvick:matrix.org
have you tried rebooting? Once mine got stuck in this state.

In reply to @tina23:matrix.org
Hi! One of our nodes is degraded and status details are IC_Networking_StateSyncLoop. We can ping it fine and all other nodes in this DC are working fine. What could this status indicate?

Hey Bhavik Vadhia , not sure if there has been further instruction about the recovery image that Saša Tomić [DFINITY] mentioned earlier.

One of our nodes had this issue and I just redeployed it immediately - now it was part of the uzr34 subnet and I should have not done so but that node is healthy now.

So if you are concerned about the degraded status, a redeploy should do the trick - otherwise, I would wait for an update from the foundation regarding the recovery USB that can fix the node.

I suppose it's this node https://dashboard.internetcomputer.org/node/ihttm-45oz5-an5mg-i2jtb-fayst-s47j6-vmuwr-fqotf-mp2il-n5s5x-cae
I've asked the consensus team for feedback. I see the following error in the logs.

Aug 05 16:29:45 guest-7cc2555fb40b orchestrator[2295]: {"log_entry":{"level":"WARN","utc_time":"2024-08-05T16:29:45.807Z","message":"Cannot propose block as the locally available validation context is smaller than the parent validation context (locally available=ValidationContext { registry_version: 44560, certified_height: 111598027, time: Time(1722875385807900339) }, parent context=ValidationContext { registry_version: 44560, certified_height: 111833046, time: Time(1722875217898549305) })","crate_":"ic_consensus","module":"block_maker","line":261,"node_id":"ihttm-45oz5-an5mg-i2jtb-fayst-s47j6-vmuwr-fqotf-mp2il-n5s5x-cae","subnet_id":"lhg73-sax6z-2zank-6oer2-575lz-zgbxx-ptudx-5korm-fy7we-kh4hl-pqe"}}
Aug 05 16:29:50 guest-7cc2555fb40b orchestrator[2295]: {"log_entry":{"level":"WARN","utc_time":"2024-08-05T16:29:50.828Z","message":"Cannot propose block as the locally available validation context is smaller than the parent validation context (locally available=ValidationContext { registry_version: 44560, certified_height: 111598027, time: Time(1722875390828747815) }, parent context=ValidationContext { registry_version: 44560, certified_height: 111833046, time: Time(1722875217898549305) })","crate_":"ic_consensus","module":"block_maker","line":261,"node_id":"ihttm-45oz5-an5mg-i2jtb-fayst-s47j6-vmuwr-fqotf-mp2il-n5s5x-cae","subnet_id":"lhg73-sax6z-2zank-6oer2-575lz-zgbxx-ptudx-5korm-fy7we-kh4hl-pqe"}}

In reply to @sasa-tomic:matrix.org

I suppose it's this node https://dashboard.internetcomputer.org/node/ihttm-45oz5-an5mg-i2jtb-fayst-s47j6-vmuwr-fqotf-mp2il-n5s5x-cae
I've asked the consensus team for feedback. I see the following error in the logs.

Aug 05 16:29:45 guest-7cc2555fb40b orchestrator[2295]: {"log_entry":{"level":"WARN","utc_time":"2024-08-05T16:29:45.807Z","message":"Cannot propose block as the locally available validation context is smaller than the parent validation context (locally available=ValidationContext { registry_version: 44560, certified_height: 111598027, time: Time(1722875385807900339) }, parent context=ValidationContext { registry_version: 44560, certified_height: 111833046, time: Time(1722875217898549305) })","crate_":"ic_consensus","module":"block_maker","line":261,"node_id":"ihttm-45oz5-an5mg-i2jtb-fayst-s47j6-vmuwr-fqotf-mp2il-n5s5x-cae","subnet_id":"lhg73-sax6z-2zank-6oer2-575lz-zgbxx-ptudx-5korm-fy7we-kh4hl-pqe"}}
Aug 05 16:29:50 guest-7cc2555fb40b orchestrator[2295]: {"log_entry":{"level":"WARN","utc_time":"2024-08-05T16:29:50.828Z","message":"Cannot propose block as the locally available validation context is smaller than the parent validation context (locally available=ValidationContext { registry_version: 44560, certified_height: 111598027, time: Time(1722875390828747815) }, parent context=ValidationContext { registry_version: 44560, certified_height: 111833046, time: Time(1722875217898549305) })","crate_":"ic_consensus","module":"block_maker","line":261,"node_id":"ihttm-45oz5-an5mg-i2jtb-fayst-s47j6-vmuwr-fqotf-mp2il-n5s5x-cae","subnet_id":"lhg73-sax6z-2zank-6oer2-575lz-zgbxx-ptudx-5korm-fy7we-kh4hl-pqe"}}

In reply to @tina23:matrix.org
Yes, that’s the one.

In reply to @sasa-tomic:matrix.org
It could be related to the time drift. The machine seems to be 2 minutes behind. Not sure why.

In reply to @sasa-tomic:matrix.org
One thing you could do to mitigate is boot the machine from a live ubuntu usb, and sync the time with the NTP (automatically sync). BUT, I would recommend waiting since we do have a time sync job on the nodes, which should have corrected the drift.

Hi Angel Yachev , it is not possible at the moment just because the network is at target topology (enough nodes to sustain current capacity on the IC).

No news yet about a new node generation

Saša Tomić [DFINITY]: we have got the approval to use the local IP subnet. And we will proceed with the migration of IPs. I have a question

in the link :https://wiki.internetcomputer.org/wiki/Changing_IPv6_addresses_of_nodes

step 3 and 4, takes usually how long? as they are NNS proposal.

Good afternoon node providers,

I hope everyone is having a pleasant summer. I wanted to draw your attention to an opportunity to join a venture fund that is launching on ICP.

ICVC is a web3 venture builder dedicated to funding high-potential projects on the network. The fund is backed by the largest institutional investors on the network, and represents the first pure investment play on the network.

I've written a small one-pager to give you an insight in to the project. Otherwise, the tldr:

ICVC:

• is a community-governed Web3 venture builder on the IC
• has raised 1,163,565 ICP and invites node providers to join
• ICVC will close the fund raise on 18.08.2024
• can be invested in at https://nns.ic0.app/project/?project=nuywj-oaaaa-aaaaq-aadta-cai

You can find all the info you need here:
https://linktr.ee/icvc_official

Thanks,
Orlando

In reply to @o.hutchings:matrix.org

Good afternoon node providers,

I hope everyone is having a pleasant summer. I wanted to draw your attention to an opportunity to join a venture fund that is launching on ICP.

ICVC is a web3 venture builder dedicated to funding high-potential projects on the network. The fund is backed by the largest institutional investors on the network, and represents the first pure investment play on the network.

I've written a small one-pager to give you an insight in to the project. Otherwise, the tldr:

ICVC:

• is a community-governed Web3 venture builder on the IC
• has raised 1,163,565 ICP and invites node providers to join
• ICVC will close the fund raise on 18.08.2024
• can be invested in at https://nns.ic0.app/project/?project=nuywj-oaaaa-aaaaq-aadta-cai

You can find all the info you need here:
https://linktr.ee/icvc_official

Thanks,
Orlando

In reply to @b.vadhia:matrix.org
Its been 2 months now this server is in degraded state. Hence, planning to re-deploy the node and make it active. Any specific known process we know for re-deploying the node. Any guidance on this will be appreciated. Thanks for your time.

Hey @b.vadhia:matrix.org , sorry for the extremely long delay here. The node team prepared a recovery image but it didn't work as well as it was expected - the recovery tool reported success but the node was still not fully functional. They are still debugging it.
In the meantime, feel free to redeploy the node, just as you would redeploy any other faulty node.
Thanks!

In reply to @o.hutchings:matrix.org

Good afternoon node providers,

I hope everyone is having a pleasant summer. I wanted to draw your attention to an opportunity to join a venture fund that is launching on ICP.

ICVC is a web3 venture builder dedicated to funding high-potential projects on the network. The fund is backed by the largest institutional investors on the network, and represents the first pure investment play on the network.

I've written a small one-pager to give you an insight in to the project. Otherwise, the tldr:

ICVC:

• is a community-governed Web3 venture builder on the IC
• has raised 1,163,565 ICP and invites node providers to join
• ICVC will close the fund raise on 18.08.2024
• can be invested in at https://nns.ic0.app/project/?project=nuywj-oaaaa-aaaaq-aadta-cai

You can find all the info you need here:
https://linktr.ee/icvc_official

Thanks,
Orlando