mergify[bot] a536f779ee scans crds table in parallel for finding old labels (#13073) (#13107) ...

From runtime profiles, the majority time of ClusterInfo::handle_purge
https://github.com/solana-labs/solana/blob/0776fa05c/core/src/cluster_info.rs#L1605-L1626
is spent scanning crds table finding old labels:
https://github.com/solana-labs/solana/blob/0776fa05c/core/src/crds.rs#L175-L197

This can be done in parallel given that gossip thread-pool:
https://github.com/solana-labs/solana/blob/0776fa05c/core/src/cluster_info.rs#L1637-L1641
is idle when handle_purge is invoked:
https://github.com/solana-labs/solana/blob/0776fa05c/core/src/cluster_info.rs#L1681

(cherry picked from commit 37c8842bcb)

Co-authored-by: behzad nouri <behzadnouri@gmail.com>

2020-10-23 15:36:06 +00:00

..

broadcast_stage

Add replacements for Pubkey::new_rand()/Hash::new_rand() (bp #12987) (#13076)

2020-10-22 05:08:01 +00:00

accounts_hash_verifier.rs

Add separate push queue to reduce push lock contention (#12713) (#12867)

2020-10-14 02:46:13 +00:00

bank_weight_fork_choice.rs

Follow up to persistent tower with tests and API cleaning (#12350) (#12972)

2020-10-19 08:47:58 +00:00

banking_stage.rs

Add replacements for Pubkey::new_rand()/Hash::new_rand() (bp #12987) (#13076)

2020-10-22 05:08:01 +00:00

bigtable_upload_service.rs

Add LARGEST_CONFIRMED_ROOT_UPLOAD_DELAY

2020-09-04 16:01:49 -07:00

broadcast_stage.rs

Address latest nightly clippy lints, but globally disable stable_sort_primitive

2020-08-17 22:36:10 -07:00

cache_block_time_service.rs

Cache block time in Blockstore (#11955)

2020-09-09 09:33:14 -06:00

cluster_info_vote_listener.rs

Add replacements for Pubkey::new_rand()/Hash::new_rand() (bp #12987) (#13076)

2020-10-22 05:08:01 +00:00

cluster_info.rs

scans crds table in parallel for finding old labels (#13073) (#13107)

2020-10-23 15:36:06 +00:00

cluster_slots_service.rs

Add separate push queue to reduce push lock contention (#12713) (#12867)

2020-10-14 02:46:13 +00:00

cluster_slots.rs

Add replacements for Pubkey::new_rand()/Hash::new_rand() (bp #12987) (#13076)

2020-10-22 05:08:01 +00:00

commitment_service.rs

Add replacements for Pubkey::new_rand()/Hash::new_rand() (bp #12987) (#13076)

2020-10-22 05:08:01 +00:00

completed_data_sets_service.rs

Detect and notify when deserializable shreds are available (#11816)

2020-09-01 22:06:06 -07:00

consensus.rs

Add replacements for Pubkey::new_rand()/Hash::new_rand() (bp #12987) (#13076)

2020-10-22 05:08:01 +00:00

contact_info.rs

Add replacements for Pubkey::new_rand()/Hash::new_rand() (bp #12987) (#13076)

2020-10-22 05:08:01 +00:00

crds_gossip_error.rs

…

crds_gossip_pull.rs

scans crds table in parallel for finding old labels (#13073) (#13107)

2020-10-23 15:36:06 +00:00

crds_gossip_push.rs

Add replacements for Pubkey::new_rand()/Hash::new_rand() (bp #12987) (#13076)

2020-10-22 05:08:01 +00:00

crds_gossip.rs

scans crds table in parallel for finding old labels (#13073) (#13107)

2020-10-23 15:36:06 +00:00

crds_shards.rs

Add replacements for Pubkey::new_rand()/Hash::new_rand() (bp #12987) (#13076)

2020-10-22 05:08:01 +00:00

crds_value.rs

Add replacements for Pubkey::new_rand()/Hash::new_rand() (bp #12987) (#13076)

2020-10-22 05:08:01 +00:00

crds.rs

scans crds table in parallel for finding old labels (#13073) (#13107)

2020-10-23 15:36:06 +00:00

data_budget.rs

implements DataBudget using atomics (#12856) (#12990)

2020-10-20 12:51:42 +00:00

deprecated.rs

Introduce automatic ABI maintenance mechanism (2/2; rollout) (#8012)

2020-07-06 20:22:23 +09:00

epoch_slots.rs

Address latest nightly clippy lints, but globally disable stable_sort_primitive

2020-08-17 22:36:10 -07:00

fetch_stage.rs

…

fork_choice.rs

Merge heaviest bank modules (#10672)

2020-06-18 03:59:08 +00:00

gen_keys.rs

…

gossip_service.rs

Add replacements for Pubkey::new_rand()/Hash::new_rand() (bp #12987) (#13076)

2020-10-22 05:08:01 +00:00

heaviest_subtree_fork_choice.rs

Various clean-ups before assert adjustment (#13006) (#13041)

2020-10-21 02:41:20 +00:00

ledger_cleanup_service.rs

Remove ledger purge batching (#10830)

2020-06-29 14:44:35 -07:00

lib.rs

Remove frozen ABI modules from solana-sdk (bp #13008) (#13036)

2020-10-21 02:00:45 +00:00

local_vote_signer_service.rs

…

non_circulating_supply.rs

Add replacements for Pubkey::new_rand()/Hash::new_rand() (bp #12987) (#13076)

2020-10-22 05:08:01 +00:00

optimistic_confirmation_verifier.rs

Add integration test for optimistic confirmation failure detection (#11353)

2020-08-03 20:01:52 -07:00

optimistically_confirmed_bank_tracker.rs

Rpc -> proper optimistic confirmation (#12514)

2020-09-28 20:43:05 -06:00

poh_recorder.rs

Skip grace blocks if previous leader was on different fork (#11679)

2020-08-19 08:16:24 +00:00

poh_service.rs

…

progress_map.rs

Add replacements for Pubkey::new_rand()/Hash::new_rand() (bp #12987) (#13076)

2020-10-22 05:08:01 +00:00

pubkey_references.rs

…

repair_response.rs

…

repair_service.rs

Add option for repairing only from trusted validators (#11752)

2020-08-21 00:35:11 -07:00

repair_weight.rs

Cleanup test utilities (#11723)

2020-08-20 05:04:38 +00:00

repair_weighted_traversal.rs

Cleanup test utilities (#11723)

2020-08-20 05:04:38 +00:00

replay_stage.rs

Add replacements for Pubkey::new_rand()/Hash::new_rand() (bp #12987) (#13076)

2020-10-22 05:08:01 +00:00

result.rs

Detect and notify when deserializable shreds are available (#11816)

2020-09-01 22:06:06 -07:00

retransmit_stage.rs

Add replacements for Pubkey::new_rand()/Hash::new_rand() (bp #12987) (#13076)

2020-10-22 05:08:01 +00:00

rewards_recorder_service.rs

Expose all rewards (fees, rent, voting and staking) in RPC getConfirmedBlock and the cli (bp #12768) (#12790)

2020-10-10 06:11:42 +00:00

rpc_health.rs

…

rpc_pubsub_service.rs

Expose validator cli arguments for pubsub buffer tuning

2020-10-01 20:30:40 -07:00

rpc_pubsub.rs

Add replacements for Pubkey::new_rand()/Hash::new_rand() (bp #12987) (#13076)

2020-10-22 05:08:01 +00:00

rpc_service.rs

Add replacements for Pubkey::new_rand()/Hash::new_rand() (bp #12987) (#13076)

2020-10-22 05:08:01 +00:00

rpc_subscriptions.rs

Add replacements for Pubkey::new_rand()/Hash::new_rand() (bp #12987) (#13076)

2020-10-22 05:08:01 +00:00

rpc.rs

Add replacements for Pubkey::new_rand()/Hash::new_rand() (bp #12987) (#13076)

2020-10-22 05:08:01 +00:00

sample_performance_service.rs

Add blockstore column to store performance sampling data (#12251)

2020-09-22 12:26:32 -07:00

send_transaction_service.rs

SendTransactionServices now exit their thread on channel drop instead of by a flag

2020-09-18 17:29:10 +00:00

serve_repair_service.rs

…

serve_repair.rs

Add replacements for Pubkey::new_rand()/Hash::new_rand() (bp #12987) (#13076)

2020-10-22 05:08:01 +00:00

shred_fetch_stage.rs

Move BankForks to solana_runtime (#10637)

2020-06-17 15:27:03 +00:00

sigverify_shreds.rs

Move BankForks to solana_runtime (#10637)

2020-06-17 15:27:03 +00:00

sigverify_stage.rs

…

sigverify.rs

…

snapshot_packager_service.rs

Add CLI options and runtime support for selection of output snapshot version. (#10536)

2020-06-19 14:38:37 +09:00

test_validator.rs

Add replacements for Pubkey::new_rand()/Hash::new_rand() (bp #12987) (#13076)

2020-10-22 05:08:01 +00:00

tpu.rs

Rpc -> proper optimistic confirmation (#12514)

2020-09-28 20:43:05 -06:00

transaction_status_service.rs

Store program logs in blockstore / bigtable (TransactionWithStatusMeta) (#12678) (#12735)

2020-10-08 20:19:26 +00:00

tree_diff.rs

Add TreeDiff trait to reuse tree functions (#11046)

2020-07-14 07:38:48 +00:00

tvu.rs

Rpc -> proper optimistic confirmation (#12514)

2020-09-28 20:43:05 -06:00

validator.rs

Allow nodes to advertise a different rpc address over gossip (#13053) (#13078)

2020-10-22 07:06:27 +00:00

verified_vote_packets.rs

Add replacements for Pubkey::new_rand()/Hash::new_rand() (bp #12987) (#13076)

2020-10-22 05:08:01 +00:00

vote_stake_tracker.rs

Add replacements for Pubkey::new_rand()/Hash::new_rand() (bp #12987) (#13076)

2020-10-22 05:08:01 +00:00

weighted_shuffle.rs

…

window_service.rs

Add replacements for Pubkey::new_rand()/Hash::new_rand() (bp #12987) (#13076)

2020-10-22 05:08:01 +00:00