a8071f1039
chore(pubkey): remove dead code ( #18162 )
...
(cherry picked from commit 755b7c7aee
)
Co-authored-by: hrls <viktor.kharitonovich@gmail.com >
2021-06-23 17:07:21 +00:00
bc08351a0a
capture sort time in hash calculation ( #18118 ) ( #18153 )
...
(cherry picked from commit d3ee73e151
)
Co-authored-by: Jeff Washington (jwash) <75863576+jeffwashington@users.noreply.github.com >
2021-06-23 15:49:28 +00:00
088b3893c3
Keep track of dirty stores on remove accounts to clean ( #17601 ) ( #18173 )
...
* Keep track of dirty stores on remove accounts to clean
and not zero_lamport key set
* Only dirty when count==0?
* Add another clean
(cherry picked from commit 3b1738c000
)
Co-authored-by: sakridge <sakridge@gmail.com >
2021-06-23 10:23:44 +00:00
d9d6dd9ba6
Add metrics for rpc send-tx failures ( #18156 ) ( #18164 )
...
(cherry picked from commit 64cff8c5a1
)
Co-authored-by: Tyera Eulberg <teulberg@gmail.com >
2021-06-22 22:28:22 -06:00
aca66674d3
correctly calculate hash_total for hash/lamport calculation ( #18144 ) ( #18146 )
...
(cherry picked from commit d5f9f3b7ce
)
Co-authored-by: Jeff Washington (jwash) <75863576+jeffwashington@users.noreply.github.com >
2021-06-22 21:21:10 +00:00
597429ab3e
Bump version to v1.7.4
2021-06-22 19:57:34 +00:00
715360c1e7
ci: fix release build agent targeting
v1.7.3
2021-06-22 13:36:34 -06:00
fcabaa7eff
sdk: refactor pda generation
2021-06-22 11:36:05 -06:00
b14af989b8
Update sysvar docs ( #18125 ) ( #18147 )
...
(cherry picked from commit 8a136736ad
)
Co-authored-by: Jack May <jack@solana.com >
2021-06-22 17:28:15 +00:00
1a919e0c3e
ci: isolate release builds ( #18133 )
...
(cherry picked from commit d43c6eafaf
)
Co-authored-by: Trent Nelson <trent@solana.com >
2021-06-22 06:14:59 +00:00
9c1a6bed7b
Fix flaky optimistic violation detection cluster test ( #18027 ) ( #18126 )
...
* Fix flaky optimistic violation detection cluster test
* Add small sleep to avoid tight loop
(cherry picked from commit 423e0d90ee
)
Co-authored-by: Ashwin Sekar <ashwin@solana.com >
2021-06-22 05:07:33 +00:00
c48ec02f42
Docs val net reqs (backport #18122 ) ( #18130 )
...
* docs: don't suggest cloud instances for validators
(cherry picked from commit cf187dcb0b
)
* docs: flesh out validator network requirements
(cherry picked from commit 93dd965947
)
Co-authored-by: Trent Nelson <trent@solana.com >
2021-06-22 02:12:49 +00:00
6f376489a5
Handle removing slots during account scans ( #17471 ) ( #17953 )
...
(cherry picked from commit ccc013e134
)
Co-authored-by: carllin <carl@solana.com >
2021-06-22 00:59:12 +00:00
0cbf7bef1e
Move stake_weighted_timestamp module ( #18114 ) ( #18120 )
...
* Move timestamp module into runtime
* Less public
* Remove unused enum
(cherry picked from commit 19fe1dd463
)
Co-authored-by: Tyera Eulberg <teulberg@gmail.com >
2021-06-22 00:11:12 +00:00
0f87e598f6
refactor generate_index_for_slot ( #17984 ) ( #18116 )
...
(cherry picked from commit 2087f5da94
)
Co-authored-by: Jeff Washington (jwash) <75863576+jeffwashington@users.noreply.github.com >
2021-06-21 18:25:56 -05:00
363b75619f
adds shred-version to ip-echo-server response (backport #18066 ) ( #18113 )
...
* adds shred-version to ip-echo-server response
When starting a validator, the node initially joins gossip with
shred_verison = 0, until it adopts the entrypoint's shred-version:
https://github.com/solana-labs/solana/blob/9b182f408/validator/src/main.rs#L417
Depending on the load on the entrypoint, this adopting entrypoint
shred-version through gossip sometimes becomes very slow, and causes
several problems in gossip because we have to partially support
shred_version == 0 which is a source of leaking crds values from one
cluster to another. e.g. see
https://github.com/solana-labs/solana/pull/17899
and the other linked issues there.
In order to remove shred_version == 0 from gossip, this commit adds
shred-version to ip-echo-server response. Once the entrypoints are
updated, on validator start-up, if --expected_shred_version is not
specified we will obtain shred-version from the entrypoint using
ip-echo-server.
(cherry picked from commit 598093b5db
)
# Conflicts:
# Cargo.lock
# net-utils/Cargo.toml
# programs/bpf/Cargo.lock
* removes backport merge conflicts
* obtains shred-version from entrypoint's ip-echo-server in validator-main
(cherry picked from commit 58e115275a
)
Co-authored-by: behzad nouri <behzadnouri@gmail.com >
2021-06-21 23:04:08 +00:00
090c801cc6
eliminate flatten and sort in hash calculation ( #17802 ) ( #18115 )
...
* eliminate flatten and sort in hash calculation
* reduce critical section time
* remove now no-longer necessary test code
* conflict with reset bins to 0 pr
(cherry picked from commit bf97627021
)
Co-authored-by: Jeff Washington (jwash) <75863576+jeffwashington@users.noreply.github.com >
2021-06-21 17:47:47 -05:00
b711778d4a
More nightly clippy fixes ( #18081 )
...
(cherry picked from commit 1b7f6d2bc0
)
Co-authored-by: Michael Vines <mvines@gmail.com >
2021-06-21 21:55:42 +00:00
d52569d66f
user process.accounts_db_test_hash_calculation for debug_verify hash ( #18053 ) ( #18109 )
...
(cherry picked from commit ec2f930475
)
Co-authored-by: Jeff Washington (jwash) <75863576+jeffwashington@users.noreply.github.com >
2021-06-21 16:15:13 -05:00
c676b7a473
refactor reconstruct_accountsdb_from_fields ( #17987 ) ( #18100 )
...
(cherry picked from commit ae82e4e25b
)
Co-authored-by: Jeff Washington (jwash) <75863576+jeffwashington@users.noreply.github.com >
2021-06-21 15:14:45 -05:00
71c49bc8cd
Add logging when RpcHealthStatus::Unknown ( #18098 ) ( #18107 )
...
(cherry picked from commit faecc41603
)
Co-authored-by: Tyera Eulberg <teulberg@gmail.com >
2021-06-21 13:53:25 -06:00
97a7f747fb
remove unused code ( #17981 ) ( #18048 )
...
(cherry picked from commit 20e714b3d0
)
Co-authored-by: Jeff Washington (jwash) <75863576+jeffwashington@users.noreply.github.com >
2021-06-21 10:12:50 -05:00
cef9e0de0c
generate_index timings ( #17983 ) ( #18049 )
...
(cherry picked from commit 1feaaf009d
)
Co-authored-by: Jeff Washington (jwash) <75863576+jeffwashington@users.noreply.github.com >
2021-06-21 10:12:27 -05:00
5637acb799
Add additional subscription metrics ( #18071 ) ( #18076 )
...
(cherry picked from commit 83a6c669a5
)
Co-authored-by: Tyera Eulberg <teulberg@gmail.com >
2021-06-19 04:51:40 +00:00
3d3bdcb966
Drop Error suffix from enum values to avoid the enum_variant_names clippy lint
...
(cherry picked from commit 4a12c715a3
)
2021-06-18 19:59:20 -07:00
c9f02ae020
fix loader instruction checker ( #18047 ) ( #18074 )
...
(cherry picked from commit d18e02ef44
)
Co-authored-by: Jack May <jack@solana.com >
2021-06-18 21:28:29 +00:00
0e7512a225
Fix Nightly Clippy Warnings (backport #18065 ) ( #18070 )
...
* chore: cargo +nightly clippy --fix -Z unstable-options
(cherry picked from commit 6514096a67
)
# Conflicts:
# core/src/banking_stage.rs
# core/src/cost_model.rs
# core/src/cost_tracker.rs
# core/src/execute_cost_table.rs
# core/src/replay_stage.rs
# core/src/tvu.rs
# ledger-tool/src/main.rs
# programs/bpf_loader/build.rs
# rbpf-cli/src/main.rs
# sdk/cargo-build-bpf/src/main.rs
# sdk/cargo-test-bpf/src/main.rs
# sdk/src/secp256k1_instruction.rs
* chore: cargo fmt
(cherry picked from commit 789f33e8db
)
* Updates BPF program assert_instruction_count tests.
(cherry picked from commit c1e03f3410
)
# Conflicts:
# programs/bpf/tests/programs.rs
* Resolve conflicts
Co-authored-by: Alexander Meißner <AlexanderMeissner@gmx.net >
Co-authored-by: Michael Vines <mvines@gmail.com >
2021-06-18 20:02:48 +00:00
c330016109
adds mapping from nodes pubkeys to their shred-version ( #17940 ) ( #18067 )
...
Crds values of nodes with different shred versions are creeping into
gossip table resulting in runtime issues as the one addressed in:
https://github.com/solana-labs/solana/pull/17899
This commit works towards enforcing more checks and filtering based on
shred version by adding necessary mapping and api to gossip table.
Once populated, pubkey->shred-version mapping persists as long as there
are any values associated with the pubkey.
(cherry picked from commit 5a99fa3790
)
Co-authored-by: behzad nouri <behzadnouri@gmail.com >
2021-06-18 18:02:23 +00:00
cb13cdec85
Fix build issues downstream due to stake state shuffle
...
(cherry picked from commit 810fce1f3d
)
2021-06-18 07:13:40 -07:00
c65c580b20
introduce LockMapType for accounts_index ( #18021 ) ( #18051 )
...
(cherry picked from commit 0a81c37fce
)
Co-authored-by: Jeff Washington (jwash) <75863576+jeffwashington@users.noreply.github.com >
2021-06-18 01:39:27 +00:00
d159ae9342
Bump version to v1.7.3
2021-06-17 15:34:50 -06:00
a540af1ca7
refactor rebuild_bank_from_snapshots (backport #17988 ) ( #18006 )
...
* refactor rebuild_bank_from_snapshots (#17988 )
(cherry picked from commit bb7413c9f9
)
# Conflicts:
# runtime/src/snapshot_utils.rs
* merge errors
Co-authored-by: Jeff Washington (jwash) <75863576+jeffwashington@users.noreply.github.com >
Co-authored-by: Jeff Washington (jwash) <wash678@gmail.com >
2021-06-17 19:26:10 +00:00
e9c234d89f
Make account shrink configurable #17544 (backport #17778 ) ( #18013 )
...
* Make account shrink configurable #17544 (#17778 )
1. Added both options for measuring space usage using total accounts usage and for individual store shrink ratio using an enum. Validator CLI options: --accounts-shrink-optimize-total-space and --accounts-shrink-ratio
2. Added code for selecting candidates based on total usage in a separate function select_candidates_by_total_usage
3. Added unit tests for the new functions added
4. The default implementations is kept at 0.8 shrink ratio with --accounts-shrink-optimize-total-space set to true
Fixes #17544
(cherry picked from commit 269d995832
)
# Conflicts:
# core/tests/snapshots.rs
# ledger/src/bank_forks_utils.rs
# runtime/src/accounts_db.rs
# runtime/src/snapshot_utils.rs
* fix some merge errors
Co-authored-by: Lijun Wang <83639177+lijunwangs@users.noreply.github.com >
Co-authored-by: Jeff Washington (jwash) <wash678@gmail.com >
v1.7.2
2021-06-17 17:32:03 +00:00
b472dac6b3
validator: expose max active pubsub subscriptions to CLI ( #18036 )
...
(cherry picked from commit 5efc48fc69
)
Co-authored-by: Trent Nelson <trent@solana.com >
2021-06-17 08:02:20 +00:00
523dac1be3
metrics: Don't unwrap client instantiation errors ( #18019 )
...
(cherry picked from commit 5cc073420a
)
Co-authored-by: Trent Nelson <trent@solana.com >
2021-06-17 07:08:36 +00:00
962a2126b5
Log more info on runtime account verification errors ( #17861 ) ( #17879 )
...
(cherry picked from commit a1fab0c5ca
)
Co-authored-by: Jack May <jack@solana.com >
2021-06-17 01:55:37 +00:00
5c495ad1b0
ledger tool limit_load_slot_count_from_snapshot avoids assert failures (backport #17974 ) ( #18008 )
...
* ledger tool limit_load_slot_count_from_snapshot avoids assert failures (#17974 )
(cherry picked from commit dbd4dc04b0
)
# Conflicts:
# core/tests/snapshots.rs
# ledger/src/blockstore_processor.rs
# runtime/benches/accounts.rs
# runtime/src/bank.rs
* fix merge errors
Co-authored-by: Jeff Washington (jwash) <75863576+jeffwashington@users.noreply.github.com >
Co-authored-by: Jeff Washington (jwash) <wash678@gmail.com >
2021-06-17 01:32:50 +00:00
f633f34e43
Clean up remove_all_authorized_voters() ( #18029 )
...
(cherry picked from commit f1ebbbab8f
)
Co-authored-by: Michael Vines <mvines@gmail.com >
2021-06-17 00:28:41 +00:00
bacf1b9acc
accounts-cluster-bench, close all accounts in a sliding window ( #17993 ) ( #18026 )
...
(cherry picked from commit ed18add7d3
)
Co-authored-by: carllin <carl@solana.com >
2021-06-16 23:53:31 +00:00
4df9da5c48
validator: run poh speed test earlier in start up ( #18024 )
...
(cherry picked from commit 5bc6c89adc
)
Co-authored-by: Trent Nelson <trent@solana.com >
2021-06-16 23:28:15 +00:00
30bbc1350d
Startup optimization in shrink - don't shrink non-shrinkable slots (backport #17405 ) ( #17792 )
...
* Skip shrink when it doesn't save anything (#17405 )
(cherry picked from commit 14c52ab018
)
# Conflicts:
# runtime/src/accounts_db.rs
* fix merge error
Co-authored-by: sakridge <sakridge@gmail.com >
Co-authored-by: Jeff Washington (jwash) <wash678@gmail.com >
2021-06-16 23:28:03 +00:00
2f0f1fd5f5
break out generate index reporting ( #17980 ) ( #18015 )
...
(cherry picked from commit 71796f4951
)
Co-authored-by: Jeff Washington (jwash) <75863576+jeffwashington@users.noreply.github.com >
2021-06-16 22:02:19 +00:00
c28e6ebc4c
do not use index for verify_bank_hash_and_lamports ( #17812 ) ( #18010 )
...
(cherry picked from commit adc683956f
)
Co-authored-by: Jeff Washington (jwash) <75863576+jeffwashington@users.noreply.github.com >
2021-06-16 21:33:30 +00:00
6479c11e9a
Don't store votes unless we are leader soon ( #17803 ) ( #17894 )
...
(cherry picked from commit 0feac57cb0
)
Co-authored-by: sakridge <sakridge@gmail.com >
2021-06-16 21:28:06 +00:00
4ed0fcdde6
avoid unnecessary empty arrays when binning ( #17944 ) ( #18011 )
...
(cherry picked from commit eee5414c64
)
Co-authored-by: Jeff Washington (jwash) <75863576+jeffwashington@users.noreply.github.com >
2021-06-16 20:48:18 +00:00
296a8ade63
set hash bins to 65k ( #17912 ) ( #18009 )
...
(cherry picked from commit 55ee3b5f2f
)
Co-authored-by: Jeff Washington (jwash) <75863576+jeffwashington@users.noreply.github.com >
2021-06-16 20:31:26 +00:00
a84953ccfd
Improve program deployment error message ( #17717 ) ( #17725 )
...
(cherry picked from commit 39654d3fa5
)
Co-authored-by: Jack May <jack@solana.com >
2021-06-16 20:16:00 +00:00
8492031fd0
refactor generate_index process_storage_slot ( #17982 ) ( #18007 )
...
(cherry picked from commit 7ca04d6a86
)
Co-authored-by: Jeff Washington (jwash) <75863576+jeffwashington@users.noreply.github.com >
2021-06-16 20:14:49 +00:00
bff7259111
parallel storage -> accounts folder ( #17955 ) ( #18004 )
...
(cherry picked from commit 7de79425ce
)
Co-authored-by: Jeff Washington (jwash) <75863576+jeffwashington@users.noreply.github.com >
2021-06-16 15:51:00 +00:00
67e1814581
nit: rename measure ( #17946 ) ( #17995 )
...
(cherry picked from commit 5ecb30ff58
)
Co-authored-by: Jeff Washington (jwash) <75863576+jeffwashington@users.noreply.github.com >
2021-06-16 14:51:38 +00:00