a983430ddb
Check CPI program is executable ( #12644 ) ( #12649 )
...
(cherry picked from commit adeb06e550
)
Co-authored-by: Jack May <jack@solana.com >
2020-10-02 22:27:29 +00:00
bd94250fca
Improve solana deploy ( #12621 ) ( #12646 )
...
* Check program account before attempting to create it
* Use last_valid_slot to timeout status checks
* Include transaction history in RpcClient::get_signature_statuses requests
* Improve solana-deploy send-transactions
* Clippy
* Improve mock deploy test
* Review comments
(cherry picked from commit 19f385db76
)
Co-authored-by: Tyera Eulberg <teulberg@gmail.com >
2020-10-02 20:44:26 +00:00
db5251a524
solana catchup
now retries if the initial RPC connection fails (#12645 )
...
(cherry picked from commit 978b26a9c5
)
Co-authored-by: Michael Vines <mvines@gmail.com >
2020-10-02 20:42:51 +00:00
efb665071c
limits number of threads in core/tests/crds_gossip.rs ( #12615 ) ( #12641 )
...
crds_gossip tests start large networks, which with large thread-pools
will exhaust system resources, causing failures in ci tests:
https://buildkite.com/solana-labs/solana/builds/31953
The commit limits size of thread-pools in the test.
(cherry picked from commit 2c669f65f1
)
Co-authored-by: behzad nouri <behzadnouri@gmail.com >
2020-10-02 20:01:49 +00:00
e69ee1ec64
Add GetConfirmedBlocksWithLimit RPC method
...
(cherry picked from commit 75b621160e
)
2020-10-02 08:21:08 -07:00
307686eeba
Add --no-port-check to validator ( #12245 ) ( #12638 )
...
(cherry picked from commit aa70dbfc62
)
Co-authored-by: Ryo Onodera <ryoqun@gmail.com >
2020-10-02 12:46:40 +00:00
de1e2f9c0c
Add inflation subcommand ( #12632 )
...
(cherry picked from commit 42aeead6b4
)
Co-authored-by: Michael Vines <mvines@gmail.com >
2020-10-02 07:14:02 +00:00
01f93003d3
Improve block
command output ( #12631 )
...
(cherry picked from commit 14036ac580
)
Co-authored-by: Michael Vines <mvines@gmail.com >
2020-10-02 07:03:29 +00:00
75219afc91
Document postBalance field ( #12628 )
...
(cherry picked from commit e03a64ae1b
)
Co-authored-by: Michael Vines <mvines@gmail.com >
2020-10-02 05:38:11 +00:00
71526923a6
Expose validator cli arguments for pubsub buffer tuning ( #12622 )
...
(cherry picked from commit f41a73d76a
)
Co-authored-by: Michael Vines <mvines@gmail.com >
2020-10-02 04:43:44 +00:00
29af9d1a36
Avoid overflow when computing rent distribution (bp #12112 ) ( #12607 )
...
* Avoid overflow when computing rent distribution (#12112 )
* Avoid overflow when computing rent distribution
* Use assert_eq!....
* Fix tests
* Add test
* Use FeatureSet
* Add comments
* Address review comments
* Tweak a bit.
* Fix fmt
(cherry picked from commit e3773d919c
)
# Conflicts:
# runtime/src/bank.rs
# runtime/src/feature_set.rs
* Fix conflict
Co-authored-by: Ryo Onodera <ryoqun@gmail.com >
2020-10-02 01:37:47 +00:00
46311181dc
Add nonced-tx check to RpcClient ( #12600 ) ( #12604 )
...
(cherry picked from commit 8f10e407ee
)
Co-authored-by: Tyera Eulberg <teulberg@gmail.com >
2020-10-01 07:51:16 +00:00
17de653ce0
Move nonce utils from runtime to sdk (bp #12577 ) ( #12583 )
...
* runtime: Move prepare_if_nonce_account into accounts
(cherry picked from commit caec631344
)
* Move nonced tx helpers to SDK
(cherry picked from commit 65b868f4eb
)
* Move remaining nonce utils from runtime to SDK
(cherry picked from commit 3c7b9c2938
)
# Conflicts:
# runtime/src/bank.rs
* Fix conflict
Co-authored-by: Trent Nelson <trent@solana.com >
Co-authored-by: Tyera Eulberg <teulberg@gmail.com >
2020-10-01 06:25:25 +00:00
387ecdf70e
Add ci env to travis config ( #12608 ) ( #12610 )
...
Co-authored-by: publish-docs.sh <maintainers@solana.com >
(cherry picked from commit a17907b9a2
)
Co-authored-by: Dan Albert <dan@solana.com >
2020-10-01 06:03:57 +00:00
fbe5a89e74
retains hash value of outdated responses received from pull requests ( #12513 ) ( #12603 )
...
pull_response_fail_inserts has been increasing:
https://cdn.discordapp.com/attachments/478692221441409024/759096187587657778/pull_response_fail_insert.png
but for outdated values which fail to insert:
https://github.com/solana-labs/solana/blob/a5c3fc14b3/core/src/crds_gossip_pull.rs#L332-L344
https://github.com/solana-labs/solana/blob/a5c3fc14b3/core/src/crds.rs#L104-L108
are not recorded anywhere, and so the next pull request may obtain the
same redundant payload again, unnecessary taking bandwidth.
This commit holds on to the hashes of failed-inserts for a while, similar
to purged_values:
https://github.com/solana-labs/solana/blob/a5c3fc14b3/core/src/crds_gossip_pull.rs#L380
and filter them out for the next pull request:
https://github.com/solana-labs/solana/blob/a5c3fc14b3/core/src/crds_gossip_pull.rs#L204
(cherry picked from commit 1866521df6
)
Co-authored-by: behzad nouri <behzadnouri@gmail.com >
2020-10-01 01:47:20 +00:00
afbdcf3068
Include post balance information for rewards ( #12598 ) ( #12602 )
...
* Include post balance information for rewards
* Add post-balance to stored Reward struct
* Handle extended Reward in bigtable
Co-authored-by: Michael Vines <mvines@gmail.com >
(cherry picked from commit c31a34fbcb
)
Co-authored-by: Tyera Eulberg <teulberg@gmail.com >
2020-10-01 01:05:37 +00:00
2d1b995006
Use protobufs to store confirmed blocks in BigTable ( #12526 ) ( #12597 )
...
* Use protobufs to store confirmed blocks in BigTable
* Cleanup
* Reorganize proto
* Clean up use statements
* Split out function for unit testing
* s/utils/convert
Co-authored-by: Tyera Eulberg <teulberg@gmail.com >
(cherry picked from commit ce598c5c98
)
Co-authored-by: Justin Starry <justin@solana.com >
2020-09-30 19:37:02 +00:00
d9d3a95a72
Fix TransactionStatusMeta breakage in blockstore ( #12587 ) ( #12596 )
...
* Add helper to facilitate deserializing legacy structs
* Use default_on_eof to fix blockstore vis-a-vis TransactionStatusMeta
* Add should-panic test and comments
(cherry picked from commit 865d01c38d
)
Co-authored-by: Tyera Eulberg <teulberg@gmail.com >
2020-09-30 19:18:43 +00:00
ea990fd259
Update devnet genesis hash
2020-09-30 11:37:51 -07:00
4f30f9c8cf
Modernize python scripts ( #12595 )
...
(cherry picked from commit fce3c70b72
)
Co-authored-by: Trent Nelson <trent@solana.com >
2020-09-30 18:24:49 +00:00
d13694d839
Tighten docs publishing flow ( #12572 ) ( #12594 )
...
(cherry picked from commit ede19ef33b
)
Co-authored-by: Dan Albert <dan@solana.com >
2020-09-30 18:23:49 +00:00
700c8c1ec1
epoch_rewards datapoint now includes the correct rewards epoch (previous epoch) ( #12582 )
...
(cherry picked from commit f57af4fec2
)
Co-authored-by: Michael Vines <mvines@gmail.com >
2020-09-30 06:56:05 +00:00
33ace54b0f
Fix banks RPC port ( #12570 ) ( #12574 )
...
* Fix Banks RPC ports
* Add get_account_with_commitment
(cherry picked from commit d158d45051
)
Co-authored-by: Greg Fitzgerald <greg@solana.com >
2020-09-30 01:23:13 +00:00
5d2f450b89
Tune the sys-tuner documentation ( #12576 )
...
(cherry picked from commit 6156dc300d
)
Co-authored-by: Michael Vines <mvines@gmail.com >
2020-09-30 01:18:24 +00:00
55b0e9e9c7
builds crds filters in parallel (bp #12360 ) ( #12571 )
...
* builds crds filters in parallel (#12360 )
Based on run-time profiles, the majority time of new_pull_requests is
spent building bloom filters, in hashing and bit-vec ops.
This commit builds crds filters in parallel using rayon constructs. The
added benchmark shows ~5x speedup (4-core machine, 8 threads).
(cherry picked from commit 537bbde22e
)
# Conflicts:
# core/Cargo.toml
* resolves mergify merge conflict
Co-authored-by: behzad nouri <behzadnouri@gmail.com >
2020-09-30 01:08:16 +00:00
6d1bea7fb4
Include active stake in 'epoch_rewards' datapoint ( #12573 )
...
(cherry picked from commit 82848d6c73
)
Co-authored-by: Michael Vines <mvines@gmail.com >
2020-09-30 01:08:04 +00:00
d19ed8816e
Query BigTable for block time if does not exist in blockstore ( #12560 ) ( #12565 )
...
(cherry picked from commit 96a7d4dbd8
)
Co-authored-by: Tyera Eulberg <teulberg@gmail.com >
2020-09-29 23:26:03 +00:00
af7f48a2fd
Track inserted repair shreds ( #12455 ) ( #12563 )
...
(cherry picked from commit ce98088457
)
Co-authored-by: sakridge <sakridge@gmail.com >
2020-09-29 22:57:58 +00:00
0965389f41
Enable json output from solana feature status ( #12554 ) ( #12559 )
2020-09-29 21:00:20 +00:00
24c60cf3db
Bump version to v1.3.15
2020-09-29 20:57:08 +00:00
c8f4bfca90
Notify but don't abort on unexpected stake account balance
v1.3.14
2020-09-29 11:39:11 -07:00
4a6b65ce53
Switch get_program_accounts to use base64
2020-09-29 18:21:19 +00:00
836ed842d6
Increase rpc pubsub max payload to unblock large account notifications ( #12548 ) ( #12551 )
...
(cherry picked from commit 36d55c0667
)
Co-authored-by: Justin Starry <justin@solana.com >
2020-09-29 17:20:31 +00:00
966d0f72bb
Move process_instruction defs to runtime ( #12507 ) ( #12549 )
...
(cherry picked from commit 2ff983647f
)
Co-authored-by: Jack May <jack@solana.com >
2020-09-29 15:52:38 +00:00
a07e90516b
separates out ClusterInfo::{gossip,listen} thread-pools ( #12535 ) ( #12547 )
...
https://github.com/solana-labs/solana/pull/12402
moved gossip-work threads:
https://github.com/solana-labs/solana/blob/afd9bfc45/core/src/cluster_info.rs#L2330-L2334
to ClusterInfo::new as a new field in the ClusterInfo struct:
https://github.com/solana-labs/solana/blob/35208c5ee/core/src/cluster_info.rs#L249
So that they can be shared between listen and gossip threads:
https://github.com/solana-labs/solana/blob/afd9bfc45/core/src/gossip_service.rs#L54-L67
However, in testing https://github.com/solana-labs/solana/pull/12360
it turned out this will cause breakage:
https://buildkite.com/solana-labs/solana/builds/31646
https://buildkite.com/solana-labs/solana/builds/31651
https://buildkite.com/solana-labs/solana/builds/31655
Whereas with separate thread pools all is good. It might be the case
that one thread is slowing down the other by exhausting the thread-pool
whereas with separate thread-pools we get fair scheduling guarantees
from the os.
This commit reverts https://github.com/solana-labs/solana/pull/12402
and instead adds separate thread-pools for listen and gossip threads:
https://github.com/solana-labs/solana/blob/afd9bfc45/core/src/gossip_service.rs#L54-L67
(cherry picked from commit 0d5258b6d3
)
Co-authored-by: behzad nouri <behzadnouri@gmail.com >
2020-09-29 11:27:47 +00:00
bd2e09d55a
patches bug in Crds::find_old_labels with pubkey specific timeout ( #12528 ) ( #12546 )
...
Current code only returns values which are expired based on the default
timeout. Example from the added unit test:
- value inserted at time 0
- pubkey specific timeout = 1
- default timeout = 3
Then at now = 2, the value is expired, but the function fails to return
the value because it compares with the default timeout.
(cherry picked from commit 57ed4e4657
)
Co-authored-by: behzad nouri <behzadnouri@gmail.com >
2020-09-29 10:13:13 +00:00
655577f9fe
feature subcommand: display active stake by feature id when feature activation is not available ( #12543 )
...
(cherry picked from commit 322dbd894f
)
Co-authored-by: Michael Vines <mvines@gmail.com >
2020-09-29 06:17:31 +00:00
3781ad259b
clap-utils: Allow nonce/offline args to be global (bp #12538 )
2020-09-29 04:51:33 +00:00
5ad5f8b458
cli-output: Add a path to handling --verbose
and --quiet
display (bp #12531 )
2020-09-29 04:44:59 +00:00
5b322a995f
Rpc -> proper optimistic confirmation ( #12514 ) ( #12537 )
...
* Add service to track the most recent optimistically confirmed bank
* Plumb service into ClusterInfoVoteListener and ReplayStage
* Clean up test
* Use OptimisticallyConfirmedBank in RPC
* Remove superfluous notifications from RpcSubscriptions
* Use crossbeam to avoid mpsc recv_timeout panic
* Review comments
* Remove superfluous last_checked_slots, but pass in OptimisticallyConfirmedBank for complete correctness
(cherry picked from commit 89621adca7
)
Co-authored-by: Tyera Eulberg <teulberg@gmail.com >
2020-09-29 03:49:18 +00:00
63d9f32bb4
purges old pending push messages more efficiently ( #12522 ) ( #12533 )
...
(cherry picked from commit c94fe9236f
)
Co-authored-by: behzad nouri <behzadnouri@gmail.com >
2020-09-29 01:34:58 +00:00
a550d82202
Enable commitment arg on solana deploy ( #12532 ) ( #12534 )
...
(cherry picked from commit 35208c5ee7
)
Co-authored-by: Tyera Eulberg <teulberg@gmail.com >
2020-09-28 23:32:50 +00:00
4cf69365b2
Port BPFLoader2 activation to FeatureSet (bp #12490 ) ( #12530 )
...
* Cargo.lock
(cherry picked from commit 6071d0d206
)
# Conflicts:
# Cargo.lock
* Port BPFLoader2 activation to FeatureSet and rework built-in program activation
(cherry picked from commit 31696a1d72
)
# Conflicts:
# core/Cargo.toml
# genesis-programs/Cargo.toml
# genesis/Cargo.toml
# ledger/Cargo.toml
# local-cluster/Cargo.toml
# runtime/src/bank.rs
* Add Builtin AbiExample
(cherry picked from commit 833ad20b01
)
* Rebase
Co-authored-by: Michael Vines <mvines@gmail.com >
2020-09-28 23:12:05 +00:00
873b4ee830
Add a couple feature tests ( #12529 )
...
(cherry picked from commit 2956cc5aed
)
Co-authored-by: Michael Vines <mvines@gmail.com >
2020-09-28 20:31:09 +00:00
672d9c9f62
Add feature to resolve spl-token v2 multisig bug ( #12525 )
...
(cherry picked from commit f9a74b51ef
)
Co-authored-by: Michael Vines <mvines@gmail.com >
2020-09-28 18:14:20 +00:00
4bd29c1b32
Add pico-inflation feature
...
(cherry picked from commit aa5c008fa8
)
2020-09-28 09:34:35 -07:00
72c082f55a
Add precompile verification to preflight ( #12486 ) ( #12516 )
...
(cherry picked from commit 6583c8cffe
)
Co-authored-by: sakridge <sakridge@gmail.com >
2020-09-28 06:37:52 +00:00
d712a908c2
Port fix_recent_blockhashes_sysvar_delay to FeatureSet ( #12503 )
...
(cherry picked from commit 5d6410c1cb
)
# Conflicts:
# runtime/src/feature_set.rs
Co-authored-by: Michael Vines <mvines@gmail.com >
2020-09-26 20:26:58 +00:00
e3ca1a81b4
Add copy-on-write executor cache (bp #12502 ) ( #12511 )
...
* Add copy-on-write executor cache (#12502 )
* Add copy-on-write executor cache
* Add remove_executor function to the bank
(cherry picked from commit 965f653471
)
# Conflicts:
# runtime/src/bank.rs
* rebase
Co-authored-by: Jack May <jack@solana.com >
Co-authored-by: Michael Vines <mvines@gmail.com >
2020-09-26 20:26:50 +00:00
16bce553e4
Nit: bpf test cleanup ( #12401 ) ( #12508 )
...
(cherry picked from commit 7c4822efb1
)
Co-authored-by: Jack May <jack@solana.com >
2020-09-26 17:53:27 +00:00