90557564c3
Accountsdb plugin postgres improvement ( #21034 ) ( #21096 )
...
Summary of Changes
Added the reference postgresql.conf
Prepare slot update statement to reduce overhead in updating slot
Support custom connection string
Allow the plugin to panic on replication issues to ensure consistency
2021-11-02 01:07:21 -07:00
6d2fd078be
Update deprecated variant in RpcClient doctests ( #21121 ) ( #21131 )
...
(cherry picked from commit 96e5342292
)
Co-authored-by: Tyera Eulberg <teulberg@gmail.com >
2021-11-01 23:48:30 -06:00
4a874e9ba1
Fixup filter deprecated since ( #21123 ) ( #21128 )
...
(cherry picked from commit 1b47f7f2cd
)
Co-authored-by: Tyera Eulberg <teulberg@gmail.com >
2021-11-02 04:23:32 +00:00
22510678b4
docs: Update language around immutable programs ( #21116 ) ( #21118 )
...
(cherry picked from commit ec86ff8fb3
)
Co-authored-by: Jon Cinque <jon.cinque@gmail.com >
2021-11-01 21:01:27 +00:00
69b973a3a6
Parallel notifications in RPC PubSub (backport #20543 ) ( #21092 )
...
* Parallel notifications in RPC PubSub (#20543 )
* generate rpc notifications in parallel
* Use multithreaded runtime for pubsub
* add metric for time since creation of rpc notification to queue
* measure notification entry processing
* fix: add n_threads config argument
* configure rayon thread pool for rpc notifications
* add config option for pubsub notification threads
* rename metric to created_to_queue_time_us
Co-authored-by: Tyera Eulberg <teulberg@gmail.com >
* rename metric to notification_entry_processing_time_us
Co-authored-by: Tyera Eulberg <teulberg@gmail.com >
* use value_of for rpc_pubsub_notification_threads parsing
Co-authored-by: Tyera Eulberg <teulberg@gmail.com >
* rename threads to sol-sub-notif-N
Co-authored-by: Tyera Eulberg <teulberg@gmail.com >
* fix rpc tests for TimestampedNotificationEntry
* rustfmt
* use rayon thread limit for rpc
Co-authored-by: Pavel Strakhov <p.strakhov@iconic.vc >
Co-authored-by: Alexander Polakov <a.polakov@zubr.io >
Co-authored-by: Nikita Podoliako <bananaelecitrus@gmail.com >
Co-authored-by: Tyera Eulberg <teulberg@gmail.com >
(cherry picked from commit 9fabff5129
)
# Conflicts:
# Cargo.lock
# rpc/Cargo.toml
* Fix conflicts
Co-authored-by: Pavel Strakhov <ri@idzaaus.org >
Co-authored-by: Tyera Eulberg <tyera@solana.com >
2021-11-01 20:19:51 +00:00
cc7ed71cb7
Fix serum-dex downstream build ( #21115 )
2021-11-01 17:54:22 +00:00
b6fe051d24
Document next_account_info(s) ( #21076 ) ( #21080 )
...
(cherry picked from commit 62c8fb4792
)
Co-authored-by: Brian Anderson <andersrb@gmail.com >
2021-10-29 22:22:09 +00:00
506d39ea82
Add missing websocket methods to rust RPC PubSub client (backport #21065 ) ( #21073 )
...
* Add missing websocket methods to rust RPC PubSub client (#21065 )
- Added accountSubscribe, programSubscribe, slotSubscribe and rootSubscribe to rust RpcClient
- Removed duplication on cleanup threads
- Moved RPCVote from rpc/ to client/rpc_response
(cherry picked from commit a0f9e0e8ee
)
# Conflicts:
# Cargo.lock
# client-test/Cargo.toml
# core/tests/client.rs
* Fix conflicts
* Make test result not depend on TestValidator setup
Co-authored-by: Manuel Gil <manugildev@gmail.com >
Co-authored-by: Tyera Eulberg <tyera@solana.com >
2021-10-29 21:46:59 +00:00
a595e06b48
Check whether vote-authorize-voter-checked new vote authority is_interactive ( #21051 ) ( #21057 )
...
* Check interactive signer for vote-authorize-voter-checked
* Recommend checked vote reauthorization
(cherry picked from commit 0b8fcf0808
)
Co-authored-by: Tyera Eulberg <teulberg@gmail.com >
2021-10-28 23:10:25 +00:00
da08f3dc2b
seeds rng for test_build_crds_filter test ( #21031 ) ( #21048 )
...
(cherry picked from commit eea3fb327f
)
Co-authored-by: behzad nouri <behzadnouri@gmail.com >
2021-10-28 22:06:13 +00:00
8dd3c1ece1
Bump version to v1.8.3 ( #21040 )
2021-10-28 11:17:11 -06:00
42a2c29234
Different error if block status is not yet available ( #20407 ) ( #21029 )
...
* Different error if block is not available
* Add slot to error message
* Make and use helper function
* Check finalized path as well
Co-authored-by: Tyera Eulberg <tyera@solana.com >
(cherry picked from commit 700e42d556
)
Co-authored-by: sakridge <sakridge@gmail.com >
v1.8.2
2021-10-27 20:58:15 +00:00
a1f1264962
Swap banking stage vote channels ( #20987 ) ( #21000 )
...
(cherry picked from commit 261dd96ae3
)
Co-authored-by: sakridge <sakridge@gmail.com >
2021-10-27 20:17:38 +00:00
66caead016
Add compute budget noops (backport #20992 ) ( #21014 )
...
* Add compute budget program as a noop (#20992 )
(cherry picked from commit 1e2bef76e3
)
# Conflicts:
# sdk/src/feature_set.rs
* resolve conflicts
Co-authored-by: Jack May <jack@solana.com >
2021-10-27 12:47:35 -07:00
de1f60fb2d
Refactor cost tracker metrics reporting (backport #20802 ) ( #20933 )
...
* - cost_tracker is data member of a bank, it can report metrics when bank is frozen (#20802 )
- removed cost_tracker_stats and histogram
- move stats reporting outside of bank freeze
(cherry picked from commit c2bfce90b3
)
# Conflicts:
# Cargo.lock
# core/src/banking_stage.rs
# core/src/replay_stage.rs
# core/src/tvu.rs
# ledger-tool/src/main.rs
# programs/bpf/Cargo.lock
# runtime/Cargo.toml
# runtime/src/cost_tracker.rs
* manual fix merge conflicts
Co-authored-by: Tao Zhu <82401714+taozhu-chicago@users.noreply.github.com >
Co-authored-by: Tao Zhu <tao@solana.com >
2021-10-27 16:48:20 +00:00
7528016e2d
Add counter for dropped duplicated packets, fix dropped_packets_count ( #20834 ) ( #21023 )
...
(cherry picked from commit 71d0bd4605
)
2021-10-27 11:36:37 -05:00
adc57899fe
tpu-client: Add send_messages_with_spinner
from program / stake-o-matic (backport #20960 ) ( #21002 )
...
* tpu-client: Move `send_messages_with_spinner` from program (#20960 )
We have too many ways of sending transactions, and too many
reimplementations of the same logic all over the place.
The program deploy logic and stake-o-matic currently make the
most use of the TPU client, so this merges their implementations into
one place to be reused by both. Yay for consolidation!
(cherry picked from commit 5f7b60576f
)
# Conflicts:
# cli/src/program.rs
# client/src/mock_sender.rs
* Fix merge issues, use older APIs
* Update mock sender fee to match block height
Co-authored-by: Jon Cinque <jon.cinque@gmail.com >
2021-10-27 12:22:17 +00:00
afe229a89e
Document entrypoint!
, custom_heap_default!
, and custom_panic_default!
( #21003 ) ( #21015 )
...
(cherry picked from commit ced1505b75
)
Co-authored-by: Brian Anderson <andersrb@gmail.com >
2021-10-27 07:49:14 +00:00
5dd00e9230
Force a recent version of the openssl crate to allow this to build on M1 macs (backport #21008 ) ( #21012 )
...
* Force a recent version of the openssl crate to allow this to build on M1 macs
(cherry picked from commit 920159fc63
)
# Conflicts:
# Cargo.lock
# programs/bpf_loader/Cargo.toml
* Run cargo check
(cherry picked from commit 8efc577374
)
# Conflicts:
# programs/bpf/Cargo.lock
* Resolve merge conflicts
Co-authored-by: Matt Wilde <matthewcwilde@gmail.com >
Co-authored-by: Michael Vines <mvines@gmail.com >
2021-10-27 02:55:49 +00:00
0a698fc48f
Instruction sysvar fixes, additions (backport #20958 ) ( #21001 )
...
* Instruction sysvar fixes, additions (#20958 )
(cherry picked from commit 4fe3354c8f
)
# Conflicts:
# programs/bpf/rust/sysvar/src/lib.rs
# programs/bpf/tests/programs.rs
# sdk/program/src/sysvar/instructions.rs
* resolve conflicts
Co-authored-by: Jack May <jack@solana.com >
2021-10-27 01:00:01 +00:00
1666fc5483
Restore getProgramAccounts spl-token secondary-index functionality (backport #20993 ) ( #21005 )
...
* Restore getProgramAccounts spl-token secondary-index functionality (#20993 )
* Allow get_spl_token_X_filters to match on any encoding, and optimize earlier
* Remove redundant optimize calls
* Compress match statements
* Add method docs, including note to use optimize_filters before spl-token checks
* Add logs
(cherry picked from commit b2f6cfb9ff
)
# Conflicts:
# rpc/src/rpc.rs
* Fix conflict
Co-authored-by: Tyera Eulberg <teulberg@gmail.com >
Co-authored-by: Tyera Eulberg <tyera@solana.com >
2021-10-26 23:43:45 +00:00
467abd1f5b
feat: update getClusterNodes
...
(cherry picked from commit dec104c580
)
2021-10-26 13:18:19 -07:00
19432f2e5f
Add CrdsData::IncrementalSnapshotHashes (backport #20374 ) ( #20994 )
...
* Add CrdsData::IncrementalSnapshotHashes (#20374 )
(cherry picked from commit 4e3818e5c1
)
# Conflicts:
# gossip/src/cluster_info.rs
* removes backport merge conflicts
Co-authored-by: Brooks Prumo <brooks@solana.com >
Co-authored-by: behzad nouri <behzadnouri@gmail.com >
2021-10-26 20:07:09 +00:00
7e7f8ef5f0
Report timing info for stakes cache updates from txs (backport #20856 ) ( #20884 )
...
* Report timing info for stakes cache updates from txs (#20856 )
(cherry picked from commit 735016661b
)
# Conflicts:
# runtime/src/bank.rs
* resolve conflicts
Co-authored-by: Justin Starry <justin@solana.com >
2021-10-26 20:04:32 +00:00
9e81798d6d
fix(docs): missing import ( #20788 ) ( #20996 )
...
add missing import of `Connection`
(cherry picked from commit 521b7b79cc
)
Co-authored-by: Colin Ogoo <ogoo.colin@gmail.com >
2021-10-26 19:10:27 +00:00
8986bd301c
adds metrics tracking gossip crds writes and votes (backport #20953 ) ( #20982 )
...
* adds metrics tracking crds writes and votes (#20953 )
(cherry picked from commit 1297a13586
)
# Conflicts:
# core/src/cluster_nodes.rs
# gossip/benches/crds_shards.rs
# gossip/src/cluster_info.rs
# gossip/src/cluster_info_metrics.rs
# gossip/src/crds_entry.rs
# gossip/src/crds_gossip.rs
# gossip/src/crds_gossip_pull.rs
# gossip/src/crds_gossip_push.rs
# gossip/src/crds_shards.rs
# gossip/tests/crds_gossip.rs
# rpc/src/rpc_service.rs
* updates itertools version in gossip
* removes backport merge conflicts
Co-authored-by: behzad nouri <behzadnouri@gmail.com >
2021-10-26 17:41:45 +00:00
6baad8e239
doubles crds unique pubkey capacity ( #20947 ) ( #20981 )
...
(cherry picked from commit 43168e6365
)
Co-authored-by: behzad nouri <behzadnouri@gmail.com >
2021-10-26 15:14:29 +00:00
782d143489
Accountsdb plugin write ordering ( #20948 ) ( #20964 )
...
Use the write_version in the Accounts's meta data so that account write with lower write_version would not overwrite the higher ones.
2021-10-26 00:05:40 -07:00
b15e87631c
[solana-test-validator] add support for keypair file parsing for --bpf-program address argument ( #20962 )
...
(cherry picked from commit 58aa2b964b
)
Co-authored-by: Paul Schaaf <paulsimonschaaf@gmail.com >
2021-10-26 01:09:56 +00:00
d18f553e2d
Extend TestBroadcastReceiver::recv timeout ( #20957 ) ( #20961 )
...
* Extend TestBroadcastReceiver timeout
* Add elapsed log
(cherry picked from commit 337b94b3bc
)
Co-authored-by: Tyera Eulberg <teulberg@gmail.com >
2021-10-26 00:51:29 +00:00
e84c57b659
Hide deploy from cli subcommands ( #20901 ) ( #20951 )
...
(cherry picked from commit af405f0ed7
)
Co-authored-by: Jack May <jack@solana.com >
2021-10-25 20:03:44 +00:00
66630804de
Accountsdb plugin postgres -- bulk insertion at startup ( #20763 ) ( #20931 )
...
* Accountsdb plugin postgres -- bulk insertion at startup (#20763 )
Use bulk insertion to Postgres at startup to reduce time taken for initial snapshot restore for postgres plugin. Avoid duplicate writes of accounts at startup. Doing account plugin notification and indexing in parallel.
Improved error handling for postgres plugin to show the real db issues for debug purpose
Added more metrics for postgres plugin.
Refactored plugin centric code out to a sub module from accounts_db and added unit tests
* Fixed the unit test failures
2021-10-25 09:18:32 -07:00
72158e3bf9
CLI: Add SW versions to feature status output (backport #20878 ) ( #20905 )
...
* cli: struct the tuples
(cherry picked from commit b9eb6242f5
)
* cli: add software version(s) to feature status
(cherry picked from commit 152da44b62
)
# Conflicts:
# cli/Cargo.toml
* cli: sort feature status output
(cherry picked from commit 30d277b9fd
)
* cli: improve feature status arithmatic readability
(cherry picked from commit d98c8b861c
)
Co-authored-by: Trent Nelson <trent@solana.com >
2021-10-25 05:04:08 +00:00
df6063a622
removes backport merge conflicts
2021-10-24 21:29:29 -07:00
55a1f03eee
adds metrics for number of outgoing shreds in retransmit stage ( #20882 )
...
(cherry picked from commit 5e1cf39c74
)
# Conflicts:
# core/src/retransmit_stage.rs
2021-10-24 21:29:29 -07:00
d20cccc26b
Add check for shred data header size ( #20668 )
...
(cherry picked from commit 588168b99d
)
2021-10-24 20:16:41 -07:00
6c4a8b2d72
feat(docs): add transactionCount to getEpochInfo response
...
(cherry picked from commit aa13c90dd7
)
2021-10-24 20:15:12 -07:00
307cda52ac
Fixed bug in AccountInfo::serialize() ( #20923 )
...
Closes #20917
(cherry picked from commit edf5bc242c
)
Co-authored-by: Eugene Lomov <eugene.v.lomov@gmail.com >
2021-10-25 02:26:18 +00:00
026385effd
ci: Increase timeout duration for coverage step ( #20888 )
...
(cherry picked from commit 4fbf44dc75
)
2021-10-24 17:44:36 -07:00
0363d8d373
Use config limit instead of default ( #20900 ) ( #20907 )
...
(cherry picked from commit 9dd87bcdb5
)
Co-authored-by: Tyera Eulberg <teulberg@gmail.com >
2021-10-23 21:05:07 +00:00
5c3f15e9c5
Support port number in postgres connection ( #20662 ) ( #20704 )
...
* Support port number in postgres connection
* Addressed a few comments from Trent
(cherry picked from commit ad0a88f1f2
)
Co-authored-by: Lijun Wang <83639177+lijunwangs@users.noreply.github.com >
2021-10-23 18:35:30 +00:00
47e80be023
Fix response examples for getTokenAccountsByOwner
and getTokenAccountsByDelegate
( #20919 )
...
(cherry picked from commit 63f94a4db3
)
Co-authored-by: Slavomir <gagliardetto@users.noreply.github.com >
2021-10-23 16:43:13 +00:00
460dcad578
solana-test-validator --log
now includes version/argument information
...
(cherry picked from commit 86bf071d77
)
2021-10-22 13:46:29 -07:00
257d19ca48
Update 'Developing with Rust' GitHub links ( #20860 ) ( #20875 )
...
* Update old GitHub links in 'Developing with Rust' docs
* exclude_entrypoint -> no-entrypoint in 'Developing with Rust'
(cherry picked from commit f729dec321
)
Co-authored-by: Brian Anderson <andersrb@gmail.com >
2021-10-22 08:13:38 +00:00
de2aa898a7
Add counter for new transactions in SendTransactionService ( #20852 ) ( #20859 )
...
* Add counter for inserted transactions
* Add counter for tx recv
(cherry picked from commit 8959d5e21c
)
Co-authored-by: Tyera Eulberg <teulberg@gmail.com >
2021-10-22 05:03:26 +00:00
23b6ce7980
Bump version to 1.8.2
2021-10-21 00:43:40 -06:00
8cba6cca76
rpc-send-tx-svc server-side retry knobs (backport #20818 ) ( #20830 )
...
* rpc-send-tx-svc: add with_config constructor
(cherry picked from commit fe098b5ddc
)
# Conflicts:
# Cargo.lock
# core/Cargo.toml
# replica-node/Cargo.toml
# rpc/src/rpc_service.rs
# rpc/src/send_transaction_service.rs
# validator/Cargo.toml
* rpc-send-tx-svc: server-side retry knobs
(cherry picked from commit 2744a2128c
)
Co-authored-by: Trent Nelson <trent@solana.com >
v1.8.1
2021-10-21 02:15:03 +00:00
85048c667c
cli: account for rpc nodes when considering feature set adoption ( #20774 )
...
(cherry picked from commit 5794bba65c
)
Co-authored-by: Trent Nelson <trent@solana.com >
2021-10-20 17:41:47 -06:00
440ccd189e
Add program heap bump instruction (backport #20607 ) ( #20815 )
...
* Add program heap bump instruction (#20607 )
(cherry picked from commit 58164517e4
)
* nudge
Co-authored-by: Jack May <jack@solana.com >
2021-10-20 23:05:57 +00:00
d5fc81e12a
Reduce budget request instruction length ( #20636 ) ( #20644 )
...
(cherry picked from commit c231cfe235
)
Co-authored-by: Jack May <jack@solana.com >
2021-10-20 12:17:29 -07:00