mergify[bot]
99001f7f2e
Bump MacOS nofile recommendation message ( #11835 )
...
(cherry picked from commit 8841c3398c
)
Co-authored-by: Trent Nelson <trent@solana.com >
2020-08-25 19:57:08 +00:00
mergify[bot]
d5d1a344c3
Switch programs activation to whole-set based gating (bp #11750 ) ( #11837 )
...
* Switch programs activation to whole-set based gating (#11750 )
* Implement Debug for MessageProcessor
* Switch from delta-based gating to whole-set gating
* Remove dbg!
* Fix clippy
* Clippy
* Add test
* add loader to stable operating mode at proper epoch
* refresh_programs_and_inflation after ancestor setup
* Callback via snapshot; avoid account re-add; Debug
* Fix test
* Fix test and fix the past history
* Make callback management stricter and cleaner
* Fix test
* Test overwrite and frozen for native programs
* Test epoch callback with genesis-programs
* Add assertions for parent bank
* Add tests and some minor cleaning
* Remove unsteady assertion...
* Fix test...
* Fix DOS
* Skip ensuring account by dual (whole/delta) gating
* Fix frozen abi implementation...
* Move compute budget constatnt init back into bank
Co-authored-by: Ryo Onodera <ryoqun@gmail.com >
(cherry picked from commit db4bbb3569
)
# Conflicts:
# genesis-programs/src/lib.rs
* Fix conflicts
Co-authored-by: Jack May <jack@solana.com >
Co-authored-by: Ryo Onodera <ryoqun@gmail.com >
2020-08-25 19:00:41 +00:00
mergify[bot]
62e3c084d3
Update system tuning and docs (bp #11680 ) ( #11830 )
...
* Sync FD limit and max maps to 500k
(cherry picked from commit 11951eb009
)
* Expand system tuning docs
(cherry picked from commit 5354df8c1c
)
Co-authored-by: Trent Nelson <trent@solana.com >
2020-08-25 17:13:27 +00:00
mergify[bot]
6540d3c63e
Make BPF Loader static (bp #11516 ) ( #11790 )
...
* Make BPF Loader static (#11516 )
(cherry picked from commit 7c736f71fe
)
# Conflicts:
# Cargo.lock
# core/Cargo.toml
# core/src/lib.rs
# core/src/validator.rs
# genesis-programs/src/lib.rs
# programs/bpf_loader/src/deprecated.rs
# programs/bpf_loader/src/lib.rs
# sdk/src/entrypoint_native.rs
# sdk/src/lib.rs
* resolve conflicts
Co-authored-by: Jack May <jack@solana.com >
2020-08-22 01:54:50 +00:00
mergify[bot]
4be9d5030d
Squash supermajority root on blockstore replay at startup ( #11727 ) ( #11765 )
...
(cherry picked from commit f7adb68599
)
Co-authored-by: carllin <wumu727@gmail.com >
2020-08-21 08:20:09 +00:00
carllin
a9f914da8e
Cleanup test utilities ( #11766 )
...
* Add voting utility
* Add blockstore utility
Co-authored-by: Carl <carl@solana.com >
2020-08-21 06:52:01 +00:00
mergify[bot]
e41004f185
rpc: rework binary encoding. BREAKING CHANGE (bp #11646 ) ( #11674 )
...
* Add base64 (binary64) encoding for getConfirmedTransaction/getConfirmedBlock
(cherry picked from commit b5f3ced860
)
* decode-transaction now supports binary64
(cherry picked from commit 2ebc68a9e2
)
# Conflicts:
# cli/src/cli.rs
* Rework UiAccountData encode/decode such that it works from Rust
(cherry picked from commit 757e147b3b
)
# Conflicts:
# account-decoder/src/lib.rs
# cli/src/cli.rs
* Rename Binary64 to Base64. Establish Base58 encoding
(cherry picked from commit adc984a225
)
# Conflicts:
# account-decoder/src/lib.rs
* Remove "binary" encoding. Document "encoding" as required
(cherry picked from commit e5281157fa
)
* resolve conflicts
Co-authored-by: Michael Vines <mvines@gmail.com >
2020-08-18 02:53:10 +00:00
mergify[bot]
9015e47cc5
Rpc: Add until parameter for getConfirmedSignaturesForAddress2 ( #11644 ) ( #11648 )
...
* Refactor bigtable apis to accept start and end keys
* Make helper fn to deserialize cell data
* Refactor get_confirmed_signatures_for_address to use get_row_data range
* Add until param to get_confirmed_signatures_for_address
* Add until param to blockstore api
* Plumb until through client/cli
* Simplify client params
(cherry picked from commit 6c5b8f324a
)
Co-authored-by: Tyera Eulberg <teulberg@gmail.com >
2020-08-15 17:59:35 +00:00
mergify[bot]
4f7bfbdbe9
RPC: getConfirmedSignaturesForAddress2 only returns confirmed signatures ( #11615 ) ( #11618 )
...
* Add failing test case
* Limit to only rooted slots
(cherry picked from commit 99fb36fe45
)
Co-authored-by: Tyera Eulberg <teulberg@gmail.com >
2020-08-13 18:19:54 +00:00
mergify[bot]
520453e1f3
Blockstore address signatures: handle slots that cross primary indexes, and refactor get_confirmed_signatures_for_address2 ( #11497 ) ( #11508 )
...
* Freeze address-signature index in the middle of slot to show failure case
* Secondary filter on signature
* Use AddressSignatures iterator instead of manually decrementing slots
* Remove unused method
* Add metrics
* Add transaction-status-index doccumentation
(cherry picked from commit de5fb3ba0e
)
Co-authored-by: Tyera Eulberg <teulberg@gmail.com >
2020-08-10 17:43:00 +00:00
mergify[bot]
f9d6fb48a4
Send votes from banking stage to vote listener ( #11434 ) ( #11454 )
...
* Send votes from banking stage to vote listener
Co-authored-by: Carl <carl@solana.com >
(cherry picked from commit 7e25130529
)
Co-authored-by: carllin <wumu727@gmail.com >
2020-08-07 19:45:40 +00:00
mergify[bot]
8be23a2bb2
Add address-based lower bound to get_confirmed_signatures_for_address2 loop ( #11426 ) ( #11432 )
...
(cherry picked from commit 5530ee4c95
)
Co-authored-by: Tyera Eulberg <teulberg@gmail.com >
2020-08-07 00:06:44 +00:00
mergify[bot]
4ff9a6910d
Fix blockstore empty panic ( #11423 ) ( #11430 )
...
* Add panicking test
* Add failing test: fresh transaction-status column shouldn't point at valid root 0
* Prevent transaction status match outside of primary-index bounds
* Initialize transaction-status and address-signature primer entries with Slot::MAX
* Revert "Add failing test: fresh transaction-status column shouldn't point at valid root 0"
This reverts commit cbad2a9fae
.
* Revert "Initialize transaction-status and address-signature primer entries with Slot::MAX"
This reverts commit ffaeac0669
.
(cherry picked from commit 1061b50665
)
Co-authored-by: Tyera Eulberg <teulberg@gmail.com >
2020-08-06 23:39:01 +00:00
mergify[bot]
5841e4d665
Long-term ledger storage with BigTable (bp #11222 ) ( #11392 )
...
* ledger-storage-bigtable boilerplate
(cherry picked from commit 9d2293bb32
)
* $ wget https://pki.goog/roots.pem -O pki-goog-roots.pem
(cherry picked from commit 1617a025ce
)
* Add access_token module
(cherry picked from commit 59d266a111
)
* Add root_ca_certificate
(cherry picked from commit faa016e4b7
)
* Add build-proto
(cherry picked from commit c31e1f5bf0
)
* UiTransactionEncoding is now copy
(cherry picked from commit 494968be66
)
* Increase timeout
(cherry picked from commit 57dfebc5ba
)
* Add build-proto/build.sh output
(cherry picked from commit 54dae6ba2c
)
* Supress doctest errors
(cherry picked from commit 019c75797d
)
* Add compression
(cherry picked from commit 243e05d59f
)
* Add bigtable
(cherry picked from commit 6e0353965a
)
* Add configuration info
(cherry picked from commit 98cca1e774
)
* Add ledger-tool bigtable subcommands
(cherry picked from commit f9049d6ee4
)
# Conflicts:
# ledger-tool/Cargo.toml
* Make room for tokio 0.2
(cherry picked from commit b876fb84ba
)
# Conflicts:
# core/Cargo.toml
* Setup a tokio 0.2 runtime for RPC usage
(cherry picked from commit 0e02740565
)
# Conflicts:
# core/Cargo.toml
* Plumb Bigtable ledger storage into the RPC subsystem
(cherry picked from commit dfae9a9864
)
# Conflicts:
# core/Cargo.toml
* Add RPC transaction history design
(cherry picked from commit e56ea138c7
)
* Simplify access token refreshing
(cherry picked from commit 1f7af14386
)
* Report block status more frequently
(cherry picked from commit 22c46ebf96
)
* after -> before
(cherry picked from commit 227ea934ff
)
* Rebase
* Cargo.lock
Co-authored-by: Michael Vines <mvines@gmail.com >
2020-08-06 04:06:44 +00:00
mergify[bot]
888f3522d8
Add getConfirmedSignaturesForAddress2 RPC method (bp #11259 ) ( #11394 )
...
* Add getConfirmedSignaturesForAddress2 RPC method
(cherry picked from commit 1b2276520b
)
* Reimplement transaction-history command with getConfirmedSignaturesForAddress2
(cherry picked from commit 087fd32ce3
)
* Rework get_confirmed_signatures_for_address2
(cherry picked from commit a11f137810
)
* Rename startAfter to before
(cherry picked from commit 02c0981ecf
)
Co-authored-by: Michael Vines <mvines@gmail.com >
2020-08-05 22:47:50 +00:00
Michael Vines
eefcf484cb
clippy
2020-08-03 18:35:15 +00:00
carllin
bf18524368
Add hook for getting vote transactions on replay ( #11264 )
...
* Add hook for getting vote transactions on replay
Co-authored-by: Carl <carl@solana.com >
2020-07-29 23:17:40 -07:00
Tyera Eulberg
6c38369042
Use OrderedIterator in TransactionStatusService ( #11149 )
...
* Split out get-first-err for unit testing
* Add failing test
* Add missing ordering
2020-07-21 20:06:49 +00:00
Tyera Eulberg
9a80e31bae
Expose tss to the other blockstore_processor path ( #11070 )
2020-07-14 21:14:48 -06:00
Michael Vines
491f5ae61a
Add block time placeholder to getConfirmedBlock
2020-07-10 14:47:11 +00:00
dependabot-preview[bot]
841ecfd927
chore(deps): bump bincode from 1.2.1 to 1.3.1 ( #10867 )
...
* chore(deps): bump bincode from 1.2.1 to 1.3.1
Bumps [bincode](https://github.com/servo/bincode ) from 1.2.1 to 1.3.1.
- [Release notes](https://github.com/servo/bincode/releases )
- [Commits](https://github.com/servo/bincode/commits )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com >
* [auto-commit] Update all Cargo lock files
* Switch from deprecated method
* Add options to maintain behavior with bincode::options()
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com >
Co-authored-by: Tyera Eulberg <tyera@solana.com >
2020-07-09 00:08:05 +00:00
carllin
3f6042d8b3
Add RepairWeight to track votes seen in gossip for weighted repair ( #10903 )
...
* Add RepairWeight
Co-authored-by: Carl <carl@solana.com >
2020-07-06 22:49:40 -07:00
sakridge
58a475b789
Add db recovery methods ( #10838 )
2020-07-06 12:43:45 -07:00
sakridge
658de5b347
Skip and warn for hard-forks which are less than the start slot ( #10918 )
...
* Skip and warn for hard-forks which are less than the start slot
Option is used during a restart, but then after the restart is
complete, then the option is not needed if the starting slot
is past the hard-fork since the hard-fork should already be
in the snapshot it started from.
* Update ledger/src/blockstore_processor.rs
Co-authored-by: Michael Vines <mvines@gmail.com >
Co-authored-by: Michael Vines <mvines@gmail.com >
2020-07-05 13:51:43 -07:00
carllin
f014c94369
Add breakdown of erasure blobs ( #10912 )
...
Co-authored-by: Carl <carl@solana.com >
2020-07-03 17:44:32 -07:00
carllin
f17ac70bb2
Add weighted traversal ( #10877 )
...
Co-authored-by: Carl <carl@solana.com >
2020-07-02 14:33:04 -07:00
Tyera Eulberg
2669ccb864
Update struct prefixes to Ui ( #10874 )
...
* Update comments
* Use Ui prefix
2020-07-01 20:06:40 +00:00
Ryo Onodera
b89e506cbb
Consistently create temp dirs under ledger/farf ( #10848 )
2020-07-01 11:38:59 +09:00
sakridge
583cec922b
Remove ledger purge batching ( #10830 )
2020-06-29 14:44:35 -07:00
carllin
0fde0d7379
Add ancestor iterator to lib.rs ( #10813 )
...
Co-authored-by: Carl <carl@solana.com >
2020-06-25 23:39:55 +00:00
Greg Fitzgerald
1c498369b5
Remove fee-payer guesswork from Message and Transaction ( #10776 )
...
* Make Message::new_with_payer the default constructor
* Remove Transaction::new_[un]signed_instructions
These guess the fee-payer instead of stating it explicitly
2020-06-24 14:52:38 -06:00
sakridge
0e393a5684
Allow for hard fork at last root ( #10762 )
2020-06-23 21:49:11 -07:00
sakridge
a1ef921b88
Rework backup and clear function ( #10751 )
2020-06-23 21:29:07 +00:00
carllin
77b8de193c
Add utility functions for testing ( #10749 )
...
* Add ancestor iterator
* Add blockstore generation from trees
Co-authored-by: Carl <carl@solana.com >
2020-06-23 12:05:00 -07:00
sakridge
2ba8fc5243
Remove slots past wait-for-supermajority slot. ( #10720 )
2020-06-22 20:27:25 -07:00
carllin
a33fef9af2
Add repair breakdown by slot and index ( #10717 )
...
* Slot full logging
* Repair stats logging
Co-authored-by: Carl <carl@solana.com >
2020-06-19 18:28:15 -07:00
Greg Fitzgerald
0550b893b0
Fix typos ( #10675 )
...
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2020-06-17 20:54:52 -07:00
Greg Fitzgerald
6ee222363e
Move BankForks to solana_runtime ( #10637 )
...
* Move BankForks to solana_runtime
* Update imports
2020-06-17 15:27:03 +00:00
Kristofer Peterson
50c93d4441
Cleanup error type mapping in serde_snapshot ( #10580 )
...
* Cleanup error type mapping in serde_snapshot
* Fail when account storage entry files cannot be moved from snapshot
2020-06-17 17:56:29 +09:00
sakridge
0de6c444d6
Simd poh ( #10604 )
...
* Simd poh
* Fix poh verify bench
2020-06-16 23:03:26 -07:00
sakridge
1eca9b19ab
Entry verify cleanup and gossip counters ( #10632 )
...
* Add prune message counter
* Switch to us verification time to match other counters
* Add separate transaction/poh verify timing
2020-06-16 14:00:29 -07:00
Greg Fitzgerald
2eb6f498a8
Remove redundant BankForks parameter ( #10537 )
2020-06-12 11:04:17 -06:00
Kristofer Peterson
e23340d89e
Clippy cleanup for all targets and nighly rust (also support 1.44.0) ( #10445 )
...
* address warnings from 'rustup run beta cargo clippy --workspace'
minor refactoring in:
- cli/src/cli.rs
- cli/src/offline/blockhash_query.rs
- logger/src/lib.rs
- runtime/src/accounts_db.rs
expect some performance improvement AccountsDB::clean_accounts()
* address warnings from 'rustup run beta cargo clippy --workspace --tests'
* address warnings from 'rustup run nightly cargo clippy --workspace --all-targets'
* rustfmt
* fix warning stragglers
* properly fix clippy warnings test_vote_subscribe()
replace ref-to-arc with ref parameters where arc not cloned
* Remove lock around JsonRpcRequestProcessor (#10417 )
automerge
* make ancestors parameter optional to avoid forcing construction of empty hash maps
Co-authored-by: Greg Fitzgerald <greg@solana.com >
2020-06-09 09:38:14 +09:00
sakridge
2725acebea
Lower counter level ( #10428 )
2020-06-05 15:53:09 -07:00
Michael Vines
aa6832964c
ledger_cleanup_service: compact at a slower rate than purging ( #10414 )
2020-06-04 21:06:06 -07:00
Ryo Onodera
caa7f7a0c9
Support opening an in-use rocksdb as secondary ( #10209 )
...
automerge
2020-06-02 21:32:44 -07:00
Tyera Eulberg
eee9a08376
Purge TransactionStatus and AddressSignatures exactly from ledger-tool ( #10358 )
...
* Add failing test
* Add execution path to purge primary-index columns exactly
* Fail gracefully if older TransactionStatus rocksdb keys are present
* Remove columns_empty check for special columns
* Move blockstore purge methods to submodule
* Remove unused column empty check
2020-06-02 19:49:31 -06:00
Greg Fitzgerald
19d11800bf
Remove WithSigner ( #10325 )
...
automerge
2020-05-29 23:17:44 -07:00
carllin
bc37dfc4c1
log leader ( #10316 )
...
automerge
2020-05-29 04:35:20 -07:00
Kristofer Peterson
fb4d8e1f62
cleanup clippy tests ( #10172 )
...
automerge
2020-05-29 00:26:06 -07:00