sakridge
1584ec220c
Move clean accounts to background service ( #10904 )
2020-07-02 22:39:22 -07:00
mergify[bot]
fb366a7236
Add weighted traversal ( #10877 ) ( #10901 )
...
Co-authored-by: Carl <carl@solana.com >
(cherry picked from commit f17ac70bb2
)
Co-authored-by: carllin <wumu727@gmail.com >
2020-07-02 23:52:03 +00:00
sakridge
191483cf9f
Update cargo.* version to 1.2.9 ( #10861 )
2020-06-30 23:21:10 +00:00
Stephen Akridge
89d78dcfcf
Update cargo.* version to 1.2.8
2020-06-30 09:03:28 -07:00
mergify[bot]
9caad645e2
Remove ledger purge batching ( #10830 ) ( #10836 )
...
(cherry picked from commit 583cec922b
)
Co-authored-by: sakridge <sakridge@gmail.com >
2020-06-29 23:10:45 +00:00
mergify[bot]
f4d70e78b6
Add ancestor iterator to lib.rs ( #10813 ) ( #10817 )
...
Co-authored-by: Carl <carl@solana.com >
(cherry picked from commit 0fde0d7379
)
Co-authored-by: carllin <wumu727@gmail.com >
2020-06-26 01:02:51 +00:00
mergify[bot]
55b92c16da
Remove fee-payer guesswork from Message and Transaction (bp #10776 ) ( #10785 )
...
* Remove fee-payer guesswork from Message and Transaction (#10776 )
* Make Message::new_with_payer the default constructor
* Remove Transaction::new_[un]signed_instructions
These guess the fee-payer instead of stating it explicitly
(cherry picked from commit 1c498369b5
)
# Conflicts:
# cli/src/nonce.rs
# core/src/rpc.rs
# ledger/src/blockstore.rs
# programs/bpf/tests/programs.rs
* Fix merge
Co-authored-by: Greg Fitzgerald <greg@solana.com >
2020-06-25 01:10:23 +00:00
Stephen Akridge
ccb7b1a698
Bump cargo version to v1.2.7
2020-06-24 09:23:12 -07:00
mergify[bot]
397f9f11c5
Allow for hard fork at last root ( #10762 ) ( #10766 )
...
(cherry picked from commit 0e393a5684
)
Co-authored-by: sakridge <sakridge@gmail.com >
2020-06-24 06:10:48 +00:00
mergify[bot]
52eea215ce
Rework backup and clear function ( #10751 ) ( #10754 )
...
(cherry picked from commit a1ef921b88
)
Co-authored-by: sakridge <sakridge@gmail.com >
2020-06-23 22:56:14 +00:00
mergify[bot]
6f48aafd3a
Add utility functions for testing ( #10749 ) ( #10752 )
...
* Add ancestor iterator
* Add blockstore generation from trees
Co-authored-by: Carl <carl@solana.com >
(cherry picked from commit 77b8de193c
)
Co-authored-by: carllin <wumu727@gmail.com >
2020-06-23 21:55:09 +00:00
Stephen Akridge
2d94c09aee
Bump Cargo.toml version to 1.2.6
2020-06-22 23:23:16 -07:00
mergify[bot]
9699b61679
Remove slots past wait-for-supermajority slot. ( #10720 ) ( #10745 )
...
(cherry picked from commit 2ba8fc5243
)
Co-authored-by: sakridge <sakridge@gmail.com >
2020-06-23 04:57:57 +00:00
mergify[bot]
f52ff777b7
Add repair breakdown by slot and index ( #10717 ) ( #10727 )
...
* Slot full logging
* Repair stats logging
Co-authored-by: Carl <carl@solana.com >
(cherry picked from commit a33fef9af2
)
Co-authored-by: carllin <wumu727@gmail.com >
2020-06-20 02:52:22 +00:00
mergify[bot]
e560fff840
Add CLI options and runtime support for selection of output snapshot version (bp #10536 ) ( #10712 )
...
* Add CLI options and runtime support for selection of output snapshot version. (#10536 )
(cherry picked from commit 6d81eede93
)
# Conflicts:
# core/src/accounts_hash_verifier.rs
# core/src/rpc_service.rs
# core/tests/bank_forks.rs
# ledger-tool/src/main.rs
# ledger/src/snapshot_package.rs
# validator/src/main.rs
* Fix conflicts
Co-authored-by: Kristofer Peterson <svenski123@users.noreply.github.com >
Co-authored-by: Ryo Onodera <ryoqun@gmail.com >
2020-06-19 07:52:09 +00:00
Stephen Akridge
4b33a2a1b8
Update Cargo.toml version from 1.2.4 to 1.2.5
2020-06-17 18:55:20 -07:00
mergify[bot]
7eb61074ab
Simd poh ( #10604 ) ( #10658 )
...
* Simd poh
* Fix poh verify bench
Co-authored-by: sakridge <sakridge@gmail.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2020-06-18 00:34:56 +00:00
mergify[bot]
a9553cb401
Entry verify cleanup and gossip counters ( #10632 ) ( #10650 )
...
* Add prune message counter
* Switch to us verification time to match other counters
* Add separate transaction/poh verify timing
Co-authored-by: sakridge <sakridge@gmail.com >
Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>
2020-06-17 19:48:05 +00:00
Stephen Akridge
dbda50941a
Bump version to 1.2.4
2020-06-16 17:03:09 -07:00
Stephen Akridge
2500881e0b
Bump version to v1.2.3
2020-06-14 09:58:10 -07:00
mergify[bot]
63314de516
Remove redundant BankForks parameter ( #10537 ) ( #10538 )
...
automerge
2020-06-12 16:41:21 -07:00
Michael Vines
a8f4c4e297
Bump version to 1.2.2
2020-06-11 20:45:13 -07:00
mergify[bot]
c021727009
Lower counter level ( #10428 ) ( #10436 )
...
automerge
2020-06-05 17:40:59 -07:00
mergify[bot]
aa6a00a03e
ledger_cleanup_service: compact at a slower rate than purging ( #10414 ) ( #10422 )
...
automerge
2020-06-04 22:56:32 -07:00
mergify[bot]
05c052e212
Support opening an in-use rocksdb as secondary ( #10209 ) ( #10382 )
...
automerge
2020-06-02 23:09:22 -07:00
mergify[bot]
dc05bb648a
Purge TransactionStatus and AddressSignatures exactly from ledger-tool ( #10358 ) ( #10376 )
...
automerge
2020-06-02 20:12:46 -07:00
mergify[bot]
37c182cd5d
log leader ( #10280 ) ( #10315 )
...
automerge
2020-05-29 13:38:46 -07:00
mergify[bot]
e71206c578
Add more logging while unpacking snapshots ( #10266 ) ( #10270 )
...
automerge
2020-05-28 13:47:58 -07:00
mergify[bot]
7813a1decd
Purge next slots to avoid a blockstore_processor panic on restart ( #10281 ) ( #10285 )
...
(cherry picked from commit 5ac2ae1178
)
Co-authored-by: Michael Vines <mvines@gmail.com >
2020-05-28 08:40:41 -07:00
Michael Vines
ace711e7f1
Bump version to 1.2.1
2020-05-26 19:07:35 -07:00
Michael Vines
156387aba4
LedgerCleanupService no longer causes an OOM and actually purges ( #10199 )
...
* cleanup_ledger() now services new_root_receiver while purging
* purge_slots() now fully deletes before compacting
* Add ledger pruning grafana graph
2020-05-24 21:41:54 -07:00
dependabot-preview[bot]
8a8384e674
Bump sha2 from 0.8.1 to 0.8.2 ( #10205 )
...
* Bump sha2 from 0.8.1 to 0.8.2
Bumps [sha2](https://github.com/RustCrypto/hashes ) from 0.8.1 to 0.8.2.
- [Release notes](https://github.com/RustCrypto/hashes/releases )
- [Commits](https://github.com/RustCrypto/hashes/compare/sha2-v0.8.1...sha2-v0.8.2 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com >
* [auto-commit] Update all Cargo lock files
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com >
2020-05-24 19:44:04 -07:00
dependabot-preview[bot]
2d3a906d55
Bump tar from 0.4.27 to 0.4.28 ( #10185 )
...
Bumps [tar](https://github.com/alexcrichton/tar-rs ) from 0.4.27 to 0.4.28.
- [Release notes](https://github.com/alexcrichton/tar-rs/releases )
- [Commits](https://github.com/alexcrichton/tar-rs/compare/0.4.27...0.4.28 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com >
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-05-22 15:55:40 -07:00
Kristofer Peterson
b7a32f01c0
Multi-version snapshot support ( #9980 )
...
* Multi-version snapshot support
* rustfmt
* Remove CLI options and runtime support for selection output snapshot version.
Address some clippy complaints.
* Muzzle clippy type complexity warning.
Despite clippy's suggestion, it is not currently possible to create type aliases
for traits and so everything within the 'Box<...>' cannot be type aliased.
This then leaves creating full blown traits, and either implementing
said traits by closure (somehow) or moving the closures into new structs
implementing said traits which seems a bit of a palaver.
Alternatively it is possible to define and use the type alias 'type ResultBox<T> = Result<Box<T>>'
which does seems rather pointless and not a great reduction in complexity but is enough to keep clippy happy.
In the end I simply went with squelching the clippy warning.
* Remove now unused Serialize/Deserialize trait implementations for AccountStorageEntry and AppendVec
* refactor versioned de/serialisers
* rename serde_utils to serde_snapshot
* move call to accounts_db.generate_index() back down to context_accountsdb_from_stream()
* update version 1.1.1 to 1.2.0
remove nested use of serialize_bytes
* cleanups
* Add back measurement of account storage entry serialization.
Remove construction of Vec and HashMap temporaries during serialization.
* consolidate serialisation test cases into serde_snapshot.
clean up leakage of implementation details in serde_snapshot.
* move short term / legacy snapshot code into child module
* add serialize_iter_as_tuple
* preliminary integration of following commit
commit 6d58b73c47294bfb93465d5a83cd2175660b6e6d
Author: Ryo Onodera <ryoqun@gmail.com >
Date: Wed May 20 14:02:02 2020 +0900
Confine snapshot 1.1 relic to versioned codepath
* refactored serde_snapshot, rustfmt
legacy accounts_db format now "owns" both leading u64s, legacy bank_rc format has none
* reduce type complexity (clippy)
2020-05-23 02:54:24 +09:00
dependabot-preview[bot]
8da2e1b2f7
Bump tar from 0.4.26 to 0.4.27 ( #10150 )
...
Bumps [tar](https://github.com/alexcrichton/tar-rs ) from 0.4.26 to 0.4.27.
- [Release notes](https://github.com/alexcrichton/tar-rs/releases )
- [Commits](https://github.com/alexcrichton/tar-rs/compare/0.4.26...0.4.27 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com >
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-05-20 20:04:22 -07:00
carllin
439fd30840
Fix erasure ( #10095 )
...
* Fix bad FEC blocks
* Add test
Co-authored-by: Carl <carl@solana.com >
2020-05-19 16:13:12 -07:00
carllin
97f2bcff69
master: Add nonce to shreds repairs, add shred data size to header ( #10109 )
...
* Add nonce to shreds/repairs
* Add data shred size to header
Co-authored-by: Carl <carl@solana.com >
2020-05-19 12:38:18 -07:00
sakridge
f562ed4cc8
Distinguish between shred type in shred fetch stage duplicate filter ( #10068 )
...
* Shred type check
* Test
2020-05-15 13:23:56 -07:00
Greg Fitzgerald
5e89bd8868
Panic if no fee-payer found via Message::new() ( #10050 )
...
automerge
2020-05-15 12:23:09 -07:00
Michael Vines
7080fb9b37
Abort if the open fd limit cannot be increased ( #10064 )
...
automerge
2020-05-15 12:14:21 -07:00
Kristofer Peterson
58ef02f02b
9951 clippy errors in the test suite ( #10030 )
...
automerge
2020-05-15 09:35:43 -07:00
dependabot-preview[bot]
6a6c5f196a
Bump libc from 0.2.69 to 0.2.70 ( #10006 )
...
* Bump libc from 0.2.69 to 0.2.70
Bumps [libc](https://github.com/rust-lang/libc ) from 0.2.69 to 0.2.70.
- [Release notes](https://github.com/rust-lang/libc/releases )
- [Commits](https://github.com/rust-lang/libc/compare/0.2.69...0.2.70 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com >
* [auto-commit] Update all Cargo lock files
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com >
2020-05-15 06:18:43 -06:00
sakridge
9575afc8fa
Refactor blockstore recovery code ( #10008 )
2020-05-13 10:09:38 -07:00
Ryo Onodera
1eb40c3fe0
Introduce eager rent collection ( #9527 )
...
* Switch AccountsIndex.account_maps from HashMap to BTreeMap
* Introduce eager rent collection
* Start to add tests
* Avoid too short eager rent collection cycles
* Add more tests
* Add more tests...
* Refacotr!!!!!!
* Refactoring follow up
* More tiny cleanups
* Don't rewrite 0-lamport accounts to be deterministic
* Refactor a bit
* Do hard fork, restore tests, and perf. mitigation
* Fix build...
* Refactor and add switch over for testnet (TdS)
* Use to_be_bytes
* cleanup
* More tiny cleanup
* Rebase cleanup
* Set Bank::genesis_hash when resuming from snapshot
* Reorder fns and clean ups
* Better naming and commenting
* Yet more naming clarifications
* Make prefix width strictly uniform for 2-base partition_count
* Fix typo...
* Revert cluster-dependent gate
* kick ci?
* kick ci?
* kick ci?
2020-05-13 16:22:14 +09:00
sakridge
903a8a3196
Add retransmit packets_by_slot metrics ( #9975 )
2020-05-11 13:49:10 -07:00
dependabot-preview[bot]
288c9751c1
Bump serde from 1.0.106 to 1.0.110 ( #9964 )
...
* Bump serde from 1.0.106 to 1.0.110
Bumps [serde](https://github.com/serde-rs/serde ) from 1.0.106 to 1.0.110.
- [Release notes](https://github.com/serde-rs/serde/releases )
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.106...v1.0.110 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com >
* [auto-commit] Update all Cargo lock files
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com >
2020-05-10 16:24:25 -07:00
carllin
ad3c8fb812
More logging around failure ( #9967 )
...
automerge
2020-05-10 16:01:20 -07:00
dependabot-preview[bot]
c970bbea4f
Bump serde_bytes from 0.11.3 to 0.11.4 ( #9914 )
...
Bumps [serde_bytes](https://github.com/serde-rs/bytes ) from 0.11.3 to 0.11.4.
- [Release notes](https://github.com/serde-rs/bytes/releases )
- [Commits](https://github.com/serde-rs/bytes/compare/0.11.3...0.11.4 )
Signed-off-by: dependabot-preview[bot] <support@dependabot.com >
Co-authored-by: dependabot-preview[bot] <27856297+dependabot-preview[bot]@users.noreply.github.com>
2020-05-07 23:26:37 -07:00
Trent Nelson
f12c6c1ed1
BSD compat for 9493de4
( #9922 )
...
automerge
2020-05-07 16:38:33 -07:00
Michael Vines
09ae61651a
Eliminate BankForksInfo ( #9887 )
2020-05-06 08:24:59 -07:00