Michael Vines
7f2977a3b0
Bump version to 1.5.20
2021-04-20 17:04:26 +00:00
mergify[bot]
23e114e077
buffers data shreds to make larger erasure coded sets ( #15849 ) ( #16674 )
...
Broadcast stage batches up to 8 entries:
https://github.com/solana-labs/solana/blob/79280b304/core/src/broadcast_stage/broadcast_utils.rs#L26-L29
which will be serialized into some number of shreds and chunked into FEC
sets of at most 32 shreds each:
https://github.com/solana-labs/solana/blob/79280b304/ledger/src/shred.rs#L576-L597
So depending on the size of entries, FEC sets can be small, which may
aggravate loss rate.
For example 16 FEC sets of 2:2 data/code shreds each have higher loss
rate than one 32:32 set.
This commit broadcasts data shreds immediately, but also buffers them
until it has a batch of 32 data shreds, at which point 32 coding shreds
are generated and broadcasted.
(cherry picked from commit 4f82b897bcbehzadnouri@gmail.com >
2021-04-20 12:40:04 +00:00
behzad nouri
f6bf48e3c8
renames is_last_in_fec_set back to is_last_data ( #15848 )
...
https://github.com/solana-labs/solana/pull/10095
renamed is_last_data to is_last_in_fec_set. However, the code shows that
this is actually meant to indicate where the serialized data is
complete:
https://github.com/solana-labs/solana/blob/420174d3d/ledger/src/shred.rs#L599-L600
https://github.com/solana-labs/solana/blob/420174d3d/ledger/src/shred.rs#L229-L231
There are multiple FEC sets for each `&[Entry]` serialized and this flag
does not represent shreds last in FEC sets (only the very last one by
overlap). So the name is wrong and confusing
(cherry picked from commit 3b85cbc504
2021-04-19 23:04:51 -07:00
Justin Starry
02762ff785
v1.5: Use blake3 message hash in status cache ( #16513 )
...
* v1.5: Use blake3 message hash in status cache
* bump bpf ix count
2021-04-14 09:52:24 +08:00
mergify[bot]
a6b346d876
removes OrderedIterator and transaction batch iteration order (backport #16153 ) ( #16510 )
...
Co-authored-by: behzad nouri <behzadnouri@gmail.com >
2021-04-13 12:47:44 +00:00
mergify[bot]
11ab894256
[easy, cleanup] Simplify some pattern-matches (bp #16402 ) ( #16445 )
...
* Simplify some pattern-matches (#16402 )
When those match an exact combinator on Option / Result.
Tool-aided by [comby-rust](https://github.com/huitseeker/comby-rust ).
(cherry picked from commit b08cff9e774142+huitseeker@users.noreply.github.com >
Co-authored-by: Tyera Eulberg <tyera@solana.com >
2021-04-08 20:01:20 +00:00
mergify[bot]
0c0b65e9ab
Only get Blockstore::last_root once ( #16362 ) ( #16365 )
...
(cherry picked from commit b8b6777262teulberg@gmail.com >
2021-04-05 06:54:23 +00:00
mergify[bot]
9b04b634bd
Fixup iterator method ( #16357 ) ( #16358 )
...
(cherry picked from commit 1a13d22984teulberg@gmail.com >
2021-04-05 00:46:47 +00:00
Trent Nelson
c32bd40aa4
Bump version to v1.5.19
2021-04-01 20:23:50 +00:00
mergify[bot]
7e480df9fa
Rpc: enable getConfirmedSignaturesForAddress2 to return confirmed (not yet finalized) data ( #16281 ) ( #16292 )
...
* Update blockstore method to allow return of unfinalized signature
* Support confirmed sigs in getConfirmedSignaturesForAddress2
* Add deprecated comments
* Update docs
* Enable confirmed transaction-history in cli
* Return real confirmation_status; fill in not-yet-finalized block time if possible
(cherry picked from commit da27acabccteulberg@gmail.com >
2021-04-01 11:29:51 -06:00
mergify[bot]
e55d5385bd
adds an inverted index to leader schedule ( #15249 ) ( #16286 )
...
next_leader_slot is doing a linear search for slots in which a pubkey is
the leader:
https://github.com/solana-labs/solana/blob/e59a24d9f/ledger/src/leader_schedule_cache.rs#L123-L157
This can be done more efficiently by adding an inverted index to leader
schedule.
(cherry picked from commit e403aeaf05behzadnouri@gmail.com >
2021-04-01 14:27:54 +00:00
mergify[bot]
afd5b9f09b
Rpc: fix getConfirmedTransaction slot ( #16288 ) ( #16289 )
...
* Fix transaction blockstore apis
* Update blockstore apis in rpc
(cherry picked from commit 18bd47dbe1teulberg@gmail.com >
2021-04-01 08:47:03 +00:00
Tyera Eulberg
ac4722afd7
Bump version to 1.5.18
2021-03-29 23:00:20 -07:00
mergify[bot]
fb08b41513
Rpc: enable getConfirmedBlock and getConfirmedTransaction to return confirmed (not yet finalized) data (bp #16142 ) ( #16159 )
...
* Rpc: enable getConfirmedBlock and getConfirmedTransaction to return confirmed (not yet finalized) data (#16142 )
* Add Blockstore block and tx apis that allow unrooted responses
* Add TransactionStatusMessage, and send on bank freeze; also refactor TransactionStatusSender
* Track highest slot with tx-status writes complete
* Rename and unpub fn
* Add commitment to GetConfirmed input configs
* Support confirmed blocks in getConfirmedBlock
* Support confirmed txs in getConfirmedTransaction
* Update sigs-for-addr2 comment
* Enable confirmed block in cli
* Enable confirmed transaction in cli
* Review comments
* Rename blockstore method
(cherry picked from commit 433f1ead1cteulberg@gmail.com >
Co-authored-by: Tyera Eulberg <tyera@solana.com >
2021-03-27 05:45:00 +00:00
mergify[bot]
3317a14bd5
rpc: add getSlotLeaders method ( #16057 ) ( #16078 )
...
(cherry picked from commit e7fd7d46cfjustin@solana.com >
2021-03-24 03:20:57 +00:00
mergify[bot]
64a754f610
Handle blockstore insert dup checks ( #16051 ) ( #16065 )
...
(cherry picked from commit d76ad33597carl@solana.com >
2021-03-23 05:19:05 +00:00
Tyera Eulberg
f356a05e96
Bump version to 1.5.17 ( #16043 )
2021-03-19 18:56:05 -06:00
Michael Vines
be05c8b121
Bump version to 1.5.16
2021-03-16 13:29:52 -07:00
Michael Vines
9a151259b2
=1.5.15
2021-03-16 00:32:15 -07:00
mergify[bot]
f511625887
Add more slot update notifications (bp #15734 ) ( #15821 )
...
* Add more slot update notifications (#15734 )
* Add more slot update notifications
* fix merge
* Address feedback and add integration test
* switch to datapoint
* remove unused shred method
* fix clippy
* new thread for rpc completed slots
* remove extra constant
* fixes
* rely on channel closing
* fix check
(cherry picked from commit 918d04e3f0justin@solana.com >
2021-03-12 15:25:45 +00:00
mergify[bot]
6e214bbc04
Docs fixups (bp #15801 ) ( #15802 )
...
* docs: add docs links for crates published to crates.io
(cherry picked from commit 24d18b3cf23e6c7c4a3e0e452c8d919c8be3490645190f6281c4ee1ab710trent@solana.com >
2021-03-11 21:49:14 +00:00
Tyera Eulberg
9fbc03d517
Bump version to 1.5.15 ( #15768 )
2021-03-09 01:48:54 +00:00
mergify[bot]
2114864626
Convert blockstore TransactionStatus column family to protobufs (bp #15733 ) ( #15737 )
...
* Convert blockstore TransactionStatus column family to protobufs (#15733 )
* Prevent panic if TransactionStatus can't be deserialized
* Convert Blockstore TransactionStatus column to protobuf
* Add compatability test
(cherry picked from commit 7e65289729teulberg@gmail.com >
Co-authored-by: Tyera Eulberg <tyera@solana.com >
2021-03-05 17:37:54 +00:00
Michael Vines
d3672ca23b
Bump version to 1.5.14
2021-03-03 19:01:25 -08:00
Michael Vines
6242809a07
Bump version to 1.5.13
2021-03-03 21:51:34 +00:00
mergify[bot]
979e07501a
Lower blockstore processor error severity ( #15578 ) ( #15609 )
...
(cherry picked from commit f1223fb783sakridge@gmail.com >
2021-03-02 07:47:15 -08:00
mergify[bot]
b550f5bc19
Sort forks in "ledger processed..." log message ( #15583 )
...
(cherry picked from commit 33eaa2b238mvines@gmail.com >
2021-03-01 02:48:16 +00:00
sakridge
fa7067950a
Update version to v1.5.11 ( #15574 )
2021-02-27 04:27:54 +00:00
Michael Vines
d69f09f152
create-snapshot subcommad now accepts the ROOT keyword
2021-02-26 20:20:41 -08:00
mergify[bot]
087c43ad33
Add limit and shrink policy for recycler ( #15320 ) ( #15565 )
...
(cherry picked from commit c2e8814dcecarl@solana.com >
2021-02-27 00:34:56 +00:00
mergify[bot]
bb5a69aa4d
ledger-tool cleanup and additions ( #15179 ) ( #15554 )
...
* Plumb allow-dead-slots to ledger-tool verify
* ledger-tool cleanup and add some useful missing args
Print root slots and how many unrooted past last root.
(cherry picked from commit bbae23358csakridge@gmail.com >
2021-02-26 07:37:46 +00:00
Michael Vines
a80ac11b68
Bump version to v1.5.11
2021-02-25 09:12:39 -08:00
Ryo Onodera
a52a22f558
Bump version to 1.5.10 ( #15533 )
2021-02-25 21:00:17 +09:00
Michael Vines
671fb3519d
Pacify clippy
2021-02-19 16:04:18 -08:00
mergify[bot]
7148aaa30c
chore: bump serde from 1.0.112 to 1.0.118 (bp #14828 ) ( #15394 )
...
* chore: bump serde from 1.0.112 to 1.0.118 (#14828 )
* chore: bump serde from 1.0.112 to 1.0.122
Bumps [serde](https://github.com/serde-rs/serde ) from 1.0.112 to 1.0.122.
- [Release notes](https://github.com/serde-rs/serde/releases )
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.112...v1.0.122 )
Signed-off-by: dependabot[bot] <support@github.com >
* [auto-commit] Update all Cargo lock files
* Update frozen_abi digest following serde update
* Revert "chore: bump serde from 1.0.112 to 1.0.122"
This reverts commit a3ef4442a4c41c3b005fhttps://github.com/serde-rs/serde ) from 1.0.112 to 1.0.118.
- [Release notes](https://github.com/serde-rs/serde/releases )
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.112...v1.0.118 )
Signed-off-by: dependabot[bot] <support@github.com >
* [auto-commit] Update all Cargo lock files
* Remove serum-dex pinning
* blind commit!
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com >
Co-authored-by: Ryo Onodera <ryoqun@gmail.com >
(cherry picked from commit 1df93fa2beryoqun@gmail.com >
2021-02-18 13:29:17 +00:00
mergify[bot]
569edbb241
Return blockstore error if previous_blockhash cannot be determined ( #15382 ) ( #15384 )
...
* Return blockstore error if previous_blockhash cannot be determined
* Add require_previous_blockshash flag
(cherry picked from commit 170cb792ebteulberg@gmail.com >
2021-02-18 02:38:48 +00:00
mergify[bot]
1a8b57fcd0
First step towards denying clippy::integer_arithmetic (bp #15366 ) ( #15381 )
...
* CI: Globally deny clippy::integer_arithmetic lint
(cherry picked from commit 7035e8485c7f7370c306trent@solana.com >
2021-02-17 22:30:03 +00:00
mergify[bot]
723c03dfbd
Adapt to fs_extra 1.2.0 ( #15380 )
...
(cherry picked from commit 9ba69a7381mvines@gmail.com >
2021-02-17 22:07:12 +00:00
Michael Vines
8820933287
Bump version to 1.5.9
2021-02-16 22:17:10 -08:00
mergify[bot]
477e5d4bff
Add --force arg for bigtable upload ( #15362 )
...
(cherry picked from commit 98e3e570d2tyera@solana.com >
2021-02-17 02:55:35 +00:00
mergify[bot]
603cae4a5c
Log if unsanitary transactions are read from blockstore ( #15319 ) ( #15322 )
...
(cherry picked from commit 0812931c38teulberg@gmail.com >
2021-02-14 07:46:54 +00:00
Trent Nelson
20afb912cd
Bump version to 1.5.8
2021-02-13 04:34:36 +00:00
Michael Vines
cd994f0162
Bump version to 1.5.7
2021-02-10 05:18:39 +00:00
mergify[bot]
7f0f43cb28
Warp timestamp and extend max-allowable-drift for accommodate slow blocks ( #15204 ) ( #15222 )
...
* Remove timestamp_correction feature gating
* Remove timestamp_bounding feature gating
* Remove unused deprecated ledger code
* Remove unused deprecated unbounded-timestamp code
* Enable independent adjustment of fast/slow timestamp bounding
* Update timestamp bounds to 25% fast, 80% slow; warp timestamp
* Update bank hash test
* Add PR number to feature
Co-authored-by: Michael Vines <mvines@gmail.com >
Co-authored-by: Michael Vines <mvines@gmail.com >
(cherry picked from commit da6753b8c0teulberg@gmail.com >
2021-02-10 00:03:26 +00:00
mergify[bot]
ec6d5933de
Revert hard nofile limit back to 500000 ( #15061 )
...
(cherry picked from commit 42bf6dc2abmvines@gmail.com >
2021-02-03 13:49:54 -08:00
mergify[bot]
4e60f95854
Don't squash caught errors, please ( #15046 ) ( #15049 )
...
* Don't squash caught errors, please
* Update blockstore.rs
* Update blockstore.rs
(cherry picked from commit 8376781ec8ryoqun@gmail.com >
2021-02-03 16:33:53 +00:00
Trent Nelson
49e608295e
docs: bump nofiles recommendations to match maps
...
(cherry picked from commit 894b412aef
2021-02-02 23:21:24 -08:00
mergify[bot]
d9fcd84bc2
Add validator flag to opt in to cpi and logs storage (bp #14922 ) ( #14973 )
...
* Add validator flag to opt in to cpi and logs storage (#14922 )
* Add validator flag to opt in to cpi and logs storage
* Default TestValidator to opt-in; allow using in multinode-demo
* No clone
Co-authored-by: Carl Lin <carl@solana.com >
(cherry picked from commit cbb8b79a60teulberg@gmail.com >
Co-authored-by: Tyera Eulberg <tyera@solana.com >
2021-02-02 02:51:35 +00:00
Michael Vines
4378634970
Bump version to 1.5.6
2021-01-27 10:50:56 -08:00
mergify[bot]
c9da25836a
Upgrade to Rust v1.49.0 (bp #14810 ) ( #14811 )
...
* Upgrade to Rust v1.49.0
(cherry picked from commit cbffab7850mvines@gmail.com >
2021-01-24 04:42:09 +00:00
