Will Hickey
08d6b9850d
Bump version to 1.9.9 ( #23247 )
2022-02-19 21:17:11 -06:00
Trent Nelson
c3098e99d1
Bump version to v1.9.8
2022-02-16 21:42:57 -07:00
Will Hickey
2d144afec5
Bump version to 1.9.6 ( #23092 )
2022-02-11 15:00:06 -06:00
mergify[bot]
432eafd730
Search for consecutive ports ( #22979 ) ( #22984 )
...
(cherry picked from commit 514aab46d9sakridge@gmail.com >
2022-02-07 18:45:02 +00:00
mergify[bot]
c43cef79b5
Add quic port for accepting transactions ( #22753 ) ( #22937 )
...
using quinn library
streamer: Sign TLS cert with validator identity key
Handle multiple incoming chunks
(cherry picked from commit 5a230f418dsakridge@gmail.com >
2022-02-04 20:53:27 +00:00
mergify[bot]
237347847b
caches WeightedShuffle struct in ClusterNodes ( #22877 ) ( #22889 )
...
Instead of reconstructing WeightedShuffle struct for each shred
broadcast or retransmit, we can use the same struct with minimal
mutations.
(cherry picked from commit e3b137066dbehzadnouri@gmail.com >
2022-02-02 16:54:57 +00:00
mergify[bot]
c715bc93cf
removes Rng field from WeightedShuffle struct ( #22850 ) ( #22868 )
...
(cherry picked from commit 45e09664b8behzadnouri@gmail.com >
2022-02-01 17:33:52 +00:00
mergify[bot]
4dfbb4347c
includes zero weighted entries in WeightedShuffle ( #22829 ) ( #22847 )
...
Current WeightedShuffle implementation excludes zero weighted entries
from the shuffle:
https://github.com/solana-labs/solana/blob/13e631dcf/gossip/src/weighted_shuffle.rs#L29-L30
Though mathematically this might make more sense, for our use-cases
(turbine specifically), this results in less efficient code:
https://github.com/solana-labs/solana/blob/13e631dcf/core/src/cluster_nodes.rs#L409-L430
This commit changes the implementation so that zero weighted indices are
also included in the shuffle but appear only at the end after non-zero
weighted indices.
(cherry picked from commit 604ca9316cbehzadnouri@gmail.com >
2022-01-31 18:16:40 +00:00
Trent Nelson
8bc4cc90d2
Bump version to 1.9.6
2022-01-21 20:15:43 -07:00
mergify[bot]
59f406d78a
Refactor: move simple vote parsing to runtime (backport #22537 ) ( #22587 )
...
* Refactor: move simple vote parsing to runtime (#22537 )
(cherry picked from commit 7f20c6149ejustin@solana.com >
2022-01-20 04:51:50 +00:00
mergify[bot]
dbf9a32883
Optimize packet dedup ( #22571 ) ( #22585 )
...
* Use bloom filter to dedup packets
* dedup first
* Update bloom/src/bloom.rs
Co-authored-by: Trent Nelson <trent.a.b.nelson@gmail.com >
* Update core/src/sigverify_stage.rs
Co-authored-by: Trent Nelson <trent.a.b.nelson@gmail.com >
* Update core/src/sigverify_stage.rs
Co-authored-by: Trent Nelson <trent.a.b.nelson@gmail.com >
* Update core/src/sigverify_stage.rs
Co-authored-by: Trent Nelson <trent.a.b.nelson@gmail.com >
* fixup
* fixup
* fixup
Co-authored-by: Trent Nelson <trent.a.b.nelson@gmail.com >
(cherry picked from commit d343713f61anatoly@solana.com >
2022-01-20 02:51:49 +00:00
mergify[bot]
41b0d6cca3
limits gossip vote stats to the top most voted slots ( #22416 ) ( #22418 )
...
(cherry picked from commit 49da347d84behzadnouri@gmail.com >
2022-01-10 23:14:57 +00:00
Trent Nelson
cb49ae21b4
Bump version to v1.9.5
2022-01-08 21:17:51 +00:00
Will Hickey
ba0188a36d
Bump version to 1.9.4 ( #22304 )
2022-01-05 12:02:36 -06:00
mergify[bot]
9c9d3e8b6b
discards serialized gossip crds votes if cannot parse tx (backport #22129 ) ( #22172 )
...
* discards serialized gossip crds votes if cannot parse tx (#22129 )
(cherry picked from commit c9c78622a8behzadnouri@gmail.com >
2021-12-29 22:38:12 +00:00
mergify[bot]
16f821ea8c
Ensure AncestorHashesSerice selects an open port ( #21919 ) ( #21997 )
...
(cherry picked from commit 7f6fb6937awumu727@gmail.com >
2021-12-28 06:46:59 +00:00
mergify[bot]
be0bcd85ed
tracks erasure coding shreds' indices explicitly ( #21822 ) ( #22094 )
...
The indices for erasure coding shreds are tied to data shreds:
https://github.com/solana-labs/solana/blob/90f41fd9b/ledger/src/shred.rs#L921
However with the upcoming changes to erasure schema, there will be more
erasure coding shreds than data shreds and we can no longer infer coding
shreds indices from data shreds.
The commit adds constructs to track coding shreds indices explicitly.
(cherry picked from commit 65d59f4ef0behzadnouri@gmail.com >
2021-12-23 19:38:50 +00:00
Will Hickey
78e7913352
Bump version to 1.9.3 ( #22065 )
2021-12-22 11:41:03 -06:00
mergify[bot]
1a2823b875
chore: bump lru from 0.7.0 to 0.7.1 ( #22018 ) ( #22056 )
...
Bumps [lru](https://github.com/jeromefroe/lru-rs ) from 0.7.0 to 0.7.1.
- [Release notes](https://github.com/jeromefroe/lru-rs/releases )
- [Changelog](https://github.com/jeromefroe/lru-rs/blob/master/CHANGELOG.md )
- [Commits](https://github.com/jeromefroe/lru-rs/compare/0.7.0...0.7.1 )
---
updated-dependencies:
- dependency-name: lru
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
(cherry picked from commit 69d0b08dd8
2021-12-21 16:27:43 -07:00
mergify[bot]
e572678176
removes next_shred_index from return value of entries to shreds api ( #21961 ) ( #21980 )
...
next-shred-index is already readily available from returned data shreds.
The commit simplifies the api for upcoming changes to erasure coding
schema which will require explicit tracking of indices for coding shreds
as well as data shreds.
(cherry picked from commit 89d66c3210behzadnouri@gmail.com >
2021-12-17 17:57:57 +00:00
Michael Vines
bfa6302985
Bump version to 1.9.2
2021-12-15 16:18:14 -08:00
mergify[bot]
01941cf3de
Rename Packets to PacketBatch (backport #21794 ) ( #21805 )
...
* Rename Packets to PacketBatch (#21794 )
(cherry picked from commit 254ef3e7b6justin@solana.com >
2021-12-11 16:53:23 +00:00
Tao Zhu
4b63d51e3e
Bump version to 1.9.1 ( #21802 )
2021-12-11 12:50:36 +00:00
Michael Vines
b8837c04ec
Reformat imports to a consistent style for imports
...
rustfmt.toml configuration:
imports_granularity = "One"
group_imports = "One"
2021-12-03 09:19:13 -08:00
behzad nouri
9886366977
exempts AccountsHashes from stake check ( #21565 )
...
Otherwise getHealth fails if account hashes are not propagated.
2021-12-02 18:01:32 +00:00
Michael Vines
dd12d90eac
Upgrade to Rust 2021
2021-11-30 20:43:46 -08:00
behzad nouri
57057f8d39
uses enum for shred type
...
Current code is using u8 which does not have any type-safety and can
contain invalid values:
https://github.com/solana-labs/solana/blob/66fa062f1/ledger/src/shred.rs#L167
Checks for invalid shred-types are scattered through the code:
https://github.com/solana-labs/solana/blob/66fa062f1/ledger/src/blockstore.rs#L849-L851
https://github.com/solana-labs/solana/blob/66fa062f1/ledger/src/shred.rs#L346-L348
The commit uses enum for shred type with #[repr(u8)]. Backward
compatibility is maintained by implementing Serialize and Deserialize
compatible with u8, and adding a test to assert that.
2021-11-19 14:16:39 +00:00
carllin
b30c94ce55
ClusterInfoVoteListener send only missing votes to BankingStage ( #20873 )
2021-11-18 15:20:41 -08:00
behzad nouri
3fc858eb60
adds methods to obtain data/coding shreds indices from ErasureMeta
2021-11-13 17:08:05 +00:00
Michael Keleti
b0ca335463
Rename "trusted" to "known" in validators/ ( #21197 )
...
* Replaced trusted with known validator
* Format Convention
2021-11-12 11:57:55 -07:00
behzad nouri
eea3fb327f
seeds rng for test_build_crds_filter test ( #21031 )
2021-10-28 18:29:32 +00:00
behzad nouri
43168e6365
doubles crds unique pubkey capacity ( #20947 )
2021-10-26 13:06:55 +00:00
behzad nouri
1297a13586
adds metrics tracking crds writes and votes ( #20953 )
2021-10-26 13:02:30 +00:00
Brooks Prumo
14af1957d6
Make pub IncrementalSnapshotHashes fields ( #20727 )
2021-10-18 13:38:43 -05:00
behzad nouri
0c0384ec32
revises turbine peers shuffling order ( #20480 )
...
Turbine randomly shuffles cluster nodes on a broadcast tree for each
shred. This requires knowing the stakes and nodes' contact-infos (from
gossip).
However gossip is subject to partitioning and propogation delays.
Additionally unstaked nodes may join and leave the cluster at any
moment, changing the cluster view from one node to another.
This commit:
* Always arranges the unstaked nodes at the bottom of turbine broadcast
tree.
* Staked nodes are always included regardless of if their contact-info
is available in gossip or not.
* Uses the unbiased WeightedShuffle construct for shuffling nodes.
2021-10-14 15:09:36 +00:00
Brooks Prumo
1fcfbfccbb
Add fn to push IncrementalSnapshotHashes to cluster via gossip ( #20395 )
2021-10-08 08:20:35 -05:00
Brooks Prumo
57592e463e
Add get_incremental_snapshot_hash_for_node() to gossip ( #20394 )
2021-10-07 19:47:14 -05:00
behzad nouri
0da661de62
adds metrics for number of nodes vs number of pubkeys ( #20512 )
2021-10-07 18:56:05 +00:00
Tao Zhu
177a375479
Tpu vote 1.7 ( #20187 ) ( #20494 )
...
* Add separate vote processing tpu port
* Add feature to send to tpu vote port
* Add vote rejecting sigverify mode
* use packet.meta.is_simple_vote_tx in place of deserialization
* consolidate code that identifies vote tx atcommon path for cpu and gpu
* new key for feature set
* banking forward tpu vote
* add tpu vote port to dockerfile and other review changes
* Simplify thread id compare
* fix a test; updated cluster_info ABI change
Co-authored-by: Tao Zhu <tao@solana.com >
Co-authored-by: sakridge <sakridge@gmail.com >
2021-10-07 09:38:23 +00:00
Trent Nelson
767f740305
Bump version to 1.9.0
2021-10-06 17:57:41 -07:00
dependabot[bot]
5ceb5ef328
chore: bump lru from 0.6.6 to 0.7.0 ( #20437 )
...
Bumps [lru](https://github.com/jeromefroe/lru-rs ) from 0.6.6 to 0.7.0.
- [Release notes](https://github.com/jeromefroe/lru-rs/releases )
- [Changelog](https://github.com/jeromefroe/lru-rs/blob/master/CHANGELOG.md )
- [Commits](https://github.com/jeromefroe/lru-rs/compare/0.6.6...0.7.0 )
---
updated-dependencies:
- dependency-name: lru
dependency-type: direct:production
update-type: version-update:semver-minor
...
Signed-off-by: dependabot[bot] <support@github.com >
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-10-06 17:32:06 -06:00
Brooks Prumo
4e3818e5c1
Add CrdsData::IncrementalSnapshotHashes ( #20374 )
2021-10-05 09:57:46 -05:00
Brooks Prumo
5d141fe01d
Rename CRDS SnapshotHash to SnapshotHashes ( #20421 )
2021-10-04 19:03:28 -05:00
carllin
ee8621a8bd
Add metric measuring number of successfully inserted push messages ( #20275 )
...
* Add number of successfully inserted push messages
2021-09-28 21:41:17 -07:00
behzad nouri
43ed727ba7
reverts #17542 ( #20259 )
...
https://github.com/solana-labs/solana/pull/17542
excludes caller's crds values from pull responses.
Reverting that commit so that when a (staked) node restarts, it can
obtain its crds values before restart from other nodes.
2021-09-27 22:03:26 +00:00
sakridge
013e1d9d49
Limit transaction forwarding from banking_stage ( #19940 )
2021-09-21 08:49:41 -07:00
sakridge
44c8b1bca2
Remove clippy ( #19793 )
2021-09-13 20:08:28 -07:00
Giles Cope
c9261e034e
remove dev deps
2021-09-11 14:33:53 -07:00
behzad nouri
d7051b0d21
adds logs when push-vote panics with invalid vote-index ( #19485 )
...
In order to debug this panic on the clusters:
panicked at 'assertion failed: (vote_index as usize) <
MAX_LOCKOUT_HISTORY', core/src/cluster_info.rs:1012:9
2021-08-31 12:15:07 +00:00
dependabot[bot]
6a53ec28e0
chore: bump serde from 1.0.129 to 1.0.130 ( #19497 )
...
* chore: bump serde from 1.0.129 to 1.0.130
Bumps [serde](https://github.com/serde-rs/serde ) from 1.0.129 to 1.0.130.
- [Release notes](https://github.com/serde-rs/serde/releases )
- [Commits](https://github.com/serde-rs/serde/compare/v1.0.129...v1.0.130 )
---
updated-dependencies:
- dependency-name: serde
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com >
* [auto-commit] Update all Cargo lock files
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <you@example.com >
2021-08-30 18:19:34 +00:00
