gaspersic/solana
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
11,312 Commits 81 Branches 357 Tags
ad5ef9cc485cf49daa25d8a3c44e6600b9d35fd8
Commit Graph

232 Commits

Author SHA1 Message Date
Sagar Dhawan
bd193535c9 Cap CrdsFilter sizes such that PullRequest no longer exceeds MTU (#5561) 2019-08-19 18:14:10 -07:00
Sagar Dhawan
e73cbdda61 Reduce log level for known issue (#5536) 
automerge
 2019-08-15 19:42:27 -07:00
Sagar Dhawan
4ee212ae4c Coalesce gossip pull requests and serve them in batches (#5501) 
* Coalesce gossip pull requests and serve them in batches

* batch all filters and immediately respond to messages in gossip

* Fix tests

* make download_from_replicator perform a greedy recv
 2019-08-15 17:04:45 -07:00
Sagar Dhawan
1d0608200c Restore blob size fix (#5516) 
* Revert "Revert "Fix gossip messages growing beyond blob size  (#5460)" (#5512)"

This reverts commit 97d57d168b.

* Fix Crds filters
 2019-08-13 18:04:14 -07:00
Sagar Dhawan
97d57d168b Revert "Fix gossip messages growing beyond blob size (#5460)" (#5512) 
This reverts commit a8eb0409b7.
 2019-08-13 10:29:26 -07:00
Justin Starry
0fde19239b Rate limit counter metrics points to one per second (#5496) 
* Rate limit counter metrics points to one per second

* Remove old env var

* Test that metrics counter is incrementing

* Fix typo
 2019-08-12 18:15:34 -04:00
Sagar Dhawan
a8eb0409b7 Fix gossip messages growing beyond blob size (#5460) 
* fixed bloom filter math

* Add split each pull request into multiple pulls with different filters

* Rework CrdsFilter to generate all possible masks to cover the keyspace

* Limit the bloom sizes such that each pull request is no larger than mtu
 2019-08-12 13:51:29 -07:00
Justin Starry
4f86c0b74a Rate limit transaction counters (#5447) 
* Rate limit transaction counters

* @sakridge feedback

* Set default high metrics rate for multinode demo

* Fix tests

* Swap defaults and fix env var tests

* Only set metrics rate if not already set
 2019-08-08 17:05:06 -04:00
Sagar Dhawan
d7a2b790dc Limit the size of gossip push and gossip pull response (#5348) 
* Limit the size of gossip push and gossip pull response

* Remove Default::default

* Rename var
 2019-07-30 15:43:17 -07:00
Pankaj Garg
a7a10e12c7 Forward transactions as packets instead of blobs (#5334) 
* Forward transactions as packets instead of blobs

* clippy
 2019-07-30 14:50:02 -07:00
Justin Starry
84368697af Fix metrics when leader does not report metrics (#5291) 2019-07-30 16:18:33 -04:00
Pankaj Garg
4c90898f0b Dynamic erasure set configuration (#5018) 
* Use local erasure session to create/broadcast coding blobs

* Individual session for each recovery (as the config might be different)

* address review comments

* new constructors for session and coding generator

* unit test for dynamic erasure config
 2019-07-11 13:58:33 -07:00
Rob Walker
f537482c86 remove set_leader from cluster_info (#4998) 2019-07-09 22:06:47 -07:00
Sagar Dhawan
65adce65fa Always send pull responses to the origin addr (#4894) 2019-07-01 16:49:05 -07:00
Justin Starry
861d6468ca Stake weighted pruning for the gossip network (#4769) 
* Stake weighted pruning

* Fix compile error

* Fix clippy errors

* Add helper for creating a connected staked network

* Bug fixes and test groundwork

* Small refactor

* Anatoly's feedback and tests

* Doc updates

* @rob-solana's feedback

* Fix test bug and add log trace

* @rob-solana's feedback
 2019-06-26 00:30:16 -07:00
carllin
46bb79df29 Support for custom BroadcastStage in local cluster tests (#4716) 
* Refactor BroadcastStage to support custom implementations, add FailEntryVerificationBroadcastRun implementation

* Plumb switch on broadcast type through validator

* Add test for validator generating non-verifiable entries to local_cluster

* Fix bad initializers

* Refactor broadcast run code into utils
 2019-06-19 00:13:19 -07:00
Sagar Dhawan
cc48773b03 Add "download from replicator" utility (#4709) 
automerge
 2019-06-17 18:12:13 -07:00
carllin
8c1b9a0b67 Data plane verification (#4639) 
* Add signature to blob

* Change Signable trait to support returning references to signable data

* Add signing to broadcast

* Verify signatures in window_service

* Add testing for signatures to erasure

* Add RPC for getting current slot, consume RPC call in test_repairman_catchup for more deterministic results
 2019-06-12 16:43:05 -07:00
anatoly yakovenko
82df267ec9 s/avalanche/turbine (#4561) 
* s/avalanche/turbine/g
 2019-06-06 12:48:40 -07:00
Pankaj Garg
70a16e91a5 Randomize avalanche broadcast peer table for each blob (#4529) 
* fix clippy warnings
 2019-06-03 20:38:05 -07:00
Pankaj Garg
3574469052 Add random distribution for avalanche peers (#4493) 
* Add random distribution for avalanche peers

* fix clippy warnings

* bug fixes

* nits
 2019-06-01 07:55:43 -07:00
Sathish
182096dc1a Create bank snapshots (#4244) 
* Revert "Revert "Create bank snapshots (#3671)" (#4243)"

This reverts commit 81fa69d347.

* keep saved and unsaved copies of status cache

* fix format check

* bench for status cache serialize

* misc cleanup

* remove appendvec storage on purge

* fix accounts restore

* cleanup

* Pass snapshot path as args

* Fix clippy
 2019-05-30 21:31:35 -07:00
Sagar Dhawan
335dfdc4d5 Fix Gossip skipping push for some values (#4463) 
* Make gossip skip over values from Pruned nodes

* Add test and init blooms to contain the origin
 2019-05-28 18:39:40 -07:00
Michael Vines
cfe5afd34c _id => _pubkey variable renaming (#4419) 
* wallet: rename *_account_id to *_account_pubkey

* s/from_id/from_pubkey/g

* s/node_id/node_pubkey/g

* s/stake_id/stake_pubkey/g

* s/voter_id/voter_pubkey/g

* s/vote_id/vote_pubkey/g

* s/delegate_id/delegate_pubkey/g

* s/account_id/account_pubkey/g

* s/to_id/to_pubkey/g

* s/my_id/my_pubkey/g

* cargo fmt

* s/staker_id/staker_pubkey/g

* s/mining_pool_id/mining_pool_pubkey/g

* s/leader_id/leader_pubkey/g

* cargo fmt

* s/funding_id/funding_pubkey/g
 2019-05-23 23:20:04 -07:00
carllin
6a9e0bc593 Change EpochSlots to use BtreeSet so that serialization/deserialization returns the same order (#4404) 
automerge
 2019-05-23 03:50:41 -07:00
carllin
591fd72e0b Implement listener for serving repairs through Repairman protocol (#4306) 
* Make listener for serving repairs through Repairman protocol
 2019-05-23 03:10:16 -07:00
sakridge
f877fb8c8f Don't print leader update message unless leader actually updates (#4365) 2019-05-21 11:06:56 -07:00
Pankaj Garg
9476fe5ce3 Use log levels for datapoint metrics (#4335) 
* Use log levels for datapoint metrics

* address review comments

* fix cyclomatic complexity
 2019-05-17 17:34:05 -07:00
Pankaj Garg
b2ce5dc9f5 Adjust log level for counter metrics (#4323) 2019-05-17 07:00:06 -07:00
Sagar Dhawan
a0ffbf50a5 Correctly remove replicator from data plane after its done repairing (#4301) 
* Correctly remove replicator from data plane after its done repairing

* Update discover to report nodes and replicators separately

* Fix print and condition to be spy
 2019-05-16 07:14:58 -07:00
Rob Walker
0c1191c3ee rework staking_utils (#4283) 2019-05-14 16:15:51 -07:00
Jack May
f567877d1d Cleanup metrics (#4230) 2019-05-10 08:33:58 -07:00
Rob Walker
81fa69d347 Revert "Create bank snapshots (#3671)" (#4243) 
This reverts commit abf2b300da.
 2019-05-09 19:27:27 -07:00
Sathish
abf2b300da Create bank snapshots (#3671) 
* Be able to create bank snapshots

* fix clippy

* load snapshot on start

* regenerate account index from the storage

* Remove rc feature dependency

* cleanup

* save snapshot for slot 0
 2019-05-09 19:27:06 -07:00
carllin
b8fd51e97d Add new gossip structure for supporting repairs (#4205) 
* Add Epoch Slots to gossip

* Add new gossip structure to support Repair

* remove unnecessary clones

* Setup dummy fast repair in repair_service

* PR comments
 2019-05-08 13:50:32 -07:00
Sagar Dhawan
2107e15bd3 Reduce Avalanche redundancy and implement traditional fanout (#4174) 
* Reduce Avalanche redundancy and implement traditional fanout

* Revert tiny fanout

* Update diagrams and docs based on review comments
 2019-05-07 13:24:58 -07:00
Sagar Dhawan
9add8d0afc Add alternative to Spy Nodes that can fully participate in Gossip (#4087) 
automerge
 2019-04-30 16:42:56 -07:00
Sagar Dhawan
4e41c81bc7 Fix the output from Gossip Discovery (#4067) 
automerge
 2019-04-29 13:19:24 -07:00
Pankaj Garg
87f1bd58b9 Reduce submit frequency of counters that are very frequent and killing metrics DB (#4027) 2019-04-26 20:37:40 -07:00
Michael Vines
c309cd80aa Add getClusterNodes/getSlotLeader JSON RPC API (#3940) 
* Minor cleanup

* Include _this_ node in the contact info trace

* Add getClusterNodes/getSlotLeader RPC API
 2019-04-23 14:46:41 -07:00
Sagar Dhawan
43f7cd8149 Fix Retransmit slamming the leader with its own blobs (#3938) 2019-04-22 18:41:01 -07:00
Sagar Dhawan
349e8a9462 Ensure forwarded Blobs don't break Erasure (#3907) 2019-04-20 16:44:06 -07:00
Sagar Dhawan
c0bffb56df Update Avalanche to use Epoch Stakes (#3900) 2019-04-19 22:31:40 -07:00
Sagar Dhawan
970cc32e65 Fix Data Plane computation when stakes are equal (#3913) 2019-04-19 21:07:21 -07:00
Sagar Dhawan
7e409a13cd Ack on empty Gossip Pull Responses and keep Entrypoint around (#3881) 
* Ack on empty Gossip Pull Responses and keep Entrypoint around

* Address comments and fix test

* Update core/src/cluster_info.rs

Co-Authored-By: sagar-solana <sagar@solana.com>

* Update core/src/cluster_info.rs

Co-Authored-By: sagar-solana <sagar@solana.com>
 2019-04-18 15:12:17 -07:00
Michael Vines
f8543a268f solana-gossip now displays other spy nodes and contact info age (#3867) 2019-04-18 09:48:21 -07:00
Greg Fitzgerald
80f3568062 Upgrade to Rust 1.34.0 (#3781) 
* Upgrade to Rust 1.34.0

* Remove redundant closures

Thanks Clippy!
 2019-04-15 15:56:08 -06:00
Michael Vines
d026ebb83a Use tvu_peers() since validators no longer run an RPC port by default (#3784) 2019-04-15 13:25:09 -07:00
Michael Vines
f6aa90e193 Add fullnode --dynamic-port-range option 2019-04-14 07:08:29 -07:00
Sagar Dhawan
1b5845ac3e Fix getting votes from gossip (#3723) 2019-04-10 17:16:08 -07:00