gaspersic/solana
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
16,833 Commits 81 Branches 357 Tags
a2df1eb5025264c1c89cc90cc69fde9ccb5119a4
Commit Graph

2675 Commits

Author SHA1 Message Date
Michael Vines
57b03c5bc1 Restore Content-Length header for streaming snapshot download 2020-12-20 23:22:26 -08:00
Michael Vines
b3dc988564 Stream RPC snapshot downloads 2020-12-19 15:54:23 -08:00
Michael Vines
0090106f60 getBlockTime RPC method now falls back to BigTable in all cases 2020-12-18 20:51:49 +00:00
behzad nouri
691031fefd limits number of crds values returned when responding to pull requests (#13739) 
Crds values buffered when responding to pull-requests can be very large taking a lot of memory.
Added a limit for number of buffered crds values based on outbound data budget.
 2020-12-18 18:45:12 +00:00
behzad nouri
6a3797e164 adds crds-value for broadcasting duplicate shreds through gossip (#14133) 
In gossip, the header overhead we get from:
https://github.com/solana-labs/solana/blob/de9ac43eb/core/src/cluster_info.rs#L434-L435
https://github.com/solana-labs/solana/blob/de9ac43eb/core/src/crds_value.rs#L31-L36
https://github.com/solana-labs/solana/blob/de9ac43eb/core/src/crds_value.rs#L73
already exceeds SIZE_OF_NONCE in shreds. We also need aditional
meta-data (wallclock, source pubkey, ...). Which means that given the
SHRED_PAYLOAD_SIZE, we cannot fit all these in PACKET_DATA_SIZE:
https://github.com/solana-labs/solana/blob/de9ac43eb/ledger/src/shred.rs#L80

On top of that, we need 2 shred payloads as the proof of duplicate. So
each DuplicateShred crds value includes only a chunk of the payload,
along with the meta-data to reconstruct the full payload from the chunks
on the receiving end.
 2020-12-18 14:32:43 +00:00
sakridge
a5db6399ad Fix test_max_hashes (#14189) 2020-12-17 15:12:18 -08:00
sakridge
da7d1e2302 Improved Transaction Forwarding (#13944) 
* Forwarding

* Dedupe leaders

* Use consistent commitment for last_valid_slot in rpc send_transaction

* Plumb rpc send_transaction options into solana-validator

* Extend num slots banking-stage holds forwarded txs

Co-authored-by: Tyera Eulberg <tyera@solana.com>
 2020-12-17 15:37:22 -07:00
behzad nouri
d6d76219b6 caches staked nodes computed from vote-accounts (#13929) 2020-12-17 21:22:50 +00:00
Michael Vines
0b92720fdb Don't require increased open file limit in solana-test-validator 
Travis CI in particular does not allow the open file limit to be
increased.
 2020-12-16 20:43:08 -08:00
Trent Nelson
6875113d82 Bump SPL crates 2020-12-17 01:54:22 +00:00
Tyera Eulberg
ac0d32bc7e Add blockstore skipped api (#14145) 
* Add blockstore api to determine if a slot was skipped

* Return custom rpc error if slot is skipped
 2020-12-16 13:40:36 -07:00
sakridge
d4a174fb7c Partial shred deserialize cleanup and shred type differentiation (#14094) 
* Partial shred deserialize cleanup and shred type differentiation in retransmit

* consolidate packet hashing logic
 2020-12-15 16:50:40 -08:00
carllin
75e9e321de Fix race between setting tick height and calculating accounts hash (#14101) 
Co-authored-by: Carl Lin <carl@solana.com>
 2020-12-15 12:45:40 -08:00
Michael Vines
1e977ac025 Bump version to v1.6.0 2020-12-15 18:28:04 +00:00
behzad nouri
c2b7115031 indexes crds values associated with a pubkey (#14088) 
record_labels returns all the possible labels for a record identified by
a pubkey, used in updating timestamp of crds values:
https://github.com/solana-labs/solana/blob/1792100e2/core/src/crds_value.rs#L560-L577
https://github.com/solana-labs/solana/blob/1792100e2/core/src/crds.rs#L240-L251
The code relies on CrdsValueLabel to be limited to a small deterministic
set of possible values for a fixed pubkey. As we expand crds values to
include duplicate shreds, this limits what the duplicate proofs can be
keyed by in the table.
In addition the computation of these labels is inefficient and will
become more so as duplicate shreds and more types of crds values are
added. An alternative is to maintain an index of all crds values
associated with a pubkey.
 2020-12-15 01:49:22 +00:00
sakridge
5294f70189 Remove some non-warnings (#14115) 2020-12-14 16:26:17 -08:00
Michael Vines
7143aaa89b Clippy 2020-12-14 08:03:29 -08:00
Michael Vines
cdd3e7d856 Remove solana-vote-signer (#14099) 2020-12-13 19:12:20 -08:00
Michael Vines
9f2d154588 Rework TestValidator API to be more like ProgramTest 2020-12-13 07:45:55 +00:00
dependabot[bot]
88d950e5a8 chore: bump log from 0.4.8 to 0.4.11 (#13691) 
* chore: bump log from 0.4.8 to 0.4.11

Bumps [log](https://github.com/rust-lang/log) from 0.4.8 to 0.4.11.
- [Release notes](https://github.com/rust-lang/log/releases)
- [Changelog](https://github.com/rust-lang/log/blob/master/CHANGELOG.md)
- [Commits](https://github.com/rust-lang/log/compare/0.4.8...0.4.11)

Signed-off-by: dependabot[bot] <support@github.com>

* [auto-commit] Update all Cargo lock files

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: dependabot-buildkite <dependabot-buildkite@noreply.solana.com>
 2020-12-13 13:48:23 +09:00
carllin
55fc963595 Move slot cleanup to AccountsBackgroundService (#13911) 
* Move bank drop to AccountsBackgroundService

* Send to ABS on drop instead, protects against other places banks are dropped

* Fix Abi

* test

Co-authored-by: Carl Lin <carl@solana.com>
 2020-12-13 01:22:34 +00:00
Tyera Eulberg
8541ffa328 Add subscription cap (#14011) 
* Add subscription cap

* Elide unwraps
 2020-12-12 01:57:40 +00:00
Trent Nelson
546c6a4531 Override yanked miow crate to 0.2.2 2020-12-11 23:44:03 +00:00
Trent Nelson
277b6790c7 Override yanked net2 0.2.37 2020-12-11 23:44:03 +00:00
Ryo Onodera
09bd412b13 Wrong rpc inflation rate (#14063) 
* Fix wrong inflation calculation in rpc

* Reorder

* Fix test
 2020-12-11 07:42:39 +00:00
Michael Vines
4fba7e6865 Move validator_block_0_fee_workaround into TestValidator 2020-12-11 04:17:38 +00:00
Michael Vines
bbad3fe501 TestValidator now implements Drop, no need to close() it 2020-12-11 04:17:38 +00:00
Michael Vines
0a9ff1dc9d Initial solana-test-validator command-line program 2020-12-11 04:17:38 +00:00
Josh
13db3eca9f SPL token balance in transaction metadata (#13673) 
* feat: store pre / post token balances

* move helper functions into separate include

* move token balance functionality to transaction-status crate

* fix blockstore processor test

* fix bigtable legacy test

* add caching to decimals
 2020-12-10 19:25:07 -08:00
sakridge
aa2751e614 Check shred type in is_duplicate (#14050) 2020-12-10 18:20:08 -08:00
behzad nouri
409fe3bca1 adds the instance token to crds-labels for node-instance crds-values (#14037) 
If a node "a" receives instance-info from node "b1" it will override any
instance-info associated with "b1" pubkey in its crds table. This makes
it less likely that when "b1" receives crds values from "a" (either
through pull or push), it sees other instances of itself (because node
"a" discarded them when it received "b1" instance info).

In order for the crds table to contain all instance-info associated with
the same pubkey at the same time, we need to add the instance tokens to
the keys in the crds table (i.e. the CrdsValueLabel).
 2020-12-10 17:01:55 +00:00
sakridge
5c95d8e963 Shred filter (#14030) 2020-12-10 07:54:15 -08:00
sakridge
c5fe076432 Better dupe detection (#13992) 2020-12-09 23:14:31 -08:00
behzad nouri
1d267eae6b std::process::exit to kill all threads 2020-12-09 10:24:23 -08:00
behzad nouri
895d7d6a65 removes RwLock on ClusterInfo.instance 2020-12-09 10:24:23 -08:00
behzad nouri
542198180a pushes node-instance along with version early in gossip 2020-12-09 10:24:23 -08:00
behzad nouri
8cd5eb9863 checks for duplicate validator instances using gossip 2020-12-09 10:24:23 -08:00
sakridge
f6600810d7 Use LRU cache and blake3 hash of shreds to filter duplicates (#13976) 2020-12-07 16:42:39 -08:00
Michael Vines
6e9dbb4f6e Add --rpc-max-multiple-accounts to override the getMultipleAccounts JSON RPC maximum 2020-12-07 16:31:01 -08:00
carllin
239a191612 Remove unneeded BankWeight fork choice (#13978) 
Co-authored-by: Carl Lin <carl@solana.com>
 2020-12-07 13:47:14 -08:00
Tyera Eulberg
6ae4d2e5cb Fix logsSubscribe (#13996) 2020-12-07 19:00:52 +00:00
Ryo Onodera
3d9d7557c8 core/validator: Wrap std::process:exit(1) for easier testing (#13990) 2020-12-07 16:43:03 +00:00
Alexander Meißner
a706706572 Validator CLI option to enable just-in-time compilation of BPF (#13789) 
* Adds a CLI option to the validator to enable just-in-time compilation of BPF.

* Refactoring to use bpf_loader_program instead of feature_set to pass JIT flag from the validator CLI to the executor.
 2020-12-07 09:49:55 +01:00
behzad nouri
6706f2b3bb removes recursive read-locks on gossip (#13973) 
ClusterInfo::tvu_peers acquires a read-lock on gossip:
https://github.com/solana-labs/solana/blob/f0e934145/core/src/cluster_info.rs#L1171-L1185
and so, ClusterInfo::repair_peers is recursively locking gossip for
read twice:
https://github.com/solana-labs/solana/blob/f0e934145/core/src/cluster_info.rs#L1202-L1223
But std::sync::RwLock is not re-entrant (recursive).
 2020-12-06 15:14:49 +00:00
Tyera Eulberg
ca35bb3ac8 Report highest_confirmed_root and _slot in commitment metric (#13964) 2020-12-05 00:50:00 +00:00
carllin
34b68288c8 Fix propagation skip check (#13933) 
Co-authored-by: Carl Lin <carl@solana.com>
 2020-12-03 12:31:38 -08:00
behzad nouri
c3048b451d samples repair peers using WeightedIndex (#13919) 
To output one random sample, weighted_best generates n random numbers:
https://github.com/solana-labs/solana/blob/f751a5d4e/core/src/weighted_shuffle.rs#L38-L63
WeightedIndex does so with only one random number:
https://github.com/rust-random/rand/blob/eb02f0e46/src/distributions/weighted_index.rs#L223-L240
Additionally, if the index is already constructed, it only does a total
of O(log(n)) amount of work; which can be achieved if RepairCache,
caches the weighted index:
https://github.com/solana-labs/solana/blob/f751a5d4e/core/src/serve_repair.rs#L83

Also, the repair-peers code can be reorganized to have fewer redundant
unlock-then-lock code.
 2020-12-03 14:26:07 +00:00
Trent Nelson
404fc1570d runtime: Replace HashAgeKind with NonceRollbackInfo 2020-12-02 20:10:08 +00:00
Tyera Eulberg
10c81a2448 Remove rpc_banks from validator (#13882) 
* Remove rpc_banks from validator

* Bump abi-digest
 2020-12-02 03:25:09 +00:00
Michael Vines
0a8bc347a1 Restore discover_cluster to avoid test panics 2020-12-01 17:58:28 -08:00