gaspersic/solana
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
7,935 Commits 81 Branches 357 Tags
4a074133f7ae55685cae8d8e1ebeefbff725f370
Commit Graph

75 Commits

Author SHA1 Message Date
Ryo Onodera
2c7447b73e Secure sysvars under hash by freezing all strictly (#7892) 
* Secure sysvars under hash by freezing all strictly

* Fix hash's non-idempotnet and add new test

* Clean up

* More cleanups
 2020-01-24 16:10:32 +09:00
Michael Vines
8b8033c72b Set BankRc slot correctly when restoring a bank snapshot 2020-01-23 13:37:13 -07:00
Justin Starry
87598c7612 Consolidate tx error counters and update metrics dashboard (#7724) 
automerge
 2020-01-16 23:26:50 -08:00
Ryo Onodera
b16c30b4c6 Fix cluster collapse due to no proper shifted read (#7797) 
* Fix cluster collapse due to no proper shifted read

* Add test for bank hash mismatch

Co-authored-by: sakridge <sakridge@gmail.com>
 2020-01-15 11:45:19 +09:00
sakridge
3b78be83cf Add hash stats information to check hashes between validators (#7780) 
automerge
 2020-01-14 11:57:29 -08:00
Ryo Onodera
865c42465a Cap file size for snapshot data files (#7182) 
* save limit deserialize

* save

* Save

* Clean up

* rustfmt

* rustfmt

* Just comment out to please CI

* Fix ci...

* Move code

* Rustfmt

* Crean up control flow

* Add another comment

* Introduce predetermined constant limit on snapshot data files (deserialize side)

* Introduce predetermined constant limit on snapshot data files (serialize side)

* rustfmt

* Tweak message

* Revert dynamic memory limit

* Limit size of snapshot data file (de)serialization

* Fix test breakage

* Clean up

* Fix uses formatting

* Rename: deserialize_{for,from}_snapshot

* Simplify comment

* Use Slot

* Provide slot for status cache

* Align variable name with snapshot_status_cache_file_path

* Define serialize_snapshot_data_file_with_metrics

* Fix build.......

* De-marco serialize_snapshot_data_file_with_metrics

* Revert u64 => Slot
 2020-01-10 09:49:36 +09:00
Michael Vines
9720c894f1 Use commas to make a log message more readable 2020-01-06 22:31:01 -07:00
Ryo Onodera
c8fe4043b6 Rename slot_hash => bank_hash in AcoountsDB (#7579) 
* Rename slot_hash => bank_hash in AcoountsDB
 2019-12-23 10:50:31 +09:00
Ryo Onodera
3c361eb759 Check account hashes in snapshot (#7559) 
* Check for incorrect hash value

* Finish up checking for incorrect hash value

* Fix comment a bit

Co-authored-by: sakridge <sakridge@gmail.com>
 2019-12-20 09:39:30 +09:00
sakridge
9d5a07bac4 Move create_dir_all to AccountsDB::new (#7465) 
AppendVec create doesn't need to try and create
paths every time and it can stall while snapshot
create is happening.
 2019-12-13 16:46:16 -08:00
Ryo Onodera
a1ab81a896 Include rent_epoch and executable into account hash (#7415) 
* Clean a bit

* Add rent_epoch and executable into account hashing

* Remove comment and instead create an issue
 2019-12-12 13:03:33 +09:00
sakridge
0aa4dc904e Accounts index updates, remove pubkey when dead account (#7408) 2019-12-11 11:11:31 -08:00
Justin Starry
b7d4330dd4 Fail fast if account paths cannot be canonicalized (#7300) 
* Canonicalize account paths to avoid symlink issues

* fixes
 2019-12-05 21:41:29 -05:00
sakridge
cfc21e1225 Only serialize rooted append vecs (#7281) 2019-12-05 14:27:46 -08:00
sakridge
887bff572a More conservative purge_zero_lamport_accounts purge logic (#7157) 2019-12-02 09:51:05 -08:00
sakridge
6c89226ccf Purge zero lamport accounts on snapshot ingestion (#7010) 
Snapshots do not load the original index, so they must
purge zero lamport accounts again.
 2019-11-22 18:22:28 -08:00
anatoly yakovenko
b150da837a Use epoch as the gossip purge timeout for staked nodes. (#7005) 
automerge
 2019-11-20 11:25:18 -08:00
Jack May
d184d3a732 Merge native programs parts into one unit (#7047) 2019-11-20 10:12:43 -08:00
Sagar Dhawan
42da1ce4e2 Fix bank hash not changing when no internal state has changed (#7052) 
* Fix bank hash not changing when no internal state has changed

* Fix unnecessary call to hash_internal_state

* Add blockhash into the bank_hash

* Add blockhash into the bank_hash and update tests

* Refactor accounts_db slot_hashes

* More clarity in comments

* Add clippy suggestion

* Grammar

* Fix compile after clippy made me break it

* Schooled by clippy
 2019-11-19 20:19:43 -08:00
Michael Vines
50a17fc00b Use Slot and Epoch type aliases instead of raw u64 (#6693) 
automerge
 2019-11-02 00:38:30 -07:00
Jack May
5264fded00 Avoid alloc due to vector pushes (#6632) 2019-10-30 21:55:17 -07:00
Rob Walker
b4119c454a credit_only credits forwarding (#6509) 
* credit_only_credits_forwarding

* whack transfer_now()

* fixup

* bench should retry the airdrop TX

* fixup

* try to make bench-exchange a bit more robust, informative
 2019-10-23 22:01:22 -07:00
sakridge
f1172617cc Purge accounts with lamports=0 on rooted forks (#6315) 2019-10-23 12:46:48 -07:00
Greg Fitzgerald
fb39bd45d7 Revert "Rename solana-runtime to sealevel (#6239)" (#6247) 
This reverts commit 2e921437cd.
 2019-10-04 19:33:29 -06:00
Greg Fitzgerald
2e921437cd Rename solana-runtime to sealevel (#6239) 
automerge
 2019-10-04 15:02:44 -07:00
Michael Vines
f9f5bc2eb5 More clippy 2019-10-02 21:21:07 -07:00
carllin
35365974bf Remove serializing all ForkHashes (#6110) 2019-09-26 02:01:25 -07:00
carllin
701d90a41d Remove some AccountStorage Serialization (#6047) 
* Remove serialization of AccountStorageEntry fields

* Add metric for evaluating BankRc serialization time

* Serialize AppendVec current len

* Add dashboard metrics

* Move flush of AppendVecs to packaging thread
 2019-09-25 18:07:41 -07:00
sakridge
093b5b5267 Prune fork_hashes with dead forks (#6085) 2019-09-25 11:16:14 -07:00
Rob Walker
72fb52ec60 rename balance (#5984) 2019-09-23 15:20:45 -07:00
sakridge
19ae556857 hash account state on store (#5573) 2019-09-20 13:21:12 -07:00
Sagar Dhawan
c1d788880d Limit Rayon threadpool threads (#5871) 2019-09-12 11:39:39 -07:00
Michael Vines
4e827af392 Remove unnecessary trailing semicolons (#5636) 2019-08-23 22:47:54 -07:00
Rob Walker
0ffe7a9c8f plumb some rent (#5610) 
* plumb some rent

* nits

* fixups

* fixups

* fixups
 2019-08-23 14:04:53 -07:00
Michael Vines
3fc5009ef2 Snapshot pipefitting through the validator cli (#5617) 
* Handle 404 errors better

* Snapshot pipefitting through the validator cli

* Add download progress bar

* Log the current entrypoint slot
 2019-08-23 13:02:07 -07:00
carllin
087c43b9ef Add snapshotting integration test (#5519) 
* Add snapshotting integration test

* Update ContactInfo on restart in local cluster nodes
 2019-08-21 23:59:11 -07:00
Rob Walker
a8b82a0b68 optimize store_accounts (#5557) 2019-08-19 13:00:37 -07:00
carllin
58d4e32c97 Remove serialization of future AppendVecs and serialize AccountStorage correctly (#5510) 2019-08-13 16:05:37 -07:00
sakridge
e30ca01999 Only create more append_vecs when the account number grows (#5454) 
We only need many append_vecs if the number of accounts is high,
so only create opportunistic ones as accounts are created.
 2019-08-07 16:43:52 -07:00
carllin
1dbb5c8647 Deserialize snapshots (#5417) 
* Deserialize snapshots
 2019-08-05 22:53:19 -07:00
carllin
6cb2040a1b Snapshot Packaging Service (#5262) 
* Snapshot serialization and packaging
 2019-07-31 17:58:10 -07:00
Rob Walker
8537da19bb groom accounts_db (#5283) 2019-07-25 22:59:28 -07:00
Rob Walker
8a12ed029c make accounts_db own the directory paths (#5230) 
* change paths to something accounts_db (the singleton) owns, fixes SIGILL

* fail deserialize if paths don't work
serialize paths, too

* test that paths are populated from a bank snapshot
 2019-07-23 13:47:48 -07:00
sakridge
595017499e accounts_index: RwLock per-account (#5198) 
* accounts_index: RwLock per-account

Lots of lock contention on the accounts_index lock,
only take write-lock on accounts_index if we need to insert/remove an
account.
For updates, take a read-lock and then write-lock on the individual
account.

* Remove unneeded enumerate and add comments.
 2019-07-20 17:58:39 -07:00
Rob Walker
027ebb6670 no more OUT_DIR (#5139) 
* no more OUT_DIR

* no more OUT_DIR

* more information about failure
 2019-07-17 14:27:58 -07:00
sakridge
b505a0df22 Throw more threads at hash_internal_state (#5023) 2019-07-16 16:58:30 -07:00
Rob Walker
0d27515d09 tmp dirs target to farf (#5079) 2019-07-12 18:28:42 -07:00
Tyera Eulberg
08f6de0acd Plumb scan_accounts into accounts_db, adding load from storage (#5029) 2019-07-11 12:16:02 -06:00
Rob Walker
727c15ef8a start from random point in fork stores (#5010) 2019-07-10 18:44:49 -07:00
sakridge
a89589a1d5 Add Measure abstraction over measuring time intervals (#4851) 
Allows one to swap in different implementations. This provides
the normal Insant::now() -> .elapsed() path.
 2019-06-29 15:34:49 +02:00