gaspersic/solana
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
12,728 Commits 81 Branches 357 Tags
21484acc20f94e67d73670252833ed35d079c197
Commit Graph

188 Commits

Author SHA1 Message Date
mergify[bot]
36ad03af1f calculate hash from store instead of index (bp #15034) (#15084) 
* calculate hash from store instead of index (#15034)

* calculate hash from store instead of index

* restore update hash in abs

(cherry picked from commit 600ff0d915)

* fix merge conflict (#15085)

Co-authored-by: Jeff Washington (jwash) <75863576+jeffwashington@users.noreply.github.com>
 2021-02-04 16:58:11 +00:00
mergify[bot]
972540907b Don't load all accounts into memory for capitalization check (#14957) (#15072) 
* Don't load all accounts into memory for capitalization check

Co-authored-by: carllin <carl@solana.com>
 2021-02-04 11:49:48 +00:00
mergify[bot]
dadebb2bba Don't reset accounts if the remove_account comes from a clean (#15022) (#15066) 
Store may be in-use with a snapshot creation, so don't disturb
it's state.

Co-authored-by: sakridge <sakridge@gmail.com>
 2021-02-04 06:02:02 +00:00
mergify[bot]
e2a874370b Cleanup v1 shrink path (#15009) (#15071) 
move legacy functions to another impl block

(cherry picked from commit 37aac5a12d)

Co-authored-by: sakridge <sakridge@gmail.com>
 2021-02-03 23:33:21 +00:00
mergify[bot]
0db5a74bb9 streamline calculate_accounts_hash (#14980) (#15015) 
Co-authored-by: Jeff Washington (jwash) <75863576+jeffwashington@users.noreply.github.com>
 2021-02-03 05:31:25 +00:00
mergify[bot]
08fd4905db remove legacy merkle root (bp #14772) (#15021) 
* remove legacy merkle root (#14772)

* remove legacy merkle root
f78197a

* clippy

* compile error

* borrow error

* derministic results

* clippy

* borrow

(cherry picked from commit 1b85114a9c)

# Conflicts:
#	merkle-root-bench/src/main.rs
#	runtime/src/accounts_db.rs

* remove legacy merkle root (#14772)

* remove legacy merkle root
f78197a

* clippy

* compile error

* borrow error

* derministic results

* clippy

* borrow

Co-authored-by: Jeff Washington (jwash) <75863576+jeffwashington@users.noreply.github.com>
 2021-02-03 03:19:28 +00:00
mergify[bot]
30d2e15945 speed up merkle root calculation (bp #14710) (#15020) 
* speed up merkle calculation (#14710)

(cherry picked from commit 18bd0c9a5b)

* back port crate versions for merkle-root-bench

Co-authored-by: Jeff Washington (jwash) <75863576+jeffwashington@users.noreply.github.com>
Co-authored-by: Jeff Washington (jwash) <wash678@gmail.com>
 2021-02-02 19:39:49 -06:00
mergify[bot]
512a193674 Use helper for count() in accountsDB (#14953) (#14956) 
(cherry picked from commit 63c44bd690)

Co-authored-by: sakridge <sakridge@gmail.com>
 2021-01-31 18:23:01 -08:00
sakridge
39515cae5e Use already-generated key set to populate dirty keys for clean (#14905) 
Don't need to scan the stores again when we already found the key
set of updates per slot. Just insert it earlier.

(cherry picked from commit 65315fa4c2)
 2021-01-29 18:02:42 -08:00
mergify[bot]
d4cc7c6b66 Only mmap file from snapshot once (#14815) (#14901) 
(cherry picked from commit a53b8558cd)

Co-authored-by: sakridge <sakridge@gmail.com>
 2021-01-28 11:03:40 -08:00
mergify[bot]
c5cfbee853 Aggregate purge and shrink metrics (#14763) (#14883) 
Co-authored-by: Carl Lin <carl@solana.com>
(cherry picked from commit 72f10f5f29)
 2021-01-27 02:56:45 -08:00
mergify[bot]
c276670a94 Snapshots missing slots from accounts cache clean optimization (#14852) (#14878) 
Co-authored-by: Carl Lin <carl@solana.com>
 2021-01-26 22:20:07 -08:00
mergify[bot]
673c679523 Partial clean (#14800) (#14813) 
* Revert "Revert "Partial accounts clean (#14652)" (#14777)"

This reverts commit ad2e10e17b.

* Remove squashed uncleaned keys

(cherry picked from commit 0d32a0e0f4)

Co-authored-by: sakridge <sakridge@gmail.com>
 2021-01-24 20:52:23 +00:00
mergify[bot]
c9da25836a Upgrade to Rust v1.49.0 (bp #14810) (#14811) 
* Upgrade to Rust v1.49.0

(cherry picked from commit cbffab7850)

# Conflicts:
#	core/src/crds_value.rs

* rebase

Co-authored-by: Michael Vines <mvines@gmail.com>
 2021-01-24 04:42:09 +00:00
mergify[bot]
40f32fd37d Speed up generate_index (#14792) (#14807) 
(cherry picked from commit 424bb797a6)

Co-authored-by: sakridge <sakridge@gmail.com>
 2021-01-23 18:50:04 +00:00
mergify[bot]
fef4100f5f Remove unnecesary flushes in previous roots (#14596) (#14803) 
Co-authored-by: Carl Lin <carl@solana.com>
(cherry picked from commit c77461e428)

Co-authored-by: carllin <wumu727@gmail.com>
 2021-01-23 15:02:32 +00:00
mergify[bot]
68bf58aac0 Parallel cache scan (#14544) (#14804) 
Co-authored-by: Carl Lin <carl@solana.com>
(cherry picked from commit 2745b79b74)

Co-authored-by: carllin <wumu727@gmail.com>
 2021-01-23 13:42:47 +00:00
sakridge
e6b53c262b Revert "Partial accounts clean (#14652) (#14751)" (#14776) 
This reverts commit c89f5e28b7.
 2021-01-22 16:17:20 -08:00
mergify[bot]
c89f5e28b7 Partial accounts clean (#14652) (#14751) 
Clean less keys by tracking the two cases:
* Touched keys per slot in uncleaned_keys derived from
accounts delta hash operation.
* Set of keys with any zero-lamport updates.

Co-authored-by: sakridge <sakridge@gmail.com>
 2021-01-22 00:34:49 +00:00
mergify[bot]
7ac2aae730 More generic accounts purge functions (#14595) (#14640) 
Co-authored-by: Carl Lin <carl@solana.com>
(cherry picked from commit 5f14f45282)

Co-authored-by: carllin <wumu727@gmail.com>
 2021-01-18 05:53:40 +00:00
mergify[bot]
0e3e3a03cc Cache account stores, flush from AccountsBackgroundService (#13140) (#14542) 
(cherry picked from commit 6dfad0652f)

Co-authored-by: carllin <wumu727@gmail.com>
 2021-01-12 06:12:18 +00:00
mergify[bot]
a4bc31341a Lower recycle store count (#14429) (#14442) 
Too many stores can cause swap usage which
is detrimental to account store times.

(cherry picked from commit 53d65009a0)

Co-authored-by: sakridge <sakridge@gmail.com>
 2021-01-05 21:39:31 +00:00
mergify[bot]
635afbabff snapshot_utils: Don't bother restoring snapshots, they're never used (bp #14392) (#14396) 
* Remove dead code

(cherry picked from commit b6dcdb90e8)

* Don't bother restoring snapshots, they're never used

(cherry picked from commit db6ee289c9)

Co-authored-by: Michael Vines <mvines@gmail.com>
 2021-01-03 05:20:26 +00:00
mergify[bot]
f6de92c346 Add secondary indexes (#14212) (#14382) 
(cherry picked from commit 5affd8aa72)

Co-authored-by: carllin <wumu727@gmail.com>
 2021-01-01 07:42:47 +00:00
mergify[bot]
eb0fd3625a Fix subtraction overflow in metrics (#14290) (#14296) 
(cherry picked from commit c693ffaa08)

Co-authored-by: sakridge <sakridge@gmail.com>
 2020-12-28 02:34:58 +00:00
mergify[bot]
52ffb9a64a Add accounts shrink paths (bp #14238) (#14270) 
* Add shrink paths (#14238)


(cherry picked from commit baa9602411)

* Ignore long/hanging test (#14261)

Co-authored-by: sakridge <sakridge@gmail.com>
Co-authored-by: Tyera Eulberg <teulberg@gmail.com>
 2020-12-23 08:03:33 +00:00
Michael Vines
7143aaa89b Clippy 2020-12-14 08:03:29 -08:00
Ryo Onodera
de9ac43ebf Simple cap by including sysvars and native programs (#13884) 
* Simpler cap by including sysvars and native programs

* Fix tests

* Add comment

* revert some unrelated code

* Update test_bank_update_sysvar_account for cap.

* Test cap. for add_native_program using new helper

* Improve the cap adjustment with new tests

* Fix typo...

* Adjust test for improved code coverage

* Rename simpler_capitalization => simple_capitalization

* More rename and bonus commenting
 2020-12-14 21:03:24 +09:00
Ryo Onodera
5788e75188 Shrink slots by sparseness of written data size (#14072) 2020-12-14 02:58:38 +09:00
Ryo Onodera
164b7895b3 Tiny add_native_program bug fixes with cleanups (#14042) 
* Tiny add_native_program bug fixes with cleanups

* Fix typo
 2020-12-11 11:03:31 +09:00
sakridge
68109a46e0 Lower priority for hashing threads. (#14043) 2020-12-10 12:26:47 -08:00
carllin
5dceddd21d Remove associated functions on AccountsDb, replace with methods (#13953) 
Co-authored-by: Carl Lin <carl@solana.com>
 2020-12-03 17:53:42 -08:00
carllin
955b99cf69 Fix roots_and_ref_count (#13827) 
Co-authored-by: Carl Lin <carl@solana.com>
 2020-11-26 13:09:20 -08:00
carllin
791fb17437 Prevent scans on unrooted slots from seeing partial clean (#13628) 
Co-authored-by: Carl Lin <carl@solana.com>
 2020-11-20 13:01:04 -08:00
carllin
6276360468 Prevent scans from seeing root updates/clean (#13464) 
Co-authored-by: Carl Lin <carl@solana.com>
 2020-11-16 17:23:11 -08:00
carllin
2c2432fddc Refactor function (#13294) 
Co-authored-by: Carl Lin <carl@solana.com>
 2020-11-10 17:20:35 -08:00
sakridge
43053dcc90 Re-use accounts stores (#12885) 
* Re-use accounts_db stores

Creating files and dropping mmap areas can be expensive

* Add test for storage finder

Can encounter an infinite loop when the store is too small, but
smaller than the normal store size.

* Fix storage finding

* Check for strong_count == 1

* try_recycle helper
 2020-11-04 09:17:05 -08:00
Jack May
c458d4b213 move Account to solana-sdk (#13198) 2020-10-28 22:01:07 -07:00
sakridge
d5e439037b Make bad_bank_hash test faster (#13206) 2020-10-28 21:44:42 -07:00
sakridge
7d2729f6bd shrink debug (#13089) 2020-10-23 08:05:19 -07:00
Michael Vines
959880db60 Remove unused pubkey::Pubkey imports 2020-10-21 19:08:13 -07:00
Michael Vines
7bc073defe Run codemod --extensions rs Pubkey::new_rand solana_sdk::pubkey::new_rand 2020-10-21 19:08:13 -07:00
carllin
e6b821c392 Finer grained AccountsIndex locking (#12787) 
Co-authored-by: Carl Lin <carl@solana.com>
 2020-10-21 17:05:27 -07:00
carllin
c8fc0a6ba1 Don't hold dashmap write lock in store create (#13007) 
Co-authored-by: Carl Lin <carl@solana.com>
 2020-10-21 12:54:09 -07:00
Michael Vines
6858950f76 Remove frozen ABI modules from solana-sdk 2020-10-20 16:11:30 -07:00
sakridge
456eae6ccb Calculate accounts hash async in accounts background service (#12852) 2020-10-19 09:48:29 -07:00
sakridge
4f6ebbdbe0 Add timings for store accounts (#12882) 2020-10-15 12:14:39 -07:00
carllin
f8d338c9cb Switch accounts storage lock to DashMap (#12126) 
Co-authored-by: Carl Lin <carl@solana.com>
 2020-10-13 18:29:50 -07:00
carllin
16d45b8480 Fix zero-lamport accounts preventing slot cleanup (#12606) 
Co-authored-by: Carl Lin <carl@solana.com>
 2020-10-09 12:40:08 -07:00
carllin
adf6f748c0 Disable rent in flaky test (#12658) 
* Disable rent in test

Co-authored-by: Carl Lin <carl@solana.com>
 2020-10-03 12:44:03 -07:00