gaspersic/solana
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
14,715 Commits 81 Branches 357 Tags
08eafe1e8a76620d12a79c43f7780512536f2e07
Commit Graph

115 Commits

Author SHA1 Message Date
Jeff Washington (jwash)
f9fccdee85 remove unnecessary copies from accounts index code paths (#18196) 2021-06-24 17:56:25 -05:00
Jeff Washington (jwash)
4b314be5bd rework dirty_pubkeys from insert_new_if_missing_into_primary_index (#18200) 2021-06-24 14:52:11 -05:00
sakridge
3b1738c000 Keep track of dirty stores on remove accounts to clean (#17601) 
* Keep track of dirty stores on remove accounts to clean

and not zero_lamport key set

* Only dirty when count==0?

* Add another clean
 2021-06-23 10:28:35 +02:00
Lijun Wang
ccf6b21bf8 Removed unused purged_slots in purge_older_root_entries (#18102) 
Removed unused purged_slots in purge_older_root_entries
 2021-06-22 15:27:37 -07:00
Alexander Meißner
6514096a67 chore: cargo +nightly clippy --fix -Z unstable-options 2021-06-18 10:42:46 -07:00
Jeff Washington (jwash)
0a81c37fce introduce LockMapType for accounts_index (#18021) 2021-06-17 14:41:52 -05:00
carllin
ccc013e134 Handle removing slots during account scans (#17471) 2021-06-14 21:04:01 -07:00
sakridge
c2191d885d Fix accounts index panic in purge_exact (#17757) 2021-06-14 16:10:26 +02:00
Jeff Washington (jwash)
d4cc975fe9 calculate_capitalization uses hash calculation (#17443) 
* calculate_capitalization uses hash calculation

* feedback

* remove debugging code, clean up slot math
 2021-06-14 08:53:07 -05:00
Jeff Washington (jwash)
58fe1d0764 add min to roots_tracker (#17806) 2021-06-08 08:32:16 -06:00
sakridge
14c52ab018 Skip shrink when it doesn't save anything (#17405) 2021-06-02 09:51:46 +02:00
Jeff Washington (jwash)
8924fbf6a0 RollingBitField: bug fixes and add tests (#17525) 
* RollingBitField: bug fixes and add tests

* respond to feedback
 2021-05-28 16:33:07 +00:00
sakridge
49402b7d82 Only add keys with multiple index entries to the clean set (#17473) 2021-05-27 16:31:24 +02:00
carllin
d8bc56fa51 Refactor purge_slots_from_cache_and_store() and handle_reclaims() (#17319) 2021-05-24 13:51:17 -07:00
Jeff Washington (jwash)
3f3324231d Hold read lock during startup shrink (#17309) 
* hold read lock during account scan of shrink

* rename and improve rusty
 2021-05-21 13:59:32 -05:00
Jeff Washington (jwash)
8143ee5502 add AccountsIndex AccountMapsReadLock type (#17365) 2021-05-21 10:02:14 -05:00
Jeff Washington (jwash)
33ab9c4e8d batch insert account_index items in generate_index (#17290) 2021-05-20 10:29:13 -05:00
Jeff Washington (jwash)
32ec8341f9 generate_index inserts ideal initial data (#17247) 
* improve insert into map initially

* rework towards single code path

* rename

* update test
 2021-05-19 16:21:24 -05:00
Jeff Washington (jwash)
ed9cbd50f0 move Ancestors to its own module (#17316) 2021-05-19 11:50:34 -05:00
Jeff Washington (jwash)
4788976517 rework slot list update (#17232) 2021-05-19 08:48:46 -05:00
Jeff Washington (jwash)
a3c0833a1c tests: cleanup test (#17305) 
* tests: cleanup test

* 2 more replacements
 2021-05-18 18:08:37 -05:00
Jeff Washington (jwash)
d1db5448b9 hold lock to speed up insert (#17194) 
* hold lock to speed up insert

* add tests
 2021-05-17 11:58:33 -05:00
Jeff Washington (jwash)
3745e0babc minor refactoring of AccountsIndex in preparation of bigger things (#17237) 2021-05-14 15:27:10 -05:00
carllin
239ab8799c Remove bloat from secondary indexes (#17048) 2021-05-12 15:29:30 -07:00
Jeff Washington (jwash)
7d96f78821 include/exclude keys on account secondary index (#17110) 
* AccountSecondaryIndexes.include/exclude

* use normal scan if key is not indexed

* add a test to ask for a scan for an excluded secondary index

* fix up cli args
 2021-05-11 22:06:22 +00:00
Jeff Washington (jwash)
f39dda00e0 type AccountSecondaryIndexes = HashSet (#17108) 2021-05-10 14:22:48 +00:00
Jeff Washington (jwash)
a6a1355b80 fix secondary index test (#17111) 2021-05-10 08:54:30 -05:00
Jeff Washington (jwash)
dc0429f5e6 add metric for assumption (#17061) 2021-05-06 15:04:13 -05:00
Jeff Washington (jwash)
ffbe8906ed get root lock once (#16829) 2021-05-05 15:17:45 -05:00
Brooks Prumo
17e6bd579f Clean unrooted dropped banks (#16580) (#16911) 
In a scenario where a bank is unrooted and dropped, any keys that exist
_only_ in that bank are now cleaned up.

This work was originally based on PR #15106.
 2021-04-30 15:34:38 -05:00
Jeff Washington (jwash)
23d67e4ac7 stretchy roots tracker (#16830) 
* stretchy roots tracker

* rename hash to hash_set in tests

* update comment

* try 2 widths in test

* bool iter

* add assert

* helper function for bitfield insert/remove

* introduce RollingBitFieldTester

* another bool iter replacement

* map cleanup

* map to cloned
 2021-04-29 09:11:28 -05:00
Jeff Washington (jwash)
9070191b8b stats on clean for removing roots (#16849) 
* stats on clean for removing roots

* rename

* accumulate and swap metrics
 2021-04-28 13:24:01 -05:00
Jeff Washington (jwash)
47ca7063f2 rootstracker.remove returns previous state (#16831) 2021-04-27 09:15:44 -05:00
Jeff Washington (jwash)
1cc9a1c0eb log roots range metric (#16636) 
* log roots range metric

* rename
 2021-04-23 16:09:39 +00:00
Jeff Washington (jwash)
91be2903da Reduce account index lookups during clean (#16689) 
* reduce account index lookups in clean

* rename

* rename enum

* hold locks during removal from zero pubkey list

* merge with zero lamport fix

* tests
 2021-04-23 09:33:14 -05:00
Jeff Washington (jwash)
9852572eb9 increase rolling slot width to 4M (#16583) 2021-04-20 21:18:15 -05:00
Jeff Washington (jwash)
015bc034a5 improve failing assert (#16581) 2021-04-19 08:55:01 -05:00
Michael Vines
a911ae00ba clippy 2021-04-18 20:55:02 -07:00
carllin
d747614b27 Account for possibility of cache flush in load() (#15454) 
* Account for possibility of cache flush in load()

* More cleaning

* More cleaning

* Remove unused method and some comment cleaning

* Fix typo

* Make the detected impossible purge race panic()!

* Finally revert to original .expect()

* Fix typos...

* Add assertion for max_root for easier reasoning

* Reframe races with LoadHint as possible opt.

* Fix test

* Make race bug tests run longer for less flaky

* Delay the clone-in-lock slow path even for RPC

* Make get_account panic-free & add its onchain ver.

* Fix rebase conflicts...

* Clean up

* Clean up comment

* Revert fn name change

* Fix flaky test...

* fmt...

Co-authored-by: Ryo Onodera <ryoqun@gmail.com>
 2021-04-17 00:23:32 +09:00
Jeff Washington (jwash)
105a6bfb46 Replace RootsTracker HashSet (#16310) 
* Replace RootsTracker HashSet

* use bitvec

* cleanup, add brenchmark test

* test cleanup

* add lots of tests

* get rid of demo

* change warp test constant

* get rid of unused function

* pr feedback

* reorder use

* rework get_all to remove range checks

* add tests, fix bugs
 2021-04-12 12:11:33 -05:00
Jeff Washington (jwash)
7ba3e710d3 latest_slot uses > current_max (#16374) 2021-04-12 10:52:24 -05:00
Jeff Washington (jwash)
6930a77a0f prepare replace Ancestors HashMap for performance (#16476) 2021-04-12 10:51:57 -05:00
Jeff Washington (jwash)
95dc7b5449 reduce lock contention on latest_root (#16306) 2021-04-05 11:35:14 -05:00
Jeff Washington (jwash)
7a997759fa reduce locking on get_rooted_entries (#16304) 2021-04-05 11:26:53 -05:00
Jeff Washington (jwash)
8a3135d17b Account->AccountSharedData (#15691) 2021-03-09 15:06:07 -06:00
Greg Fitzgerald
edd159e7d7 Fix typos (#15721) 2021-03-05 07:16:53 +00:00
Greg Fitzgerald
2463cc1e6a Fix typos (#15610) 2021-03-02 06:36:49 -08:00
carllin
e4d0d4bfae Fix pubkey refcount for shrink + clean (#14987) 2021-02-04 12:44:19 -08:00
sakridge
e5225b7e68 Add ref count from storage (#15078) 2021-02-04 09:11:05 -08:00
carllin
2970b59853 Don't load all accounts into memory for capitalization check (#14957) 
* Don't load all accounts into memory for capitalization check
 2021-02-03 15:00:42 -08:00