solana/src at 3252dc7203cc44e08044a9f56f8b89a32b7a151f - solana - Source Code Repository

gaspersic/solana

Files

History

behzad nouri 3252dc7203 uses structural sharing for stake-delegations hash-map (#23585 )

StakeDelegations is using Arc to implement copy-on-write semantics:
https://github.com/solana-labs/solana/blob/58c0db970/runtime/src/stake_delegations.rs#L14-L16

However a single delegation change will still clone the entire hash-map,
resulting in excessive memory use as observed in:
https://github.com/solana-labs/solana/issues/23061#issuecomment-1063444072

This commit instead uses immutable hash-map implementing structural
sharing:
> which means that if two data structures are mostly copies of each
> other, most of the memory they take up will be shared between them.
https://docs.rs/im/latest/im/

2022-03-16 12:58:05 +00:00

..

Rename AccountsDb plugins to Geyser plugins (#23604 )

2022-03-14 19:18:46 -06:00

Refactor: Sanitized transaction creation (#23558 )

2022-03-15 12:02:22 +08:00

uses structural sharing for stake-delegations hash-map (#23585 )

2022-03-16 12:58:05 +00:00

Move ArchiveFormat into own module (#23562 )

2022-03-09 16:09:34 -06:00

account_info.rs

assert on AcctInfo.store_id with cached store (#21952 )

2022-02-15 15:22:36 -06:00

account_rent_state.rs

Resized accounts must be rent exempt

2022-03-02 13:02:02 -08:00

accounts_background_service.rs

cleanup api (#22845 )

2022-01-31 11:39:23 -06:00

accounts_cache.rs

Reformat imports to a consistent style for imports

2021-12-03 09:19:13 -08:00

accounts_db.rs

avoid data copies in writing to cache (#23674 )

2022-03-15 16:42:26 -05:00

accounts_hash.rs

clippy (#23310 )

2022-02-23 18:07:00 -06:00

accounts_index_storage.rs

AcctIdx: resize in-mem after startup for disk index (#21676 )

2021-12-08 16:52:22 -06:00

accounts_index.rs

allow index update to change storage slot # (#23311 )

2022-03-03 08:40:48 -06:00

accounts_update_notifier_interface.rs

Refactor slot status notification to decouple from accounts notifications (#21308 )

2021-11-17 17:11:38 -08:00

accounts.rs

Banking Stage drops transactions that'll exceed the total account data size limit (#23537 )

2022-03-13 15:58:57 +00:00

active_stats.rs

add ActiveStats to track when long running, expensive bg processes are running (#22608 )

2022-01-21 10:51:23 -06:00

ancestors.rs

clarify that RollingBitField max is exclusive (#22947 )

2022-02-07 13:40:31 -06:00

append_vec.rs

fix memory ordering in append_vec (#23215 )

2022-02-20 20:30:49 -06:00

bank_client.rs

Add quic-client module (#23166 )

2022-03-09 21:33:05 -05:00

bank_forks.rs

Pacify clippy

2022-01-21 19:12:57 -08:00

bank_utils.rs

Refactor: move simple vote parsing to runtime (#22537 )

2022-01-20 10:39:21 +08:00

bank.rs

uses structural sharing for stake-delegations hash-map (#23585 )

2022-03-16 12:58:05 +00:00

block_cost_limits.rs

Banking Stage drops transactions that'll exceed the total account data size limit (#23537 )

2022-03-13 15:58:57 +00:00

blockhash_queue.rs

clippy (#23563 )

2022-03-09 15:33:50 -06:00

bucket_map_holder_stats.rs

AcctIdx: items() uses held ranges (#21954 )

2021-12-17 09:59:29 -06:00

bucket_map_holder.rs

AcctIdx: env var "SOLANA_TEST_ACCOUNTS_INDEX_MEMORY_LIMIT_MB" (#23194 )

2022-02-22 09:40:12 -06:00

builtins.rs

followup safety checks for #23295

2022-02-24 17:50:58 -07:00

cache_hash_data_stats.rs

cache account hash info (#19426 )

2021-09-13 20:39:26 -05:00

cache_hash_data.rs

minor cleanup (#22610 )

2022-01-20 18:11:00 -06:00

commitment.rs

Set the correct root in block commitment cache initialization (#22750 )

2022-01-27 00:48:00 +08:00

contains.rs

More generic accounts purge functions (#14595 )

2021-01-17 20:31:03 -08:00

cost_model.rs

make upsert infallible op

2022-03-15 17:05:41 -05:00

cost_tracker.rs

Refactor: Sanitized transaction creation (#23558 )

2022-03-15 12:02:22 +08:00

epoch_stakes.rs

Reformat imports to a consistent style for imports

2021-12-03 09:19:13 -08:00

execute_cost_table.rs

make upsert infallible op

2022-03-15 17:05:41 -05:00

genesis_utils.rs

Fix builtin handling on epoch boundaries (#23256 )

2022-02-22 20:54:08 +08:00

hardened_unpack.rs

(LedgerStore) Use different path for different blockstore storage type. (#23236 )

2022-03-02 18:30:22 -08:00

in_mem_accounts_index.rs

Add FlushGuard to ensure flushing_active is used safely (#23571 )

2022-03-14 10:35:00 -05:00

inline_spl_associated_token_account.rs

spl-associated-token-account: Add feature for new program (#22648 )

2022-01-24 22:54:41 +01:00

inline_spl_token_2022.rs

accounts_index: Add SPL Token account indexing for token-2022 accounts (#23043 )

2022-02-16 16:23:25 -08:00

inline_spl_token.rs

accounts_index: Add SPL Token account indexing for token-2022 accounts (#23043 )

2022-02-16 16:23:25 -08:00

lib.rs

uses structural sharing for stake-delegations hash-map (#23585 )

2022-03-16 12:58:05 +00:00

loader_utils.rs

Reformat imports to a consistent style for imports

2021-12-03 09:19:13 -08:00

message_processor.rs

Add fees to tx-wide caps (#22081 )

2022-02-11 16:23:16 -08:00

non_circulating_supply.rs

Cleanup activated rent_for_sysvars feature (#22454 )

2022-01-14 20:34:09 +08:00

nonce_keyed_account.rs

Revert: KeyedAccount refactoings in builtin programs (#23649 )

2022-03-16 11:30:01 +01:00

pubkey_bins.rs

AcctIdx: support 2^24 bins (#20739 )

2021-10-18 14:05:16 -05:00

read_only_accounts_cache.rs

optimizes ReadOnlyAccountsCache LRU eviction implementation (#22403 )

2022-01-11 17:25:28 +00:00

rent_collector.rs

new counter data point for unexpected rent_epoch (#23449 )

2022-03-03 09:09:31 -06:00

secondary_index.rs

Reformat imports to a consistent style for imports

2021-12-03 09:19:13 -08:00

serde_snapshot.rs

fix typo (#23535 )

2022-03-08 18:28:00 -06:00

shared_buffer_reader.rs

Reformat imports to a consistent style for imports

2021-12-03 09:19:13 -08:00

snapshot_archive_info.rs

Separate remotely downloaded snapshot archives (#23510 )

2022-03-14 14:03:59 -05:00

snapshot_config.rs

Reformat imports to a consistent style for imports

2021-12-03 09:19:13 -08:00

snapshot_hash.rs

SnapshotPackagerService pushes incremental snapshot hashes to CRDS (#20442 )

2021-10-08 15:14:56 -05:00

snapshot_package.rs

convert std::sync::mpsc to crossbeam_channel (#22264 )

2022-01-11 02:44:46 -08:00

snapshot_utils.rs

fix logging: only walk remote dir if it exist (#23663 )

2022-03-15 08:56:22 -05:00

sorted_storages.rs

Add rustfmt.toml and cargo fmt (#23238 )

2022-02-19 13:32:29 +08:00

stake_history.rs

Add rustfmt.toml and cargo fmt (#23238 )

2022-02-19 13:32:29 +08:00

stake_weighted_timestamp.rs

Reformat imports to a consistent style for imports

2021-12-03 09:19:13 -08:00

stakes.rs

uses structural sharing for stake-delegations hash-map (#23585 )

2022-03-16 12:58:05 +00:00

status_cache.rs

Remove unnecessary & from AsRef params (#22523 )

2022-01-15 04:51:05 +00:00

storable_accounts.rs

slot per account in StorableAccounts (#23313 )

2022-02-24 10:34:38 -06:00

system_instruction_processor.rs

Revert: KeyedAccount refactoings in builtin programs (#23649 )

2022-03-16 11:30:01 +01:00

transaction_batch.rs

Revert "Count compute units even when transaction errors (#22059 )" (#22174 )

2021-12-30 02:42:32 -05:00

transaction_cost_metrics_sender.rs

Add hidden cli option to allow validator reports replayed transaction cost metrics (#22369 )

2022-01-15 00:31:21 +00:00

vote_account.rs

Deserialize accounts before acquiring stakes cache lock (#21733 )

2021-12-10 16:02:35 -05:00

vote_parser.rs

Add rustfmt.toml and cargo fmt (#23238 )

2022-02-19 13:32:29 +08:00

vote_sender_types.rs

Refactor: move simple vote parsing to runtime (#22537 )

2022-01-20 10:39:21 +08:00

vote_transaction.rs

Refactor: move simple vote parsing to runtime (#22537 )

2022-01-20 10:39:21 +08:00

waitable_condvar.rs

Reformat imports to a consistent style for imports

2021-12-03 09:19:13 -08:00