solana/core/src/lib.rs

//! The `solana` library implements the Solana high-performance blockchain architecture.
//! It includes a full Rust implementation of the architecture (see
//! [Validator](server/struct.Validator.html)) as well as hooks to GPU implementations of its most
//! paralellizable components (i.e. [SigVerify](sigverify/index.html)).  It also includes
//! command-line tools to spin up validators and a Rust library
//!

pub mod bank_forks;
pub mod banking_stage;
#[macro_use]
pub mod blocktree;
pub mod broadcast_stage;
pub mod chacha;
pub mod chacha_cuda;
pub mod cluster_info_vote_listener;
pub mod confidence;
pub mod perf_libs;
pub mod recycler;
pub mod shred_fetch_stage;
#[macro_use]
pub mod contact_info;
pub mod blockstream;
pub mod blockstream_service;
pub mod blocktree_processor;
pub mod cluster_info;
pub mod cluster_info_repair_listener;
pub mod consensus;
pub mod crds;
pub mod crds_gossip;
pub mod crds_gossip_error;
pub mod crds_gossip_pull;
pub mod crds_gossip_push;
pub mod crds_value;
pub mod cuda_runtime;
pub mod entry;
pub mod erasure;
pub mod fetch_stage;
pub mod gen_keys;
pub mod genesis_utils;
pub mod gossip_service;
pub mod leader_schedule;
pub mod leader_schedule_cache;
pub mod leader_schedule_utils;
pub mod ledger_cleanup_service;
pub mod local_vote_signer_service;
pub mod packet;
pub mod poh;
pub mod poh_recorder;
pub mod poh_service;
pub mod recvmmsg;
pub mod repair_service;
pub mod replay_stage;
pub mod replicator;
pub mod result;
pub mod retransmit_stage;
pub mod rpc;
pub mod rpc_pubsub;
pub mod rpc_pubsub_service;
pub mod rpc_service;
pub mod rpc_subscriptions;
pub mod sendmmsg;
pub mod service;
pub mod shred;
pub mod sigverify;
pub mod sigverify_stage;
pub mod snapshot_package;
pub mod snapshot_utils;
pub mod staking_utils;
pub mod storage_stage;
pub mod streamer;
pub mod test_tx;
pub mod tpu;
pub mod tvu;
pub mod validator;
pub(crate) mod version;
pub mod weighted_shuffle;
pub mod window_service;

#[macro_use]
extern crate dlopen_derive;

#[macro_use]
extern crate solana_budget_program;

extern crate solana_storage_program;

#[cfg(test)]
#[macro_use]
extern crate hex_literal;

#[macro_use]
extern crate log;

#[macro_use]
extern crate serde_derive;

#[cfg(test)]
#[macro_use]
extern crate serde_json;

#[macro_use]
extern crate solana_metrics;

#[cfg(test)]
#[macro_use]
extern crate matches;

extern crate bzip2;
extern crate crossbeam_channel;
extern crate dir_diff;
extern crate fs_extra;
extern crate symlink;
extern crate tar;
extern crate tempfile;
Better docs for the bank 2018-06-06 09:49:22 -06:00			//! The `solana` library implements the Solana high-performance blockchain architecture.
Cleanup top-level lib doc 2018-06-07 14:51:29 -06:00			`//! It includes a full Rust implementation of the architecture (see`
More fullnode -> validator renaming (#4414) * s/fullnode_config/validator_config/g * s/FullnodeConfig/ValidatorConfig/g * mv core/lib/fullnode.rs core/lib/validator.rs * s/Fullnode/Validator/g * Add replicator-x.sh * Rename fullnode.md to validator.md * cargo fmt 2019-05-23 22:05:16 -07:00			`//! [Validator](server/struct.Validator.html)) as well as hooks to GPU implementations of its most`
Cleanup top-level lib doc 2018-06-07 14:51:29 -06:00			`//! paralellizable components (i.e. [SigVerify](sigverify/index.html)). It also includes`
More fullnode to validator renaming (#6337) 2019-10-11 13:30:52 -06:00			`//! command-line tools to spin up validators and a Rust library`
Better docs for the bank 2018-06-06 09:49:22 -06:00			`//!`

Add a way to make a DAG of checkpointed Banks 2019-02-16 20:58:07 -07:00			`pub mod bank_forks;`
Extract event processing from request_stage 2018-05-14 17:31:13 -06:00			`pub mod banking_stage;`
Broadcast final shred for slots that are interrupted (#6269) * Broadcast final shred for slots that are interrupted 2019-10-09 16:07:18 -07:00			`#[macro_use]`
			`pub mod blocktree;`
Rename BroadcastService back to BroadcastStage 2019-03-01 20:43:30 -07:00			`pub mod broadcast_stage;`
Add chacha module to encrypt ledger files 2018-09-27 10:48:40 -07:00			`pub mod chacha;`
Initial validator code for rust side hooks for chacha cuda parallel encrypt 2018-10-08 13:12:33 -07:00			`pub mod chacha_cuda;`
Push and query the ClusterInfo for votes. (#2622) 2019-02-01 05:21:29 +05:30			`pub mod cluster_info_vote_listener;`
Offload remaining confidence cache computation to separate thread (#5792) * Move remaining confidence cache computation to separate thread * Move confidence cache out of bank forks 2019-09-04 23:10:25 -07:00			`pub mod confidence;`
Remove CUDA feature (#6094) 2019-09-26 13:36:51 -07:00			`pub mod perf_libs;`
Page-pin packet memory for cuda (#4250) * Page-pin packet memory for cuda Bring back recyclers and pin offset buffers * Add packet recycler to streamer * Add set_pinnable to sigverify vecs to pin them * Add packets reset test * Add test for recycler and reduce the gc lock critical section * Add comments/tests to cuda_runtime * Add recycler to recv_blobs path. * Add trace/names for debug and PacketsRecycler to bench-streamer * Predict realloc and unpin beforehand. * Add helper to reserve and pin * Cap buffered packets length * Call cuda wrapper functions 2019-06-27 09:32:32 +02:00			`pub mod recycler;`
BlobFetchStage cleanup post shred work (#6254) 2019-10-07 11:08:01 -07:00			`pub mod shred_fetch_stage;`
Remove CrdsValue::LeaderId 2019-03-08 19:28:19 -08:00			`#[macro_use]`
			`pub mod contact_info;`
Switch blockstream_service to create_new_tmp_ledger! 2019-02-28 07:46:42 -08:00			`pub mod blockstream;`
			`pub mod blockstream_service;`
Extract process_ledger from Bank Fullnode was the only real consumer of process_ledger and it was only there to process a Blocktree. Blocktree is a tree, and a ledger is a sequence, so something's clearly not right here. Drop all other dependencies on process_ledger (only one test) so that it can be fixed up in isolation. 2019-02-16 03:26:21 -07:00			`pub mod blocktree_processor;`
Add scalable gossip library (#1546) * Cluster Replicated Data Store Separate the data storage and merge strategy from the network IO boundary. Implement an eager push overlay for transporting recent messages. Simulation shows fast convergence with 20k nodes. 2018-11-15 13:23:26 -08:00			`pub mod cluster_info;`
Implement listener for serving repairs through Repairman protocol (#4306) * Make listener for serving repairs through Repairman protocol 2019-05-23 03:10:16 -07:00			`pub mod cluster_info_repair_listener;`
tower consensus naming (#4598) s/locktower/tower/g 2019-06-24 13:41:23 -07:00			`pub mod consensus;`
Broadcast final shred for slots that are interrupted (#6269) * Broadcast final shred for slots that are interrupted 2019-10-09 16:07:18 -07:00			`pub mod crds;`
			`pub mod crds_gossip;`
			`pub mod crds_gossip_error;`
			`pub mod crds_gossip_pull;`
			`pub mod crds_gossip_push;`
			`pub mod crds_value;`
Page-pin packet memory for cuda (#4250) * Page-pin packet memory for cuda Bring back recyclers and pin offset buffers * Add packet recycler to streamer * Add set_pinnable to sigverify vecs to pin them * Add packets reset test * Add test for recycler and reduce the gc lock critical section * Add comments/tests to cuda_runtime * Add recycler to recv_blobs path. * Add trace/names for debug and PacketsRecycler to bench-streamer * Predict realloc and unpin beforehand. * Add helper to reserve and pin * Cap buffered packets length * Call cuda wrapper functions 2019-06-27 09:32:32 +02:00			`pub mod cuda_runtime;`
Move entry into its own module Hmm, Logger doesn't depend on log. 2018-03-06 17:31:17 -07:00			`pub mod entry;`
improve the error messages 2018-04-21 21:12:57 +08:00			`pub mod erasure;`
Finally made fetch happen 2018-05-29 11:18:12 -06:00			`pub mod fetch_stage;`
Rename the module that now contains only GenKeys 2019-01-25 22:58:35 -07:00			`pub mod gen_keys;`
rework genesis (passive staking groundwork) (#4187) * rework genesis * fixup 2019-05-07 11:16:22 -07:00			`pub mod genesis_utils;`
Rename Ncp to GossipService And BroadcastStage to BroadcastService since it's not included in the TPU pipeline. 2018-12-06 13:52:47 -07:00			`pub mod gossip_service;`
Hoist new leader scheduler up to protocol level Attempt to feel similar to LeaderScheduler to easy migration. 2019-02-26 08:44:24 -07:00			`pub mod leader_schedule;`
Add a cache for leader schedules (#3841) * Add a cache for leader schedules 2019-04-19 02:39:44 -07:00			`pub mod leader_schedule_cache;`
Make leader_schedule a utitlity module named leader_schedule_utils (#2988) 2019-02-27 14:41:46 -08:00			`pub mod leader_schedule_utils;`
Drop older slots in the ledger (#5188) * Add facility to delete blocktree columns in range * Add ledger cleanup service * Add local_cluster test 2019-07-20 13:13:55 -07:00			`pub mod ledger_cleanup_service;`
Refactor vote signer code (#2368) * Refactor vote signer code * fixed test compilation errors * address clippy errors * fix missing macro_use * move macro use * review comments 2019-01-10 09:21:38 -08:00			`pub mod local_vote_signer_service;`
Change for cuda verify integration 2018-03-26 21:07:11 -07:00			`pub mod packet;`
step one of lastidnotfound: record_stage->record_service, trim recorder to hashes (#1281) step one of lastidnotfound * record_stage->record_service, trim recorder to hashes * doc updates, hash multiple without alloc() cc #1171 2018-09-20 15:02:24 -07:00			`pub mod poh;`
Synchronize PoH, bank last_id queue and ledger entry channel. PoH, bank's last_id queue and the Entry channel need to have a synchronized order of ids. 2018-09-26 05:52:13 -07:00			`pub mod poh_recorder;`
Create Poh Service (#1604) * Create new Poh Service, replace tick generation in BankingStage 2018-10-25 14:56:21 -07:00			`pub mod poh_service;`
Implements recvmmsg() for UDP packets (#1161) * Implemented recvmmsg() for UDP packets - This change implements binding between libc API for recvmmsg() - The function can receive multiple packets using one system call Fixes #1141 * Added unit tests for recvmmsg() * Added recv_mmsg() wrapper for non Linux OS * Address review comments for recvmmsg() * Remove unnecessary imports * Moved target specific dependencies to the function 2018-09-13 14:41:28 -07:00			`pub mod recvmmsg;`
Support multiple forks in the ledger (#2277) * Modify db_ledger to support per_slot metadata, add signal for updates, and add chaining to slots in db_ledger * Modify replay stage to ask db_ledger for updates based on slots * Add repair send/receive metrics * Add repair service, remove old repair code * Fix tmp_copy_ledger and setup for tests to account for multiple slots and tick limits within slots 2019-02-07 15:10:54 -08:00			`pub mod repair_service;`
Free up the term 'replicate' for exclusive use in replicator Also, align Sockets field names with ContactInfo. 2018-12-07 15:09:29 -07:00			`pub mod replay_stage;`
Placeholder storage contract and replicator client (#1286) * Add hooks for executing the storage contract * Add store_ledger stage Similar to replicate_stage but no voting/banking stuff, just convert blobs to entries and write the ledger out * Add storage_addr to tests and add new NodeInfo constructor to reduce duplication... 2018-09-21 15:32:15 -07:00			`pub mod replicator;`
Fast UdpSocket reader * message needs to fit into 256 bytes * allocator to keep track of blocks of messages * udp socket receiver server that fills up the block as fast as possible * udp socket sender server that sends out the block as fast as possible 2018-03-07 13:47:13 -08:00			`pub mod result;`
Rename WindowStage to RetransmitStage The window is used for both broadcasting from leader to validator and retransmitting between validators. 2018-08-09 13:03:34 -06:00			`pub mod retransmit_stage;`
Implement json-rpc functionality 2018-08-10 17:05:23 -06:00			`pub mod rpc;`
pubsub.rs -> rpc_pubsub.rs 2018-10-12 08:17:28 -07:00			`pub mod rpc_pubsub;`
Move RpcPubSubService into its own module 2019-02-17 10:09:46 -07:00			`pub mod rpc_pubsub_service;`
Move RpcService into its own module 2019-02-17 10:29:08 -07:00			`pub mod rpc_service;`
Move RpcSubscriptions into its own module 2019-02-17 09:38:36 -07:00			`pub mod rpc_subscriptions;`
Implement sendmmsg() API (#6304) * Implement sendmmsg() * fixes 2019-10-09 17:06:56 -07:00			`pub mod sendmmsg;`
Add Service trait Added a consistent interface to all the microservices. 2018-07-03 22:14:08 -06:00			`pub mod service;`
Initial implementation of packet shredder (#5401) * Initial implementation of packet shredder * tests * clippy * review comments 2019-08-02 15:53:42 -07:00			`pub mod shred;`
Rename sigverify modules 2018-05-25 16:52:17 -06:00			`pub mod sigverify;`
			`pub mod sigverify_stage;`
Snapshot Packaging Service (#5262) * Snapshot serialization and packaging 2019-07-31 17:58:10 -07:00			`pub mod snapshot_package;`
			`pub mod snapshot_utils;`
Add get_supermajority_slot() function (#2976) * Moved supermajority functions into new module, staking_utils * Move staking functions out of bank, and into staking_utils, change get_supermajority_slot to only use state from epoch boundary * Move bank slot height in staked_nodes_at_slot() to be bank id 2019-02-28 13:15:25 -08:00			`pub mod staking_utils;`
Add storage stage which does storage mining verification for validators 2018-10-08 13:12:33 -07:00			`pub mod storage_stage;`
Nightly rustfmt Format code with the nightly version of rustfmt, which sorts imports. 2018-03-26 22:03:26 -06:00			`pub mod streamer;`
Move system_transaction out of src/ 2018-12-04 15:37:11 -08:00			`pub mod test_tx;`
Add TPU 2018-05-14 17:36:19 -06:00			`pub mod tpu;`
Move validation processor to its own module 2018-05-12 00:31:32 -06:00			`pub mod tvu;`
More fullnode -> validator renaming (#4414) * s/fullnode_config/validator_config/g * s/FullnodeConfig/ValidatorConfig/g * mv core/lib/fullnode.rs core/lib/validator.rs * s/Fullnode/Validator/g * Add replicator-x.sh * Rename fullnode.md to validator.md * cargo fmt 2019-05-23 22:05:16 -07:00			`pub mod validator;`
Rpc to return software version (#5456) * Add getSoftwareVersion rpc * Add getSoftwareVersion to doc * Rename to getVersion and return object * Update jsonrpc-api.md 2019-08-07 20:06:27 -06:00			`pub(crate) mod version;`
Add random distribution for avalanche peers (#4493) * Add random distribution for avalanche peers * fix clippy warnings * bug fixes * nits 2019-06-01 07:55:43 -07:00			`pub mod weighted_shuffle;`
Split window into two modules 2018-09-07 16:00:26 -06:00			`pub mod window_service;`
cargo +nightly fix --features=bpf_c,cuda,erasure,chacha --edition-idioms 2018-12-08 22:44:20 -07:00
Remove CUDA feature (#6094) 2019-09-26 13:36:51 -07:00			`#[macro_use]`
			`extern crate dlopen_derive;`

get program names from programs (#4273) * get program names from programs * fixup 2019-05-14 10:44:16 -07:00			`#[macro_use]`
			`extern crate solana_budget_program;`

make runtime depend on bpf_loader (#4601) * make runtime depend on bpf_loader * remove vote redundancy, move bpf_loader to genesis, export program\! from bpf_loader crate * move bpf_loader specification into genesis * bpf tests to use genesis with bpf * need to avoid depending on programs, except for macros 2019-06-11 10:27:22 -07:00			`extern crate solana_storage_program;`

Storage mining fixups... * Use IV to make unique identies * Use hex! macro for hex literal and not string converted to u8 slice * fix sha sampling to control init/end of sha state 2018-10-19 10:39:13 -07:00			`#[cfg(test)]`
			`#[macro_use]`
			`extern crate hex_literal;`
cargo +nightly fix --features=bpf_c,cuda,erasure,chacha --edition-idioms 2018-12-08 22:44:20 -07:00
Fast UdpSocket reader * message needs to fit into 256 bytes * allocator to keep track of blocks of messages * udp socket receiver server that fills up the block as fast as possible * udp socket sender server that sends out the block as fast as possible 2018-03-07 13:47:13 -08:00			`#[macro_use]`
No longer rename log crate 2018-03-19 10:18:48 -06:00			`extern crate log;`
cargo +nightly fix --features=bpf_c,cuda,erasure,chacha --edition-idioms 2018-12-08 22:44:20 -07:00
Add serialization/deseriation support to event log See bincode and serde_json for usage: https://github.com/TyOverby/bincode Fixes #1 2018-02-20 16:26:11 -07:00			`#[macro_use]`
			`extern crate serde_derive;`
switch over to passive stakes (#4295) * add failing test * switch over to passive stakes * test multiple stakers 2019-05-16 08:23:31 -07:00
			`#[cfg(test)]`
Request/reqwest improvements - Use json macro to simplify request builds - Add proxy option for reqwest to use TLS - Add rpc port options for configured nodes 2018-09-21 15:27:03 -06:00			`#[macro_use]`
Initialize the testnode from a log $ cargo run --bin silk-genesis-file-demo > demo-genesis.json $ cat demo-genesis.json \| cargo run --bin silk-genesis-block > demo-genesis.log $ cat demo-genesis.log \| cargo run --bin silk-testnode 2018-03-05 15:34:15 -07:00			`extern crate serde_json;`
cargo +nightly fix --features=bpf_c,cuda,erasure,chacha --edition-idioms 2018-12-08 22:44:20 -07:00
Move Bank to its own crate Also: * counters.rs to solana_metrics * genesis_block.rs to solana_sdk 2019-02-18 23:26:22 -07:00			`#[macro_use]`
			`extern crate solana_metrics;`

Fast UdpSocket reader * message needs to fit into 256 bytes * allocator to keep track of blocks of messages * udp socket receiver server that fills up the block as fast as possible * udp socket sender server that sends out the block as fast as possible 2018-03-07 13:47:13 -08:00			`#[cfg(test)]`
			`#[macro_use]`
			`extern crate matches;`
Change to crossbeam channel in banking_threads VerifiedReceiver (#4822) * Add crossbeam channel instead of channel in banking_stage 2019-06-26 18:42:27 -07:00
Move genesis/snapshot archive download into Rust (#5515) 2019-08-14 19:25:22 -07:00			`extern crate bzip2;`
Change to crossbeam channel in banking_threads VerifiedReceiver (#4822) * Add crossbeam channel instead of channel in banking_stage 2019-06-26 18:42:27 -07:00			`extern crate crossbeam_channel;`
Snapshot Packaging Service (#5262) * Snapshot serialization and packaging 2019-07-31 17:58:10 -07:00			`extern crate dir_diff;`
			`extern crate fs_extra;`
Snapshot optimizations (#5525) * Change serializing snapshot tar to use shell command 2019-08-14 23:14:40 -07:00			`extern crate symlink;`
Snapshot Packaging Service (#5262) * Snapshot serialization and packaging 2019-07-31 17:58:10 -07:00			`extern crate tar;`
			`extern crate tempfile;`