Commit Graph

12205 Commits

Author SHA1 Message Date
7ed513c24f Include Clock sysvar in AuthorizeWithSeed instruction
(cherry picked from commit 8359f4f5ff)
2021-01-26 08:53:20 -08:00
700478e6f8 fixes test_filter_current flakiness (#14816)
(cherry picked from commit d1df9da7d3)
2021-01-25 12:45:03 -08:00
5471f9373d Reduce ~2 GBs mem by avoiding another overalloc. (#14806) (#14819)
* Reduce few GBs mem by avoiding another overalloc.

* Use x.len() for the last item from chunks()

(cherry picked from commit 015058e0b7)

Co-authored-by: Ryo Onodera <ryoqun@gmail.com>
2021-01-25 05:47:57 +00:00
ea97d82df2 CLI: Reinstate logging, disabled by default (#14790)
(cherry picked from commit a44392048d)

Co-authored-by: Trent Nelson <trent@solana.com>
2021-01-23 04:04:30 +00:00
feb27f0add CLI: Strive for at least one signer (bp #14767) (#14778)
* CLI: Strive for at least one signer

(cherry picked from commit 8f8d593457)

* CLI: Allow missing pubkey in `--verbose` config output

(cherry picked from commit 90e1778cd2)

* CLI: Don't scare the users

(cherry picked from commit e9c98f2416)

Co-authored-by: Trent Nelson <trent@solana.com>
2021-01-22 19:46:17 +00:00
1041532c0e Rpc: Add custom error for BigTable data not found (bp #14762) (#14764)
* Rpc: Add custom error for BigTable data not found (#14762)

* Expose not-found bigtable error

* Add custom rpc error for bigtable data not found

* Return custom rpc error when bigtable block is not found

* Generalize long-term storage

(cherry picked from commit 71e9958e06)

# Conflicts:
#	client/src/rpc_custom_error.rs

* Fix conflicts

Co-authored-by: Tyera Eulberg <teulberg@gmail.com>
Co-authored-by: Tyera Eulberg <tyera@solana.com>
2021-01-22 06:09:22 +00:00
e4068cb1bc SPL token balance in transaction metadata (bp #13673) (#14752)
* SPL token balance in transaction metadata  (#13673)

* feat: store pre / post token balances

* move helper functions into separate include

* move token balance functionality to transaction-status crate

* fix blockstore processor test

* fix bigtable legacy test

* add caching to decimals

(cherry picked from commit 13db3eca9f)

# Conflicts:
#	core/src/banking_stage.rs
#	storage-proto/Cargo.toml
#	storage-proto/src/convert.rs

* resolve merges storage-proto banking_stage

* fix bpf tests with token deltas

Co-authored-by: Josh <josh.hundley@gmail.com>
2021-01-22 02:58:51 +00:00
6c0d867d87 CLI: Add calculate-rent subcommand (bp #14725) (#14758)
* cli-output: Genericize `writeln_name_value()`

(cherry picked from commit 2820d0a23d)

# Conflicts:
#	cli-output/src/display.rs

* CLI: Add `calculate-rent` subcommand

(cherry picked from commit 12410541a4)

Co-authored-by: Trent Nelson <trent@solana.com>
2021-01-22 01:31:07 +00:00
4a6f17fb2d fixes test_filter_current flakiness (bp #14749) (#14760)
* fixes test_filter_current flakiness (#14749)

(cherry picked from commit e4da6761a7)

# Conflicts:
#	core/src/crds_value.rs

* removes backport merge conflicts

Co-authored-by: behzad nouri <behzadnouri@gmail.com>
2021-01-22 01:17:59 +00:00
24665ef7fb Update bigtable confirm to use confirmation_status (#14750) (#14753)
(cherry picked from commit ca95302038)

Co-authored-by: Tyera Eulberg <teulberg@gmail.com>
2021-01-21 22:08:29 +00:00
47cf0726f9 Add signer/writable de/escalation tests (bp #14726) (#14738)
* Add signer/writable de/escalation tests (#14726)

(cherry picked from commit aa96ad042b)

# Conflicts:
#	programs/bpf/tests/programs.rs

* resolve conflicts

* nudge

Co-authored-by: Jack May <jack@solana.com>
2021-01-21 21:35:58 +00:00
53ea18d3b3 Add block_time to getConfirmedSignaturesForAddress2 and getConfirmedTransaction (bp #14572) (#14727)
* Add block_time to getConfirmedSignaturesForAddress2 and getConfirmedTransaction (#14572)

* add block_time to get_confirmed_signatures_for_address2 and protobuf implementation for tx_by_addr

* add tests for convert

* update cargo lock

* run cargo format after rebase

* introduce legacy TransactionByAddrInfo

* move LegacyTransactionByAddrInfo back to storage-bigtable

(cherry picked from commit 1de6d28eaf)

# Conflicts:
#	storage-proto/src/convert.rs

* merge storage proto convert

* fix bpf test for ConfirmedTransaction

Co-authored-by: Josh <josh.hundley@gmail.com>
2021-01-21 17:19:30 +00:00
4c2e1a5ebf Sanitize transactions more (bp #14716) (#14734)
* `solana decode-transaction` no longer panics on unsanitary transactions

(cherry picked from commit e9b5d65f40)

* Ensure sanitary transactions

(cherry picked from commit 04ce33a04e)

Co-authored-by: Michael Vines <mvines@gmail.com>
2021-01-21 09:55:54 +00:00
60999811de Add generalized voting process to enable full inflation (#14731)
(cherry picked from commit 072e5e54d8)

Co-authored-by: Michael Vines <mvines@gmail.com>
2021-01-21 09:10:44 +00:00
65bef638ba Nonce address doesn't sign AdvanceNonceAccount (#14721)
(cherry picked from commit 447e3de1f2)

Co-authored-by: Trent Nelson <trent@solana.com>
2021-01-21 05:31:05 +00:00
2b5ae54d84 Return confirmation-status (#14709) (#14714)
(cherry picked from commit 0e87572eb0)

Co-authored-by: Tyera Eulberg <teulberg@gmail.com>
2021-01-21 03:09:44 +00:00
9dd5d4407b Sanitize base58 pubkeys and sigs (bp #14708) (#14711)
* SDK: Sanitize base58 pubkey input

(cherry picked from commit 250b3969d4)

* SDK: Sanitize base58 signature input

(cherry picked from commit 2783aee483)

Co-authored-by: Trent Nelson <trent@solana.com>
2021-01-21 02:37:50 +00:00
6ae51ec5c3 Default to highest finalized block if no slot provided (#14701) (#14703)
(cherry picked from commit c64d4f7693)

Co-authored-by: Tyera Eulberg <teulberg@gmail.com>
2021-01-20 22:16:20 +00:00
ad89be3c85 Cli: promote commitment to a global arg + config.yml (bp #14684) (#14697)
* Cli: promote commitment to a global arg + config.yml (#14684)

* Make commitment a global arg

* Add commitment to solana/cli/config.yml

* Fixup a couple Display/Verbose bugs

(cherry picked from commit a7086a0f83)

# Conflicts:
#	cli/src/program.rs

* Fix conflicts

Co-authored-by: Tyera Eulberg <teulberg@gmail.com>
Co-authored-by: Tyera Eulberg <tyera@solana.com>
2021-01-20 19:39:45 +00:00
5d2bd179b1 Bump version to 1.4.25 2021-01-20 05:47:10 +00:00
c44330d16f Bail on small deploy buffers (bp #14677) (#14681)
* Bail on small deploy buffers (#14677)

(cherry picked from commit a480b63234)

# Conflicts:
#	sdk/program/src/loader_upgradeable_instruction.rs

* resolve conflicts

Co-authored-by: Jack May <jack@solana.com>
v1.4.24
2021-01-20 03:20:41 +00:00
540e23c987 Prevent the invoke and upgrade of programs in the same tx batch (bp #14653) (#14679)
* Prevent the invoke and upgrade of programs in the same tx batch (#14653)

* Prevent the invoke and upgrade of programs in the same tx batch

* Pass program address as writable in the upgrade instruction

(cherry picked from commit e3bd9e5300)

# Conflicts:
#	programs/bpf/Cargo.lock
#	programs/bpf/Cargo.toml
#	programs/bpf/tests/programs.rs

* fix conflicts

Co-authored-by: Jack May <jack@solana.com>
2021-01-19 18:28:23 -08:00
702a353d71 Cli: default to single gossip (bp #14673) (#14675)
* Use singleGossip for program deployment

* Cli: default to single gossip (#14673)

* Init cli RpcClient with chosen commitment; default to single_gossip

* Fill in missing client methods

* Cli tests: make RpcClient commitment specific

* Simply rpc_client calls, using configured commitment

* Check validator vote account with single-gossip commitment

(cherry picked from commit 4964b0fe61)

Co-authored-by: Michael Vines <mvines@gmail.com>
Co-authored-by: Tyera Eulberg <teulberg@gmail.com>
2021-01-20 00:36:20 +00:00
afa1905cda Configure Bigtable's timeout, enabling by default (#14657) (#14668)
* Configure bigtable's timeout when read-only

* Review comments

* Apply nits (thanks!)

Co-authored-by: Michael Vines <mvines@gmail.com>

* Timeout in the streamed decoding as well

Co-authored-by: Michael Vines <mvines@gmail.com>
(cherry picked from commit dcaa025822)

Co-authored-by: Ryo Onodera <ryoqun@gmail.com>
2021-01-19 15:36:32 +00:00
cd8c12c749 Improve docs around bigtable read limit (#14660) (#14661)
(cherry picked from commit 2eb19fa5e5)

Co-authored-by: Tyera Eulberg <teulberg@gmail.com>
2021-01-19 08:02:08 +00:00
1460b844bc feature gates turbine retransmit peers patch (bp #14631) (#14658)
* feature gates turbine retransmit peers patch (#14631)

(cherry picked from commit c6ae0667e6)

# Conflicts:
#	sdk/src/feature_set.rs

* removes backport merge conflicts

* adds .clone for backport

Co-authored-by: behzad nouri <behzadnouri@gmail.com>
2021-01-19 06:11:21 +00:00
6f56f9ec1b Make Bigtable::get_confirmed_blocks inclusive of requested start_slot and end_slot (#14651) (#14654)
* Fix off-by-one error

* Filter out blocks greater than end slot

(cherry picked from commit cbf8ef7480)

Co-authored-by: Tyera Eulberg <teulberg@gmail.com>
2021-01-19 03:54:43 +00:00
4d4215386d Clean up and add comment
(cherry picked from commit 8d4ab1bab1)
2021-01-17 20:04:33 -08:00
008e387381 WIP fix the occasional stuck RPC request
(cherry picked from commit 5cf9094bb9)
2021-01-17 20:04:33 -08:00
2e31f4d8f7 Use optimistic confirmation in getSignatureStatuses, and various downstream client methods (bp #14430) (#14610)
* Use optimistic confirmation in getSignatureStatuses, and various downstream client methods (#14430)

* Add optimistically_confirmed field to TransactionStatus

* Update docs

* Convert new field to confirmation_status

* Update docs to confirmationStatus

* Update variants

* Update docs

* Just Confirmed

(cherry picked from commit 9a89689ad3)

# Conflicts:
#	tokens/src/commands.rs

* Fix conflict

Co-authored-by: Tyera Eulberg <teulberg@gmail.com>
Co-authored-by: Tyera Eulberg <tyera@solana.com>
2021-01-16 04:46:08 +00:00
a1a70060e9 Support account on tmpfs via net/ scripts (bp #14459) (#14620)
* multinode-demo: Pass --accounts through bootstrap leader wrapper

(cherry picked from commit 327be55acc)

* gce.sh: Factor out default custom memory

(cherry picked from commit ddf1d2dbf5)

* net/: Support accounts on swap-backed tmpfs

(cherry picked from commit ff599ace4d)

* net/gce.sh: Add cusom RAM arg instead of doubling default with tmpfs

(cherry picked from commit 3175cf1deb)

Co-authored-by: Trent Nelson <trent@solana.com>
2021-01-16 01:35:44 +00:00
b064956e20 Add load/execute/store timings (#14561) (#14590)
Co-authored-by: sakridge <sakridge@gmail.com>
2021-01-15 21:13:09 +00:00
ea55cac8bb net/net.sh: Quite pre-emptible instance status check (#14617)
(cherry picked from commit 7b67228bc1)

Co-authored-by: Trent Nelson <trent@solana.com>
2021-01-15 21:13:02 +00:00
6a5d664d6a patches bug in turbine's neighbors computation (#14565) (#14612)
Removing local node's index early from the set here:
https://github.com/solana-labs/solana/blob/e1b59ded4/core/src/retransmit_stage.rs#L346
distorts the order of nodes depending on which node is computing the
turbine fan-out tree, and results in incorrect neighbors computation.

(cherry picked from commit cfcca1cd3c)

Co-authored-by: behzad nouri <behzadnouri@gmail.com>
2021-01-15 18:42:44 +00:00
fad7f198b4 Use highest-confirmed-root for max check (#14599) (#14603)
(cherry picked from commit 465f991035)

Co-authored-by: Tyera Eulberg <teulberg@gmail.com>
2021-01-15 09:16:48 +00:00
8a24707fe4 docs: Add stake programming documentation (#14529) (#14581)
* Add stake programming documentation

We had some questions about stake programming documentation, and there
wasn't a place that contained information about the stake-o-matic and
other stake development in one place.  This adds a page with that
information.

* Update docs/src/staking/stake-programming.md

Co-authored-by: Eric Williams <eric@solana.com>

* Update docs/src/staking/stake-programming.md

Co-authored-by: Eric Williams <eric@solana.com>

* Update docs/src/staking/stake-programming.md

Co-authored-by: Eric Williams <eric@solana.com>

* Update docs/src/staking/stake-programming.md

Co-authored-by: Eric Williams <eric@solana.com>

* Update docs/src/staking/stake-programming.md

Co-authored-by: Eric Williams <eric@solana.com>

* Apply suggestions from code review

* Remove trailing whitespace

Co-authored-by: Eric Williams <eric@solana.com>
(cherry picked from commit b37dbed479)

Co-authored-by: Jon Cinque <jon.cinque@gmail.com>
2021-01-14 16:11:34 +00:00
e822f8cc39 Don't stop to find newer cluster-confirmed roots (bp #14557) (#14559)
* Don't stop to find newer cluster-confirmed roots (#14557)

* Don't stop to find newer cluster-confirmed roots

* Fix and add new tests

* nits

(cherry picked from commit e95ebcf864)

# Conflicts:
#	ledger/src/blockstore_processor.rs

* My blind merge conflict edit!

* blind 2

Co-authored-by: Ryo Onodera <ryoqun@gmail.com>
2021-01-14 01:17:38 +00:00
b1335041c8 validator: Add --rpc-threads argument (bp #14553) (#14567)
* Add --rpc-threads argument

(cherry picked from commit 11daaadc93)

# Conflicts:
#	Cargo.lock
#	validator/Cargo.toml

* rebase

Co-authored-by: Michael Vines <mvines@gmail.com>
2021-01-14 00:09:22 +00:00
6d67dc6ead adds pubkey for behzad@solana.com (bp #14558) (#14562)
* adds pubkey for behzad@solana.com (#14558)

(cherry picked from commit 673cb39975)

# Conflicts:
#	net/scripts/solana-user-authorized_keys.sh

* removes backport merge conflicts

Co-authored-by: behzad nouri <behzadnouri@gmail.com>
2021-01-13 17:40:37 +00:00
3d7562339f feat: publish more docker ports in localnet script (bp #12788) (#14552) 2021-01-12 14:25:56 -08:00
682acd5bfd Bump version to v1.4.24 (#14543) 2021-01-12 02:44:28 +00:00
51fbc1a73e Use standard tmp-snapshot- file prefix for the "new_state" archive for better cleanup/consistency 2021-01-11 17:34:47 -08:00
375295a605 v1.4: Update timestamp max allowable drift to 50% of PoH (#14532)
* Add timestamp warp

* Change max_allowable_drift to 50%

* Fill in PR#

* Fix rpc test setup
v1.4.23
2021-01-11 22:49:19 +00:00
664e772d0f Restore snapshot hard linking (#14533)
(cherry picked from commit 872a249e97)

Co-authored-by: Michael Vines <mvines@gmail.com>
2021-01-11 21:52:21 +00:00
45381acd82 Clarify log message, the remote snapshot might not actually be newer 2021-01-11 11:54:18 -08:00
f925828f79 Avoid tmp snapshot backlog in SnapshotPackagerService under high load (bp #14516) (#14527)
* Avoid tmp snapshot backlog in SnapshotPackagerService under high load (#14516)

(cherry picked from commit a95675a7ce)

# Conflicts:
#	core/src/validator.rs

* rebase

Co-authored-by: Michael Vines <mvines@gmail.com>
2021-01-11 19:46:04 +00:00
f67820cc56 rebase 2021-01-11 08:40:07 -08:00
db26cdf8f0 Rename CompressionType to ArchiveFormat
(cherry picked from commit 7be6770808)

# Conflicts:
#	core/src/test_validator.rs
2021-01-11 08:40:07 -08:00
683d748784 Rename AccountsPackage::root to AccountsPackage::slot
(cherry picked from commit 141e6706e6)
2021-01-11 08:40:07 -08:00
72ef444257 Reduce TempDir exposure
(cherry picked from commit 9f70f7dc3e)
2021-01-11 08:40:07 -08:00