gaspersic/solana
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
15,232 Commits 81 Branches 357 Tags
f3126f7e77bb256a68fccd5eb78d70009673a089
Commit Graph

15232 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Anatoly Yakovenko
f3126f7e77 sigverify -- dedupe bloom filter too slow followups 2022-01-22 05:57:24 +00:00
Trent Nelson
9b90162564 Bump version to 1.8.15 (#22670) 2022-01-22 11:15:07 +08:00
mergify[bot]
9c01d90c70 Handle already discarded packets in discard_excess_packets (#22594) (#22634) 
(cherry picked from commit 38b02bbcc0)

Co-authored-by: sakridge <sakridge@gmail.com>
v1.8.14 		2022-01-22 01:10:31 +00:00
anatoly yakovenko
edf1954817 Faster dedup v1.8 (#22619) 
* Faster dedup
 2022-01-21 08:19:55 -08:00
mergify[bot]
59eee75d65 Speed up packet dedup and fix benches (backport #22592) (#22611) 
* Speed up packet dedup and fix benches (#22592)

* Speed up packet dedup and fix benches

* fix tests

* allow int arithmetic in bench

(cherry picked from commit a2d251ce1e)

# Conflicts:
#	perf/src/sigverify.rs

* resolve conflicts

Co-authored-by: Justin Starry <justin@solana.com>
 2022-01-21 07:34:57 +00:00
Justin Starry
c2dd9a006d Fetch sysvars from invoke context for vote program (backport #22444) (#22621) 
* Fetch sysvars from invoke context for vote program (#22444)

* resolve conflicts
 2022-01-21 02:59:33 +00:00
mergify[bot]
8eb0a1091a system-monitor-service: support percentages from bigger numbers (#22597) 
(cherry picked from commit cca3dbc76d)

Co-authored-by: Trent Nelson <trent@solana.com>
 2022-01-20 23:22:48 +00:00
anatoly yakovenko
cb5106a15b Dedup v1.8 (#22584) 
backport
 2022-01-19 21:31:55 -08:00
Justin Starry
2d5957a4b4 Refactor: move sysvar cache to new module (#22586) 2022-01-20 03:27:03 +00:00
mergify[bot]
99846eea12 Add PacketBatch packet_indexes stat (#22564) (#22574) 
* collect stats on packet batch indicies

* cleanup

* cleanup

* cleanup

* change name

(cherry picked from commit 650882217c)

# Conflicts:
#	core/src/banking_stage.rs

Co-authored-by: buffalu <85544055+buffalu@users.noreply.github.com>
 2022-01-20 00:48:18 +00:00
mergify[bot]
78b82dedb1 improves sigverify discard_excess_packets performance (backport #22577) (#22579) 
* improves sigverify discard_excess_packets performance (#22577)

As shown by the added benchmark, current code does worse if there is a
spam address plus a lot of unique addresses.

on current master:
test bench_packet_discard_many_senders  ... bench:   1,997,960 ns/iter (+/- 103,715)
test bench_packet_discard_mixed_senders ... bench:  14,256,116 ns/iter (+/- 534,865)
test bench_packet_discard_single_sender ... bench:   1,306,809 ns/iter (+/- 61,992)

with this commit:
test bench_packet_discard_many_senders  ... bench:   1,644,025 ns/iter (+/- 83,715)
test bench_packet_discard_mixed_senders ... bench:   1,089,789 ns/iter (+/- 86,324)
test bench_packet_discard_single_sender ... bench:     955,234 ns/iter (+/- 55,953)

(cherry picked from commit dcf44d2523)

# Conflicts:
#	core/benches/sigverify_stage.rs
#	core/src/sigverify_stage.rs

* removes mergify merge conflicts

Co-authored-by: behzad nouri <behzadnouri@gmail.com>
 2022-01-19 21:23:34 +00:00
Justin Starry
db942269f0 Stop caching sysvars, instead load them ahead of time (backport #21108) (#22572) 
* Bump version to v1.8.14

* Stop caching sysvars, instead load them ahead of time (backport #21108)

Co-authored-by: Trent Nelson <trent@solana.com>
 2022-01-19 17:42:43 +08:00
Trent Nelson
eede487797 Bump version to v1.8.14 (#22573) 2022-01-19 17:40:37 +08:00
mergify[bot]
42c3fbc198 Track discard time of excess packets in sigverify (#22554) (#22569) 
* discard time histogram

* closer to the if

* update

(cherry picked from commit e616a7ebfc)

# Conflicts:
#	core/src/sigverify_stage.rs

Co-authored-by: anatoly yakovenko <anatoly@solana.com>
v1.8.13 		2022-01-19 02:42:13 +00:00
mergify[bot]
4706aa4900 wrap create executor timings datapoint in a module (#22397) 
Co-authored-by: Trent Nelson <trent@solana.com>
 2022-01-19 00:33:36 +00:00
Tao Zhu
b357eda15b Revert "count vote transaction units to block cost" 
This reverts commit 5655ea0061.
 2022-01-18 15:10:49 -07:00
Tao Zhu
fc8f61368d Revert "Added vote limits to be 75% of total block limit" 
This reverts commit 3e131a5324.
 2022-01-18 15:10:49 -07:00
mergify[bot]
aabcdcf8fb Add execute metrics (backport #22296) (#22334) 
* consolidate execute timings to a common module

* Add execute metrics

* Add metrics for executor creation

* Use saturating_add_assign macro

Co-authored-by: Trent Nelson <trent@solana.com>
Co-authored-by: Carl Lin <carl@solana.com>
 2022-01-18 19:18:24 +00:00
mergify[bot]
81e65eae0b Use VecDeque instead of Vec in sigverify stage (#22538) (#22549) 
avoid bad performance of remove(0) for a single sender

(cherry picked from commit 49443406fd)

# Conflicts:
#	core/src/sigverify_stage.rs

Co-authored-by: sakridge <sakridge@gmail.com>
 2022-01-17 22:19:25 +00:00
mergify[bot]
38e72982bc metrics for generate new bank forks (#22492) (#22547) 
* metrics for generate new bank forks

* fixed

* Apply suggestions from code review

Co-authored-by: Trent Nelson <trent.a.b.nelson@gmail.com>

* --fixup

* fixup!

Co-authored-by: Trent Nelson <trent.a.b.nelson@gmail.com>
(cherry picked from commit 2d94e6e5d3)

# Conflicts:
#	core/src/replay_stage.rs

Co-authored-by: anatoly yakovenko <anatoly@solana.com>
 2022-01-17 21:48:20 +00:00
mergify[bot]
d52dd97ad1 log internals (#22493) (#22496) 
(cherry picked from commit eca8d21249)

Co-authored-by: carllin <carl@solana.com>
 2022-01-15 05:22:08 +00:00
mergify[bot]
61f88e04d2 adds methods to obtain shreds' erasure coded block and index (#21325) (#22508) 
(cherry picked from commit 7da2df7d8c)

Co-authored-by: behzad nouri <behzadnouri@gmail.com>
 2022-01-14 17:43:16 +00:00
Tao Zhu
3e131a5324 Added vote limits to be 75% of total block limit 2022-01-14 10:49:17 -06:00
Tao Zhu
5655ea0061 count vote transaction units to block cost 2022-01-14 10:49:17 -06:00
mergify[bot]
40ef11ec86 implements copy-on-write for staked-nodes (backport #19090) (#22507) 
* implements copy-on-write for staked-nodes (#19090)

Bank::staked_nodes and Bank::epoch_staked_nodes redundantly clone
staked-nodes HashMap even though an immutable reference will suffice:
https://github.com/solana-labs/solana/blob/a9014cece/runtime/src/vote_account.rs#L77

This commit implements copy-on-write semantics for staked-nodes by
wrapping the underlying HashMap in Arc<...>.

(cherry picked from commit f302774cf7)

# Conflicts:
#	runtime/src/bank.rs
#	runtime/src/stakes.rs
#	runtime/src/vote_account.rs

* removes backport merge conflicts

Co-authored-by: behzad nouri <behzadnouri@gmail.com>
 2022-01-14 15:26:11 +00:00
Michael Vines
debac00724 Soften vote account identity mismatch from panic to runtime error 2022-01-13 19:31:03 -08:00
Justin Starry
304afd42c6 Revert "Stop caching sysvars, instead load them ahead of time (backport #21108) (#22466)" 
This reverts commit 5d3f3bc9b1.
 2022-01-14 11:13:04 +08:00
mergify[bot]
5d3f3bc9b1 Stop caching sysvars, instead load them ahead of time (backport #21108) (#22466) 
* Stop caching sysvars, instead load them ahead of time. (#21108)

(cherry picked from commit 29ad081555)

# Conflicts:
#	programs/bpf/tests/programs.rs
#	programs/bpf_loader/src/syscalls.rs
#	programs/stake/src/stake_instruction.rs
#	runtime/src/bank.rs
#	runtime/src/message_processor.rs
#	sdk/program/src/sysvar/mod.rs
#	sdk/src/process_instruction.rs

* resolve conflicts

Co-authored-by: Alexander Meißner <AlexanderMeissner@gmx.net>
Co-authored-by: Justin Starry <justin@solana.com>
 2022-01-13 17:51:13 +00:00
mergify[bot]
42531a11a5 limits gossip vote stats to the top most voted slots (#22416) (#22473) 
(cherry picked from commit 49da347d84)

Co-authored-by: behzad nouri <behzadnouri@gmail.com>
 2022-01-13 16:23:42 +00:00
Justin Starry
10c40c9c2d Remove program-runtime/src/invoke_context.rs 2022-01-13 23:59:02 +08:00
Tao Zhu
1ef48f369e downgrade individual per-program-timing to trace to reduce writes to influx 
(cherry picked from commit 6614727be8)
 2022-01-12 22:01:56 -06:00
Justin Starry
05e75ae937 Don't forward packets received from TPU forwards port (backport #22078) (#22180) 
* Don't forward packets received from TPU forwards port (#22078)

* resolve conflicts
 2022-01-10 14:36:56 +08:00
mergify[bot]
a7aa5202ab bank: fix executor cache metrics (#22395) 
(cherry picked from commit 3b4aad9df1)

Co-authored-by: Trent Nelson <trent@solana.com>
 2022-01-09 05:55:08 +00:00
Trent Nelson
9aa7821277 Bump version to v1.8.13 2022-01-08 12:27:11 -07:00
mergify[bot]
fee86726f2 improve multi executor cache addition (#22381) 
(cherry picked from commit 4a9f4e2505)

Co-authored-by: Jack May <jack@solana.com>
v1.8.12 		2022-01-08 12:52:16 +00:00
Trent Nelson
8a470d3ae8 add excutor creation trace timings 2022-01-08 04:46:31 -07:00
mergify[bot]
8c6df1f234 bank: prime new executor cache entry use-counts (#22374) 
Co-authored-by: Trent Nelson <trent@solana.com>
 2022-01-08 10:14:05 +00:00
mergify[bot]
7cbfab0958 remove per program timings from blockstore processor ledger replay (#22370) (#22371) 
(cherry picked from commit 813006b33b)

Co-authored-by: carllin <carl@solana.com>
 2022-01-08 08:33:31 +00:00
mergify[bot]
6130466a21 Executor cache metrics (backport #22332) (#22367) 
* Add helper macro for `AddAssign`ing with saturating arithmetic

* bank: Add executors cache metrics

Co-authored-by: Trent Nelson <trent@solana.com>
 2022-01-08 02:19:36 +00:00
mergify[bot]
299a59f458 removes CowCachedExecutors (backport #22343) (#22362) 
* removes CowCachedExecutors (#22343)

Copy-on-write semantics for cached executors can be implemented by a
simple Arc<CachedExecutors> as opposed to CowCachedExecutors:
https://github.com/solana-labs/solana/blob/f1e2598ba/runtime/src/bank.rs#L244-L247

This will also avoid the need for double locking as in:
https://github.com/solana-labs/solana/blob/f1e2598ba/runtime/src/bank.rs#L3490-L3491
https://github.com/solana-labs/solana/blob/f1e2598ba/runtime/src/bank.rs#L3525-L3526

(cherry picked from commit c2389fc209)

# Conflicts:
#	runtime/src/bank.rs

* removes backport merge conflicts

Co-authored-by: behzad nouri <behzadnouri@gmail.com>
 2022-01-07 16:18:00 +00:00
mergify[bot]
b30c726d22 Add aarch64-apple-darwin publish tarball step (#22355) 
(cherry picked from commit e2aa932e97)

Co-authored-by: Michael Vines <mvines@gmail.com>
 2022-01-07 10:13:46 +00:00
Justin Starry
069bb5e32f Increase timeout of local-cluster-slow CI step 2022-01-07 15:31:28 +08:00
mergify[bot]
cad0e7f04f cache executors on failed transactions (backport #22308) (#22327) 
* cache executors on failed transactions (#22308)

(cherry picked from commit 12e160269e)

# Conflicts:
#	program-runtime/src/invoke_context.rs
#	programs/bpf_loader/src/lib.rs
#	runtime/src/bank.rs

* resolve conflicts

Co-authored-by: Jack May <jack@solana.com>
 2022-01-06 15:38:39 -08:00
mergify[bot]
c90fa6643e Retain executor cache counts (#22322) (#22340) 
(cherry picked from commit f1e2598baa)

Co-authored-by: Jack May <jack@solana.com>
 2022-01-06 19:11:05 +00:00
mergify[bot]
54db774203 Split up local cluster tests into separate CI steps (backport #22295) (#22302) 
* Split up local cluster tests into separate CI steps (#22295)

* Split up local cluster tests into separate CI steps

* Update buildkite-pipeline.sh

(cherry picked from commit 0e1afcbb26)

# Conflicts:
#	local-cluster/tests/local_cluster.rs

* resolve conflicts

Co-authored-by: Justin Starry <justin@solana.com>
 2022-01-06 15:26:56 +00:00
mergify[bot]
57b5ce5731 [ledger-tool]compare_blocks (#22229) (#22329) 
* 1.made load_credentials accept credential path as a parameter. 2.partial implement bigtable comparasion function

* finding missing blocks in bigtables in a specified range

* refactor compare-blocks,add unit test for missing_blocks and fmt

* compare-block fix last block bug

* refactor compare-block and improve wording

* Update ledger-tool/src/bigtable.rs

Co-authored-by: Tyera Eulberg <teulberg@gmail.com>

* update compare-block command-line description

* style:improve wording/naming/code style

Co-authored-by: Tyera Eulberg <teulberg@gmail.com>
(cherry picked from commit d9220652ad)

Co-authored-by: pieceofr <komimi.p@gmail.com>
 2022-01-06 08:47:08 +00:00
mergify[bot]
e0d933f940 perf: skip updating already cached executors if unmodified (backport #22300) (#22315) 
* Skip updating already cached executors if unmodified

(cherry picked from commit f2ed6f09ee)

# Conflicts:
#	program-runtime/src/invoke_context.rs
#	runtime/src/bank.rs

* resolve conflicts

Co-authored-by: Justin Starry <justin@solana.com>
 2022-01-06 02:04:55 +00:00
mergify[bot]
e2559f20df fix(rpc): recreate dead and uncleaned subscriptions (#22281) (#22293) 
(cherry picked from commit c1995c647b)

Co-authored-by: Nikita <bananaelecitrus@gmail.com>
 2022-01-05 10:23:34 +00:00
mergify[bot]
7b9ca3e9d9 Flip iter operations to keep associated address/header/packets together (backport #22245) (#22256) 
* Flip iter operations to keep associated address/header/packets together (#22245)

Flip iter operations to keep associated address/header/packets together

Before this change, if cast_socket_addr() returned a None for any
address/header pair, the subsequent zip() would misalign the
address/header pair and packet. So, this change zips all three together,
then does filter_map() so keep things aligned.

Additionally, compute total_size inline to avoid running through packets
a second time.

(cherry picked from commit 20b61e28b6)

# Conflicts:
#	streamer/src/recvmmsg.rs

* removes backport merge conflicts

Co-authored-by: steviez <steven@solana.com>
Co-authored-by: behzad nouri <behzadnouri@gmail.com>
 2022-01-04 16:31:59 +00:00
mergify[bot]
f0de9b43be Lower vote-only-mode to 400 (#22210) (#22271) 
(cherry picked from commit 2486e21ffe)

Co-authored-by: sakridge <sakridge@gmail.com>
 2022-01-04 14:17:31 +00:00