gaspersic/solana
1
0
Fork 0
Code Issues Pull Requests Projects Releases Wiki Activity
18,118 Commits 81 Branches 357 Tags
mergify/bp/v1.10/pr-24195
Commit Graph

44 Commits

Author SHA1 Message Date
mergify[bot]
c0d3cd145e Optimize TpuConnection and its implementations and refactor connection-cache to not use dyn in order to enable those changes (#23877) (#23909) 
Co-authored-by: ryleung-solana <91908731+ryleung-solana@users.noreply.github.com>
 2022-03-25 19:09:26 +01:00
Stephen Akridge
976b138e76 Add tx weighting stage 2022-03-17 19:31:28 -05:00
ryleung-solana
17b00ad3a4 Add quic-client module (#23166) 
* Add quic-client module to send transactions via quic, abstracted behind the TpuConnection trait (along with a legacy UDP implementation of TpuConnection) and change thin-client to use TpuConnection
 2022-03-09 21:33:05 -05:00
sakridge
7a9884c831 Quic limit connections (#23283) 
* quic server limit connections

* bump per_ip

* Review comments

* Make the connections per port
 2022-03-09 10:52:31 +01:00
Trent Nelson
d4292774c5 checks 2022-02-25 08:05:28 +00:00
buffalu
70ebab2c82 Add rustfmt.toml and cargo fmt (#23238) 
* fmt

* formatted

Co-authored-by: Lucas B <buffalu@jito.network>
 2022-02-19 13:32:29 +08:00
behzad nouri
c078ca3fb3 uses sendmmsg in streamer (#23062) 
packet::send_to sends packets one by one:
https://github.com/solana-labs/solana/blob/9213fcb11/streamer/src/packet.rs#L63-L75

sendmmsg uses a single system call for multiple messages:
https://github.com/solana-labs/solana/blob/9213fcb11/streamer/src/sendmmsg.rs#L94
 2022-02-11 13:36:50 +00:00
sakridge
5a230f418d Add quic port for accepting transactions (#22753) 
using quinn library

streamer: Sign TLS cert with validator identity key

Handle multiple incoming chunks
 2022-02-04 15:27:09 +01:00
Michael Vines
6d5bbca630 Pacify clippy 2022-01-21 19:12:57 -08:00
Jeff Biseda
8b66625c95 convert std::sync::mpsc to crossbeam_channel (#22264) 2022-01-11 02:44:46 -08:00
behzad nouri
379feecae5 patches bug in recv_mmsg when npkts != nrecv 
If recv_mmsg receives 2 packets where the first one is filtered out,
then it returns npkts == 1:
https://github.com/solana-labs/solana/blob/01a096adc/streamer/src/recvmmsg.rs#L104-L115

But then streamer::packet::recv_from will erroneously keep the 1st
packet and drop the 2nd one:
https://github.com/solana-labs/solana/blob/01a096adc/streamer/src/packet.rs#L34-L49

To avoid this bug, this commit updates recv_mmsg to always return total
number of received packets. If socket address cannot be correctly
obtained, it is left as the default value which is UNSPECIFIED:
https://github.com/solana-labs/solana/blob/01a096adc/sdk/src/packet.rs#L145
 2022-01-04 21:06:59 +00:00
behzad nouri
4b24499916 removes total-size from return value of recv_mmsg 2022-01-04 21:06:59 +00:00
behzad nouri
73a7741c49 uses std::net::IpAddr type for Packet.Meta.addr 2022-01-04 13:53:40 +00:00
steviez
20b61e28b6 Flip iter operations to keep associated address/header/packets together (#22245) 
Flip iter operations to keep associated address/header/packets together

Before this change, if cast_socket_addr() returned a None for any
address/header pair, the subsequent zip() would misalign the
address/header pair and packet. So, this change zips all three together,
then does filter_map() so keep things aligned.

Additionally, compute total_size inline to avoid running through packets
a second time.
 2022-01-03 17:15:50 -06:00
Jeff Biseda
97a1fa10a6 streamer send destination metrics for repair, gossip (#21564) 2021-12-17 15:21:05 -08:00
Justin Starry
254ef3e7b6 Rename Packets to PacketBatch (#21794) 2021-12-11 09:44:15 -05:00
Michael Vines
b8837c04ec Reformat imports to a consistent style for imports 
rustfmt.toml configuration:
  imports_granularity = "One"
  group_imports = "One"
 2021-12-03 09:19:13 -08:00
Michael Vines
7027d56064 Resolve nightly-2021-10-05 clippy complaints 2021-10-06 10:37:58 -07:00
sakridge
94668c95c2 Prune sigverify queue (#20331) 2021-09-30 05:41:05 +02:00
Jeff Biseda
640e93187c periodically report sigverify_stage stats (#19674) 2021-09-21 10:37:58 -07:00
behzad nouri
8229a4fbf6 removes raw indexing from streamer (#19183) 
Raw indexing is verbose and error-prone. This same code had an indexing
bug causing validator nodes panic just a few months ago:
https://github.com/solana-labs/solana/commit/482b8c6be
 2021-08-12 01:42:12 +00:00
Jeff Biseda
0b7ed18cfa recvmmsg IPv6 awareness (#18957) 2021-08-03 20:35:50 -07:00
behzad nouri
049fb0417f allows sendmmsg api taking owned values (as well as references) (#18999) 
Current signature of api in sendmmsg requires a slice of inner
references:
https://github.com/solana-labs/solana/blob/fe1ee4980/streamer/src/sendmmsg.rs#L130-L152

That forces the call-site to convert owned values to references even
though doing so is redundant and adds an extra level of indirection:
https://github.com/solana-labs/solana/blob/fe1ee4980/core/src/repair_service.rs#L291

This commit expands the api using AsRef and Borrow traits to allow
calling the method with owned values (as well as references like
before).
 2021-07-30 20:58:49 +00:00
behzad nouri
d2d5f36a3c adds validator flag to allow private ip addresses (#18850) 2021-07-23 15:25:03 +00:00
behzad nouri
e316586516 excludes private ip addresses 2021-07-16 20:05:48 -06:00
Jeff Biseda
ae5ad5cf9b sendmmsg cleanup #18589 
Rationalize usage of sendmmsg(2). Skip packets which failed to send and track failures.
 2021-07-16 14:36:49 -07:00
Michael Vines
4a12c715a3 Drop Error suffix from enum values to avoid the enum_variant_names clippy lint 2021-06-18 23:02:13 +00:00
sakridge
eeee75c5be Don't use pinned memory when unnecessary (#17832) 
Reports of excessive GPU memory usage and errors
from cudaHostRegister. There are some cases where pinning is
not required.
 2021-06-14 16:10:04 +02:00
behzad nouri
e405747409 Revert "Add limit and shrink policy for recycler (#15320)" 
This reverts commit c2e8814dce.
 2021-04-18 19:29:24 +00:00
Christian Drappi
54a04bac3d Apple M1 compatibility (#16346) 
Co-authored-by: Christian Drappi <christiandrappi@Christians-MacBook-Pro.local>
 2021-04-09 17:21:01 -07:00
behzad nouri
482b8c6be9 Merge pull request from GHSA-qgrq-w56v-hr62 2021-04-01 09:54:45 -07:00
behzad nouri
570fd3f810 makes turbine peer computation consistent between broadcast and retransmit (#14910) 
get_broadcast_peers is using tvu_peers:
https://github.com/solana-labs/solana/blob/84e52b606/core/src/broadcast_stage.rs#L362-L370
which is potentially inconsistent with retransmit_peers:
https://github.com/solana-labs/solana/blob/84e52b606/core/src/cluster_info.rs#L1332-L1345

Also, the leader does not include its own contact-info when broadcasting
shreds:
https://github.com/solana-labs/solana/blob/84e52b606/core/src/cluster_info.rs#L1324
but on the retransmit side, slot leader is removed only _after_ neighbors and
children are computed:
https://github.com/solana-labs/solana/blob/84e52b606/core/src/retransmit_stage.rs#L383-L384
So the turbine broadcast tree is different between the two stages.

This commit:
* Removes retransmit_peers. Broadcast and retransmit stages will use tvu_peers
  consistently.
* Retransmit stage removes slot leader _before_ computing children and
  neighbors.
 2021-03-24 13:34:48 +00:00
sakridge
830be855dc Forward and hold packets (#15634) 2021-03-03 10:23:05 -08:00
sakridge
05409e51ce Increase tpu coalescing and add parameter (#15536) 
Should create larger entries on average
 2021-02-26 09:15:45 -08:00
carllin
c2e8814dce Add limit and shrink policy for recycler (#15320) 2021-02-24 00:15:58 -08:00
Michael Vines
5df36aec7d Pacify clippy 2021-02-19 20:08:41 -08:00
Trent Nelson
7f7370c306 Re-allow clippy::integer_arithmetic at crate-level 2021-02-17 13:55:08 -07:00
Ryo Onodera
d6873b82ab Remove potentially too costly Packets::default() (#14821) 
* Remove potentially too costly Packets::default()

* Fix test...

* Restore Packets::default()

* Restore Packets::default() more
 2021-01-29 09:32:38 +09:00
Michael Vines
7143aaa89b Clippy 2020-12-14 08:03:29 -08:00
sakridge
0a0f17b9d2 Reduce responder error prints (#10664) 2020-06-18 13:30:55 -07:00
Kristofer Peterson
58ef02f02b 9951 clippy errors in the test suite (#10030) 
automerge
 2020-05-15 09:35:43 -07:00
sakridge
4677cdb4c2 Optimize broadcast cluster_info critical section (#9327) 2020-04-06 17:36:22 -07:00
sakridge
b0c83921be Move streamer test to integration test (#9050) 
Failing in the coverage build.
 2020-03-24 11:39:36 -07:00
anatoly yakovenko
9cedeb0a8d Pull streamer out into its own module. (#8917) 
automerge
 2020-03-17 23:30:23 -07:00