Commit Graph

11036 Commits

Author SHA1 Message Date
74b12e35bf network/retrieve: add bzz-retrieve protocol (#1589)
* network/retrieve: initial commit

* network: import dependencies from stream package branch

* network/retrieve: address pr comments

* network/retrieve: fix pr comments

* network/retrieve: create logger for peer

* network: address pr comments

* network/retrieve: lint

* network/retrieve: prevent forever loop

* network/retrieve: address pr comments

* network/retrieve: fix linter

* network/retrieve: pr comments

* network/retrieval: pr comments
2019-07-25 10:53:46 +02:00
388d8ccd9f PoC: Network simulation framework (#1555)
* simv2: wip

* simulation: exec adapter start/stop

* simulation: add node status to exec adapter

* simulation: initial simulation code

* simulation: exec adapter, configure path to executable

* simulation: initial docker adapter

* simulation: wip kubernetes adapter

* simulation: kubernetes adapter proxy

* simulation: implement GetAll/StartAll/StopAll

* simulation: kuberentes adapter - set env vars and resource limits

* simulation: discovery test

* simulation: remove port definitions within docker adapter

* simulation: simplify wait for healthy loop

* simulation: get nat ip addr from interface

* simulation: pull docker images automatically

* simulation: NodeStatus -> NodeInfo

* simulation: move discovery test to example dir

* simulation: example snapshot usage

* simulation: add goclient specific simulation

* simulation: add peer connections to snapshot

* simulation: close rpc client

* simulation: don't export kubernetes proxy server

* simulation: merge simulation code

* simulation: don't export nodemap

* simulation: rename SimulationSnapshot -> Snapshot

* simulation: linting fixes

* simulation: add k8s available helper func

* simulation: vendor

* simulation: fix 'no non-test Go files' when building

* simulation: remove errors from interface methods where non were returned

* simulation: run getHealthInfo check in parallel
2019-07-24 17:00:13 +02:00
9720da34db network: structured output for kademlia table (#1586) 2019-07-19 13:35:11 +02:00
090197227f client: add bzz client, update smoke tests (#1582) 2019-07-18 18:49:20 +02:00
48857ae88e swarm-smoke: fix check max prox hosts for pull/push sync modes (#1578) 2019-07-17 16:21:50 +02:00
ad77f43b9d cmd/swarm: allow using a network interface by name for nat purposes (#1557) 2019-07-16 09:35:04 +02:00
9d96d9bef5 pss: disable TestForwardBasic (#1544) 2019-07-11 18:17:26 +02:00
7101f65a8b api, network: count chunk deliveries per peer (#1534) 2019-07-09 22:50:06 +02:00
af3b5e9ce1 network/newstream: new stream! protocol base implementation (#1500)
network/newstream: merge new stream protocol wire protocol changes, changes to docs, add basic protocol handlers and placeholders
2019-07-08 13:25:56 +03:00
7deac5693c swarm: fix bzz_info.port when using dynamic port allocation (#1537) 2019-07-05 12:15:17 +02:00
d5f6ee4620 cmd/swarm: make bzzaccount flag optional and add bzzkeyhex flag (#1531)
* cmd/swarm: don't require bzzaccount flag

* docker: remove setup script because bzzaccount is not required anymore

* cmd/swarm: manage account creation/selection when bzzflag is not defined

* cmd/swarm: no bzzaccount flag tests

* cmd/swarm: use random network ports on tests

* cmd/swarm: fix typo

* cmd/swarm: add --bzzkeyhex flag

* cmd/swarm: use different ipc paths for tests

* readme: update example on how to run swarm

* cmd/swarm: rename getAccount -> getOrCreateAccount

* cmd/swarm: remove unneeded comment

* cmd/swarm: use shorter ipc path for test
2019-07-04 13:14:10 +02:00
fb73e6cb9b cmd/swarm: remove separate function to parse env vars (#1536) 2019-07-04 13:13:39 +02:00
a6e64aea67 network/bitvector: Multibit set/unset + string rep (#1530)
* network/bitvector: Multibit set/unset + string rep

* network/bitvector: Add code comments

* network/bitvector: Make Unset -> Set with bool false

* network/bitvector: Revert to Set/Unset

* network/stream: Update to new bitvector signature
2019-07-02 18:08:00 +02:00
b3f21ddbba swarm: 0.4.3 unstable (#1526)
* swarm: 0.4.3 unstable

* CHANGELOG: consistent date format
2019-06-28 12:22:07 +02:00
3cdc45ee0f travis: also build on release tags (#1527) v0.4.2 2019-06-28 12:02:47 +02:00
bef511363e swarm: release v0.4.2 (#1496)
* CHANGELOG: reflect latest merged PRs

* changelog: updated changelog for swarm 0.4.2

* version: mark 0.4.2 stable
2019-06-28 11:19:28 +02:00
fb75cdce03 network: bump bzz stream hive (#1522) 2019-06-28 10:21:14 +02:00
13774a8aee docker: update ca-certificates file (#1525) 2019-06-27 18:06:09 +02:00
4d66995fee Add swarm guide to /docs (#1513)
* docs: add swarm-guide

* readthedocs build configuration file
2019-06-26 10:18:32 +02:00
a0a14cc11c network/simulation: Add ExecAdapter capability to swarm simulations (#1503) 2019-06-24 09:48:40 +02:00
8afb316399 docs: add initial stream! protocol specification (#1454)
* docs: add initial pull sync spec
2019-06-20 12:21:07 +02:00
f2a12b38c4 docs: release process setup (#1487) 2019-06-19 11:12:56 +02:00
f828da674d build: enable ubuntu ppa disco (19.04) builds (#1495) 2019-06-18 15:34:30 +02:00
9fa6d29c88 network/stream: remove send.offered.hashes trace (#1497) 2019-06-18 14:53:18 +02:00
d589af14a8 simple fetchers (#1492)
* network: disable shouldNOTRequestAgain
* vendor singleflight
* network: disable shouldNOTRequestAgain
* network, storage: fix tests
* network/storage: remove HopCount and SkipCheck
* network/stream: use localstore when providing chunks a node has offered
* storage: refactor lnetstore
* storage: rename FetcherItem to Fetcher
* storage/feed: no distinction between catastrophic err or chunk not found
* network/stream: remove TestDeliveryFromNodes, as FindPeer is changed, and Swarm connectivity is not a chain
* network/stream: fixed intervals tests
* swarm: fixes for linter
* storage: use LRU cache for fetchers
* network, storage: better godoc
* storage/netstore: explicit errors
* storage/feed/lookup: Clarify ReadFunc expected return error values
* storage: address comments by elad
2019-06-18 08:47:27 +02:00
f57d4f0802 swarm/storage: Support for uploading 100gb files (#1395)
* swarm/storage: Fix gouroutine leak while uploading large files
* swarm/storage: Fix pyramid chunker to wrap properly level3 and above
2019-06-18 08:46:20 +02:00
604960938b Revert "simplification of Fetchers (#1344)" (#1491)
This reverts commit 0b724bd4d5.
2019-06-17 10:30:55 +02:00
0b724bd4d5 simplification of Fetchers (#1344) 2019-06-17 10:01:12 +02:00
21adbe2fac docker: include git commit hash in swarm version (#1488)
* dockerignore: remove .git - needed for git hash on builds

* changelog: include #1488
2019-06-14 15:49:18 +02:00
8b37def961 cmd/swarm-smoke: fix what we wanted to avoid (#1486) 2019-06-14 14:49:21 +02:00
fce3e45f2b build: don't upload buildinfo (#1484) 2019-06-14 14:24:12 +02:00
99db027993 docker: fix run-smoke.sh path to binary (#1485) 2019-06-14 14:22:55 +02:00
8a1f6a6c6f README: add docker section and fix license section (#1483)
* readme: add docker section

* readme: fix license info

* readme: omit sections in toc
2019-06-14 12:18:56 +02:00
9704ced894 cmd/swarm-smoke: add paging to trackChunks (#1464)
* cmd/swarm-smoke: add paging to trackChunks
2019-06-14 10:46:41 +02:00
99a431cf50 version: update to v0.4.2 unstable (#1470) 2019-06-13 17:45:36 +02:00
0b9a3ea407 swarm: release v0.4.1 (#1469) v0.4.1 2019-06-13 16:32:55 +02:00
2f0b94fa1a network: bump proto versions due to change in OfferedHashesMsg (#1465) 2019-06-13 16:11:46 +02:00
815a6d120f changelog: initial setup (#1466) 2019-06-13 16:04:16 +02:00
4744b7c9d7 p2p/protocols: do not vendor swarm related packages (#1462) 2019-06-13 15:11:00 +02:00
3243c7ba07 docker: create new dockerfiles that are context aware (#1463) 2019-06-13 14:30:13 +02:00
76e71cca3b network/stream: disable flaky TestStartNetworkSync test (#1458) 2019-06-12 15:50:44 +02:00
b3f601427c storage: fix alignement panics on 32 bit arch (#1460) 2019-06-12 12:55:36 +02:00
f709083e47 api: temporary fix test failing on windows due to access denied (#1450) 2019-06-12 10:00:46 +02:00
e865445f17 network/stream: remove cast for msg type (#1449) 2019-06-12 08:55:15 +02:00
de220b8323 docs: arch diagram - use source of truth images (#1434) 2019-06-11 10:17:45 +02:00
c1126aaa1b swarm/network/stream: add syncing test (#1399)
* swarm/network/stream: remove old syncing test and replace it with two more granular tests, with the first one testing a full sync between two nodes (makes sure that when all subscriptions are established on all bins - all content is replicated from one node to the other), and a second test that adds a bigger amount of nodes to a star network topology, effectively making the pivot node have a depth > 0 to sync just certain content to the connected nodes (due to a star topology this test (always 1 hop) does not check that, for example, specific content is routed across multiple nodes, but assumes content should be only on the most proximate node)

* api, cmd/swarm-smoke, fuse, network, storage: fix data dir leak when using ephemeral filestore, pull test params to be easily adjustable
2019-06-10 10:52:19 +02:00
ee7ccbdb4d docs: initial swarm arch diagram (#1432)
Important high-level diagrams added
2019-06-07 13:27:20 +02:00
bedd06762d swarm-smoke: add debug flag (#1428) 2019-06-06 15:06:18 +02:00
5663cb2c76 docs: push syncing tags doc (#1429) 2019-06-06 14:51:58 +02:00
a454aa6c8d swarm,cmd: fix migration link, change loglevel severity (#1420) 2019-06-06 14:46:28 +02:00