wiki:org/teams/NetworkTeam/BandwidthAuthority/sbws

sbws

Roadmap Q1 2020

Owner: gk (1 match)

Ticket Summary Priority Parent ID Status Type Milestone Keywords Points
#33832 For relays that change ip, only the measurements with the last ip are kept Medium #33121 needs_information defect sbws: 1.1.x-final sbws-roadmap, intro, GeorgKoppen202004

Owner: juga (2 matches)

Ticket Summary Priority Parent ID Status Type Milestone Keywords Points
#33831 Relays without descriptors are not scaled, but still added to the bwlines without vote=0 Medium #33121 assigned defect sbws: 1.1.x-final sbws-roadmap, intro 1
#33871 Scale exactly as torflow does? Medium #33775 needs_review defect sbws: 1.1.x-final sbws-majority-blocker, sbws-roadmap

Owner: metrics-team (2 matches)

Ticket Summary Priority Parent ID Status Type Milestone Keywords Points
#33076 Graph onionperf and consensus information from Rob's experiments Medium #33327 needs_review task metrics-team-roadmap-2020Q1, sbws-roadmap 6
#33077 Graph results from the torflow to sbws transition Medium #33121 new task sbws-roadmap 4

Owner: (none) (8 matches)

Ticket Summary Priority Parent ID Status Type Milestone Keywords Points
#33121 Deploy sbws in the rest of bwauths High new defect sbws: 1.1.x-final sbws-roadmap 2
#33775 sbws measures some relays 100x lower than Torflow High #33121 new defect sbws: 1.1.x-final sbws-majority-blocker, sbws-roadmap 2
#29728 Deprecate torflow Medium #33121 new defect sbws: 1.1.x-final sbws-roadmap 1
#33198 Check changes related to descriptors in a bandwidth file created by a bwauth before next release Medium #33947 new defect sbws: 1.1.x-final sbws-roadmap
#33350 Is sbws weighting some relays too high? Medium #33947 new defect sbws: 1.1.x-final sbws-roadmap, network-health 2
#33472 Document that bwauths should checkout stable versions when installing sbws from git Medium #33121 new defect sbws: 1.1.x-final sbws-roadmap, intro
#33947 Compare sbws and Torflow Medium #33121 new defect sbws: 1.1.x-final sbws-roadmap, GeorgKoppen202006
#34309 Check that relay_recent_measurement_attempt_count and relay_recent_priority_list_count are correc Medium #33121 new defect sbws: 1.1.x-final sbws-roadmap

Future work

Proposed order to solve remaining tickets:

Deploy sbws in all bandwidth authorities and deprecate torflow:

Ticket Summary Priority Parent ID Status Type Milestone Keywords Modified Points
#29290 Help 2-3 dirauths to deploy sbws High assigned task sbws: 1.1.x-final 10-proposed, no-changes-version 12 months ago 1
#33121 Deploy sbws in the rest of bwauths High new defect sbws: 1.1.x-final sbws-roadmap 4 months ago 2
#33775 sbws measures some relays 100x lower than Torflow High #33121 new defect sbws: 1.1.x-final sbws-majority-blocker, sbws-roadmap 2 months ago 2

Improve test coverage and integration tests:

Ticket Summary Parent ID Status Type Milestone Keywords Modified Points
#29358 Stop overloading the CPU when the test network is run in the integration tests #33149 new defect sbws: 1.2.x-final no-changes-version, tests, sbws-11x-final-removed-20190312 4 months ago 1
#27361 Tests that launch sbws in a subprocess #33149 new defect sbws: unspecified 4 months ago
#28774 Stop the integration tests http server when the tests end #33149 needs_revision defect sbws: unspecified no-changes-version, tests, sbws-11x-final-removed-20190312, reviewer-was-teor-20190422 4 months ago
#29727 Check output of generate in the integration tests #33149 new defect sbws: unspecified no-changes-version, tests, sbws-110-removed-20180318 4 months ago 1
#30902 Stop comparing file_created key in test #33149 new defect sbws: unspecified ci, tests 4 months ago 1
#33150 Allow to connect to an external control port #33149 new defect sbws: unspecified tests, network-health-roadmap-2020Q1 4 months ago 1
#33166 Test tor dormant mode #33149 new defect sbws: unspecified tests, dormant 4 months ago 1
#33167 Test changes in descriptors #33149 new defect sbws: unspecified tests, scanner 4 months ago 1

Detect measurements issues automatically using the bandwidth files:

Ticket Summary Parent ID Status Type Milestone Keywords Modified Points
#30226 Work out why 4% of sbws measurements are excluded due to errors #29710 new defect sbws: 1.2.x-final 12 months ago
#30227 Work out why 3% of sbws measurements are excluded because the relay only has 1 measurement #29710 new defect sbws: 1.2.x-final 12 months ago
#30228 Work out why 1% of sbws measurements are excluded because they are all in the same day #29710 new defect sbws: 1.2.x-final 12 months ago
#30230 Work out what sbws is doing in its measurement threads #29710 new defect sbws: 1.1.x-final 12 months ago
#30723 Work out why no measurements are excluded because they are too old #29710 new defect sbws: 1.1.x-final 12 months ago
#30724 Work out why relay_in_recent_consensus_count is 13 days for some relays #29710 new defect sbws: 1.1.x-final 12 months ago
#30725 Does "success" record relay measurements older than 5 days? #29710 new defect sbws: 1.1.x-final 12 months ago
#33152 Create a tool to detect issues in the bandwidth files given their key/values new defect sbws: unspecified 4 months ago

Scanner/measurement improvement tickets:

Ticket Summary Parent ID Status Type Milestone Keywords Modified Points
#29291 Work out a better way to choose the data size to download #29954 new defect sbws: 1.2.x-final sbws-11x-final-removed-20190312, scanner 12 months ago 1
#29720 Consider storing measured bandwidth for both the measured relay and the helper relay #29954 new defect sbws: 1.2.x-final scanner 12 months ago 1
#28694 When CircuitPadding is implemented in Tor, set it to 0 in sbws #29954 new enhancement sbws: 1.1.x-final wtf-pad, tor-relay, tor-cell, padding, changes-version-patch, sbws-11x-final-removed-20190312, scanner 11 months ago
#16559 bwauth code needs to be smarter about failed circuits #29954 assigned defect sbws: unspecified tor-bwauth, sbws, scanner 14 months ago
#28087 Investigate circuit timeout times and if sbws is properly cleaning up circuits when it gives up on them #29954 new defect sbws: unspecified scanner 14 months ago
#28463 Measure exits as non-exits with 50% probability #29954 new defect sbws: unspecified scanner 14 months ago
#28545 Use an 11 second download in sbws #29954 new defect sbws: unspecified scanner 14 months ago
#29292 Document number of threads configuration depending on the machine available bandwidth #29954 new defect sbws: unspecified changes-version-patch, sbws-11x-final-removed-20190312, scanner 14 months ago 1
#29954 Parent ticket for scanner improvements new defect sbws: unspecified scanner 14 months ago

Tech-debt, minor changes:

Ticket Summary Parent ID Status Type Milestone Keywords Modified Points
#27362 (sub-)packages outside of core (cli) should not need to know about confs and args #28684 new defect sbws: unspecified tech-debt, refactor, config 14 months ago 1
#28282 Refactor bandwidth file generation code #28684 assigned enhancement sbws: unspecified refactor, technical-debt, generator 14 months ago 1
#28684 Make sbws easy to understand and maintain new defect sbws: unspecified 17 months ago
#28718 Simplify configuration options #28684 new defect sbws: unspecified tech-debt, refactor, config 14 months ago 1
#29047 Improve code style following PEP8 and PEP257 #28684 assigned defect sbws: unspecified easy, no-changes-version, sbws-11x-final-removed-20190312, tech-debt, refactor 14 months ago 1
#29048 Remove unused code #28684 assigned defect sbws: unspecified easy, no-changes-version, tech-debt, refactor 15 months ago 1
#29057 Adapt bandwidth file classes to be compatible with stem (descriptors, etc) documents #28684 assigned defect sbws: unspecified no-changes-version, sbws-11x-final-removed-20190312, tech-debt, refactor, generator 14 months ago 1
#29717 Refactor Relay and RelayList to be able to initialize them without Tor's controller #28684 new defect sbws: unspecified tech-debt, refactor, scanner, relays 14 months ago 1
#29718 Include a refactor plan #28684 new defect sbws: unspecified tech-debt, refactor, docs, no-changes-version 15 months ago 1
#29721 Refactor RelayList #28684 new defect sbws: unspecified tech-debt, refactor, scanner, relays 14 months ago
#29726 Rename constants, variables, classes, methods, functions #28684 new defect sbws: unspecified tech-debt, refactor 15 months ago 1
#33197 Refactor code that obtain headers from the state file #28684 new defect sbws: unspecified 4 months ago 1
#33571 Rename constants containing list of keys in v3bwfile.py #28684 new defect sbws: unspecified 3 months ago

Easy bugfixes:

Ticket Summary Parent ID Status Type Milestone Keywords Modified Points
#28045 Start supporting python 3.7, python 3.8, and pypy3.5 #29953 accepted defect sbws: 1.2.x-final easy, no-changes-version 12 months ago 1
#29952 Document that there is now stable branch #29953 new defect sbws: 1.1.x-final docs, no-changes-version 12 months ago 1
#28589 Open trac tickets for every open sbws GitHub issue #29953 assigned defect sbws: unspecified sbws-1.0-nice-moved-20181128, no-changes-version, sbws-11x-final-removed-20180318 14 months ago 1
#28758 Add requirements files #29953 new enhancement sbws: unspecified easy, no-changes-version 14 months ago 1
#28759 Upload sbws to PyPI #29953 new enhancement sbws: unspecified easy, no-changes-version 14 months ago 1
#29294 Create an script to automate releases #29953 needs_revision defect sbws: unspecified easy, 10-proposed, no-changes-version, sbws-11x-final-removed-20190312, reviewer-was-teor-20190422 4 months ago 1
#29953 Parent ticket for easy tickets that do not change version new defect sbws: unspecified easy, no-changes-version 14 months ago

Important ticket that requires research: #28582

All open tickets not listed above:

Ticket Summary Parent ID Status Type Milestone Keywords Modified Points
#32799 SBWS maatuska descriptor information appears stale new defect 6 months ago
#32939 Make sbws become idle and re-try sending messages to the controller when it fails new defect 4 months ago
#33599 Fix typos in sbws comments/code assigned defect GeorgKoppen202004 2 months ago
#33606 Catch common bash errors in sbws scripts new task 3 months ago
#33784 Think about using `self._relays` in `_relays_with_flag()` and friends new enhancement 2 months ago
#33797 Provide better logging for unit test runs in sbws new enhancement 2 months ago
#33824 relay measures low / high on same network and same server #33775 new defect 8 weeks ago
#27363 Make the sbws node cap a proportion of the capped bandwidth new defect sbws: 1.2.x-final 12 months ago
#27689 Round bandwidth in bandwidth files based on proposal 276 new enhancement sbws: 1.2.x-final prop276 12 months ago
#28452 3. implement rounding gap smoothing as in proposal 276 #27689 needs_revision enhancement sbws: 1.2.x-final prop276, teor-unreached-2019-03-08 12 months ago
#29355 Include scanner nickname and UUID in the bandwidth file headers? #30255 new enhancement sbws: 1.2.x-final sbws-11x-final-removed-20190312 14 months ago 1
#29719 Consider to measure all the network at once #30227 new defect sbws: 1.2.x-final 12 months ago 1
#30174 possible SBWS measurement quality regression needs_information defect sbws: 1.2.x-final 12 months ago
#30229 Automatically set the scanner country and AS #30255 new enhancement sbws: 1.2.x-final needs-proposal 14 months ago
#30231 Allow a wider range of acceptable download times #30227 new defect sbws: 1.2.x-final 12 months ago
#30232 Reduce the number of downloads for each measurement #30227 new defect sbws: 1.2.x-final 12 months ago
#30233 Ask for more bytes in our initial request #30227 new defect sbws: 1.2.x-final 12 months ago
#30251 Add the operating system to the bandwidth file headers #30255 needs_revision enhancement sbws: 1.2.x-final 14 months ago 1
#30252 Add the tor OpenSSL and NSS versions to the sbws bandwidth file headers #30255 needs_revision enhancement sbws: 1.2.x-final 14 months ago
#30253 Work out how to specify the country and AS for a CDN #30229 new enhancement sbws: 1.2.x-final needs-proposal 14 months ago
#30254 Work out how to contact bandwidth scanner operators #30255 new enhancement sbws: 1.2.x-final 14 months ago
#30255 Add additional bandwidth file headers in sbws 1.2 new task sbws: 1.2.x-final 13 months ago
#30256 Add data_period to the bandwidth file headers #30255 new enhancement sbws: 1.2.x-final 14 months ago
#30406 Refactor bandwidth file header constants #30255 needs_revision defect sbws: 1.2.x-final 12 months ago 1
#30643 Add Travis CI jobs with stem 1.7.0 and stem master #30406 new enhancement sbws: 1.2.x-final 12 months ago
#30728 Report the time of the earliest eligible bandwidth measurement for each relay new defect sbws: 1.2.x-final 12 months ago
#30904 Change time delta units to seconds new defect sbws: 1.2.x-final 12 months ago 1
#30906 Replace state file extension from .dat to .json new defect sbws: 1.2.x-final 12 months ago 1
#29728 Deprecate torflow #33121 new defect sbws: 1.1.x-final sbws-roadmap 4 months ago 1
#30274 Do not scale relays' bandwidth when there is not descriptor new defect sbws: 1.1.x-final generate 12 months ago 1
#30903 Remove division when logging "last days" new defect sbws: 1.1.x-final 12 months ago 1
#33060 Check that consensus timestamp lists is initialied and has at list one item new defect sbws: 1.1.x-final 4 months ago 0.1
#33198 Check changes related to descriptors in a bandwidth file created by a bwauth before next release #33947 new defect sbws: 1.1.x-final sbws-roadmap 6 weeks ago
#33350 Is sbws weighting some relays too high? #33947 new defect sbws: 1.1.x-final sbws-roadmap, network-health 10 days ago 2
#33472 Document that bwauths should checkout stable versions when installing sbws from git #33121 new defect sbws: 1.1.x-final sbws-roadmap, intro 8 weeks ago
#33691 Migrate to gitlab.tpo new defect sbws: 1.1.x-final 2 months ago 2
#33831 Relays without descriptors are not scaled, but still added to the bwlines without vote=0 #33121 assigned defect sbws: 1.1.x-final sbws-roadmap, intro 2 weeks ago 1
#33832 For relays that change ip, only the measurements with the last ip are kept #33121 needs_information defect sbws: 1.1.x-final sbws-roadmap, intro, GeorgKoppen202004 7 weeks ago
#33871 Scale exactly as torflow does? #33775 needs_review defect sbws: 1.1.x-final sbws-majority-blocker, sbws-roadmap 42 hours ago
#33947 Compare sbws and Torflow #33121 new defect sbws: 1.1.x-final sbws-roadmap, GeorgKoppen202006 3 days ago
#34309 Check that relay_recent_measurement_attempt_count and relay_recent_priority_list_count are correc #33121 new defect sbws: 1.1.x-final sbws-roadmap 10 days ago
#2550 bwauth should reschedule quicker bandwidth test when bandwidthrate changes? new enhancement sbws: unspecified 3 months ago ?
#2888 Testing framework/dataset for bw auths new enhancement sbws: unspecified 3 months ago
#4359 Minimize time between new relay appearing and having some bw vote for it new enhancement sbws: unspecified 3 months ago
#4708 Implement bwauth cap for latency new enhancement sbws: unspecified performance 11 months ago
#4709 Implement bwauth cap for TCP socket exhaustion new enhancement sbws: unspecified performance 11 months ago
#5457 Bw auths don't count circuit failures in descriptor mode #5456 new defect sbws: unspecified 3 months ago
#7177 Understand how accurate the bandwidth authority estimates are #25925 new project sbws: unspecified 18 months ago
#10791 Detect overtuned exit relays new enhancement sbws: unspecified 11 months ago
#25925 bwauth improvements (ex-parent ticket for SoP planned tasks) assigned defect sbws: unspecified 18 months ago
#27343 Dockerfile for sbws basic install needs_revision enhancement sbws: unspecified 18 months ago
#27790 sbws: design and construct bias curves new enhancement sbws: unspecified needs-research, needs-proposal 14 months ago
#27791 sbws: compare relays against other similar relays new enhancement sbws: unspecified 14 months ago
#28106 Change integration tests from bash to shell new defect sbws: unspecified 18 months ago
#28667 Obtain the new descriptors and network status documents by signals instead of every 5min new defect sbws: unspecified tech-debt, refactor, scanner, relays 12 months ago 1
#28684 Make sbws easy to understand and maintain new defect sbws: unspecified 17 months ago
#28706 Maybe implement resolving destination domain using Tor's RESOLVE and ADDRMAP events new defect sbws: unspecified 18 months ago
#28985 Does sbws need Tor to report observed bandwidths more often? new defect sbws: unspecified changes-version-patch, sbws-11x-final-removed-20190312 15 months ago
#28990 Move all or part of the documentation about Tor and the bandwidth scanner new defect sbws: unspecified 15 months ago
#29033 Some tor configuration options are sensitive to the order new defect sbws: unspecified 17 months ago
#29582 Create a git hook to set default commit message that will help automate releases new defect sbws: unspecified 15 months ago
#29710 sbws reports fewer relays than torflow new defect sbws: unspecified 11 months ago
#29749 Remove never used "userquery" code needs_review defect sbws: unspecified no-changes-version, easy, tech-dev, sbws-11x-final-removed-20180318 4 months ago 1
#29752 Document new sbws trac keywords new defect sbws: unspecified not-to-review, sbws-11x-final-removed-20180318 15 months ago 1
#29838 Update trac wiki pages where sbws should be listed new defect sbws: unspecified tor-bwauth 15 months ago 1
#29851 Catch SIGHUP to be able to reload configuration without stopping the scanner new defect sbws: unspecified 15 months ago 1
#29892 Easy deployments in test server running in public network new defect sbws: unspecified 15 months ago 1
#29953 Parent ticket for easy tickets that do not change version new defect sbws: unspecified easy, no-changes-version 14 months ago
#29954 Parent ticket for scanner improvements new defect sbws: unspecified scanner 14 months ago
#30907 Write the contents of the state file in order new defect sbws: unspecified 12 months ago 1
#31331 scanner integration test fails some times because the test Web server is not multi-threaded new defect sbws: unspecified 10 months ago 1
#33149 Parent ticket to improve test coverage and integration tests new defect sbws: unspecified tests 4 months ago
#33152 Create a tool to detect issues in the bandwidth files given their key/values new defect sbws: unspecified 4 months ago
#33473 Document which branches developers should base their patches on new defect sbws: unspecified 3 months ago 1
#34310 Maybe add new type of errors in the bandwidth file new defect sbws: unspecified 10 days ago

Last modified 2 months ago Last modified on Apr 6, 2020, 10:49:47 PM