Opened 5 weeks ago

Last modified 45 hours ago

#33947 new defect

Compare sbws and Torflow

Reported by: juga Owned by:
Priority: Medium Milestone: sbws: 1.1.x-final
Component: Core Tor/sbws Version: sbws: 1.1.0
Severity: Normal Keywords: sbws-roadmap, GeorgKoppen202005
Cc: juga, gk Actual Points:
Parent ID: #33121 Points:
Reviewer: Sponsor:

Description

gk and i were talking about what to review in #30375 and we thought it'd be useful to create a ticket to check whether the bugfixes we have been working on (https://trac.torproject.org/projects/tor/query?keywords=~sbws-roadmap&status=closed) to deploy sbws in all bwauths are working, ie. making sbws to behave very close to Torflow.

I think we should document what to check, where/how to check it and which ticket(s) intended to fix it.

I also think we should add this as documentation in sbws itself because they're important questions that have been blockers to deploy sbws in all bwauths and to avoid regressions in the future.

Some of the main things to check that should be further explained are:

  • whether sbws "failures" "low" (#30719)
  • whether the number of relays to vote on reported by sbws "similar" to the number of relays reported by torflow (#30727, #30735)
  • whether sbws relay descriptors are updated (#30733)
  • whether sbws router statuses (relay info. from consensus) are updated (#30733)
  • whether sbws consensus bandwidth total sum is similar to torflow (#33871, #33009, #33350)?
  • whether changes in a relay consensus bandwidth affect in a similar way as torflow (#33871)

Child Tickets

TicketStatusOwnerSummaryComponent
#33198newCheck changes related to descriptors in a bandwidth file created by a bwauth before next releaseCore Tor/sbws
#33350newIs sbws weighting some relays too high?Core Tor/sbws

Attachments (1)

bw_comparative_extra.ods (960.7 KB) - added by juga 45 hours ago.

Download all attachments as: .zip

Change History (3)

comment:1 Changed 9 days ago by gk

Keywords: GeorgKoppen202005 added

comment:2 Changed 45 hours ago by juga

Something have not commented here is to check is how individual bandwidth values differ from one authority to other.
I think this is useful for #33871, so i'm including it here.
For that, i've implemented a new function in https://gitlab.torproject.org/juga/bwauthealth.
I obtained the bw of all bwauths for the consensus on 25.05.2020, then in libre office i calculated the median of the torflow bwauths, then calculated the percentage difference with longclaw and maatuska (right before maatuska changed to last sbws version) and finally counted the number of relays for which the percentage difference is greater than 50.
This is 626 relays for lonclaw.
Then i counted how many of the relays with a percentage difference greater than 50 are greater than 1.
This is 151 for longclaw. The cases in which longclaw (but not Torflow) has bw 1 is probably because not having the descriptors and consensus bandwidth.
I attach the libre office file.
I think it would be interesting also to see if it's actually the case that those bw are 1 cause of missing descriptors/consensus.
I could have include this calculations as part of the code too, but for now, it was faster this way.
I leave for #33350 the case of maatuska and the case in which the sbws bws are greater than Torflow.

Changed 45 hours ago by juga

Attachment: bw_comparative_extra.ods added
Note: See TracTickets for help on using tickets.