Add graph that compares total consensus weights across bandwidth authorities

We were talking today about how to compare bandwidth authorities, and make sure that different implementations are producing similar figures.

One easy way to compare bandwidth authority implementations is to compare their total bandwidth weights.

For example, this is the total bandwidth weight in the consensus:

$ cat Library/Application\ Support/TorBrowser-Data/Tor/cached-microdesc-consensus | grep "^w" | cut -d= -f2 | grep -v Unmeasured | paste -s -d + - | bc
43763163

Do you think we can do a graph of total bandwidth weight for votes? Should this go somewhere on metrics? Or should it be a once-off thing that Tom (or someone else) does?

added component::metrics/statistics owner::karsten priority::medium resolution::fixed severity::normal status::closed type::enhancement labels

This should start as a once-off thing. I'll make a first graph in the next few hours and post it here.

Trac:
Status: new to accepted
Owner: metrics-team to karsten

Trac:
totalcw-2018-03-11.csv

Trac:

Here's a graph showing total consensus weights across bandwidth authorities in March 2018:

Let me know if you want something else or another graph for a longer time frame (like all of 2018).

Trac:
Cc: tom to tom, metrics-team

Thanks, this is interesting.

I'd like to see a graph from the "normal state" around September? 2017, through the DDoS in December and failure in February.

Sure, that'll take a while. I'll post the graph as soon it's ready.

Trac:
totalcw-2018-03-11a.csv

Trac:

Here's a new graph covering the time between July 2017 and today:

Thanks! For reference, we'll use this graph in the scaling part of the bandwidth authority session [org/meetings/2018Rome/Notes/BandwidthAuthorityRequirements]

Trac:
Username: nikita
Cc: tom, metrics-team to tom, metrics-team, nikita

It seems like the one-off analysis is done and there are no open question or requests for change particular to that.

Does that mean we can close this ticket? Or should we turn it into a ticket for adding a new graph to Tor Metrics at some point in the future?

Trac:
Status: accepted to needs_information

Replying to karsten:

It seems like the one-off analysis is done and there are no open question or requests for change particular to that.

Yes, thanks, the total consensus weight graphs were really helpful.

Does that mean we can close this ticket? Or should we turn it into a ticket for adding a new graph to Tor Metrics at some point in the future?

It looks like we might need to scale sbws' results to match torflow. So having these graphs permanently would be useful to determine the scaling parameters. And they are useful to monitor the health of each bandwidth authority.

So let's make permanent graphs!

Trac:
Component: Metrics/Analysis to Metrics/Statistics
Status: needs_information to new

Sounds good. Blocking on #21378 (moved), but once the data is available in CollecTor, let's make a new graph.

Trac:
Summary: Compare total consensus weights across bandwidth authorities to Add graph that compares total consensus weights across bandwidth authorities
Owner: karsten to metrics-team
Status: new to assigned

Replying to karsten:

Sounds good. Blocking on #21378 (moved), but once the data is available in CollecTor, let's make a new graph.

I don't think archiving bandwidth files (#21378 (moved)) is blocking this ticket. These graphs show the total bandwidth voted for by each bandwidth authority, and this total bandwidth is in the votes.

Specifically, we want to graph the sum of the "Measured" fields in "w" lines in votes: https://gitweb.torproject.org/torspec.git/tree/dir-spec.txt#n2337

Replying to teor:

Replying to karsten:

Sounds good. Blocking on #21378 (moved), but once the data is available in CollecTor, let's make a new graph.

I don't think archiving bandwidth files (#21378 (moved)) is blocking this ticket.

Uhm, you're right. We can start working on this ticket as time permits. Sorry for the confusion!

No worries!

Please let juga know if there is anything they can do to help with these graphs (for example, reviewing the output).

Trac:
Cc: tom, metrics-team, nikita to tom, metrics-team, nikita, juga

I started working on this ticket and pushed a temporary commit to the task-25459 branch in my repository. I'll now import a few months and then years of data. This may take a while...

Trac:
Owner: metrics-team to karsten
Status: assigned to accepted

Trac: