Opened 2 years ago

Last modified 15 months ago

#21883 needs_information defect

Perform one-off analysis for number of relays a bwauth decided the median for

Reported by: Sebastian Owned by: tom
Priority: Medium Milestone:
Component: Metrics/Analysis Version:
Severity: Normal Keywords: metrics-2018
Cc: metrics-team Actual Points:
Parent ID: Points:
Reviewer: Sponsor:

Description

Having some graphs for all-time, last year and maybe last month or so would be cool. Thanks!

Child Tickets

Change History (11)

comment:1 Changed 2 years ago by karsten

I put a sample graph on #21882, because there were lots of good thoughts on making such a graph. Please take a look there. Once we have a graph we're happy with, I'll make one for a few months of data (which takes a while).

comment:2 Changed 2 years ago by tom

Owner: changed from metrics-team to tom
Status: newassigned

So for the historical bwauth measuring graphs - I think i will generate historical data for them... What i do currently is place data into a sqlite database, and then every hour export the most recent 90 days worth of data in a csv for javascript graph generation. I think I will backfill the database... so I ought to be able to generate some one-off graphs like the ones you created showing historical data.

I'm wondering if/what is the best approach to let my consensus-health graphs get configurable and usable in metrics.tpo

comment:3 in reply to:  2 Changed 2 years ago by karsten

Replying to tom:

So for the historical bwauth measuring graphs - I think i will generate historical data for them... What i do currently is place data into a sqlite database, and then every hour export the most recent 90 days worth of data in a csv for javascript graph generation. I think I will backfill the database... so I ought to be able to generate some one-off graphs like the ones you created showing historical data.

That would be neat!

I'm wondering if/what is the best approach to let my consensus-health graphs get configurable and usable in metrics.tpo

Fine question! There's no easy answer, because so far we don't use externally provided .csv files for graphs on Tor Metrics. But I could imagine doing this in the future, if the data reaches back to more than the past 90 days (ideally a few years back when bandwidth authorities became a thing). We could simply fetch the .csv files as part of the cronjob that generates .csv files. Though I'd say, for now, let's start with the graphs on consensus-health.tpo and see if they're as useful as we hope. If they are, let's have this discussion again!

comment:4 Changed 2 years ago by tom

I have created a first draft of the historical graphs here, covering 90, 180, 365, and 720 days: https://ritter.vg/misc/bwauth-historical/graphs-historical.html

If these graphs are useful enough (for now) this can be the final draft until.... I expect that I will be making interactive graphs that enable historical analysis also, so feedback on how these graphs look will guide into that.

comment:5 Changed 2 years ago by tom

Status: assignedneeds_information

comment:6 Changed 21 months ago by karsten

Summary: One-off analysis for number of relays a bwauth decided the median forPerform one-off analysis for number of relays a bwauth decided the median for

Adding a verb to the summary to make this ticket "actionable". Speaking of, what remains to be done here?

comment:7 Changed 21 months ago by tom

I don't think anything needs to be done, unless Sebastian or Karsten or anyone has comments about the graphs (either the look or questions about the data.) Although it's been a while since I generated them so I will need to relearn what I did ;)

comment:8 Changed 21 months ago by karsten

Keywords: metrics-2018 added

comment:9 Changed 21 months ago by karsten

Keywords: metrics-2017 added; metrics-2018 removed

comment:10 Changed 18 months ago by iwakeh

Keywords: metrics-2018 added; metrics-2017 removed

Will be completed in 2018.

comment:11 Changed 15 months ago by irl

Cc: metrics-team added

Adding metrics-team to cc

Note: See TracTickets for help on using tickets.