Write script to aggregate relay weights by country, AS, or relay family

lunar is interested in adding pie charts about relays/capacity per AS network and similar statistics to Atlas. In order to do this, Onionoo should provide these data in a convenient way. These data would be based on the very last consensus and would not incorporate any history.

We should probably wait for the Python Onionoo to implement this and not extend the Java Onionoo. Setting priority to minor.

added component::metrics utilities owner::karsten parent::6460 priority::medium resolution::implemented status::closed type::enhancement labels

Trac:
stats.py

PoC to get percentages of consensus weight of running relays by country

See also the working script here:

https://gitweb.torproject.org/metrics-tasks.git/tree/HEAD:/task-6329

This ticket is related to metrics to measure the safety of the Tor network, too.

Trac:
Parent: N/A to #6460 (moved)

The original ticket description isn't as accurate anymore. We have a script that downloads Onionoo's details document and aggregates weights locally. There's no need to add another document type to Onionoo only to provide the same data in a more compact format. Changing the description to something that focuses on the script using Onionoo's existing data. Also changing the component to something more general and setting priority back to normal.

The "relay family" part is still in progress. There's a patch on tor-relays that needs reviewing, and maybe Onionoo needs a new field to facilitate filtering/aggregating by relay family.

Once the relay family part is implemented, we'll probably want to add the script's functionality to Atlas. But that requires a new ticket then.

Trac:
Priority: minor to normal
Status: new to assigned
Summary: Make Onionoo provide aggregate data based on the current consensus to Write script to aggregate relay weights by country, AS, or relay family
Component: Onionoo to Metrics Utilities
Owner: N/A to karsten

Trac:
Cc: lunar to lunar, gsathya

Replying to karsten:

The "relay family" part is still in progress. There's a patch on tor-relays that needs reviewing, and maybe Onionoo needs a new field to facilitate filtering/aggregating by relay family.

There's #6662 (moved) for grouping by family now. Turns out it's not trivial to group by family, so we'll have to agree on one of a few definitions. That's an argument against adding a new field to Onionoo, and a reason to put this in whichever Onionoo client wants to group by relay family.

Once the relay family part is implemented, we'll probably want to add the script's functionality to Atlas. But that requires a new ticket then.

Instead of extending Atlas, we created Compass as web interface for this script.

That concludes this ticket. Closing.

Trac:
Resolution: N/A to implemented
Status: assigned to closed

closed

mentioned in issue #6450 (moved)

mentioned in issue #6498 (moved)

mentioned in issue #6509 (moved)