Opened 8 months ago

Last modified 6 months ago

#33507 new task

Deploy new exit scanner and check combo on check-01 using metrics-cloud

Reported by: irl Owned by: metrics-team
Priority: Very High Milestone:
Component: Metrics/Exit Scanner Version:
Severity: Normal Keywords:
Cc: metrics-team, gaba Actual Points:
Parent ID: Points:
Reviewer: Sponsor:


This is not the same project as #29650, which was a more ambitious attempt at fixing some of the shortcomings of the current setup. Instead, this project aims to keep the service running with minimal changes until we have more time/funding to take on the increased level of work that would be involved for the more ambitious project. For avoidance of doubt, I still believe that #29650 is going to be needed soon and is entirely valid work for the Metrics Team to do.

This ticket blocks #29399 which is of a high priority to the sysadmin team.

The parts of the existing service that can be reused will be reused, which is really just the check application. The check application is written in Go and uses local filesystem data sources (which have to be updated by a tor client). It has an embedded web server and we reverse proxy this via Apache.

The exit scanner and DNS server were written in Haskell. We can't maintain this so instead we are using exitmap wrapped in a Python script to produce exit lists compatible with the existing format (i.e. we're not going to a new format yet). A second python script runs by cron job to write out a BIND compatible zone file, which is served by bind.

The exact split between Metrics Team and Sysadmin Team responsibilities are details in the ops doc for this service (which is yet to be written).

Child Tickets

#33506closedirlComplete Ansible playbook for exit scanner (check-01) deploymentMetrics/Exit Scanner
#33508acceptedirlWrite Ops Doc for check serviceMetrics/Exit Scanner
#33509closedmetrics-teamConfirm that CollecTor will be happy consuming data from the new check serviceMetrics/CollecTor
#33536closedanarcatAdd aliases to apache config on check-01Internal Services/Tor Sysadmin Team

Change History (7)

comment:1 Changed 8 months ago by irl

Component: Internal Services/Tor Sysadmin TeamMetrics/Exit Scanner
Owner: changed from tpa to metrics-team

comment:2 in reply to:  description Changed 8 months ago by anarcat

Replying to irl:

This ticket blocks #29399 which is of a high priority to the sysadmin team.

Thank you so much for writing this up and prioritizing this work. :)

comment:3 Changed 8 months ago by gaba

Keywords: metrics-team-roadmap-2020Q1 added

comment:4 Changed 7 months ago by gaba

Keywords: metrics-team-roadmap-2020April added; metrics-team-roadmap-2020Q1 removed

Move some of the tickets from last metrics roadmap to the roadmap in April.

comment:5 Changed 7 months ago by anarcat

Parent ID: #29399

removing parent ticket so i can retire chiwui, as agreed in #29399

comment:6 Changed 6 months ago by gaba

Keywords: metrics-team-roadmap-2020 added; metrics-team-roadmap-2020April removed

We need to review all this tickets for metrics roadmap.

comment:7 Changed 6 months ago by gaba

Keywords: metrics-team-roadmap-2020 removed
Note: See TracTickets for help on using tickets.