MS: Perform fetches of check.tpo in an exitmap plugin

For this milestone, the connection helper (#32263 (moved)) is glued to the ExitSpider class (#32262 (moved)) in a new ExitScanner plugin.

It will be necessary to implement some parser for check.tpo's output in order to extract the IP address from it.

Trac:
Parent Ticket: #29654 (moved)

added component::metrics/exit scanner owner::irl parent::29654 priority::medium resolution::fixed reviewer::karsten severity::normal status::closed type::task labels

exitmap can do this

Trac:
Summary: MS: Perform fetches of check.tpo in an ExitScanner plugin to MS: Perform fetches of check.tpo in an exitmap plugin

Trac:
Owner: metrics-team to irl
Status: new to accepted

https://github.com/irl/exitmap/commit/fb0e74e6f818aa368f5119f9499d84019ab6c52e is the commit, but really it is just adding a more verbose log message at a higher log level on line 73.

I think the big changes between this and the current system are:

• things will be scanned more often (with the current network we can check every relay every 50 minutes or so)
• there are no retries (maybe doesn't matter with the more frequent scanning, i'm not sure if the old system had retries)
• the scanner is stateless, tor holds the state, it's the job of the merger script in #32265 (moved) to carry forward old results
• the scanner doesn't output a published or last

Exit policies are checked to see if it's possible to exit to check.torproject.org. If it's not possible, no attempt will be made.

No descriptor information other than the fingerprint is in the output. This means exit lists don't contain the OR IP address. I /think/ Exonerator gets this from parsing server descriptors anyway.

Review is more for the concept than the code.

Trac:
Reviewer: N/A to karsten
Status: accepted to needs_review

Trac:
Status: needs_review to accepted

This is completed.

Trac:
Status: accepted to closed
Resolution: N/A to fixed

closed

mentioned in issue #32265 (moved)

mentioned in issue #32473 (moved)

mentioned in issue #29654 (moved)