Rewrite Onionoo in python

Ticket to track the progress of pyonionoo

Milestones - 

• Parse consensus

• GeoIP lookups

• Reverse DNS lookups 

• Parse server descriptors

• Parse exit lists

• Read and parse extra-info descriptors

• Store data in db

added component::pyonionoo owner::gsathya parent::8252 priority::medium resolution::wontfix status::closed type::project labels

Trac:
Cc: N/A to gsathya, atagar, karsten
Description: Ticket to track the progress of pyonionoo

to

Ticket to track the progress of pyonionoo

Milestones - 

• Parse consensus

• GeoIP lookups

• Reverse DNS lookups 

• Parse server descriptors

• Parse exit lists

• Read and parse extra-info descriptors

• Store data in db

A bunch of completed milestones (https://gitweb.torproject.org/user/gsathya/pyonionoo.git/shortlog/refs/heads/backend)

• Parse consensus

I've written a simple consensus parser - https://gitweb.torproject.org/user/gsathya/pyonionoo.git/blob/refs/heads/backend:/backend/main.py#l14

neena is working on a network status descriptor parser for stem and once that's completed, I'll use that.

The consensus is parsed and the data is stored in a "Router"(https://gitweb.torproject.org/user/gsathya/pyonionoo.git/blob/refs/heads/backend:/backend/router.py#l4) object.

• GeoIP lookups

Use pygeoip to parse Maxmind's GeoIP database.

• Reverse DNS lookups

Use threads (https://gitweb.torproject.org/user/gsathya/pyonionoo.git/blob/refs/heads/backend:/backend/util.py) to find the hostnames (https://gitweb.torproject.org/user/gsathya/pyonionoo.git/blob/refs/heads/backend:/backend/main.py#l49)

Next Up - I'm going to read and parse the server descriptors using stem.

Trac:
Status: new to needs_review

Leaving the component empty makes baby turtles cry.

Trac:
Component: - Select a component to Metrics Utilities

Trac:
Component: Metrics Utilities to Onionoo

Trac:
Type: defect to project

Trac:
Status: needs_review to new

Trac:
Owner: N/A to gsathya
Component: Onionoo to pyonionoo

Trac:
Summary: rewrite onionoo in python to Rewrite Onionoo in python
Parent: N/A to #8252 (closed)

The above list of things that need to be done in order to rewrite Onionoo in Python is very likely outdated. Whoever may pick up pyonionoo coding in the future will have to make a new list. No need to keep this ticket open anymore. Closing.

Trac:
Status: new to closed
Resolution: N/A to wontfix

closed

mentioned in issue #7987 (moved)