Opened 9 years ago

Closed 8 years ago

#5875 closed task (fixed)

Write progress report to date.

Reported by: phobos Owned by: phobos
Priority: Medium Milestone:
Component: Archived/Ooni Version:
Severity: Keywords: SponsorH201208
Cc: hellais Actual Points:
Parent ID: Points:
Reviewer: Sponsor:


Child Tickets

Change History (3)

comment:1 Changed 8 years ago by karsten

Keywords: SponsorH201208 added
Milestone: Sponsor H: August 2012

Switching from using milestones to keywords for sponsor deliverables. See #6365 for details.

comment:2 Changed 8 years ago by arma

Cc: hellais added

Arturo tells me some tor-reports mail he sent satisfies this ticket. Arturo, can you paste which one and then close?

comment:3 Changed 8 years ago by hellais

Resolution: fixed
Status: newclosed

## August

The month of August was dedicated to laying out the foundations and the overall architecture of the ooniprobe backend and client system.

  • Work on daphn3

## September

This month was mainly aimed at designing an API that would be flexible enough for supporting the writing of tests easily from third party developers.

  • Implemented the ooniprobe client API based on twisted trial:

  • Write documentation for the API:

  • Implement Scapy test template. This allows developers to write tests using the Scapy packet injection framework:

  • Find bugs in YAML, fix them:

  • Add timeout support to scapy test template:

  • Outline what is necessary for having database support in oonibackend:

  • Add basic SSL support in our test helper:

## October

  • Get the captive portal test to work:

  • Rewrite DNS tamper test to use twisted functions instead of default python ones:

  • Add support for getting the probes IP address via check.tpo:

  • Work on removing dead code and refactoring:

  • Multiple iterations over getting the documentation ready and the tests working as they should

## November

November was dedicated to making sure that the design layer out and experimented with in the past months worked properly. Focus was placed on the ooniprobe command line tool. The ooniprobe backend was made to do the basic set of tasks it needed to support the running of tests.


  • Alpha support for logging to PCAP
  • Alpha support for starting and stopping of Tor
  • Alpha support for reporting to Tor Hidden Services
  • Revert to a state in which everything was not broken and attempt to port Bridget

  • Make the DNS Tamper test use the a lower, more flexible twisted API call:

  • Work on the backend system database support:

  • Drop support for the old API:

  • Add GeoIP Lookup support for determining the probes ASN number and country:

  • Improve the scapy test template:

  • Iterations over existing tests:

  • Add basic basic capture support by spawning a thread:

  • Improve txscapy so that it uses a valid file descriptor instead of spawning a thread:

  • Config file support for oonib:

  • Engage the community in contributing code:

  • First iteration over Tor Hidden Service support for oonib and ooniprobe

  • First iteration over TCP Test template. This allows to specify a TCP payload from a flat file and it will get sent to the destination address and the response will be recorded.

  • Work with somebody in Turkey to get them to run some tests.
  • Implement DNS Spoofing test:

  • First iteration over resume support and test state tracking:

  • Add support for starting Tor via txtorcon:

  • Get aagbsn up to speed on ooniprobe.
  • Implement HTTP Request Line "fuzzer":

and document it:

  • Add support for ooniprobe test decks:

  • Work on documentation for various tests.
  • Lot's of refactoring:

## December

December has started as a month of craziness and me and aagbsn have been working very hard to make sure that we reach the 0.1 in time for the expected date.

In particular we have started data collection from some machines we have rented.

  • Get aagbsn up to speed with ooniprobe and guide him through the things that need to be done
  • Buy some machines for running of tests
  • Coordinate the migration of to ooni.tpo

  • Talk with the developer to get a Tor hidden service running to deliver us safe code via pip.
  • Iterations over the bugs that aaron encountered while running the code:

  • Work with twisted developers of a better SOCKS5/4/4a implementation:

Note: this is not yet bundled with ooniprobe and at this point will probably only be done post 0.1

  • Normalize the report format so that it follows ISO8601:

  • Setting up of the machines for the collector and test helper
  • Documentation and quality assurance for the 0.1 release:

Note: See TracTickets for help on using tickets.