Changes between Version 7 and Version 8 of org/meetings/2017Montreal/Notes/MetricsTimelineWorkshop


Ignore:
Timestamp:
Oct 17, 2017, 9:21:52 PM (2 years ago)
Author:
dcf
Comment:

Copy notes from 2017Montreal/Notes/MetricsTimeline.

Legend:

Unmodified
Added
Removed
Modified
  • org/meetings/2017Montreal/Notes/MetricsTimelineWorkshop

    v7 v8  
    3535
    3636== Notes ==
     37
     38Date: 2017-10-12\\
     39Facilitator: David Fifield\\
     40Session wiki: <https://trac.torproject.org/projects/tor/wiki/org/meetings/2017Montreal/AgendaIdeas#Metricstimelineworkshop>\\
     41Tables with event timelines online at <https://trac.torproject.org/projects/tor/wiki/doc/MetricsTimeline>
     42
     43- David shows graphs of connections from Iran
     44  - Directly-connecting users shows a couple of significant drops
     45  - Data comes from directory mirrors
     46  - Adding graph of bridge users indicates users switched to using bridges
     47  - Adding bridge of bridge users by pluggable transport shows that some specific transports were blocked but others were not
     48  - Compared to global users, which shows universal drop in obfs3 users, which leads one to realize that the drop was a statistics anomaly caused by the time between the Bridge Authority Tonga went offline and Bifröst came online
     49
     50- David shows list of events he has been compiling that collectively can help explain patterns and features of metrics graphs
     51
     52- David shows monster list of per-country Tor users from 2011 to present
     53  - Each graph shows a noticeable increase in users in 2013, which we know is due to a botnet using Tor but which is frequently misinterprited
     54
     55- Options for group
     56  1. Look for interesting patterns in per-country user counts
     57  2. Search the Internet for events that can explain interesting changes in Tor statistics
     58  3. Research the entries in the "Unknown" category to find any possible explanations.
     59
     60- Example of ideal metrics annotation, spike in users from Bangladesh (due to block of Facebook, WhatsApp, and Viber)
     61
     62- News timeline data already put on metrics website <https://metrics.torproject.org/news.html>
     63
     64- No current plan for ongoing updating and maintaining event data related to metrics
     65
     66- OONI has a similar need of real-world explanations for its measurements
     67
     68- Analytics packages exist with timeline annotations?
     69
     70- Group proceeds to identify interesting features of graphs of per-country user numbers 2011-present.
     71- Things that might be useful to keep in mind when explaining graph features
     72  - Change in GeoIP database
     73  - Change in the way that Directory Authorities or Bridge Authorities work
     74  - Smaller countries have fewer users, and so changes are less likely to be related to any Tor or censorship event, and moreover it is probably harder to find data about events an that country due to less coverage
     75  - Tor Browser and Orbot releases, which sometimes contain new default bridges
     76
     77- Interesting methods of analysis
     78  - Anomaly detector (e.g. from Joss Wright)
     79  - Joint analysis of relay and bridge users
     80  - Use Google Trends to search for popularity of Tor-related search terms over time broken down by country
     81
     82- Discussion of how to get reports explaining metrics observations
     83  - Everybody is invited to contribute to the wiki at <https://trac.torproject.org/projects/tor/wiki/doc/MetricsTimeline>. These events will ideally be overlaid/annotating Tor Metrics graphs. The input would ideally be machine readable to allow this annotation to be done automatically. Perhaps this would be better done as a form for users.
     84  - Present an anomaly to affected users and ask them to give suggestions for explanations. Can operate through existing network of people partnering with OONI.
     85  - Infolabe anomalies mailing list does send anomalies to subscribed users.