Log whether flash proxies have opted in

Make the facilitator log, for each request, whether the proxy has set the flashproxy-allow cookie. This will allow us to estimate how much proxy capacity we will lose by going to opt-in-only.

added component::archived/flashproxy owner::aallai priority::high resolution::fixed status::closed type::enhancement labels

Trac:
Cc: N/A to bastik.public@gmx-topmail.de

It occurs to me that we could also just require opt-in for a few days and see what happens. Proxies reload themselves every 24 hours because of a meta refresh in the embed. Make the switch, give them 24 hours to settle, then a day or two of measuring capacity, then switch back.

Trac:
Owner: dcf to aallai
Status: new to assigned

I have an implementation at https://github.com/aallai/flashproxy.git branch opt-in.The proxy sends the repr() of the cookie setting to facilitator.cgi, which then writes a timestamp and newline to the appropriate text file. 

According to http://pubs.opengroup.org/onlinepubs/009695399/functions/pwrite.html, we don't need to worry about file locking for appends, as long as we don't run into file size limits (i.e. disk gets full). 

Trac:
Username: aallai
Cc: bastik.public@gmx-topmail.de to bastik.public@gmx-topmail.de, alexandre.allaire@mail.mcgill.ca
Status: assigned to needs_review

I rebased and reworked your opt-in branch to this: https://gitweb.torproject.org/user/dcf/flashproxy.git/shortlog/refs/heads/allow-log.

This is running now on the public facilitator (as of 2013-02-05 19:13:28 EST) and we are logging cookie values. I'll wait a few days and update the ticket.

Trac:
Status: needs_review to needs_information

I showed graphs of the last two weeks of logs in my talk today. Thanks aallai for helping with the graphs. Also attaching the grpahs to the ticket.

http://bamsoftware.com/talks/ee380-flashproxy/index.html#s13 http://bamsoftware.com/talks/ee380-flashproxy/index.html#s14

It looks like about 2 or 3 percent of our current proxies have opted in. Marking this done because we got the logging done, now have to decide what to do with the results.

Trac:
Status: needs_information to closed
Resolution: N/A to fixed

Trac:

Trac:

Actually I decided I don't want to keep the cookie logging forever. Let's turn it on again in the future if we need it. I pushed proxy code that doesn't send the cookie value at Thu Feb 21 13:04:51 PST 2013.

Attaching the log file that was the data source for the attached graphs. Also present in http://bamsoftware.com/talks/ee380-flashproxy.zip.

closed

Trac:
flashproxy-allow.20130220.gz

Log file of cookie settings.