Opened 2 months ago

Closed 7 weeks ago

Last modified 7 weeks ago

#32129 closed enhancement (fixed)

Increase Snowflake proxy poll interval to 300 s

Reported by: dcf Owned by:
Priority: Medium Milestone:
Component: Circumvention/Snowflake Version:
Severity: Normal Keywords:
Cc: arlolra, cohosh, phw, dcf Actual Points:
Parent ID: Points:
Reviewer: Sponsor:

Description

The Snowflake proxies are polling the broker more frequently than necessary for the number of clients we have. The broker reports about 500 proxies currently, which at the current poll interval of 20 s, is 25 polls/s.

At the anti-censorship meeting today we talked about increasing the interval to 300 s, which would still give us an expected time-to-proxy-assignment of less than 1 s.

17:41:02 <dcf1> A few weeks ago I tailed the log of the broker, and requests were coming in furiously.
17:41:23 <dcf1> Lately those particular log lines have been removed, so it's not as apparent, but according to https://snowflake-broker.bamsoftware.com/debug there's 500 proxies,
17:41:39 <dcf1> and with a poll interval of 20 s, that's 25 incoming proxy requests per second.
17:41:42 <arma2> i liked the idea of having the broker tell each snowflake when to come back
17:41:59 <dcf1> Something on the order of 1 or 2 per second is probably adequate.
17:42:07 <cohosh> arma2: serna has started on that ticket
17:42:14 <cohosh> i agree
17:42:23 <dcf1> arma2: yeah that's #25598, serna ran into some trouble with that.
17:42:42 <cohosh> we have metrics of how many idle proxies we have: https://metrics.torproject.org/collector/archive/snowflakes/
17:42:57 <cohosh> and it is orders of magnitude more than the the number of client matches
17:43:31 <dcf1> Anyway, I think an interval of around 300 seconds would be workable.
17:43:37 <cohosh> sounds good

Child Tickets

Attachments (1)

0001-Increase-proxy-poll-interval-to-300-s.patch (1.3 KB) - added by dcf 2 months ago.

Download all attachments as: .zip

Change History (8)

comment:1 Changed 2 months ago by dcf

Status: newneeds_review

comment:2 Changed 2 months ago by cohosh

Looks good, but we could take this opportunity to increase user experience a bit more and only change the poll interval for web-based proxies. There are only about 10 standalone proxies, so having these poll more often shouldn't overload the broker.

This might help alleviate things until #29206 is merged.

comment:3 Changed 7 weeks ago by cohosh

Status: needs_reviewmerge_ready

I'm gonna say this is ready for merge, but I'd prefer the change to apply only to browser proxies and not proxy-go instances for now.

comment:5 Changed 7 weeks ago by cohosh

Just updated the Firefox and Chrome webextension versions (along with a translation update)

comment:6 in reply to:  3 Changed 7 weeks ago by dcf

Resolution: fixed
Status: merge_readyclosed

Replying to cohosh:

I'm gonna say this is ready for merge, but I'd prefer the change to apply only to browser proxies and not proxy-go instances for now.

Okay, that works for me.

comment:7 Changed 7 weeks ago by dcf

I updated the snowflake.torproject.org deployment to webext-0.0.13 at 2019-10-29 00:54:35.

Note: See TracTickets for help on using tickets.