Opened 9 months ago

Closed 9 months ago

Last modified 8 months ago

#31703 closed defect (fixed)

Downloading Tor Browser from 2620:0:6b0:b:225:dada:19:1 is painfully slow

Reported by: pospeselr Owned by: anarcat
Priority: Medium Milestone:
Component: Internal Services/Service - dist Version:
Severity: Normal Keywords:
Cc: traumschule, trac-dip-importer, mcs Actual Points:
Parent ID: Points:
Reviewer: Sponsor:



(2019-09-11 12:44:26 PM) pospeselr: this one i think: 2620:0:6b0:b:225:dada:19:1
(2019-09-11 12:47:30 PM) pospeselr: though if i wget it it does come down a bit faster
(2019-09-11 12:47:53 PM) arma1: that address is a team cymru address
(2019-09-11 12:48:03 PM) arma1: i wonder if its magic black box ddos defense thinks you're a bad person
(2019-09-11 12:48:21 PM) pospeselr: well i mean i am obviously, but i would still like to dl tor browser quickly >:[
(2019-09-11 12:48:52 PM) pospeselr: and i take it back, the wget dl is slowly slowing down, 80 kb/s now 
(2019-09-11 12:49:23 PM) arma1: anarcat: ^ you any good at these topics? :)
(2019-09-11 12:49:43 PM) anarcat: arma1: i'm in a meeting, but i'll be here in 10min
(2019-09-11 12:49:47 PM) anarcat: arma1: what's the TL;DR
(2019-09-11 12:49:59 PM) pospeselr: server slow plz make fast
(2019-09-11 12:50:03 PM) arma1: one of the dist.tpo is being slow for pospeselr
(2019-09-11 12:50:14 PM) arma1: not critical
(2019-09-11 12:50:18 PM) anarcat: one of, which?
(2019-09-11 12:50:37 PM) anarcat: how to reproduce?
(2019-09-11 12:50:38 PM) arma1: aka 2620:0:6b0:b:225:dada:19:1
(2019-09-11 12:50:51 PM) anarcat: Host not found: 3(NXDOMAIN)
(2019-09-11 12:50:53 PM) anarcat: great
(2019-09-11 12:51:21 PM) anarcat: that's at cymru
(2019-09-11 12:52:25 PM) anarcat: it's specifically
(2019-09-11 12:52:34 PM) anarcat: which file should i try to get?
(2019-09-11 12:53:03 PM) anarcat: ( i found the server through a search in ldap)
(2019-09-11 12:53:54 PM) pospeselr:
(2019-09-11 12:54:36 PM) anarcat: Connecting to (|2620:0:6b0:b:225:dada:19:1|:443... failed: Network is unreachable.
(2019-09-11 12:54:37 PM) anarcat: duh
(2019-09-11 12:55:18 PM) anarcat: i'm getting 130KB/s there now
(2019-09-11 12:55:30 PM) pospeselr: yeah exactly
(2019-09-11 12:55:41 PM) pospeselr: and it'll slow down to tourghly 50 kb/s shortly
(2019-09-11 12:56:33 PM) anarcat: yeah, there might be saturation there
(2019-09-11 12:56:39 PM) anarcat: i'll take a look at the host (moly)
(2019-09-11 12:58:26 PM) anarcat: network's saturated on moly
(2019-09-11 12:58:28 PM) anarcat: 12MB/s
(2019-09-11 12:58:32 PM) anarcat: mbps
(2019-09-11 1:01:38 PM) arma1: anarcat: in the past, sometimes, cymru ran black box ddos resistance doohickeys on their network, and we discovered them (and bugs in them) by seeing anomalies like this
(2019-09-11 1:09:41 PM) anarcat: well it sure seems like the cymru web mirror is capped to 100mbps

Child Tickets

Attachments (1)

traffic-per-class.png (87.5 KB) - added by anarcat 8 months ago.

Download all attachments as: .zip

Change History (8)

comment:1 Changed 9 months ago by anarcat

battle plan:

  1. i poked cymru about upgrading to gbps. weasel memory tells us we used to be but we have been downgraded over 6 months ago at least (according to backups)
  2. if cymru fails or times out (7 days?), we setup another mirror (or varnish cache) elsewhere (fsn cluster?)

comment:2 Changed 9 months ago by ggus

Cc: ggus removed
Component: Webpages/WebsiteInternal Services/Service - dist

Moving to Internal Services/Service - dist.

comment:3 Changed 9 months ago by anarcat

rejected options:

  • redirect traffic to sunet (got cold feet after last DDOS) or savii (not all the files)
  • just pull cymru out of rotation altogether (could overload existing mirrors and kill other mirrors)

comment:4 Changed 9 months ago by mcs

Cc: mcs added

comment:5 Changed 9 months ago by anarcat

it seems this fixed itself, maybe by cymru:

14:12:30 <weasel> [412201.561239] igb 0000:01:00.0 eth0: igb: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX

Local time (UTC-4). Traffic now flows freely on moly and you should have better performance now:

anarcat@angela:~(master)$ curl --resolve '' -o /dev/null 
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 72.3M  100 72.3M    0     0  2490k      0  0:00:29  0:00:29 --:--:-- 2513k

Thanks for the report!

comment:6 Changed 9 months ago by anarcat

Resolution: fixed
Status: assignedclosed

forgot to close this

Changed 8 months ago by anarcat

Attachment: traffic-per-class.png added

comment:7 Changed 8 months ago by anarcat

proof there was network saturation and it is solved:

pretty clear, no? :)

Note: See TracTickets for help on using tickets.