Opened 8 years ago

Last modified 2 years ago

#3266 needs_information defect

gabelmoo publishes only 1 extra-info descriptor per week

Reported by: karsten Owned by:
Priority: Low Milestone: Tor: unspecified
Component: Core Tor/Tor Version:
Severity: Normal Keywords: tor-relay needs-insight mystery-bug
Cc: Actual Points:
Parent ID: Points:
Reviewer: Sponsor:

Description

I noticed that gabelmoo started publishing exactly 1 extra-info descriptor per week a couple of weeks ago. Here are the number of server descriptors and extra-info descriptors that gabelmoo published per day in 2011:

 date       | platform                                                  | serverdescs | extrainfos
------------+-----------------------------------------------------------+-------------+------------
 2011-01-01 | Tor 0.2.2.20-alpha (git-aae58deb2cdcaad0) on Linux x86_64 |           2 |          2
 2011-01-02 | Tor 0.2.2.20-alpha (git-aae58deb2cdcaad0) on Linux x86_64 |           1 |          1
 2011-01-03 | Tor 0.2.2.20-alpha (git-aae58deb2cdcaad0) on Linux x86_64 |           1 |          1
 2011-01-04 | Tor 0.2.2.20-alpha (git-aae58deb2cdcaad0) on Linux x86_64 |           2 |          2
 2011-01-05 | Tor 0.2.2.20-alpha (git-aae58deb2cdcaad0) on Linux x86_64 |           1 |          1
 2011-01-06 | Tor 0.2.2.20-alpha (git-aae58deb2cdcaad0) on Linux x86_64 |           1 |          1
 2011-01-07 | Tor 0.2.2.20-alpha (git-aae58deb2cdcaad0) on Linux x86_64 |           1 |          1
 2011-01-08 | Tor 0.2.2.20-alpha (git-aae58deb2cdcaad0) on Linux x86_64 |           2 |          2
 2011-01-09 | Tor 0.2.2.20-alpha (git-aae58deb2cdcaad0) on Linux x86_64 |           1 |          1
 2011-01-10 | Tor 0.2.2.20-alpha (git-aae58deb2cdcaad0) on Linux x86_64 |           1 |          1
 2011-01-11 | Tor 0.2.2.20-alpha (git-aae58deb2cdcaad0) on Linux x86_64 |           2 |          2
 2011-01-12 | Tor 0.2.2.20-alpha (git-aae58deb2cdcaad0) on Linux x86_64 |           2 |          2
 2011-01-13 | Tor 0.2.2.20-alpha (git-aae58deb2cdcaad0) on Linux x86_64 |           1 |          1
 2011-01-14 | Tor 0.2.2.20-alpha (git-aae58deb2cdcaad0) on Linux x86_64 |           1 |          1
 2011-01-15 | Tor 0.2.2.20-alpha (git-aae58deb2cdcaad0) on Linux x86_64 |           2 |          2
 2011-01-16 | Tor 0.2.2.20-alpha (git-aae58deb2cdcaad0) on Linux x86_64 |           1 |          3
 2011-01-16 | Tor 0.2.2.21-alpha (git-5f63f0d6312d9f0d) on Linux x86_64 |           2 |          3
 2011-01-17 | Tor 0.2.2.21-alpha (git-5f63f0d6312d9f0d) on Linux x86_64 |           2 |          2
 2011-01-18 | Tor 0.2.2.21-alpha (git-5f63f0d6312d9f0d) on Linux x86_64 |           4 |          3
 2011-01-19 | Tor 0.2.2.21-alpha (git-5f63f0d6312d9f0d) on Linux x86_64 |           2 |          2
 2011-01-20 | Tor 0.2.2.21-alpha (git-5f63f0d6312d9f0d) on Linux x86_64 |           1 |          1
 2011-01-21 | Tor 0.2.2.21-alpha (git-5f63f0d6312d9f0d) on Linux x86_64 |           1 |          3
 2011-01-21 | Tor 0.2.2.19-alpha (git-13e9a2b19d4a65d9) on Linux x86_64 |           2 |          3
 2011-01-22 | Tor 0.2.2.19-alpha (git-13e9a2b19d4a65d9) on Linux x86_64 |           2 |          2
 2011-01-23 | Tor 0.2.2.19-alpha (git-13e9a2b19d4a65d9) on Linux x86_64 |           1 |          1
 2011-01-24 | Tor 0.2.2.19-alpha (git-13e9a2b19d4a65d9) on Linux x86_64 |           1 |          1
 2011-01-25 | Tor 0.2.2.19-alpha (git-13e9a2b19d4a65d9) on Linux x86_64 |           2 |          2
 2011-01-26 | Tor 0.2.2.19-alpha (git-13e9a2b19d4a65d9) on Linux x86_64 |           2 |          2
 2011-01-27 | Tor 0.2.2.19-alpha (git-13e9a2b19d4a65d9) on Linux x86_64 |           1 |          1
 2011-01-28 | Tor 0.2.2.19-alpha (git-13e9a2b19d4a65d9) on Linux x86_64 |           1 |          1
 2011-01-29 | Tor 0.2.2.19-alpha (git-13e9a2b19d4a65d9) on Linux x86_64 |           2 |          2
 2011-01-30 | Tor 0.2.2.19-alpha (git-13e9a2b19d4a65d9) on Linux x86_64 |           1 |          1
 2011-01-31 | Tor 0.2.2.19-alpha (git-13e9a2b19d4a65d9) on Linux x86_64 |           1 |          1
 2011-02-01 | Tor 0.2.2.19-alpha (git-13e9a2b19d4a65d9) on Linux x86_64 |           2 |          2
 2011-02-02 | Tor 0.2.2.19-alpha (git-13e9a2b19d4a65d9) on Linux x86_64 |           2 |          2
 2011-02-03 | Tor 0.2.2.19-alpha (git-13e9a2b19d4a65d9) on Linux x86_64 |           1 |          5
 2011-02-03 | Tor 0.2.2.22-alpha (git-e5e38e55b33b2cc0) on Linux x86_64 |          13 |          5
 2011-02-04 | Tor 0.2.2.22-alpha (git-e5e38e55b33b2cc0) on Linux x86_64 |          24 |          5
 2011-02-05 | Tor 0.2.2.22-alpha (git-e5e38e55b33b2cc0) on Linux x86_64 |          23 |          7
 2011-02-06 | Tor 0.2.2.22-alpha (git-e5e38e55b33b2cc0) on Linux x86_64 |          24 |          6
 2011-02-07 | Tor 0.2.2.22-alpha (git-e5e38e55b33b2cc0) on Linux x86_64 |          24 |          9
 2011-02-08 | Tor 0.2.2.22-alpha (git-e5e38e55b33b2cc0) on Linux x86_64 |          25 |         12
 2011-02-09 | Tor 0.2.2.22-alpha (git-e5e38e55b33b2cc0) on Linux x86_64 |          23 |         13
 2011-02-10 | Tor 0.2.2.22-alpha (git-e5e38e55b33b2cc0) on Linux x86_64 |          24 |         13
 2011-02-11 | Tor 0.2.2.22-alpha (git-e5e38e55b33b2cc0) on Linux x86_64 |          24 |         11
 2011-02-12 | Tor 0.2.2.22-alpha (git-e5e38e55b33b2cc0) on Linux x86_64 |          24 |         11
 2011-02-13 | Tor 0.2.2.22-alpha (git-e5e38e55b33b2cc0) on Linux x86_64 |          23 |         12
 2011-02-14 | Tor 0.2.2.22-alpha (git-e5e38e55b33b2cc0) on Linux x86_64 |          24 |         11
 2011-02-15 | Tor 0.2.2.22-alpha (git-e5e38e55b33b2cc0) on Linux x86_64 |          25 |         10
 2011-02-16 | Tor 0.2.2.22-alpha (git-e5e38e55b33b2cc0) on Linux x86_64 |          23 |         12
 2011-02-17 | Tor 0.2.2.22-alpha (git-e5e38e55b33b2cc0) on Linux x86_64 |          24 |         12
 2011-02-18 | Tor 0.2.2.22-alpha (git-e5e38e55b33b2cc0) on Linux x86_64 |          24 |         11
 2011-02-19 | Tor 0.2.2.22-alpha (git-e5e38e55b33b2cc0) on Linux x86_64 |          24 |          9
 2011-02-20 | Tor 0.2.2.22-alpha (git-e5e38e55b33b2cc0) on Linux x86_64 |          24 |         14
 2011-02-21 | Tor 0.2.2.22-alpha (git-e5e38e55b33b2cc0) on Linux x86_64 |          24 |          9
 2011-02-22 | Tor 0.2.2.22-alpha (git-e5e38e55b33b2cc0) on Linux x86_64 |          25 |         11
 2011-02-23 | Tor 0.2.2.22-alpha (git-e5e38e55b33b2cc0) on Linux x86_64 |          24 |         12
 2011-02-24 | Tor 0.2.2.22-alpha (git-e5e38e55b33b2cc0) on Linux x86_64 |          24 |          9
 2011-02-25 | Tor 0.2.2.22-alpha (git-e5e38e55b33b2cc0) on Linux x86_64 |          26 |         13
 2011-02-26 | Tor 0.2.2.22-alpha (git-e5e38e55b33b2cc0) on Linux x86_64 |          25 |         11
 2011-02-27 | Tor 0.2.2.22-alpha (git-e5e38e55b33b2cc0) on Linux x86_64 |          28 |         12
 2011-02-28 | Tor 0.2.2.22-alpha (git-e5e38e55b33b2cc0) on Linux x86_64 |          25 |         12
 2011-03-01 | Tor 0.2.2.22-alpha (git-e5e38e55b33b2cc0) on Linux x86_64 |          26 |          6
 2011-03-02 | Tor 0.2.2.22-alpha (git-e5e38e55b33b2cc0) on Linux x86_64 |          24 |          5
 2011-03-03 | Tor 0.2.2.22-alpha (git-e5e38e55b33b2cc0) on Linux x86_64 |          24 |          7
 2011-03-04 | Tor 0.2.2.22-alpha (git-e5e38e55b33b2cc0) on Linux x86_64 |          24 |          5
 2011-03-05 | Tor 0.2.2.22-alpha (git-e5e38e55b33b2cc0) on Linux x86_64 |          24 |          9
 2011-03-06 | Tor 0.2.2.22-alpha (git-e5e38e55b33b2cc0) on Linux x86_64 |          10 |          4
 2011-03-06 | Tor 0.2.2.19-alpha (git-35fcec38809f9805) on Linux x86_64 |           2 |          4
 2011-03-07 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          15 |          8
 2011-03-08 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          26 |         14
 2011-03-09 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          23 |         11
 2011-03-10 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          24 |         13
 2011-03-11 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          24 |         13
 2011-03-12 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          24 |         12
 2011-03-13 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          24 |         10
 2011-03-14 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          26 |         15
 2011-03-15 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          28 |         17
 2011-03-16 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          24 |         12
 2011-03-17 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          24 |         13
 2011-03-18 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          24 |         11
 2011-03-19 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          24 |         10
 2011-03-20 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          24 |         10
 2011-03-21 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          24 |         10
 2011-03-22 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          25 |         10
 2011-03-23 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          24 |         10
 2011-03-24 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          24 |          9
 2011-03-25 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          24 |         10
 2011-03-26 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          24 |         10
 2011-03-27 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          24 |          9
 2011-03-28 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          24 |         12
 2011-03-29 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          26 |          7
 2011-03-30 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          24 |          5
 2011-03-31 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          22 |          5
 2011-04-01 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          24 |          8
 2011-04-02 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          22 |          9
 2011-04-03 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          24 |         12
 2011-04-04 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          24 |         11
 2011-04-05 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          25 |         10
 2011-04-06 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          24 |         13
 2011-04-07 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          24 |         11
 2011-04-08 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          24 |         12
 2011-04-09 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          24 |         15
 2011-04-10 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          24 |         11
 2011-04-11 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          24 |         11
 2011-04-12 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          25 |         11
 2011-04-13 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          22 |         12
 2011-04-14 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          24 |         13
 2011-04-15 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |           7 |          4
 2011-04-16 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          18 |          6
 2011-04-17 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          24 |          6
 2011-04-18 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          24 |          8
 2011-04-19 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          25 |         11
 2011-04-20 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          24 |         12
 2011-04-21 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          24 |         10
 2011-04-22 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          24 |         11
 2011-04-23 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          24 |         11
 2011-04-24 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          24 |         10
 2011-04-25 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          24 |         10
 2011-04-26 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          25 |          8
 2011-04-27 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          23 |           
 2011-04-28 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          23 |           
 2011-04-29 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          19 |           
 2011-04-30 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          22 |           
 2011-05-01 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          23 |           
 2011-05-02 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          24 |           
 2011-05-03 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          25 |          1
 2011-05-04 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          23 |           
 2011-05-05 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          24 |           
 2011-05-06 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          24 |           
 2011-05-07 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          24 |           
 2011-05-08 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          24 |           
 2011-05-09 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          24 |           
 2011-05-10 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          25 |          1
 2011-05-11 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          24 |           
 2011-05-12 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          23 |           
 2011-05-13 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          24 |           
 2011-05-14 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          24 |           
 2011-05-15 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          24 |           
 2011-05-16 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          24 |           
 2011-05-17 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          25 |          1
 2011-05-18 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          24 |           
 2011-05-19 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          24 |           
 2011-05-20 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          24 |           
 2011-05-21 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          24 |           
 2011-05-22 | Tor 0.2.2.22-alpha (git-20569f9297fad087) on Linux x86_64 |          17 |           

There are a few irregularities in this table; see also #3265. In this ticket, I'm mostly worried why gabelmoo started publishing only a single extra-info descriptor per week from May 3 on. The exact publication times of the last extra-info descriptors are:

 gabelmoo | 2011-04-25 15:11:50
 gabelmoo | 2011-04-25 18:11:27
 gabelmoo | 2011-04-25 20:10:54
 gabelmoo | 2011-04-26 03:10:27
 gabelmoo | 2011-04-26 04:10:44
 gabelmoo | 2011-04-26 05:12:30
 gabelmoo | 2011-04-26 08:11:24
 gabelmoo | 2011-04-26 08:42:22
 gabelmoo | 2011-04-26 10:12:09
 gabelmoo | 2011-04-26 13:11:09
 gabelmoo | 2011-04-26 14:11:11
 gabelmoo | 2011-05-03 08:42:15
 gabelmoo | 2011-05-10 08:41:46
 gabelmoo | 2011-05-17 08:41:47

Note the almost exact 1-week interval at the end.

It looks like gabelmoo is not the only affected relay, but it's the one with the clearest pattern.

Any idea what's going on?

Child Tickets

Attachments (2)

missing-extra-infos.csv.gz (545.4 KB) - added by karsten 7 years ago.
missing-extra-infos.png (211.4 KB) - added by karsten 7 years ago.

Download all attachments as: .zip

Change History (9)

comment:1 Changed 8 years ago by arma

Weird.

See also
or.h:#define MIN_ONION_KEY_LIFETIME (7*24*60*60)

comment:2 Changed 7 years ago by nickm

Milestone: Tor: 0.2.3.x-final

We should at least try to investigate this one on an 0.2.3.x timeframe, if it's still happening.

comment:3 Changed 7 years ago by nickm

Milestone: Tor: 0.2.3.x-finalTor: unspecified

I'd still like to know what's going on here. If it's simple, the fix might be backportable.

Changed 7 years ago by karsten

Attachment: missing-extra-infos.csv.gz added

Changed 7 years ago by karsten

Attachment: missing-extra-infos.png added

comment:4 Changed 7 years ago by karsten

The problem seems to have stopped around end of 2011, but I still don't know why it happened. I just attached a visualization of missing extra-info descriptors and a CSV file containing the raw data behind the graph. The graph has a dot for each server descriptor that is referenced from a consensus; that dot is black if we also have the referenced extra-info descriptor, or red if we don't have it. Only the top 10 relays by missing extra-info descriptors are shown.

Interesting facts:

  • gabelmoo (F204) failed to publish some of its extra-info descriptors from February to April 2011, before it failed to publish almost all of them for about a month.
  • Relays E812, CE3D, 39BD, and 1E39 started failing to publish their extra-info descriptors in October 2011 for almost two months (or until they went offline in case of E812). Then they suddenly resumed publishing them.
  • Relays AD96 and 3372 had short bursts of a few days or a week of not publishing their extra-info descriptors.
  • Relays F11E, DEF3, and B47B had a phase in early 2011 when they published only some of their extra-info descriptors. This phase coincides with gabelmoo publishing only some of its extra-info descriptors.

I should say that what we see here might not be a bug in tor, but in metrics-db and weasel's directory-archive script. I'm running out of ideas here.

comment:5 Changed 7 years ago by nickm

Keywords: tor-relay added

comment:6 Changed 7 years ago by nickm

Component: Tor RelayTor

comment:7 Changed 2 years ago by nickm

Keywords: needs-insight mystery-bug added
Priority: MediumLow
Severity: Normal
Status: newneeds_information
Note: See TracTickets for help on using tickets.