Opened 3 years ago

Closed 2 months ago

#20473 closed defect (fixed)

Fix Chutney Nodes that don't bootstrap

Reported by: teor Owned by: teor
Priority: Medium Milestone:
Component: Core Tor/Chutney Version:
Severity: Normal Keywords: network-team-roadmap-2019-Q1Q2-maybe
Cc: Actual Points: 0.4
Parent ID: #30066 Points: 1
Reviewer: Sponsor: Sponsor19-can

Description

In https://trac.torproject.org/projects/tor/ticket/14881#comment:58 , pastly reports:

./nodes.basic-min/000a/ probably failed to bootstrap
./nodes.basic-min/001a/ probably failed to bootstrap
./nodes.basic-min/002r/ probably failed to bootstrap
./nodes.bridges-ipv6-min/000a/ probably failed to bootstrap
./nodes.bridges-ipv6-min/001ba/ probably failed to bootstrap
./nodes.bridges-ipv6-min/002r/ probably failed to bootstrap
./nodes.bridges-min/000a/ probably failed to bootstrap
./nodes.bridges-min/001ba/ probably failed to bootstrap
./nodes.bridges-min/002r/ probably failed to bootstrap
./nodes.ipv6-exit-min/000a/ probably failed to bootstrap
./nodes.ipv6-exit-min/001a/ probably failed to bootstrap
./nodes.ipv6-exit-min/002r/ probably failed to bootstrap

We should fix this.
We should also integrate this check into chutney.

Child Tickets

Attachments (1)

bootstrap-test (460 bytes) - added by pastly 3 years ago.
bash script that generated the output in the description

Download all attachments as: .zip

Change History (12)

comment:1 Changed 3 years ago by teor

Points: 1

Changed 3 years ago by pastly

Attachment: bootstrap-test added

bash script that generated the output in the description

comment:2 Changed 19 months ago by teor

Owner: teor deleted
Status: newassigned

Disowning tickets I don't intend to work on in the next 6 months.

comment:3 Changed 19 months ago by teor

Status: assignednew

Mark all tickets that are assigned to nobody as "new".

comment:4 Changed 8 months ago by teor

Parent ID: #27912

This might be needed for #27912

comment:5 Changed 8 months ago by teor

Parent ID: #27912#20647

Not required for #27912.

comment:6 Changed 3 months ago by teor

Parent ID: #20647#22132

comment:7 Changed 3 months ago by teor

Sponsor: Sponsor19-can

If not bootstrapping is a common failure mode, we should do this for Sponsor 19.

comment:8 Changed 3 months ago by teor

Parent ID: #22132

But we don't need to do it for #22132.

comment:9 Changed 3 months ago by teor

Keywords: network-team-roadmap-2019-Q1Q2-maybe added
Owner: set to teor
Parent ID: #29729
Status: newassigned

We might need this for #29729.

comment:10 Changed 2 months ago by teor

Parent ID: #29729#30066

I've found some bootstrap issues in #30066:

basic-min:

Launching chutney using Python 2.7.10
DEBUG: Tor version 0.4.1.0-alpha-dev (git-7741b21d0e3afbfc).

test000a     is running with PID  7352: Tor 0.4.1.0-alpha-dev (git-7741b21d0e3afbfc)
test001a     is running with PID  7355: Tor 0.4.1.0-alpha-dev (git-7741b21d0e3afbfc)
test002r     is running with PID  7358: Tor 0.4.1.0-alpha-dev (git-7741b21d0e3afbfc)
test003c     is running with PID  7361: Tor 0.4.1.0-alpha-dev (git-7741b21d0e3afbfc)
4/4 nodes are running
Waiting 60 seconds for a consensus containing relays to be generated...

Launching chutney using Python 2.7.10
Waiting for nodes to bootstrap...
Bootstrap failed. Node status:
DEBUG: Tor version 0.4.1.0-alpha-dev (git-7741b21d0e3afbfc).

test000a: (0, 'starting', 'Starting')
test001a: (0, 'starting', 'Starting')
test002r: (0, 'starting', 'Starting')
test003c: (100, 'done', 'Done')
Tor bootstrap failed, ignoring for now.

bridges-min:

Launching chutney using Python 2.7.10
test000a     is running with PID  7446: Tor 0.4.1.0-alpha-dev (git-7741b21d0e3afbfc)
test001ba    is running with PID  7449: Tor 0.4.1.0-alpha-dev (git-7741b21d0e3afbfc)
test002r     is running with PID  7452: Tor 0.4.1.0-alpha-dev (git-7741b21d0e3afbfc)
test003br    is running with PID  7455: Tor 0.4.1.0-alpha-dev (git-7741b21d0e3afbfc)
test004bc    is running with PID  7458: Tor 0.4.1.0-alpha-dev (git-7741b21d0e3afbfc)
5/5 nodes are running
Waiting 60 seconds for a consensus containing relays to be generated...

Launching chutney using Python 2.7.10
Waiting for nodes to bootstrap...
Bootstrap failed. Node status:
test000a: (0, 'starting', 'Starting')
test001ba: (0, 'starting', 'Starting')
test002r: (0, 'starting', 'Starting')
test003br: (100, 'done', 'Done')
test004bc: (100, 'done', 'Done')
Tor bootstrap failed, ignoring for now.

bridges+ip6-min:

Launching chutney using Python 2.7.10
test000a     is running with PID  7751: Tor 0.4.1.0-alpha-dev (git-7741b21d0e3afbfc)
test001ba    is running with PID  7754: Tor 0.4.1.0-alpha-dev (git-7741b21d0e3afbfc)
test002r     is running with PID  7757: Tor 0.4.1.0-alpha-dev (git-7741b21d0e3afbfc)
test003br    is running with PID  7760: Tor 0.4.1.0-alpha-dev (git-7741b21d0e3afbfc)
test004bc    is running with PID  7763: Tor 0.4.1.0-alpha-dev (git-7741b21d0e3afbfc)
5/5 nodes are running
Waiting 130 seconds for a consensus containing relays to be generated...

Launching chutney using Python 2.7.10
Waiting for nodes to bootstrap...
Bootstrap failed. Node status:
test000a: (0, 'starting', 'Starting')
test001ba: (0, 'starting', 'Starting')
test002r: (0, 'starting', 'Starting')
test003br: (100, 'done', 'Done')
test004bc: (100, 'done', 'Done')
Tor bootstrap failed, ignoring for now.

ipv6-exit-min:

Launching chutney using Python 2.7.10
test000a     is running with PID  7851: Tor 0.4.1.0-alpha-dev (git-7741b21d0e3afbfc)
test001a     is running with PID  7854: Tor 0.4.1.0-alpha-dev (git-7741b21d0e3afbfc)
test002r     is running with PID  7857: Tor 0.4.1.0-alpha-dev (git-7741b21d0e3afbfc)
test003c     is running with PID  7860: Tor 0.4.1.0-alpha-dev (git-7741b21d0e3afbfc)
4/4 nodes are running
Waiting 60 seconds for a consensus containing relays to be generated...

Launching chutney using Python 2.7.10
Waiting for nodes to bootstrap...
Bootstrap failed. Node status:
test000a: (0, 'starting', 'Starting')
test001a: (0, 'starting', 'Starting')
test002r: (0, 'starting', 'Starting')
test003c: (100, 'done', 'Done')
Tor bootstrap failed, ignoring for now.

hs-ipv6:

Launching chutney using Python 2.7.10
test000a     is running with PID  7942: Tor 0.4.1.0-alpha-dev (git-7741b21d0e3afbfc)
test001a     is running with PID  7945: Tor 0.4.1.0-alpha-dev (git-7741b21d0e3afbfc)
test002r     is running with PID  7948: Tor 0.4.1.0-alpha-dev (git-7741b21d0e3afbfc)
test003r     is running with PID  7951: Tor 0.4.1.0-alpha-dev (git-7741b21d0e3afbfc)
test004r     is running with PID  7954: Tor 0.4.1.0-alpha-dev (git-7741b21d0e3afbfc)
test005c     is running with PID  7957: Tor 0.4.1.0-alpha-dev (git-7741b21d0e3afbfc)
test006c     is running with PID  7960: Tor 0.4.1.0-alpha-dev (git-7741b21d0e3afbfc)
test007h     is running with PID  7963: Tor 0.4.1.0-alpha-dev (git-7741b21d0e3afbfc)
8/8 nodes are running
Waiting 60 seconds for a consensus containing relays to be generated...

Launching chutney using Python 2.7.10
Waiting for nodes to bootstrap...
Bootstrap failed. Node status:
test000a: (100, 'done', 'Done')
test001a: (100, 'done', 'Done')
test002r: (100, 'done', 'Done')
test003r: (100, 'done', 'Done')
test004r: (100, 'done', 'Done')
test005c: (75, 'enough_dirinfo', 'Loaded enough directory info to build circuits')
test006c: (75, 'enough_dirinfo', 'Loaded enough directory info to build circuits')
test007h: (75, 'enough_dirinfo', 'Loaded enough directory info to build circuits')
Tor bootstrap failed, ignoring for now.

comment:11 Changed 2 months ago by teor

Actual Points: 0.4
Resolution: fixed
Status: assignedclosed

Fixed in the latest version of #29729.

Note: See TracTickets for help on using tickets.