Opened 5 years ago

Closed 4 years ago

#14797 closed task (fixed)

Migrate BridgeDB to a new host machine

Reported by: isis Owned by: isis
Priority: Medium Milestone:
Component: Internal Services/Tor Sysadmin Team Version:
Severity: Normal Keywords: bridgedb, isis2015Q1, isisExB, isisExC
Cc: isis, weasel Actual Points:
Parent ID: Points:
Reviewer: Sponsor:

Description

Weasel mentioned on IRC recently that we have a new host machine which we should migrate ponticum to. This ticket concerns doing that task.

Child Tickets

Change History (13)

comment:1 Changed 5 years ago by isis

Keywords: isisExB isisExC added

comment:2 Changed 5 years ago by isis

Keywords: isis2015Q1 added; isis201502 isis2015Q1Q2 removed

comment:3 Changed 5 years ago by arma

Component: Tor VMTor Sysadmin Team

(The Tor VM component is, I believe, the long defunct Whonix like thing that coderman et al worked on years ago.)

comment:4 Changed 5 years ago by weasel

Can/Should we do that this week, isis?

comment:5 in reply to:  4 Changed 5 years ago by isis

Replying to weasel:

Can/Should we do that this week, isis?

Yes! That would be great.

comment:6 Changed 5 years ago by isis

Mostly done moving. Testing things out now.

comment:7 Changed 5 years ago by isis

There was an error written to ./log/server.log while trying to start the BridgeDB servers for the first time on the new machine:

Traceback (most recent call last):
  File "/home/bridgedb/virtualenvs/bridgedb/bin/bridgedb", line 5, in <module>
    pkg_resources.run_script('bridgedb==0.2.4-1-ge08b98e-dirty', 'bridgedb')
  File "/usr/lib/python2.7/dist-packages/pkg_resources.py", line 499, in run_script
    self.require(requires)[0].run_script(script_name, ns)
  File "/usr/lib/python2.7/dist-packages/pkg_resources.py", line 1235, in run_script
    execfile(script_filename, namespace, namespace)
  File "/srv/bridges.torproject.org/home/virtualenvs/bridgedb/lib/python2.7/site-packages/bridgedb-0.2.4_1_ge08b98e_dirty-py2.7.egg/EGG-INFO/scripts/bridgedb", line 31, in <module>
    run(option)
  File "/home/bridgedb/virtualenvs/bridgedb/local/lib/python2.7/site-packages/bridgedb-0.2.4_1_ge08b98e_dirty-py2.7.egg/bridgedb/Main.py", line 558, in run
    startup(options)
  File "/home/bridgedb/virtualenvs/bridgedb/local/lib/python2.7/site-packages/bridgedb-0.2.4_1_ge08b98e_dirty-py2.7.egg/bridgedb/Main.py", line 353, in startup
    proxyList.replaceProxyList(loadProxyList(config))
  File "/home/bridgedb/virtualenvs/bridgedb/local/lib/python2.7/site-packages/bridgedb-0.2.4_1_ge08b98e_dirty-py2.7.egg/bridgedb/Main.py", line 187, in loadProxyList
    f = open(fname, 'r')
IOError: [Errno 2] No such file or directory: '/srv/bridges.torproject.org/var/bulk-exitlist'

There will probably be more errors like these, I'm going to document and fix them as I go along.

comment:8 Changed 5 years ago by isis

The above error is fixed in my hotfix/0.2.4-14797-var-bulkexitlist branch.

comment:9 Changed 5 years ago by isis

Ugh, the next one is:

Traceback (most recent call last):
  File "/home/bridgedb/virtualenvs/bridgedb/bin/bridgedb", line 5, in <module>
    pkg_resources.run_script('bridgedb==0.2.4-2-geeca831-dirty', 'bridgedb')
  File "/usr/lib/python2.7/dist-packages/pkg_resources.py", line 499, in run_script
    self.require(requires)[0].run_script(script_name, ns)
  File "/usr/lib/python2.7/dist-packages/pkg_resources.py", line 1235, in run_script
    execfile(script_filename, namespace, namespace)
  File "/srv/bridges.torproject.org/home/virtualenvs/bridgedb/lib/python2.7/site-packages/bridgedb-0.2.4_2_geeca831_dirty-py2.7.egg/EGG-INFO/scripts/bridgedb", line 31, in <module>
    run(option)
  File "/home/bridgedb/virtualenvs/bridgedb/local/lib/python2.7/site-packages/bridgedb-0.2.4_2_geeca831_dirty-py2.7.egg/bridgedb/Main.py", line 566, in run
    startup(options)
  File "/home/bridgedb/virtualenvs/bridgedb/local/lib/python2.7/site-packages/bridgedb-0.2.4_2_geeca831_dirty-py2.7.egg/bridgedb/Main.py", line 496, in startup
    emailDistributor, ipDistributor = reload(False)
  File "/home/bridgedb/virtualenvs/bridgedb/local/lib/python2.7/site-packages/bridgedb-0.2.4_2_geeca831_dirty-py2.7.egg/bridgedb/Main.py", line 425, in reload
    load(state, splitter, clear=False)
  File "/home/bridgedb/virtualenvs/bridgedb/local/lib/python2.7/site-packages/bridgedb-0.2.4_2_geeca831_dirty-py2.7.egg/bridgedb/Main.py", line 70, in load
    f = open(state.STATUS_FILE, 'r')
IOError: [Errno 2] No such file or directory: '/srv/bridges.torproject.org/from-authority/networkstatus-bridges'

I'm not sure I want to fix that now, since #9380 is being merged into the next version and then it shouldn't be an issue.

comment:10 Changed 5 years ago by isis

Okay, another one, similar to comment:7 but with the new code from #4405 that is merged into develop:

Traceback (most recent call last):
  File "/home/bridgedb/virtualenvs/bridgedb/bin/bridgedb", line 5, in <module>
    pkg_resources.run_script('bridgedb==0.2.4-222-g7de653e-dirty', 'bridgedb')
  File "/usr/lib/python2.7/dist-packages/pkg_resources.py", line 499, in run_script
    self.require(requires)[0].run_script(script_name, ns)
  File "/usr/lib/python2.7/dist-packages/pkg_resources.py", line 1235, in run_script
    execfile(script_filename, namespace, namespace)
  File "/srv/bridges.torproject.org/home/virtualenvs/bridgedb/lib/python2.7/site-packages/bridgedb-0.2.4_222_g7de653e_dirty-py2.7.egg/EGG-INFO/scripts/bridgedb", line 31, in <module>
    run(option)
  File "/srv/bridges.torproject.org/home/virtualenvs/bridgedb/lib/python2.7/site-packages/bridgedb-0.2.4_222_g7de653e_dirty-py2.7.egg/bridgedb/Main.py", line 372, in run
    proxy.loadProxiesFromFile(proxyfile, proxyList)
  File "/srv/bridges.torproject.org/home/virtualenvs/bridgedb/lib/python2.7/site-packages/bridgedb-0.2.4_222_g7de653e_dirty-py2.7.egg/bridgedb/proxy.py", line 85, in loadProxiesFromFile
    with open(filename, 'r') as proxyFile:
IOError: [Errno 2] No such file or directory: '/srv/bridges.torproject.org/var/bulk-exitlist'
Last edited 5 years ago by isis (previous) (diff)

comment:11 Changed 5 years ago by isis

My hotfix/0.2.4-14797-4405-missing-proxylistfile branch contains an integration test and a patch for the above error.

comment:12 Changed 4 years ago by isis

Severity: Normal
Status: newneeds_review

We should be ready to switch the DNS to the new host at any time. Everything looks ready to me.

comment:13 Changed 4 years ago by isis

Resolution: fixed
Status: needs_reviewclosed

This is done; BridgeDB is now running on the new host. Thanks, weasel!

Note: See TracTickets for help on using tickets.