Opened 11 months ago

Last modified 2 months ago

#31659 assigned defect

new onionoo hosts

Reported by: weasel Owned by: weasel
Priority: Medium Milestone:
Component: Internal Services/Tor Sysadmin Team Version:
Severity: Normal Keywords:
Cc: irl, metrics-team Actual Points:
Parent ID: Points:
Reviewer: Sponsor:

Description

Right now we have two onionoo backends (that run the java stuff) and also serve users, and two additional frontend-only hosts (that only serve users and ask the backends if they don't have a cached answer). So we have 4 hosts in total, two of which serve a double role.

To make the setup easier to monitor, scale, and maintain we should split these roles. For communications between frontends and backends we'll switch to using ipsec rather than the stunnels.

As a first step, we'll set up a new backend-only host (on Debian 10/buster) and Iain will set up the service there.

Child Tickets

TicketStatusOwnerSummaryComponent
#31952closedmetrics-teamjavax.xml.bind is not longer part of the JREMetrics/Onionoo
#31953closedmetrics-teamIllegalStateException on fresh instancesMetrics/Onionoo
#32179closedweaselretire orestisInternal Services/Tor Sysadmin Team
#32180closedtparetire oschaniniiInternal Services/Tor Sysadmin Team
#32268closedkarstensecond new onionoo backendInternal Services/Tor Sysadmin Team
#32763closedtpaPlease provision an onionoo-backend-02 and add to the varnish configurationInternal Services/Tor Sysadmin Team
#34306closedanarcatretire omeienseInternal Services/Tor Sysadmin Team

Change History (12)

comment:1 Changed 11 months ago by weasel

Onionoo on oo-hetzner-03 and on omeiense use about 40gb (each) of disk space and about 8-9GB of ram.

comment:2 Changed 11 months ago by weasel

Cc: irl added

irl, the host onionoo-backend-01.torproject.org should be ready for you.

I suggest you use systemd user services instead of @reboot cronjobs. lingering is already enabled for both roles.

Please let us know when we can proceed.

comment:3 Changed 11 months ago by irl

Adding to the Metrics roadmap, but probably for next week's sprint at the earliest.

comment:4 Changed 11 months ago by karsten

Cc: metrics-team added

comment:5 Changed 11 months ago by weasel

ping

comment:6 Changed 10 months ago by irl

Update: once #32062 is resolved I will be able to finish off the Ansible scripts. With a dev build I have confirmed that the patch there will solve the last problem we are having.

comment:7 Changed 10 months ago by weasel

rotated onionoo-frontend-01, which is backed by the two old onionoo backends as well as onionoo-backend-01.

comment:8 Changed 10 months ago by weasel

We can probably retire the two old frontend only hosts: orestis and oschaninii.

comment:9 Changed 3 months ago by weasel

We have two new backends, and two new-style frontends that also are .onion endpoints.

We might want to re-add orestis as new-style frontend, but other than that it's all done.

comment:10 Changed 3 months ago by weasel

in a day or two we should then also retire oo-hetzner-03 and omeiense

comment:11 Changed 3 months ago by weasel

oo-hetzner-03 and omeiense shut down (but not yet deleted/retired)

comment:12 Changed 2 months ago by anarcat

Owner: changed from tpa to weasel
Status: newassigned

weasel has picked this up again. oo-hetzner-03 retired, and omeiense (#34036), and orestis (#32179) scheduled for retirement.

Note: See TracTickets for help on using tickets.