Opened 8 years ago

Closed 8 years ago

#6086 closed task (fixed)

Set up Amazon EC2 instance as backup for collecting relay descriptors

Reported by: karsten Owned by:
Priority: Medium Milestone:
Component: Internal Services/Tor Sysadmin Team Version:
Severity: Keywords:
Cc: Actual Points:
Parent ID: Points:
Reviewer: Sponsor:


metrics-db on yatei downloads the current consensus and all referenced descriptors in an hourly cronjob. Until a few weeks ago we had weasel's host collect relay descriptors, too, which we imported into yatei's metrics-db. But that host is gone. If yatei becomes unavailable for an hour or even longer, we'll never download those descriptors. That's bad, because we rely on relay descriptors to be complete for ExoneraTor, metrics tarballs, statistical analyses, etc.

We should run a second metrics-db instance in a different place than where we host yatei, configure it to download relay descriptors once per hour, rsync its output to yatei, and import those files into the metrics-db instance on yatei.

Andrew suggested an Amazon EC2 instance. That host:

  • can be a Small Instance with 160 GB of local instance storage,
  • needs to run 24/7, and
  • needs a sysadmin who's not me (of course, I'm going to operate the metrics-db service).

Child Tickets

Change History (6)

comment:1 Changed 8 years ago by phobos

Component: CompanyTor Sysadmin Team

comment:2 Changed 8 years ago by karsten

What's the status here?

comment:3 Changed 8 years ago by phobos

Owner: phobos deleted
Status: newassigned

where are the scripts? anyone could set this up on lemmonii as a backup.

comment:4 Changed 8 years ago by karsten

The scripts are here. The config file should contain these two lines:

DownloadRelayDescriptors 1
WriteDirectoryArchives 1

./ starts the download. There should be an hourly cronjob calling this script, e.g., at *:05.

I just started setting this up on lemmonii using my user name. I need javac, java, and ant to run this. Can you please install the required packages (should be openjdk-6-jdk, but I'm not sure)?

comment:5 Changed 8 years ago by phobos

openjdk-6-jdk installed on lemmonii.

comment:6 Changed 8 years ago by karsten

Resolution: fixed
Status: assignedclosed

Thanks. metrics-db is now running on lemmonii as a backup. Closing.

Note: See TracTickets for help on using tickets.