Opened 2 months ago

Closed 2 months ago

#31911 closed defect (fixed)

disk filled on up savii

Reported by: anarcat Owned by: tbb-team
Priority: High Milestone:
Component: Applications/Tor Browser Version:
Severity: Major Keywords: TorBrowserTeam201910R
Cc: Actual Points: 0.1
Parent ID: Points: 0.1
Reviewer: Sponsor:

Description

the source for the TBB releases is full:

Filesystem                Size  Used Avail Use% Mounted on
/dev/mapper/vg_savii-srv   98G   93G   40M 100% /srv

That's 40MB free! While we could change the reserved space here to get an extra 5GB, it would not allow us to cut another TBB release anyways, so I figured I might let you know. :)

It seems there are three 9.0 alpha releases on there, maybe one too many?

root@savii:/srv# ls -l static.torproject.org/mirrors/cdn.torproject.org/tree-*/aus1/torbrowser
static.torproject.org/mirrors/cdn.torproject.org/tree-a/aus1/torbrowser:
total 200
drwxr-xr-x 2 mirroradm mirroradm 12288 Apr 19  2017 6.5.2
-rw-r--r-- 2 mirroradm mirroradm   138 Apr 19  2017 6.5.2-do-not-remove.txt
drwxr-xr-x 2 mirroradm mirroradm 16384 Sep  4  2018 8.0
-rw-r--r-- 2 mirroradm mirroradm    11 Sep  4  2018 8.0-do-not-remove.txt
drwxr-xr-x 2 mirroradm mirroradm 20480 Jun 27  2018 8.0a9
-rw-r--r-- 2 mirroradm mirroradm    11 Aug 20  2018 8.0a9-do-not-remove.txt
drwxr-xr-x 2 mirroradm mirroradm 20480 Jul  8 22:01 8.5.4
drwxr-xr-x 2 mirroradm mirroradm 28672 Sep  3 13:40 8.5.5
drwxr-xr-x 2 mirroradm mirroradm 28672 Jul  9 22:12 9.0a4
drwxr-xr-x 2 mirroradm mirroradm 28672 Sep  4 17:54 9.0a6
drwxr-xr-x 2 mirroradm mirroradm 24576 Oct  1 13:09 9.0a7
drwxr-xr-x 2 mirroradm mirroradm  4096 Oct  1 12:41 bug_20814
-rw-r--r-- 2 mirroradm mirroradm   165 May 20  2016 moo

static.torproject.org/mirrors/cdn.torproject.org/tree-b/aus1/torbrowser:
total 176
drwxr-xr-x 2 mirroradm mirroradm 12288 Apr 19  2017 6.5.2
-rw-r--r-- 2 mirroradm mirroradm   138 Apr 19  2017 6.5.2-do-not-remove.txt
drwxr-xr-x 2 mirroradm mirroradm 16384 Sep  4  2018 8.0
-rw-r--r-- 2 mirroradm mirroradm    11 Sep  4  2018 8.0-do-not-remove.txt
drwxr-xr-x 2 mirroradm mirroradm 20480 Jun 27  2018 8.0a9
-rw-r--r-- 2 mirroradm mirroradm    11 Aug 20  2018 8.0a9-do-not-remove.txt
drwxr-xr-x 2 mirroradm mirroradm 20480 Jul  8 22:01 8.5.4
drwxr-xr-x 2 mirroradm mirroradm 28672 Sep  3 13:40 8.5.5
drwxr-xr-x 2 mirroradm mirroradm 28672 Jul  9 22:12 9.0a4
drwxr-xr-x 2 mirroradm mirroradm 28672 Sep  4 17:54 9.0a6
drwxr-xr-x 2 mirroradm mirroradm  4096 Apr 20  2017 bug_20814
-rw-r--r-- 2 mirroradm mirroradm   165 May 20  2016 moo

It might also be possible that TBB releases have grown too big that we need more disk space on that server. We don't have much wiggle room on that right now, but we do have some: let me know if that's something you need.

I can also show you the different tools we have to monitor disk space on that server.

let me know if you need any further help!

Child Tickets

Attachments (1)

0001-Bug-31911-Add-information-about-monitoring-disk-spac.patch (1.2 KB) - added by boklm 2 months ago.

Download all attachments as: .zip

Change History (6)

comment:1 Changed 2 months ago by boklm

It seems there are three 9.0 alpha releases on there, maybe one too many?

Yes, I forgot to remove 9.0a4 before uploading 9.0a7. I have removed it now.

To save some space we could also remove 6.5.2 and 8.0a9, which we have been keeping for updating older releases due to updater changes in those versions, but this was two years ago for 6.5.2 and one year for 8.0a9 so most users should have updated now.

comment:2 Changed 2 months ago by boklm

It might also be possible that TBB releases have grown too big that we need more disk space on that server. We don't have much wiggle room on that right now, but we do have some: let me know if that's something you need.

I think we are still good for now (if we remember to keep only two versions), but we'll probably need to increase the disk space at some point as we're frequently adding new Tor Browser locales, so I'm interested to see how to monitor disk space on this server.

comment:3 Changed 2 months ago by anarcat

assuming you have shell access, of course, you can use df -h to see the immediate disk usage. :)

otherwise, grafana.torproject.org can show you long-term metrics. there you need to find the "node exporter full" dashboard (direct link) and select savii.torproject.org in the host drop-down (you can type it to avoid scrolling all the way down). you can also change the time range on the top right.

good luck!

comment:4 in reply to:  3 Changed 2 months ago by boklm

Keywords: TorBrowserTeam201910R added
Status: newneeds_review

Replying to anarcat:

assuming you have shell access, of course, you can use df -h to see the immediate disk usage. :)

otherwise, grafana.torproject.org can show you long-term metrics. there you need to find the "node exporter full" dashboard (direct link) and select savii.torproject.org in the host drop-down (you can type it to avoid scrolling all the way down). you can also change the time range on the top right.

Thanks!

I think we can add this information to our release process doc, so I attached a patch for gk to review.

comment:5 Changed 2 months ago by gk

Actual Points: 0.1
Points: 0.1
Resolution: fixed
Status: needs_reviewclosed

Looks good to me, thanks! Merged to tor-browser-spec's master (commit aff3780c19d235bc98ff6b765f0eeb5e52a98535).

Note: See TracTickets for help on using tickets.