Opened 10 months ago

Last modified 6 months ago

#32881 assigned task

Make script to optimize upload and download of Tor Browser releases

Reported by: boklm Owned by: tbb-team
Priority: Medium Milestone:
Component: Applications/Tor Browser Version:
Severity: Normal Keywords: ReleaseTrainMigration, TorBrowserTeam202006
Cc: tbb-team Actual Points:
Parent ID: Points:
Reviewer: Sponsor:

Description

Given that bundles for each platform are 95% the same, except for the localization part, it might be possible to write a script that optimize the upload/download of a Tor Browser release, doing the following steps:

  • upload/download the en-US bundles for all platforms
  • copy the en-US bundle to the filenames of all the other locales
  • use rsync to upload/download the part of the files that differ

If we find that such a script can improve upload/download time significantly, we should add it somewhere in the tools/ directory.

Child Tickets

Change History (6)

comment:1 Changed 8 months ago by pili

Keywords: TorBrowserTeam202002 added; TorBrowserTeam202001 removed

Moving tickets to February

comment:2 Changed 8 months ago by sysrqb

Keywords: ReleaseTrainMigration added

Release Train Migration.

comment:3 Changed 8 months ago by pili

Keywords: TorBrowserTeam202003 added; TorBrowserTeam202002 removed

We are no longer in February, moving tickets

comment:4 Changed 7 months ago by sysrqb

Keywords: TorBrowserTeam202006 added; TorBrowserTeam202003 removed

Move tickets to 2020 June

comment:5 Changed 7 months ago by sysrqb

I manually experimented with this a little bit during recent releases. While the localized packages are very similar to the en-US package, they are very different in reality due to compression. In some cases, we can sync the compressed en-US package, uncompress it, clone/copy it for each locale, sync each uncompressed localized package, then compress each resulting localized bundle on the destination.

tar.xz bundles are probably good candidates for this. It seems like .dmg, .exe, and .mar are using compression internally, so using a technique like what is described here doesn't seem easy.

comment:6 Changed 6 months ago by gaba

Owner: changed from boklm to tbb-team

Release all this tickets back into tbb-team.

Note: See TracTickets for help on using tickets.