Opened 4 years ago

Closed 4 years ago

#19067 closed task (fixed)

Create a testsuite bundle to provide an easy way for users to run the test suite

Reported by: boklm Owned by: boklm
Priority: Medium Milestone:
Component: Applications/Quality Assurance and Testing Version:
Severity: Normal Keywords: TorBrowserTeam201610
Cc: arthuredelstein Actual Points:
Parent ID: Points:
Reviewer: Sponsor: SponsorU

Description

We should create a bundle containing the Tor Browser testsuite and all its dependencies, to allow users to easily run it to test Tor Browser, on all supported platforms.

Child Tickets

Change History (12)

comment:1 Changed 4 years ago by boklm

Type: defecttask

comment:2 Changed 4 years ago by gk

Sponsor: SponsorU

This is the ticket for the user-deployable automated Mac, Windows, and Linux testing SpnsorU item, right?

comment:3 in reply to:  2 Changed 4 years ago by boklm

Replying to gk:

This is the ticket for the user-deployable automated Mac, Windows, and Linux testing SpnsorU item, right?

Yes.

comment:4 Changed 4 years ago by gk

Keywords: TorBrowserTeam201606 added; TorBrowserTeam201605 removed

comment:5 Changed 4 years ago by gk

Keywords: TorBrowserTeam201607 added; TorBrowserTeam201606 removed

comment:6 Changed 4 years ago by gk

Keywords: TorBrowserTeam201608 added; TorBrowserTeam201607 removed

Moving items to August 2016.

comment:7 Changed 4 years ago by gk

Keywords: TorBrowserTeam201609 added; TorBrowserTeam201608 removed

Tickets for September.

comment:8 Changed 4 years ago by arthuredelstein

Cc: arthuredelstein added

comment:9 Changed 4 years ago by gk

Keywords: TorBrowserTeam201610 added; TorBrowserTeam201609 removed

Moving SponsorU items to October.

comment:10 Changed 4 years ago by boklm

The differents things I'm planning to do in this ticket are:

  • adding some build scripts to generate bundles containing the testsuite and its dependencies, for Linux, Windows, OSX
  • making those builds reproducible
  • adding some process to update the bundle, when some new dependencies have been added
  • adding a small GUI allowing to launch tests on Tor Browser, show results, and update the testsuite

In commit f3be72d91a02570c1f1f6f6263e3d94e849bfe94 I started adding build scripts to generate a bundle for Linux.

comment:11 in reply to:  10 Changed 4 years ago by boklm

This ticket is about having a testsuite bundle for Linux, OSX and Windows. I opened ticket #20443 for the improvements we want to make after that.

comment:12 Changed 4 years ago by boklm

Resolution: fixed
Status: newclosed

We now have a first version for Linux, Windows and OSX.

Linux:
https://people.torproject.org/~boklm/tbb-testsuite/0.0.1/tbb-testsuite-0.0.1-linux-x86_64.tar.gz
https://people.torproject.org/~boklm/tbb-testsuite/0.0.1/tbb-testsuite-0.0.1-linux-x86_64.tar.gz.asc

OSX:
https://people.torproject.org/~boklm/tbb-testsuite/0.0.1/tbb-testsuite-0.0.1-osx-x86_64.tar.gz
https://people.torproject.org/~boklm/tbb-testsuite/0.0.1/tbb-testsuite-0.0.1-osx-x86_64.tar.gz.asc

Windows:
https://people.torproject.org/~boklm/tbb-testsuite/0.0.1/tbb-testsuite-0.0.1-win-i686.zip
https://people.torproject.org/~boklm/tbb-testsuite/0.0.1/tbb-testsuite-0.0.1-win-i686.zip.asc

On Linux and OSX, after extracting the tarball, the testsuite can be run with the command:

./start-tbb-testsuite /path/to/tor-browser-bundle.tar.x

On Windows, the file start-tbb-testsuite.bat should be run. On the first run, it will take a few minutes to setup python and cygwin in the bundle/ directory, before opening a Cygwin shell. From this shell the following command can be run to start the testsuite:

./start-tbb-testsuite /cygdrive/c/path/to/torbrowser-install.exe

The update-tbb-testsuite script can be used to update the testsuite (update-tbb-testsuite.bat on Windows).

Other improvements to this bundle will be made in ticket #20443.

Note: See TracTickets for help on using tickets.