Opened 5 years ago

Closed 5 years ago

#11029 closed task (fixed)

Automatically run the TBB test suite on TBB nighlies

Reported by: boklm Owned by: boklm
Priority: Medium Milestone:
Component: Applications/Quality Assurance and Testing Version:
Severity: Keywords:
Cc: Actual Points:
Parent ID: #11024 Points:
Reviewer: Sponsor:

Description

Linus is building some TBB nightlies:
https://people.torproject.org/~linus/builds/

We should run the TBB test suite on those nightly builds every day.

Child Tickets

Change History (3)

comment:1 Changed 5 years ago by boklm

Current status of this tasks:
The test suite accepts as argument the URL of a sha256sums.txt file. In that case, it will download it, download all the linux64 bundles that it contains and run the tests on them.

So we can run tests on nightly builds with something like this:
$ ./tbb-testsuite https://people.torproject.org/~linus/builds/tbb-nightly-2014-02-26/sha256sums.txt

Next steps:

  • add verification of the gpg signature on the sha256sums.txt
  • add option to select where test reports are stored (#11082)
  • deploy this on some server

comment:2 Changed 5 years ago by boklm

Some news about this:

It's now possible to run the tests on the latest nightly build using "./tbb-testsuite --config=linus-nightly".

Next step: deploy this on some server

comment:3 Changed 5 years ago by boklm

Component: Tor bundles/installationQuality Assurance and Testing
Resolution: fixed
Status: newclosed

The test suite is automatically run on nightly builds, with results published there:
https://people.torproject.org/~boklm/tbbtests/

Note: See TracTickets for help on using tickets.