Opened 20 months ago

Last modified 12 months ago

#20647 new enhancement

Run chutney tests in Jenkins

Reported by: chelseakomlo Owned by:
Priority: Medium Milestone: Tor: unspecified
Component: Core Tor/Tor Version:
Severity: Normal Keywords: test, chutney, consistency, jenkins, integration-testing, continuous-integration
Cc: Actual Points:
Parent ID: Points:
Reviewer: weasel Sponsor:

Description

It would be nice for chutney tests to be run on every build.

However, because chutney tests cannot be entirely deterministic (although we can do more work to get them closer), this probably should not block the build if tests fail (at least for the short term & we eliminate as much flakiness as possible).

Child Tickets

Change History (8)

comment:1 Changed 20 months ago by chelseakomlo

If we wanted to use docker for this, I did a proof of concept here: git@github.com:chelseakomlo/tor-integration-ci.git, master branch

We can also test using different OS/versions as we do with unit tests.

This runs both stem and chutney tests, but I see that we already have a stem task in jenkins, so I can change this to run only chutney tests if we want to keep them separate.

comment:2 Changed 20 months ago by chelseakomlo

After a short chat with weasel, we talked about:

  1. Docker doesn't fit into our current setup but the ideas from the docker file should translate well
  2. Chutney tests should be their own task
  3. Ideally we will use the tor binary that has already been built in prior tasks

For 3, it looks like the location of the tor binary needs to be set by the environment variable CHUTNEY_TOR

comment:3 Changed 20 months ago by chelseakomlo

Component: - Select a componentCore Tor/Tor

comment:4 Changed 19 months ago by dgoulet

Keywords: test added
Milestone: Tor: 0.2.???

comment:5 Changed 19 months ago by teor

Milestone: Tor: 0.2.???Tor: 0.3.???

Milestone renamed

comment:6 Changed 18 months ago by nickm

Keywords: tor-03-unspecified-201612 added
Milestone: Tor: 0.3.???Tor: unspecified

Finally admitting that 0.3.??? was a euphemism for Tor: unspecified all along.

comment:7 Changed 13 months ago by nickm

Keywords: tor-03-unspecified-201612 removed

Remove an old triaging keyword.

comment:8 Changed 12 months ago by nickm

Keywords: chutney consistency jenkins integration-testing continuous-integration added
Note: See TracTickets for help on using tickets.