Opened 5 years ago

Closed 15 months ago

#13568 closed task (wontfix)

Setup the containers for the various steps of the data pipeline

Reported by: hellais Owned by: hellais
Priority: Medium Milestone:
Component: Archived/Ooni Version:
Severity: Normal Keywords: archived-closed-2018-07-04
Cc: asn, sysrqb, kudrom, aagbsn, infinity0, joelanders, otr, shidash, david415, dawuud, kojgelo@… Actual Points:
Parent ID: Points:
Reviewer: Sponsor:


We need to setup 3 containers for running the 3 steps of the pipeline.

Here is a schematic representation of the pipeline:

STATE 1              STATE 2              STATE3
+-----------+        +-----------+        +-------------+
| raw data  |------->| sanitized |------->| DB (public) |
+-----------+        +-----------+        +-------------+
/data/raw            /data/sanitized      /data/reports

To move into STATE 1 you must run:

To move into STATE 2 you must run:

To move into STATE 3 you must run:

Child Tickets

Change History (5)

comment:1 Changed 5 years ago by hellais

Cc: dawuud added

comment:2 Changed 5 years ago by anadahz

Cc: kojgelo@… added
           STATE 4
------->| | Pub Mirror|
           /data/public (?)
Last edited 5 years ago by anadahz (previous) (diff)

comment:4 Changed 22 months ago by teor

Severity: Normal

Set all open tickets without a severity to "Normal"

comment:5 Changed 15 months ago by teor

Keywords: archived-closed-2018-07-04 added
Resolution: wontfix
Status: newclosed

Close all tickets in archived components

Note: See TracTickets for help on using tickets.