Opened 17 months ago

Last modified 8 months ago

#25924 new enhancement

Improve execution time of onion service statistics module

Reported by: karsten Owned by: metrics-team
Priority: Medium Milestone:
Component: Metrics/Statistics Version:
Severity: Normal Keywords:
Cc: metrics-team Actual Points:
Parent ID: Points:
Reviewer: Sponsor:


Two years ago, in February 2016, we noticed that some of our back-end modules had really long execution times. Back then we made improvements to two of these modules. I'm going to post a graph of execution times in the comments.

Looks like we'll have to do it again, and this time work even harder on improving execution times. The onion service statistics module again takes roughly 2 hours to complete, with a clear trend. I assume that we'll reach execution times of 3 hours by the end of 2018 and 5 to 6 hours by the end of 2019.

I'm going to post another graph with recent execution times. (Note that we don't have logs for just the onion service statistics module, but only for that module plus the previous module together; but that other module is still relatively fast, contributing with just a few minutes execution time to the graph.)

I don't have concrete suggestions for improvements. And it's still early enough to try to get this work funded before we dive into it. That's why I'm setting priority to low. But it's clear that we'll have to do something here in 2019.

Child Tickets

Attachments (2)

metrics-modules-2016-01-07.png (102.2 KB) - added by karsten 17 months ago.
metrics-modules-2018-04-26.png (96.3 KB) - added by karsten 17 months ago.

Download all attachments as: .zip

Change History (5)

Changed 17 months ago by karsten

Changed 17 months ago by karsten

comment:1 Changed 17 months ago by karsten

comment:2 Changed 10 months ago by karsten

Priority: LowHigh

comment:3 Changed 8 months ago by gaba

Priority: HighMedium
Note: See TracTickets for help on using tickets.