Opened 8 months ago

Last modified 2 weeks ago

#25924 new enhancement

Improve execution time of onion service statistics module

Reported by: karsten Owned by: metrics-team
Priority: High Milestone:
Component: Metrics/Statistics Version:
Severity: Normal Keywords:
Cc: metrics-team Actual Points:
Parent ID: Points:
Reviewer: Sponsor:

Description

Two years ago, in February 2016, we noticed that some of our back-end modules had really long execution times. Back then we made improvements to two of these modules. I'm going to post a graph of execution times in the comments.

Looks like we'll have to do it again, and this time work even harder on improving execution times. The onion service statistics module again takes roughly 2 hours to complete, with a clear trend. I assume that we'll reach execution times of 3 hours by the end of 2018 and 5 to 6 hours by the end of 2019.

I'm going to post another graph with recent execution times. (Note that we don't have logs for just the onion service statistics module, but only for that module plus the previous module together; but that other module is still relatively fast, contributing with just a few minutes execution time to the graph.)

I don't have concrete suggestions for improvements. And it's still early enough to try to get this work funded before we dive into it. That's why I'm setting priority to low. But it's clear that we'll have to do something here in 2019.

Child Tickets

Attachments (2)

metrics-modules-2016-01-07.png (102.2 KB) - added by karsten 8 months ago.
metrics-modules-2018-04-26.png (96.3 KB) - added by karsten 8 months ago.

Download all attachments as: .zip

Change History (4)

Changed 8 months ago by karsten

Changed 8 months ago by karsten

comment:1 Changed 8 months ago by karsten



comment:2 Changed 2 weeks ago by karsten

Priority: LowHigh
Note: See TracTickets for help on using tickets.