Opened 22 months ago

Last modified 22 months ago

#22738 new defect

Crawlers slowing down our services

Reported by: hiro Owned by: qbi
Priority: Medium Milestone:
Component: Internal Services/Service - trac Version:
Severity: Normal Keywords:
Cc: mcs Actual Points:
Parent ID: Points:
Reviewer: Sponsor:

Description

Hey,

Lately crawling is slowing down some of our services. This has been affecting trac and gitweb particularly. Maybe we should try to find out if requests come from a single crawler and see if we can limit the number of requests per amount of time, or just slow it down.

Child Tickets

Change History (3)

comment:1 Changed 22 months ago by dgoulet

Priority: MediumVery High

Bumping the priority because here I'm having timeouts most of the time or I have to wait minutes before I can push/pull which means I simply can't work with git.tpo. Thanks!

comment:2 Changed 22 months ago by mcs

Cc: mcs added

comment:3 Changed 22 months ago by weasel

Component: Internal Services/Tor Sysadmin TeamInternal Services/Service - trac
Owner: changed from tpa to qbi
Priority: Very HighMedium

Seems like something for the service owners, not tpa.

Note: See TracTickets for help on using tickets.