Opened 4 years ago

Last modified 4 days ago

#12522 assigned enhancement

Add sitemap.xml to make Relay Search pages indexed by Google et al.

Reported by: karsten Owned by: metrics-team
Priority: Medium Milestone:
Component: Metrics/Website Version:
Severity: Normal Keywords: metrics-2018
Cc: Actual Points:
Parent ID: Points:
Reviewer: Sponsor:

Description (last modified by irl)

Right now, Google doesn't index Relay Search details pages.

One way to provide this file is to fetch the full https://onionoo.torproject.org/summary and generate the details page URLs from that. Caching the Onionoo summary file and using the If-Modified-Modified header would be very much appreciated here.

The specification for sitemap.xml can be found at:

https://www.sitemaps.org/index.html

Child Tickets

Change History (9)

comment:1 Changed 3 years ago by isis

Owner: changed from rndm to isis
Status: newassigned

Changing Globe tickets to be owned by isis.

comment:2 Changed 3 years ago by isis

Status: assignednew

comment:3 Changed 22 months ago by karsten

Component: Metrics/GlobeMetrics/Atlas
Owner: changed from isis to phw
Severity: Normal

This could be useful for Atlas as well, so let's consider this. I'm moving this ticket to the Atlas component, because we're shutting down Globe soon.

comment:4 Changed 5 months ago by karsten

Keywords: metrics-2018 added

comment:5 Changed 5 months ago by karsten

Owner: changed from phw to metrics-team
Status: newassigned

comment:6 Changed 3 months ago by irl

Parent ID: #23518

This actually becomes possible when moving to metrics-web as the sitemap can be generated independently of the JavaScript application.

comment:7 Changed 3 months ago by karsten

Component: Metrics/AtlasMetrics/Website

Ah, that would be a background process of metrics-web downloading Onionoo's summary document and updating a sitemap file? If so, sure, sounds doable. Moving to the Website component. (Feel free to undo, if I understood the idea wrong.)

comment:8 Changed 7 days ago by irl

This is correct, yes it's a metrics-web thing.

comment:9 Changed 4 days ago by irl

Description: modified (diff)
Parent ID: #23518
Summary: Add sitemap.xml to Globe to make details pages indexed by Google et al.Add sitemap.xml to make Relay Search pages indexed by Google et al.

This is not a requirement for #23518, only enabled by it. Enough of #23518 has now been implemented that we can implement this when we are ready to do so.

Updated the summary and description to reflect what this ticket would actually want now.

Note: See TracTickets for help on using tickets.