Opened 8 years ago

Closed 4 years ago

#2755 closed task (wontfix)

Reconsider BridgeDB's pool assignment file implementation and deployment

Reported by: karsten Owned by: isis
Priority: Low Milestone:
Component: Obfuscation/BridgeDB Version:
Severity: Keywords: bridgedb
Cc: isis, karsten Actual Points:
Parent ID: Points:
Reviewer: Sponsor:


While deploying the new BridgeDB feature that dumps bridge pool assignments to disk, I had two ideas for improving that feature. Neither of these ideas are critical, and I wanted to see how well the current implementation works before making it even more perfect. Maybe we should revisit these ideas in a month or two from now.

  • We only write to assignments.log after parsing a new network status file, but not after dumping unallocated bridges to file buckets. That means we might miss the fact that, say, Twitter distributes new bridges for up to 30 minutes between dumping to file buckets and reading the next network status. Does that matter? Should we also write to assignments.log after dumping to file buckets?
  • Appending to a single assignments.log file and rsyncing that to the host that sanitizes it won't scale forever. We could run a monthly or weekly cronjob that runs "mv assignments.log assignments.log.old". metrics-db can handle multiple input files and will read both files, as long as they are rsync'ed correctly.

Child Tickets

Change History (4)

comment:1 Changed 8 years ago by karsten

See also #3015.

comment:2 Changed 8 years ago by karsten

kaner and I discussed that we could assign a weekly timestamp to assignments.log, e.g. assignments-2011-07-11.log and start writing to a new file every week. We could then move away files on the BridgeDB machine as soon as they're two or three weeks old. I'm pretty sure metrics-db can already handle this. If not, I'll fix that.

comment:3 Changed 4 years ago by isis

Cc: isis karsten added
Keywords: bridgedb added
Owner: set to isis
Status: newassigned

comment:4 Changed 4 years ago by isis

Resolution: wontfix
Status: assignedclosed

Closing due to assignments.log files no longer being used, as per #14082.

Note: See TracTickets for help on using tickets.