Opened 2 years ago

Last modified 4 months ago

#27187 needs_review defect

Possible for inconsistency between summary and details with AS number

Reported by: irl Owned by: metrics-team
Priority: Medium Milestone:
Component: Metrics/Onionoo Version:
Severity: Normal Keywords:
Cc: metrics-team Actual Points:
Parent ID: Points:
Reviewer: Sponsor:

Description

{"version":"6.2",
"next_major_version_scheduled":"2018-09-03",
"build_revision":"79de0d2",
"relays_published":"2018-08-17 12:00:00",
"relays":[
{"fingerprint":"008E7B70C3B4A7520B5BEAB8067ABCDC8E63F1FD"},
{"fingerprint":"070A0DC5AE71D60A9567FF908A4EBFB52C670E39"},
{"fingerprint":"0AE3AC492B709AA851488D01B1AD1EDFC040947F"},
{"fingerprint":"0CA2FF775712F67AFFAB64CF16EA96E3D13016B4"},
{"fingerprint":"0DE225407D80F8C1121AED264A97EBF56F31F299"},
{"fingerprint":"11757C1EAD3BAD46D2EA2E950D5E9A34035D9B17"},
{"fingerprint":"126B2DD209618B666FF3184EC9D50363B3FB46B7"},
{"fingerprint":"136F9299A5009A4E0E96494E723BDB556FB0A26B"},
{"fingerprint":"19D235674BCA4EAF55BBFFAAE5441C1E392E4C72"},
{"fingerprint":"1CD464437CF6F0AA8B41660D74DCAB8DD7C14373"},
{"fingerprint":"1D3174338A1131A53E098443E76E1103CDED00DC"},
{"fingerprint":"2093B5DC4B595BFD307A26F494A4C31F455DCCCA"},
{"fingerprint":"22E975935BA77EA59A28EA1AA8387F906034FCBE"},
{"fingerprint":"2C8BD998EDE0C66668D7CCAA1A724BF566524395"},
{"fingerprint":"2CDCFED0142B28B002E89D305CBA2E26063FADE2"},
{"fingerprint":"2D74D7EFACC75DCDB3BEE9221B0BEB226754F96E"},
{"fingerprint":"3098231A16A3661AF98A80D62D161AE7B039358E"},
{"fingerprint":"3444F4ACA2A1AB4A5E9DC64295A6D414A03D3503"},
{"fingerprint":"363E2F30AC9823E6094786CE0ABB64B14D2BE233"},
{"fingerprint":"387A7D62EEC5C14FF45ED8AD9B2235BFE9FE9463"},
{"fingerprint":"38A42B8D7C0E6346F4A4821617740AEE86EA885B"},
{"fingerprint":"3B52392E2256C35CDCF7801FF898FC88CE6D431A"},
{"fingerprint":"3D765C586CCA8B437B7697EA2CE6A51312530AB1"},
{"fingerprint":"3E50CBCA98A20F637BC4551FD4F132D062DB9A51"},
{"fingerprint":"41A3C16269C7B63DB6EB741DBDDB4E1F586B1592"},
{"fingerprint":"4C3165B64B8237E5273D388429480080022C6481"},
{"fingerprint":"557B274903A48A611B43B66C5761E4F0AFB248A8"},
{"fingerprint":"55D7C9776246C3C5E683A777D97D3ECDD0C5AF37"},
{"fingerprint":"572D22C1AF720F274D274A189EDB75C3F9BDC777"},
{"fingerprint":"5CEF9FD40E64948093EBC041E33ED3ED12F70DFE"},
{"fingerprint":"5CF8AFA5E4B0BB88942A44A3F3AAE08C3BDFD60B"},
{"fingerprint":"5FAA9FC7000138C480F042DE4C602C56C5AA3C42"},
{"fingerprint":"60D2F22EE6FB75739C1F1EF80A2D99D943F12D9E"},
{"fingerprint":"65F260EAC76E4F72ED2F8C34CE47A8E1E0621B90"},
{"fingerprint":"723E9B29DF0357E19B2D1C86B86A0165335BFAA9","as_number":"AS39309"},
{"fingerprint":"728B01C767259E92262329DC148750C08A3A5259"},
{"fingerprint":"73D6694F1E71EBD138A15091EA6CBB6F94271405"},
{"fingerprint":"75FCFA1225B5B4B35E25DA53C8BA7545463B679E"},
{"fingerprint":"77C99455CF6F68A7FF72F78048D1C39A4719EC59"},
{"fingerprint":"79D41A16341822F03D11361B0A31DC9309CEB748"},
{"fingerprint":"7A622004AE337495692986D973A62EAAF2524455"},
{"fingerprint":"7C494B5BBC1558303DB1CFB840D980A0B4BCC324"},
{"fingerprint":"7DBB97846CC559FDB82FDD53360127A17742C9D8"},
{"fingerprint":"7E7006F96EF48C688EEE1B1095BEC66B4EF28029"},
{"fingerprint":"837D5EA513DF7FDDA36BE569C646151CDA4B9935"},
{"fingerprint":"83F03DA35C8E65474B2B9B5EF81896E12AD6282A"},
{"fingerprint":"851491607C61F6C878FF4C92253274095FD20FBB"},
{"fingerprint":"87EDD379CB568F65704665A291A6186006AFAF57"},
{"fingerprint":"8CC6AAB9CBAB31EE4D9E80071F1330100A962EEF"},
{"fingerprint":"8FA258D0E5F525F6E28E13A0BC2351F766D1DAF7"},
{"fingerprint":"8FC24B546A3603D86901E1892270DAE9718A09A3"},
{"fingerprint":"90352FBFD5D0BD4D6FDC867309F393A8AF99FF8A"},
{"fingerprint":"92CFD9565B24646CAC2D172D3DB503D69E777B8A"},
{"fingerprint":"94342E68666C1307ECC4CB083070F4DEC87408E0"},
{"fingerprint":"95D68B64F42F27AED4CA15D0E9A1D0DA86E60339"},
{"fingerprint":"960F231C1C2CABF752E747A57D6CDEFD13F35570"},
{"fingerprint":"9A90F846871641CB97C70B948963FCA3F7486E5A"},
{"fingerprint":"9B7D6254CE9C2D6EDC9A4510699ADADDF6F4D5F9"},
{"fingerprint":"9BF565F0600126D3E2179CC933AA15E7702B4CE9"},
{"fingerprint":"A2534EF23390CAE079B1586F0FDF9CE11F556062"},
{"fingerprint":"A29B3032E92CB2D79903198DB36E78F848636CF4"},
{"fingerprint":"A2DB293FFC5A76A718863BF1AEDBC8DFB1CB1097"},
{"fingerprint":"A4C98CEA3F34E05299417E9F885A642C88EF6029"},
{"fingerprint":"AD2060260080FE092DE928384E2514A1C596772F"},
{"fingerprint":"AF2249FD0897A9FB961883C567309DE41472D5C6"},
{"fingerprint":"B116D652E092760C1F1C44F4A9CA5D628D17CDE9"},
{"fingerprint":"B44FBE5366AD98B46D829754FA4AC599BAE41A6A"},
{"fingerprint":"B584C23DD8B22121FD1B20F926A528F4586F47E7"},
{"fingerprint":"B7E04B6EC8F69EA05FD8CAD9B70AA76327004B13"},
{"fingerprint":"C28B23A00EFFAD65B705601E6B7E640EB41FF2B7"},
{"fingerprint":"C3503770F465DA6F549F6065AFF7B8CFBF62C222"},
{"fingerprint":"C3F1DC3E6B1FDDC5B09387ACCC06CD89843DD476"},
{"fingerprint":"C4AEA05CF380BAD2230F193E083B8869B4A29937"},
{"fingerprint":"C55AC4238C66CE8D00838572D563A284DBEF0228"},
{"fingerprint":"C6B684F84AEA5E5E90CD77FF1E7BD33A3B9C74B5"},
{"fingerprint":"CA94704217260E7483DA88719CACD7A94C564D5C"},
{"fingerprint":"CD5A298960D0BE77ABBBBBA5177CE4615A9A223B"},
{"fingerprint":"CFA45A4739FBE477D8C6500834B59F41A749A294"},
{"fingerprint":"CFE1359C6D1462BFA70500935AD5F2A4AD80826E"},
{"fingerprint":"D0F09FA43F68E134B9E56743797D040F647174D1","as_number":"AS39309"},
{"fingerprint":"D329417643EF2B0B21E9876A397967A7F190CCA1"},
{"fingerprint":"D3C6D2828C09806AF08D120CB3565D8C41B4383F"},
{"fingerprint":"D5FAAC4138272BEE29EA4BA3F1981B25CB6B6F5F"},
{"fingerprint":"D623B6311821F9DB62AD370ADA0A307BA2E26BAA"},
{"fingerprint":"D6D6B6614C9EF2DAD13AC0C94487AD8ED3B6877F"},
{"fingerprint":"DCAFAE7D9DDFDA41959A6E64D89383F9F3CEFE48"},
{"fingerprint":"DD9B36139A546EFB43CBE1E18F399F02ECBD4EC6"},
{"fingerprint":"DDFD587212E4E1905114377851FFAF6659F19823"},
{"fingerprint":"E43A346CB81DDF364B6FF68235AFADBA0E8692B8"},
{"fingerprint":"F012AD9A08A9E0B4A5C61155284FD795B553B361"},
{"fingerprint":"F50C39BCA90ED9B9E37FB66696D19A74530115D6"},
{"fingerprint":"F81C9B79150D85D78B4DF5D70A1789FBE0D608A4"},
{"fingerprint":"FA16B46809F9ABEE2DB68293E6E400D217554155"},
{"fingerprint":"FD4D401A1D3591653B7DA868A0B4D0754C242447"},
{"fingerprint":"FDAED15C98CFE7A416E5676F614254F78406105C"}
],
"bridges_published":"2018-08-17 11:56:51",
"bridges":[
]}

https://oo-hetzner-03.torproject.org/details?as=000000&fields=as_number,fingerprint

My theory is that when the GeoIP database does not contain information on an IP address but it did before, that information is not cleared from the details status but is cleared from the summary.

I also noticed that two less hosts were "resolved" than "looked up" in the output stats for geoip. Maybe it is these two hosts. I'm not sure exactly what this means.

Child Tickets

Change History (2)

comment:1 Changed 2 years ago by irl

This is also happening with host names. There is some deeper underlying problem here.

comment:2 Changed 4 months ago by karsten

Cc: metrics-team added
Status: newneeds_review

I think it's related to how we're merging newly created NodeStatus instances with data from parsed descriptors with existing instances from the previous run

I wrote a patch that fixes inconsistencies related to host names. I didn't find any inconsistencies related to ASes in the current data set. I cannot say for sure whether this patch will fix them, too.

Please review commit aae7859 in my task-27187 branch.

Note: See TracTickets for help on using tickets.