[Author Prev][Author Next][Thread Prev][Thread Next][Author Index][Thread Index]
Re: [tor-bugs] #19437 [Metrics/Onionoo]: Find more reliable and universal way to get ASN and ASorg mappings
#19437: Find more reliable and universal way to get ASN and ASorg mappings
-------------------------------------------------+-------------------------
Reporter: twim | Owner:
Type: project | Status: new
Priority: Medium | Milestone:
Component: Metrics/Onionoo | Version:
Severity: Normal | Resolution:
Keywords: asn, as, geoip, maxmind, bgp, | Actual Points:
organisations, diversity | Points:
Parent ID: | Sponsor:
Reviewer: |
-------------------------------------------------+-------------------------
Comment (by cypherpunks):
As a stopgap solution for the currently broken MaxMind DB, I trying to
repair at least nameless maxmind entries with data from
http://thyme.apnic.net/current/data-used-autnums
quick'n dirty solution (this reduces nameless AS entries by 49k records):
{{{
#convert data-used-autnums into a csv file and prefix AS numbers with "AS"
sed 's/^[ \t]*//' data-used-autnums.orig | sed 's/ /,/'|sed 's/"//g'|awk
'{ print "AS" $0 }'|sort -t, -k 1b,1 > data-used-autnums.csv
#get all maxmind entries without AS names
grep -v '"' GeoIPASNum2.csv.orig |sort -t, -k 3 > nameless_AS_entries
join -o 1.1,1.2,1.3,2.2 -a 1 -t, -1 3 -2 1 nameless_AS_entries data-
used-autnums.csv|awk -F, '{ print $1 "," $2 ",." $3 " " $4 "."}'|sed
's,\.,",g' > repaired_entries
grep '"' GeoIPASNum2.csv.orig > entries_with_names
cat entries_with_names repaired_entries > GeoIPASNum2.csv.partially-
repaired
}}}
Note: also records with AS names are broken (but I'm not touching them)
https://lists.torproject.org/pipermail/tor-dev/2016-June/011095.html
would be great to have at least a workaround deployed soon - otherwise
I'll have to postprocess onionoo data before using it.
--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/19437#comment:6>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online
_______________________________________________
tor-bugs mailing list
tor-bugs@xxxxxxxxxxxxxxxxxxxx
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs