[Author Prev][Author Next][Thread Prev][Thread Next][Author Index][Thread Index]

Re: [tor-bugs] #15844 [Onionoo]: Develop database schema to support Onionoo's search parameter efficiently



#15844: Develop database schema to support Onionoo's search parameter efficiently
-----------------------------+-----------------
     Reporter:  karsten      |      Owner:
         Type:  enhancement  |     Status:  new
     Priority:  normal       |  Milestone:
    Component:  Onionoo      |    Version:
   Resolution:               |   Keywords:
Actual Points:               |  Parent ID:
       Points:               |
-----------------------------+-----------------

Comment (by Ueland):

 I now how a Solr instance up and running locally with the data from the
 status-summary file, around 600K rows. The first issue i noticed is
 figuring out what to do with each node`s port list, but i will not dig
 more into that unless this is something worth working further on, which i
 let you guys decide.  (This is only a issue if you want to list all relays
 that allows port 49, for example).

 The Solr index is around 200MB in size with this data, let me know if any
 of you want a zipped copy to play around in.

 Here are a few example queries and their response time on first(uncached)
 query:
 "nickname:*h3x*" - 215ms (looking for my relays with prefix and suffix
 wildcard)
 "nickname:h3x*" - 6 ms (suffix wildcard)
 "nickname:*h3x" - 209 ms (prefix wildcard)
 "countryCode:no" - 22 ms (countrycode query)
 "id:*0*" - 600ms (prefix and suffix wildcard, one char)
 "contact:*gmail.com*" - 28ms (all contacts mentioning gmail)
 "consensusWeight:[100   TO   9000]" - 13ms (all relays within given
 consensu weight)


 /Tor

--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/15844#comment:24>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online
_______________________________________________
tor-bugs mailing list
tor-bugs@xxxxxxxxxxxxxxxxxxxx
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs