[Author Prev][Author Next][Thread Prev][Thread Next][Author Index][Thread Index]
Re: [tor-bugs] #25100 [Metrics/CollecTor]: Make CollecTor's webstats module use less RAM and CPU time
#25100: Make CollecTor's webstats module use less RAM and CPU time
-------------------------------+--------------------------------
Reporter: karsten | Owner: iwakeh
Type: enhancement | Status: needs_revision
Priority: High | Milestone:
Component: Metrics/CollecTor | Version:
Severity: Normal | Resolution:
Keywords: | Actual Points:
Parent ID: | Points:
Reviewer: | Sponsor:
-------------------------------+--------------------------------
Comment (by karsten):
I think that an in-memory database is the second-best solution. The
"manual compression" sounds more promising to me, because it leverages a
specific redundancy of web server logs. Of course, we could further
normalize the data and store request line parts in separate tables. But
I'd say that the effort to make code changes and get them reviewed is
several times as high as using the suggested data structure, whereas we'd
already achieve 2/3 or 3/4 of possible improvements just from that without
using a database.
--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/25100#comment:10>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online
_______________________________________________
tor-bugs mailing list
tor-bugs@xxxxxxxxxxxxxxxxxxxx
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs