[Author Prev][Author Next][Thread Prev][Thread Next][Author Index][Thread Index]
Re: [tor-bugs] #22983 [Metrics/metrics-lib]: add a descriptor interface and implementation for web-logs
#22983: add a descriptor interface and implementation for web-logs
---------------------------------+------------------------------
Reporter: iwakeh | Owner: metrics-team
Type: enhancement | Status: new
Priority: Medium | Milestone:
Component: Metrics/metrics-lib | Version:
Severity: Normal | Resolution:
Keywords: | Actual Points:
Parent ID: | Points:
Reviewer: | Sponsor:
---------------------------------+------------------------------
Comment (by karsten):
Random thought: these logs can be really huge and also quite repetitive.
Maybe we can try to save a bit of memory by trying out a few things when
parsing them. Ideas:
1. Store indexes into the raw descriptor string rather than copies of
strings.
2. Alternatively, only store fields that have changed compared to the
previous line. If a field has not changed, store a reference to the first
line that contains the same field contents. This makes use of the fact
that lines are sorted.
3. Maybe don't even store the raw descriptor string and instead throw an
exception when it gets called. Only do this if 2 requires a lot less
memory than 1 above.
--
Ticket URL: <https://trac.torproject.org/projects/tor/ticket/22983#comment:1>
Tor Bug Tracker & Wiki <https://trac.torproject.org/>
The Tor Project: anonymity online
_______________________________________________
tor-bugs mailing list
tor-bugs@xxxxxxxxxxxxxxxxxxxx
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-bugs