[Author Prev][Author Next][Thread Prev][Thread Next][Author Index][Thread Index]

Re: [tor-relays] Memory Problems with tor releay

To: tor-relays@xxxxxxxxxxxxxxxxxxxx
Subject: Re: [tor-relays] Memory Problems with tor releay
From: Dirk <tor-relay.dirk@xxxxxxxxxx>
Date: Sat, 27 May 2017 08:08:56 +0200
Delivered-to: archiver@xxxxxxxx
Delivery-date: Sat, 27 May 2017 02:16:44 -0400
Dkim-signature: v=1; a=rsa-sha256; c=relaxed/simple; d=banes.ch; s=mail; t=1495865335; bh=EaWUd/NVXDEEQP1qXzlrKXsXoTRWK66Zia/Xc/ahgww=; h=Subject:To:References:From:Date:In-Reply-To; z=Subject:=20Re:=20[tor-relays]=20Memory=20Problems=20with=20tor=20 releay|To:=20tor-relays@xxxxxxxxxxxxxxxxxxxx|References:=20<1a448f cf-f8b6-998a-aa6d-1e07ae21cee5@xxxxxxxxxx>=0D=0A=20<7456A4E0-16F1- 42D2-800E-BFD297E62580@xxxxxxxxx>|From:=20Dirk=20<tor-relay.dirk@o .banes.ch>|Date:=20Sat,=2027=20May=202017=2008:08:56=20+0200|In-Re ply-To:=20<7456A4E0-16F1-42D2-800E-BFD297E62580@xxxxxxxxx>; b=JLS6dkxvZ631ZqzlR59XGJyUmMq4oZj5G13PF36YH3kqIOHezSrIIXzeqfrYvvumE frUhJhPO7m5SPmtbRqEE6IqPbBT3wTRQY9KTGEA1ZVf4AbVDhksQRXMqiqC78jIwWA bPIHUWBgKu6rBfWbmPBg5aphkqzLgYlekyh60G1k=
In-reply-to: <7456A4E0-16F1-42D2-800E-BFD297E62580@gmail.com>
List-archive: <http://lists.torproject.org/pipermail/tor-relays/>
List-help: <mailto:tor-relays-request@lists.torproject.org?subject=help>
List-id: "support and questions about running Tor relays \(exit, non-exit, bridge\)" <tor-relays.lists.torproject.org>
List-post: <mailto:tor-relays@lists.torproject.org>
List-subscribe: <https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-relays>, <mailto:tor-relays-request@lists.torproject.org?subject=subscribe>
List-unsubscribe: <https://lists.torproject.org/cgi-bin/mailman/options/tor-relays>, <mailto:tor-relays-request@lists.torproject.org?subject=unsubscribe>
References: <1a448fcf-f8b6-998a-aa6d-1e07ae21cee5@o.banes.ch> <7456A4E0-16F1-42D2-800E-BFD297E62580@gmail.com>
Reply-to: tor-relays@xxxxxxxxxxxxxxxxxxxx
Sender: "tor-relays" <tor-relays-bounces@xxxxxxxxxxxxxxxxxxxx>
User-agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.1.1

Hello Teor
> Your process is being killed when using 0.45 GB of RAM.
>
> On my Exit, which handles about 150 Mbps, it is normal for tor to use
> 900 MB of RAM or more.
>
> To reduce this, you could try setting:
> DirPort 0
> DirCache 0

I will try this settings.


Yesterday I was logged in as it happend.
There are no other services running (except ssh of course).
I tried to investigate more. Only thing I got was the top (attached).
Because the machine was so busy an unresponsive that I got kicked out of
ssh and a remote console shell session was aborted.

There are no significant other process on the machine beside tor.

Last login: Fri May 26 22:29:17 2017 from 217.150.229.239
dirk@tor1:~$ ps -ef
UID        PID  PPID  C STIME TTY          TIME CMD
root         1     0  0 Mai23 ?        00:00:00 /sbin/init
root         2     0  0 Mai23 ?        00:00:00 [kthreadd]
root         3     2  0 Mai23 ?        00:05:19 [ksoftirqd/0]
root         5     2  0 Mai23 ?        00:00:00 [kworker/0:0H]
root         7     2  0 Mai23 ?        00:10:30 [rcu_sched]
root         8     2  0 Mai23 ?        00:04:11 [rcuos/0]
root         9     2  0 Mai23 ?        00:04:03 [rcuos/1]
root        10     2  0 Mai23 ?        00:03:58 [rcuos/2]
root        11     2  0 Mai23 ?        00:04:37 [rcuos/3]
root        12     2  0 Mai23 ?        00:00:00 [rcuos/4]
root        13     2  0 Mai23 ?        00:00:00 [rcuos/5]
root        14     2  0 Mai23 ?        00:00:00 [rcuos/6]
root        15     2  0 Mai23 ?        00:00:00 [rcuos/7]
root        16     2  0 Mai23 ?        00:00:00 [rcuos/8]
root        17     2  0 Mai23 ?        00:00:00 [rcuos/9]
root        18     2  0 Mai23 ?        00:00:00 [rcuos/10]
root        19     2  0 Mai23 ?        00:00:00 [rcuos/11]
root        20     2  0 Mai23 ?        00:00:00 [rcuos/12]
root        21     2  0 Mai23 ?        00:00:00 [rcuos/13]
root        22     2  0 Mai23 ?        00:00:00 [rcuos/14]
root        23     2  0 Mai23 ?        00:00:00 [rcuos/15]
root        24     2  0 Mai23 ?        00:00:00 [rcuos/16]
root        25     2  0 Mai23 ?        00:00:00 [rcuos/17]
root        26     2  0 Mai23 ?        00:00:00 [rcuos/18]
root        27     2  0 Mai23 ?        00:00:00 [rcuos/19]
root        28     2  0 Mai23 ?        00:00:00 [rcuos/20]
root        29     2  0 Mai23 ?        00:00:00 [rcuos/21]
root        30     2  0 Mai23 ?        00:00:00 [rcuos/22]
root        31     2  0 Mai23 ?        00:00:00 [rcuos/23]
root        32     2  0 Mai23 ?        00:00:00 [rcuos/24]
root        33     2  0 Mai23 ?        00:00:00 [rcuos/25]
root        34     2  0 Mai23 ?        00:00:00 [rcuos/26]
root        35     2  0 Mai23 ?        00:00:00 [rcuos/27]
root        36     2  0 Mai23 ?        00:00:00 [rcuos/28]
root        37     2  0 Mai23 ?        00:00:00 [rcuos/29]
root        38     2  0 Mai23 ?        00:00:00 [rcuos/30]
root        39     2  0 Mai23 ?        00:00:00 [rcuos/31]
root        40     2  0 Mai23 ?        00:00:00 [rcuos/32]
root        41     2  0 Mai23 ?        00:00:00 [rcuos/33]
root        42     2  0 Mai23 ?        00:00:00 [rcuos/34]
root        43     2  0 Mai23 ?        00:00:00 [rcuos/35]
root        44     2  0 Mai23 ?        00:00:00 [rcuos/36]
root        45     2  0 Mai23 ?        00:00:00 [rcuos/37]
root        46     2  0 Mai23 ?        00:00:00 [rcuos/38]
root        47     2  0 Mai23 ?        00:00:00 [rcuos/39]
root        48     2  0 Mai23 ?        00:00:00 [rcuos/40]
root        49     2  0 Mai23 ?        00:00:00 [rcuos/41]
root        50     2  0 Mai23 ?        00:00:00 [rcuos/42]
root        51     2  0 Mai23 ?        00:00:00 [rcuos/43]
root        52     2  0 Mai23 ?        00:00:00 [rcuos/44]
root        53     2  0 Mai23 ?        00:00:00 [rcuos/45]
root        54     2  0 Mai23 ?        00:00:00 [rcuos/46]
root        55     2  0 Mai23 ?        00:00:00 [rcuos/47]
root        56     2  0 Mai23 ?        00:00:00 [rcuos/48]
root        57     2  0 Mai23 ?        00:00:00 [rcuos/49]
root        58     2  0 Mai23 ?        00:00:00 [rcuos/50]
root        59     2  0 Mai23 ?        00:00:00 [rcuos/51]
root        60     2  0 Mai23 ?        00:00:00 [rcuos/52]
root        61     2  0 Mai23 ?        00:00:00 [rcuos/53]
root        62     2  0 Mai23 ?        00:00:00 [rcuos/54]
root        63     2  0 Mai23 ?        00:00:00 [rcuos/55]
root        64     2  0 Mai23 ?        00:00:00 [rcuos/56]
root        65     2  0 Mai23 ?        00:00:00 [rcuos/57]
root        66     2  0 Mai23 ?        00:00:00 [rcuos/58]
root        67     2  0 Mai23 ?        00:00:00 [rcuos/59]
root        68     2  0 Mai23 ?        00:00:00 [rcuos/60]
root        69     2  0 Mai23 ?        00:00:00 [rcuos/61]
root        70     2  0 Mai23 ?        00:00:00 [rcuos/62]
root        71     2  0 Mai23 ?        00:00:00 [rcuos/63]
root        72     2  0 Mai23 ?        00:00:00 [rcu_bh]
root        73     2  0 Mai23 ?        00:00:00 [rcuob/0]
root        74     2  0 Mai23 ?        00:00:00 [rcuob/1]
root        75     2  0 Mai23 ?        00:00:00 [rcuob/2]
root        76     2  0 Mai23 ?        00:00:00 [rcuob/3]
root        77     2  0 Mai23 ?        00:00:00 [rcuob/4]
root        78     2  0 Mai23 ?        00:00:00 [rcuob/5]
root        79     2  0 Mai23 ?        00:00:00 [rcuob/6]
root        80     2  0 Mai23 ?        00:00:00 [rcuob/7]
root        81     2  0 Mai23 ?        00:00:00 [rcuob/8]
root        82     2  0 Mai23 ?        00:00:00 [rcuob/9]
root        83     2  0 Mai23 ?        00:00:00 [rcuob/10]
root        84     2  0 Mai23 ?        00:00:00 [rcuob/11]
root        85     2  0 Mai23 ?        00:00:00 [rcuob/12]
root        86     2  0 Mai23 ?        00:00:00 [rcuob/13]
root        87     2  0 Mai23 ?        00:00:00 [rcuob/14]
root        88     2  0 Mai23 ?        00:00:00 [rcuob/15]
root        89     2  0 Mai23 ?        00:00:00 [rcuob/16]
root        90     2  0 Mai23 ?        00:00:00 [rcuob/17]
root        91     2  0 Mai23 ?        00:00:00 [rcuob/18]
root        92     2  0 Mai23 ?        00:00:00 [rcuob/19]
root        93     2  0 Mai23 ?        00:00:00 [rcuob/20]
root        94     2  0 Mai23 ?        00:00:00 [rcuob/21]
root        95     2  0 Mai23 ?        00:00:00 [rcuob/22]
root        96     2  0 Mai23 ?        00:00:00 [rcuob/23]
root        97     2  0 Mai23 ?        00:00:00 [rcuob/24]
root        98     2  0 Mai23 ?        00:00:00 [rcuob/25]
root        99     2  0 Mai23 ?        00:00:00 [rcuob/26]
root       100     2  0 Mai23 ?        00:00:00 [rcuob/27]
root       101     2  0 Mai23 ?        00:00:00 [rcuob/28]
root       102     2  0 Mai23 ?        00:00:00 [rcuob/29]
root       103     2  0 Mai23 ?        00:00:00 [rcuob/30]
root       104     2  0 Mai23 ?        00:00:00 [rcuob/31]
root       105     2  0 Mai23 ?        00:00:00 [rcuob/32]
root       106     2  0 Mai23 ?        00:00:00 [rcuob/33]
root       107     2  0 Mai23 ?        00:00:00 [rcuob/34]
root       108     2  0 Mai23 ?        00:00:00 [rcuob/35]
root       109     2  0 Mai23 ?        00:00:00 [rcuob/36]
root       110     2  0 Mai23 ?        00:00:00 [rcuob/37]
root       111     2  0 Mai23 ?        00:00:00 [rcuob/38]
root       112     2  0 Mai23 ?        00:00:00 [rcuob/39]
root       113     2  0 Mai23 ?        00:00:00 [rcuob/40]
root       114     2  0 Mai23 ?        00:00:00 [rcuob/41]
root       115     2  0 Mai23 ?        00:00:00 [rcuob/42]
root       116     2  0 Mai23 ?        00:00:00 [rcuob/43]
root       117     2  0 Mai23 ?        00:00:00 [rcuob/44]
root       118     2  0 Mai23 ?        00:00:00 [rcuob/45]
root       119     2  0 Mai23 ?        00:00:00 [rcuob/46]
root       120     2  0 Mai23 ?        00:00:00 [rcuob/47]
root       121     2  0 Mai23 ?        00:00:00 [rcuob/48]
root       122     2  0 Mai23 ?        00:00:00 [rcuob/49]
root       123     2  0 Mai23 ?        00:00:00 [rcuob/50]
root       124     2  0 Mai23 ?        00:00:00 [rcuob/51]
root       125     2  0 Mai23 ?        00:00:00 [rcuob/52]
root       126     2  0 Mai23 ?        00:00:00 [rcuob/53]
root       127     2  0 Mai23 ?        00:00:00 [rcuob/54]
root       128     2  0 Mai23 ?        00:00:00 [rcuob/55]
root       129     2  0 Mai23 ?        00:00:00 [rcuob/56]
root       130     2  0 Mai23 ?        00:00:00 [rcuob/57]
root       131     2  0 Mai23 ?        00:00:00 [rcuob/58]
root       132     2  0 Mai23 ?        00:00:00 [rcuob/59]
root       133     2  0 Mai23 ?        00:00:00 [rcuob/60]
root       134     2  0 Mai23 ?        00:00:00 [rcuob/61]
root       135     2  0 Mai23 ?        00:00:00 [rcuob/62]
root       136     2  0 Mai23 ?        00:00:00 [rcuob/63]
root       137     2  0 Mai23 ?        00:00:00 [migration/0]
root       138     2  0 Mai23 ?        00:00:00 [watchdog/0]
root       139     2  0 Mai23 ?        00:00:00 [watchdog/1]
root       140     2  0 Mai23 ?        00:00:00 [migration/1]
root       141     2  0 Mai23 ?        00:02:21 [ksoftirqd/1]
root       143     2  0 Mai23 ?        00:00:00 [kworker/1:0H]
root       144     2  0 Mai23 ?        00:00:00 [watchdog/2]
root       145     2  0 Mai23 ?        00:00:00 [migration/2]
root       146     2  0 Mai23 ?        00:04:40 [ksoftirqd/2]
root       148     2  0 Mai23 ?        00:00:00 [kworker/2:0H]
root       149     2  0 Mai23 ?        00:00:00 [watchdog/3]
root       150     2  0 Mai23 ?        00:00:00 [migration/3]
root       151     2  0 Mai23 ?        00:02:10 [ksoftirqd/3]
root       153     2  0 Mai23 ?        00:00:00 [kworker/3:0H]
root       154     2  0 Mai23 ?        00:00:00 [khelper]
root       155     2  0 Mai23 ?        00:00:00 [kdevtmpfs]
root       156     2  0 Mai23 ?        00:00:00 [netns]
root       157     2  0 Mai23 ?        00:00:00 [writeback]
root       158     2  0 Mai23 ?        00:00:00 [kintegrityd]
root       159     2  0 Mai23 ?        00:00:00 [bioset]
root       160     2  0 Mai23 ?        00:00:00 [kworker/u129:0]
root       161     2  0 Mai23 ?        00:00:00 [kblockd]
root       162     2  0 Mai23 ?        00:00:00 [ata_sff]
root       163     2  0 Mai23 ?        00:00:00 [khubd]
root       164     2  0 Mai23 ?        00:00:00 [md]
root       165     2  0 Mai23 ?        00:00:00 [devfreq_wq]
root       168     2  0 Mai23 ?        00:00:00 [khungtaskd]
root       169     2  1 Mai23 ?        01:27:45 [kswapd0]
root       170     2  0 Mai23 ?        00:00:00 [vmstat]
root       171     2  0 Mai23 ?        00:00:00 [ksmd]
root       172     2  0 Mai23 ?        00:00:02 [khugepaged]
root       173     2  0 Mai23 ?        00:00:00 [fsnotify_mark]
root       174     2  0 Mai23 ?        00:00:00 [ecryptfs-kthrea]
root       175     2  0 Mai23 ?        00:00:00 [crypto]
root       187     2  0 Mai23 ?        00:00:00 [kthrotld]
root       208     2  0 Mai23 ?        00:00:00 [deferwq]
root       209     2  0 Mai23 ?        00:00:00 [charger_manager]
root       236     2  0 Mai23 ?        00:08:13 [kworker/2:1]
root       260     2  0 Mai23 ?        00:00:00 [kpsmoused]
root       267     2  0 Mai23 ?        00:00:00 [scsi_eh_0]
root       268     2  0 Mai23 ?        00:00:00 [hpsa]
root       272     2  0 Mai23 ?        00:00:00 [scsi_eh_1]
root       273     2  0 Mai23 ?        00:00:00 [scsi_eh_2]
root       274     2  0 Mai23 ?        00:00:00 [scsi_eh_3]
root       275     2  0 Mai23 ?        00:00:00 [scsi_eh_4]
root       276     2  0 Mai23 ?        00:00:00 [scsi_eh_5]
root       277     2  0 Mai23 ?        00:00:00 [scsi_eh_6]
root       288     2  0 Mai23 ?        00:12:54 [kworker/0:3]
root       289     2  0 Mai23 ?        00:11:52 [kworker/3:1]
root       291     2  0 Mai23 ?        00:00:00 [kdmflush]
root       292     2  0 Mai23 ?        00:00:00 [bioset]
root       293     2  0 Mai23 ?        00:00:00 [kdmflush]
root       295     2  0 Mai23 ?        00:00:00 [bioset]
root       312     2  0 Mai23 ?        00:00:01 [jbd2/dm-0-8]
root       313     2  0 Mai23 ?        00:00:00 [ext4-rsv-conver]
root     32890     1  0 Mai23 tty1     00:00:00 /bin/login --    
root     32898     1  0 Mai23 ?        00:00:00 upstart-udev-bridge --daemon
root     32899     2  0 Mai23 ?        00:00:00 [ext4-rsv-conver]
root     32904     1  0 Mai23 ?        00:00:00
/lib/systemd/systemd-udevd --daemon
root     32938     2  0 Mai23 ?        00:00:00 [kauditd]
root     32993     1  0 Mai23 ?        00:00:00 upstart-file-bridge --daemon
root     33020     2  0 Mai23 ?        00:00:17 [kipmi0]
root     33052     2  0 Mai23 ?        00:00:00 [kvm-irqfd-clean]
root     33077     1  0 Mai23 tty4     00:00:00 /sbin/getty -8 38400 tty4
root     33080     1  0 Mai23 tty5     00:00:00 /sbin/getty -8 38400 tty5
root     33085     1  0 Mai23 tty2     00:00:00 /sbin/getty -8 38400 tty2
root     33086     1  0 Mai23 tty3     00:00:00 /sbin/getty -8 38400 tty3
root     33088     1  0 Mai23 tty6     00:00:00 /sbin/getty -8 38400 tty6
syslog   33093     1  0 Mai23 ?        00:00:00 rsyslogd
root     33109     1  0 Mai23 ?        00:00:00 acpid -c
/etc/acpi/events -s /var/run/acpid.socket
message+ 33117     1  0 Mai23 ?        00:00:00 dbus-daemon --system --fork
root     33121     1  0 Mai23 ?        00:00:00 /usr/sbin/sshd -D
root     33139     1  0 Mai23 ?        00:00:22 /usr/sbin/irqbalance
root     33141     1  0 Mai23 ?        00:00:01 cron
daemon   33142     1  0 Mai23 ?        00:00:00 atd
root     33147     1  0 Mai23 ?        00:00:00 upstart-socket-bridge
--daemon
root     33156     1  0 Mai23 ?        00:00:00 /lib/systemd/systemd-logind
root     33245     1  0 Mai23 ?        00:06:51 /usr/bin/perl -w
/usr/bin/collectl -D
vnstat   33397     1  0 Mai23 ?        00:00:12 /usr/sbin/vnstatd -d
--pidfile /run/vnstat/vnstat.pid
debian-+ 37159     1 26 Mai24 ?        15:30:01 /usr/bin/tor
--defaults-torrc /usr/share/tor/tor-service-defaults-torrc -f
/etc/tor/torrc2 --hush
root     37478     2  0 Mai24 ?        00:00:00 [kworker/u129:1]
root     41443     2  0 Mai25 ?        00:00:00 [kworker/1:1]
debian-+ 44973     1 12 Mai26 ?        02:47:52 /usr/bin/tor
--defaults-torrc /usr/share/tor/tor-service-defaults-torrc -f
/etc/tor/torrc1 --hush
root     45193     2  0 Mai26 ?        00:03:08 [kworker/2:2]
root     45258     2  0 Mai26 ?        00:00:00 [kworker/0:1]
dirk     45265 32890  0 Mai26 tty1     00:00:00 -bash
root     46095     2  0 Mai26 ?        00:04:34 [kworker/3:0]
root     47141     2  0 Mai26 ?        00:01:14 [kworker/1:0]
root     47839     2  0 04:00 ?        00:00:00 [kworker/u128:1]
root     48547     2  0 07:35 ?        00:00:00 [kworker/u128:2]
root     48579 33121  0 07:52 ?        00:00:00 sshd: dirk [priv]  
dirk     48696 48579  0 07:52 ?        00:00:00 sshd: dirk@pts/1   
dirk     48697 48696  2 07:52 pts/1    00:00:00 -bash
dirk     48711 48697  0 07:52 pts/1    00:00:00 ps -ef
dirk@tor1:~$

The unresponsive machine also described by Tyler in this thread on the
22.05.
>> The systems are physical machines with Ubuntu 14.04.5 LTS with 4 GB of
>> memory. This was sufficient the last 2 years.
> If two tor process are using 0.5 GB, what is using the other 3 GB?
>
Good question.
But their loss seem to be related to tor or why does OOM chose it so
frequent ?

this is server 2:
Mit Mai 24 21:45:01 CEST 2017 Process tor2 is not running -> starting
Don Mai 25 08:50:02 CEST 2017 Process tor2 is not running -> starting
Don Mai 25 10:10:22 CEST 2017 Process tor1 is not running -> starting
Don Mai 25 11:25:02 CEST 2017 Process tor2 is not running -> starting
Don Mai 25 15:40:02 CEST 2017 Process tor2 is not running -> starting
Fre Mai 26 10:50:22 CEST 2017 Process tor2 is not running -> starting

The above described incident on server1 brought down the server about 5h
until it recovered.

thx and best regards

Dirk

Attachment: Screenshot_2017-05-26_09-56-09.png
Description: PNG image

_______________________________________________
tor-relays mailing list
tor-relays@xxxxxxxxxxxxxxxxxxxx
https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-relays

References:
- [tor-relays] Memory Problems with tor releay
  - From: tor-relay . dirk
- Re: [tor-relays] Memory Problems with tor releay
  - From: teor

Prev by Author: Re: [tor-relays] Memory Problems with tor releay
Next by Author: Re: [tor-relays] tornull
Previous by thread: Re: [tor-relays] Memory Problems with tor releay
Next by thread: [tor-relays] exit relay consensus weight
Index(es):
- Author
- Thread