[Author Prev][Author Next][Thread Prev][Thread Next][Author Index][Thread Index]
Re: [Libevent-users] bufferevent_openssl_filter_new and event_base_free
On Wed, Sep 17, 2014 at 03:19:18PM -0400, Topher LaFata wrote:
> Hello,
>
> I am running into a problem where I am unable to properly free the
> event_base when using the bufferevent_openssl_filter.
> I have a use case where I need to connect and immediately disconnect from a
> remote server.
>
> This is the error I am seeing.
>
> [debug] event_add: event: 0x7fd99ac1e490 (fd 6), EV_READ call 0x10811b8f0
>
> [debug] event_callback_finalize_many_: 3 events finalizing
>
> [debug] event_del: 0x7fd99ad00b00 (fd -1), callback 0x1081175c0
>
> [debug] event_del: 0x7fd99ad00b80 (fd -1), callback 0x108117620
>
> [debug] event_del: 0x7fd99ad00b00 (fd -1), callback 0x1081175c0
>
> [debug] event_del: 0x7fd99ac1e490 (fd 6), callback 0x10811b8f0
>
> [debug] event_del: 0x7fd99ad00b00 (fd -1), callback 0x108116c70
>
> [debug] event_callback_finalize_many_: 3 events finalizing
>
> [debug] event_del: 0x7fd99ac1e490 (fd 6), callback 0x10811b8f0
>
> [debug] event_del: 0x7fd99ac1e510 (fd 6), callback 0x10811bb30
>
> [debug] event_del: 0x7fd99ac1e490 (fd 6), callback 0x10811b8f0
>
> [debug] event_base_free_: 1 events were still set in base
>
> [err] event.c:840: Assertion TAILQ_EMPTY(&base->activequeues[i]) failed in
> event_base_free_Abort trap: 6
>
>
> I attached a small test program demonstrating the problem. You will have to
> change the LIBEVENT_BASE_DIR variable in the included Makefile.
>
> I am able to get around the problem by not freeing the underlying
> bufferevent or by using event_base_free_nofinalize but then we are leaking
> memory according to valgrind.
>
> It is not clear to me that I am even setting up this stuff properly even
> though it is working well. Any insight would be greatly appreciated!
Hi Topher,
That is because bufferevent_finalize_cb_() -> ...
bufferevent_decref_and_unlock_() ... -> event_queue_insert_active().
IOW bufferevent finalize add events into active queue, during cleaning this
active queue in event_base_free_():
...
for (i = 0; i < base->nactivequeues; ++i) {
struct event_callback *evcb, *next;
for (evcb = TAILQ_FIRST(&base->activequeues[i]); evcb; ) {
next = TAILQ_NEXT(evcb, evcb_active_next);
/* Here TAILQ_REMOVE() called, and TAILQ_INSERT_*() too
* from bufferevent_decref_and_unlock_() -> ... ->
* event_queue_insert_active() */
n_deleted += event_base_cancel_single_callback_(base, evcb, run_finalizers);
evcb = next;
}
}
...
for (i = 0; i < base->nactivequeues; ++i)
EVUTIL_ASSERT(TAILQ_EMPTY(&base->activequeues[i]));
Watchpoint 3: -location base->activequeues[0]
Old value = {
tqh_first = 0x0,
tqh_last = 0x61fdf0
}
New value = {
tqh_first = 0x621d00,
tqh_last = 0x61fdf0
}
0x00007ffff7ba2a91 in event_queue_insert_active (base=0x61f9c0, evcb=0x621d00) at event.c:3269
3269 TAILQ_INSERT_TAIL(&base->activequeues[evcb->evcb_pri],
(gdb) bt
#0 0x00007ffff7ba2a91 in event_queue_insert_active (base=0x61f9c0, evcb=0x621d00) at event.c:3269
#1 0x00007ffff7ba1948 in event_callback_activate_nolock_ (base=0x61f9c0, evcb=0x621d00) at event.c:2903
#2 0x00007ffff7b9f115 in event_callback_finalize_nolock_ (base=0x61f9c0, flags=0, evcb=0x621d00, cb=0x7ffff7b93239 <bufferevent_finalize_cb_>) at event.c:2181
#3 0x00007ffff7b9f2e3 in event_callback_finalize_many_ (base=0x61f9c0, n_cbs=3, evcbs=0x7fffffffdbb0, cb=0x7ffff7b93239 <bufferevent_finalize_cb_>) at event.c:2223
#4 0x00007ffff7b931f7 in bufferevent_decref_and_unlock_ (bufev=0x621cf0) at bufferevent.c:717
#5 0x00007ffff7b93453 in bufferevent_decref_ (bufev=0x621cf0) at bufferevent.c:783
#6 0x00007ffff7b93401 in bufferevent_finalize_cb_ (evcb=0x622240, arg_=0x622230) at bufferevent.c:776
#7 0x00007ffff7b9b622 in event_base_cancel_single_callback_ (base=0x61f9c0, evcb=0x622240, run_finalizers=1) at event.c:741
#8 0x00007ffff7b9b867 in event_base_free_ (base=0x61f9c0, run_finalizers=1) at event.c:814
#9 0x00007ffff7b9bb6a in event_base_free (base=0x61f9c0) at event.c:869
#10 0x0000000000401747 in _close ()
#11 0x0000000000401899 in main ()
*But* bufferevent_decref_and_unlock_() called not only from
event_base_free():
(gdb) bt
#0 event_callback_finalize_many_ (base=0x6b40e0, n_cbs=3, evcbs=0x7fffffffd8b0, cb=0x7ffff7b93239 <bufferevent_finalize_cb_>) at event.c:2199
#1 0x00007ffff7b931f7 in bufferevent_decref_and_unlock_ (bufev=0x6b4ea0) at bufferevent.c:717
#2 0x00007ffff7b98cbf in bufferevent_writecb (fd=12, event=4, arg=0x6b4ea0) at bufferevent_sock.c:313
#3 0x00007ffff7b9d147 in event_persist_closure (base=0x6b40e0, ev=0x6b4f30) at event.c:1510
#4 0x00007ffff7b9d430 in event_process_active_single_queue (base=0x6b40e0, activeq=0x6b4530, max_to_process=2147483647, endtime=0x0) at event.c:1569
#5 0x00007ffff7b9da58 in event_process_active (base=0x6b40e0) at event.c:1668
#6 0x00007ffff7b9e1b7 in event_base_loop (base=0x6b40e0, flags=0) at event.c:1891
#7 0x00007ffff7b9dade in event_base_dispatch (event_base=0x6b40e0) at event.c:1702
#8 0x000000000044237a in test_bufferevent_connect (arg=0x6b46b0) at regress_bufferevent.c:576
#9 0x0000000000485d19 in testcase_run_bare_ (testcase=0x6a4af0 <bufferevent_testcases+240>) at tinytest.c:105
#10 0x0000000000485dc6 in testcase_run_forked_ (group=0x6a5fb0 <testgroups+112>, testcase=0x6a4af0 <bufferevent_testcases+240>) at tinytest.c:189
#11 0x0000000000485feb in testcase_run_one (group=0x6a5fb0 <testgroups+112>, testcase=0x6a4af0 <bufferevent_testcases+240>) at tinytest.c:247
#12 0x000000000048693a in tinytest_main (c=2, v=0x7fffffffdef8, groups=0x6a5f40 <testgroups>) at tinytest.c:434
#13 0x000000000047343f in main (argc=2, argv=0x7fffffffdef8) at regress_main.c:459
I'm not sure about the proper patch, maybe some EV_FINALIZE flag for that
events or something like this (and only when it called from event_base_free()).
Nick could you look into this?
Cheers,
Azat.
***********************************************************************
To unsubscribe, send an e-mail to majordomo@xxxxxxxxxxxxx with
unsubscribe libevent-users in the body.