taskstats: add_del_listener() should ignore !valid listeners