Segmentation fault probably in zmq
The last LOG of webui: [2018-08-10 06:46:21.477873][4][0x00000b94][0x00007f988affd700]: [ZMQBaseClass] - int chaos::common::direct_io::impl::ZMQBaseClass::moreMessageToRead(void*, bool&)(323) - Error checking the send more option on socket with error:zmq error 88 [Socket operation on non-socket] [2018-08-10 06:46:21.478820][4][0x00000b94][0x00007f988affd700]: [ZMQBaseClass] - int chaos::common::direct_io::impl::ZMQBaseClass::reveiceDatapack(void*, chaos::common::direct_io::DirectIODataPackSPtr&)(424) - Error checking other message in socket [2018-08-10 06:46:21.478948][4][0x00000b94][0x00007f988affd700]: [ZMQDirectIOClientConnection] - int chaos::common::direct_io::impl::ZMQDirectIOClientConnection::writeToSocket(void*, std::__cxx11::string&, chaos::common::direct_io::DirectIODataPackSPtr, chaos::common::direct_io::DirectIODataPackSPtr&)(357) - Error receiving answer datapack with code:88 [2018-08-10 06:46:21.479819][0][0x00000b94][0x00007f98b97fa700]: [HTTPUIInterface] - checkActivity - * pruning "FLAME/CAMERA/LASER001" because elapsed 375.273 s last time access:1.53388e+09 s ago [2018-08-10 06:46:21.483390][4][0x00000b94][0x00007f988affd700]: [ZMQDirectIOClientConnection] - virtual int chaos::common::direct_io::impl::ZMQDirectIOClientConnection::sendPriorityData(chaos::common::direct_io::DirectIODataPackSPtr, chaos::common::direct_io::DirectIODataPackSPtr&)(275) - Error configuring new id for socker :127.0.0.1:18970
Stack Trace: terminate called after throwing an instance of 'boost::exception_detail::clone_impl<boost::exception_detail::error_info_injectorboost::lock_error >' what(): boost: mutex lock failed in pthread_mutex_lock: Invalid argument Stack trace (most recent call last) in thread 3011: #27 (closed) Object "[0xffffffffffffffff], at 0xffffffffffffffff, in #26 (closed) Object "/lib/x86_64-linux-gnu/libc.so.6, at 0x7f9904eba41c, in clone #25 (closed) Object "/lib/x86_64-linux-gnu/libpthread.so.0, at 0x7f990762b6b9, in #24 (closed) Object "/usr/local/chaos/chaos-distrib/bin/webui, at 0x67747c, in #23 (closed) Object "/usr/local/chaos/chaos-distrib/bin/webui, at 0x60cf35, in boost::detail::thread_data<boost::_bi::bind_t<void, boost::_mfi::mf0<void, common::misc::scheduler::Scheduler>, boost::_bi::list1<boost::_bi::valuecommon::misc::scheduler::Scheduler* > > >::run() #22 (closed) Object "/usr/local/chaos/chaos-distrib/bin/webui, at 0x60cf83, in boost::_bi::bind_t<void, boost::_mfi::mf0<void, common::misc::scheduler::Scheduler>, boost::_bi::list1<boost::_bi::valuecommon::misc::scheduler::Scheduler* > >::operator()() #21 (closed) Object "/usr/local/chaos/chaos-distrib/bin/webui, at 0x60cfeb, in void boost::_bi::list1<boost::_bi::valuecommon::misc::scheduler::Scheduler* >::operator()<boost::_mfi::mf0<void, common::misc::scheduler::Scheduler>, boost::_bi::list0>(boost::_bi::type, boost::_mfi::mf0<void, common::misc::scheduler::Scheduler>&, boost::_bi::list0&, int) #20 (closed) Object "/usr/local/chaos/chaos-distrib/bin/webui, at 0x60d088, in boost::_mfi::mf0<void, common::misc::scheduler::Scheduler>::operator()(common::misc::scheduler::Scheduler*) const #19 Object "/usr/local/chaos/chaos-distrib/bin/webui, at 0x607bb7, in common::misc::scheduler::Scheduler::sched_task() #18 Object "/usr/local/chaos/chaos-distrib/lib/libchaos_driver_misc.so, at 0x7f9907a879fd, in driver::misc::ChaosController::sched(unsigned long) #17 Object "/usr/local/chaos/chaos-distrib/lib/libchaos_metadata_service_client.so.1, at 0x7f99071ace04, in chaos::metadata_service_client::node_controller::CUController::fetchAllDataset() #16 Object "/usr/local/chaos/chaos-distrib/lib/libchaos_common.so.1, at 0x7f990653ea3b, in chaos::common::io::IODirectIODriver::retriveMultipleData(std::vector<std::__cxx11::basic_string<char, std::char_traits, std::allocator >, std::allocator<std::__cxx11::basic_string<char, std::char_traits, std::allocator > > > const&, std::vector<std::shared_ptrchaos::common::data::CDataWrapper, std::allocator<std::shared_ptrchaos::common::data::CDataWrapper > >&) #15 (closed) Object "/usr/local/chaos/chaos-distrib/lib/libchaos_common.so.1, at 0x7f990652e51e, in chaos::common::direct_io::channel::DirectIODeviceClientChannel::requestLastOutputData(std::vector<std::__cxx11::basic_string<char, std::char_traits, std::allocator >, std::allocator<std::__cxx11::basic_string<char, std::char_traits, std::allocator > > > const&, std::vector<std::shared_ptrchaos::common::data::CDataWrapper, std::allocator<std::shared_ptrchaos::common::data::CDataWrapper > >&) #14 (closed) Object "/usr/local/chaos/chaos-distrib/lib/libchaos_common.so.1, at 0x7f990652c0f6, in chaos::common::direct_io::channel::DirectIOVirtualClientChannel::sendPriorityData(std::shared_ptrchaos::common::direct_io::DirectIODataPack, std::shared_ptrchaos::common::direct_io::DirectIODataPack&) #13 Object "/usr/local/chaos/chaos-distrib/lib/libchaos_common.so.1, at 0x7f9906526e09, in chaos::common::direct_io::impl::ZMQDirectIOClientConnection::sendPriorityData(std::shared_ptrchaos::common::direct_io::DirectIODataPack, std::shared_ptrchaos::common::direct_io::DirectIODataPack&) #12 (closed) Object "/usr/local/chaos/chaos-distrib/bin/webui, at 0x59ec56, in boost::unique_lockboost::shared_mutex::~unique_lock() #11 (closed) Object "/usr/local/chaos/chaos-distrib/bin/webui, at 0x59cffb, in boost::shared_mutex::unlock() #10 (closed) Object "/usr/local/chaos/chaos-distrib/bin/webui, at 0x58d9b8, in boost::unique_lockboost::mutex::unique_lock(boost::mutex&) #9 (closed) Object "/usr/local/chaos/chaos-distrib/bin/webui, at 0x58dbd2, in boost::unique_lockboost::mutex::lock() #8 (closed) Object "/usr/local/chaos/chaos-distrib/bin/webui, at 0x589716, in boost::mutex::lock() #7 (closed) Object "/lib/x86_64-linux-gnu/libgcc_s.so.1, at 0x7f990518d486, in _Unwind_Resume #6 (closed) Object "/lib/x86_64-linux-gnu/libgcc_s.so.1, at 0x7f990518cf82, in #5 (closed) Object "/usr/lib/x86_64-linux-gnu/libstdc++.so.6, at 0x7f9905420004, in __gxx_personality_v0 #4 (closed) Object "/usr/lib/x86_64-linux-gnu/libstdc++.so.6, at 0x7f990541f6a8, in #3 Object "/usr/lib/x86_64-linux-gnu/libstdc++.so.6, at 0x7f99054206b5, in #2 (closed) Object "/usr/lib/x86_64-linux-gnu/libstdc++.so.6, at 0x7f990542284c, in __gnu_cxx::__verbose_terminate_handler() #1 (closed) Object "/lib/x86_64-linux-gnu/libc.so.6, at 0x7f9904dea029, in abort #0 Object "/lib/x86_64-linux-gnu/libc.so.6, at 0x7f9904de8428, in gsignal Aborted (Signal sent by tkill() 2964 0)