mishmash_error.2.rqm1uyraoplsp9alqcaayebh9

The task was shut down prematurely (before the stack was manually stopped)
It seems there was an error during the task execution
Task details
Desired state
shutdown
Node ID
xabg2jtix07dgcn2y30ri5x8m
Service ID
qoio2zh6mw32tqom1leobewsq
Task ID
rqm1uyraoplsp9alqcaayebh9
Container ID
87e9ce837029bb5e306d8a5242bb005a66940bf75933f5195e06ac6c2b338d3b
Created at
2020-12-29T16:08:27.986575+00:00
Updated at
2020-12-29T16:12:32.371021+00:00
Started at
2020-12-29T16:08:58.773925+00:00
Memory limit (MB)
3944.539
Logs
Snapshot of the most recent log entries
mishmash_error.2.rqm1uyraopls@manager1    | 2020-12-29 16:11:51 mishmash_error.2.rqm1uyraoplsp9alqcaayebh9 wotemu.utils[1] DEBUG /usr/bin/cgget -v -r memory.limit_in_bytes /: b'/:\n9223372036854771712\n\n'
mishmash_error.2.rqm1uyraopls@manager1    | 2020-12-29 16:11:51 mishmash_error.2.rqm1uyraoplsp9alqcaayebh9 wotemu.monitor.base[1] DEBUG ZADD (2 items): wotemu:system:mishmash_error.2.rqm1uyraoplsp9alqcaayebh9
mishmash_error.2.rqm1uyraopls@manager1    | 2020-12-29 16:11:56 mishmash_error.2.rqm1uyraoplsp9alqcaayebh9 wotemu.utils[1] DEBUG /usr/bin/cgget -v -r cpuacct.usage /: b'/:\n7823546186\n\n'
mishmash_error.2.rqm1uyraopls@manager1    | 2020-12-29 16:11:56 mishmash_error.2.rqm1uyraoplsp9alqcaayebh9 wotemu.utils[1] DEBUG /usr/bin/cgget -v -r cpu.cfs_period_us /: b'/:\n100000\n\n'
mishmash_error.2.rqm1uyraopls@manager1    | 2020-12-29 16:11:56 mishmash_error.2.rqm1uyraoplsp9alqcaayebh9 wotemu.utils[1] DEBUG /usr/bin/cgget -v -r cpu.cfs_quota_us /: b'/:\n-1\n\n'
mishmash_error.2.rqm1uyraopls@manager1    | 2020-12-29 16:11:57 mishmash_error.2.rqm1uyraoplsp9alqcaayebh9 wotemu.utils[1] DEBUG /usr/bin/cgget -v -r memory.usage_in_bytes /: b'/:\n221782016\n\n'
mishmash_error.2.rqm1uyraopls@manager1    | 2020-12-29 16:11:57 mishmash_error.2.rqm1uyraoplsp9alqcaayebh9 wotemu.utils[1] DEBUG /usr/bin/cgget -v -r memory.limit_in_bytes /: b'/:\n9223372036854771712\n\n'
mishmash_error.2.rqm1uyraopls@manager1    | 2020-12-29 16:12:02 mishmash_error.2.rqm1uyraoplsp9alqcaayebh9 wotemu.utils[1] DEBUG /usr/bin/cgget -v -r cpuacct.usage /: b'/:\n7885836685\n\n'
mishmash_error.2.rqm1uyraopls@manager1    | 2020-12-29 16:12:02 mishmash_error.2.rqm1uyraoplsp9alqcaayebh9 wotemu.utils[1] DEBUG /usr/bin/cgget -v -r cpu.cfs_period_us /: b'/:\n100000\n\n'
mishmash_error.2.rqm1uyraopls@manager1    | 2020-12-29 16:12:02 mishmash_error.2.rqm1uyraoplsp9alqcaayebh9 wotemu.utils[1] DEBUG /usr/bin/cgget -v -r cpu.cfs_quota_us /: b'/:\n-1\n\n'
mishmash_error.2.rqm1uyraopls@manager1    | 2020-12-29 16:12:02 mishmash_error.2.rqm1uyraoplsp9alqcaayebh9 wotemu.utils[1] DEBUG /usr/bin/cgget -v -r memory.usage_in_bytes /: b'/:\n221159424\n\n'
mishmash_error.2.rqm1uyraopls@manager1    | 2020-12-29 16:12:02 mishmash_error.2.rqm1uyraoplsp9alqcaayebh9 wotemu.utils[1] DEBUG /usr/bin/cgget -v -r memory.limit_in_bytes /: b'/:\n9223372036854771712\n\n'
mishmash_error.2.rqm1uyraopls@manager1    | 2020-12-29 16:12:02 mishmash_error.2.rqm1uyraoplsp9alqcaayebh9 wotemu.monitor.base[1] DEBUG ZADD (2 items): wotemu:system:mishmash_error.2.rqm1uyraoplsp9alqcaayebh9
mishmash_error.2.rqm1uyraopls@manager1    | 2020-12-29 16:12:07 mishmash_error.2.rqm1uyraoplsp9alqcaayebh9 wotemu.utils[1] DEBUG /usr/bin/cgget -v -r cpuacct.usage /: b'/:\n7951140923\n\n'
mishmash_error.2.rqm1uyraopls@manager1    | 2020-12-29 16:12:07 mishmash_error.2.rqm1uyraoplsp9alqcaayebh9 wotemu.utils[1] DEBUG /usr/bin/cgget -v -r cpu.cfs_period_us /: b'/:\n100000\n\n'
mishmash_error.2.rqm1uyraopls@manager1    | 2020-12-29 16:12:07 mishmash_error.2.rqm1uyraoplsp9alqcaayebh9 wotemu.utils[1] DEBUG /usr/bin/cgget -v -r cpu.cfs_quota_us /: b'/:\n-1\n\n'
mishmash_error.2.rqm1uyraopls@manager1    | 2020-12-29 16:12:07 mishmash_error.2.rqm1uyraoplsp9alqcaayebh9 wotemu.utils[1] DEBUG /usr/bin/cgget -v -r memory.usage_in_bytes /: b'/:\n221216768\n\n'
mishmash_error.2.rqm1uyraopls@manager1    | 2020-12-29 16:12:07 mishmash_error.2.rqm1uyraoplsp9alqcaayebh9 wotemu.utils[1] DEBUG /usr/bin/cgget -v -r memory.limit_in_bytes /: b'/:\n9223372036854771712\n\n'
mishmash_error.2.rqm1uyraopls@manager1    | 2020-12-29 16:12:12 mishmash_error.2.rqm1uyraoplsp9alqcaayebh9 wotemu.utils[1] DEBUG /usr/bin/cgget -v -r cpuacct.usage /: b'/:\n8018140653\n\n'
mishmash_error.2.rqm1uyraopls@manager1    | 2020-12-29 16:12:12 mishmash_error.2.rqm1uyraoplsp9alqcaayebh9 wotemu.utils[1] DEBUG /usr/bin/cgget -v -r cpu.cfs_period_us /: b'/:\n100000\n\n'
mishmash_error.2.rqm1uyraopls@manager1    | 2020-12-29 16:12:12 mishmash_error.2.rqm1uyraoplsp9alqcaayebh9 wotemu.utils[1] DEBUG /usr/bin/cgget -v -r cpu.cfs_quota_us /: b'/:\n-1\n\n'
mishmash_error.2.rqm1uyraopls@manager1    | 2020-12-29 16:12:12 mishmash_error.2.rqm1uyraoplsp9alqcaayebh9 wotemu.utils[1] DEBUG /usr/bin/cgget -v -r memory.usage_in_bytes /: b'/:\n218742784\n\n'
mishmash_error.2.rqm1uyraopls@manager1    | 2020-12-29 16:12:12 mishmash_error.2.rqm1uyraoplsp9alqcaayebh9 wotemu.utils[1] DEBUG /usr/bin/cgget -v -r memory.limit_in_bytes /: b'/:\n9223372036854771712\n\n'
mishmash_error.2.rqm1uyraopls@manager1    | 2020-12-29 16:12:12 mishmash_error.2.rqm1uyraoplsp9alqcaayebh9 wotemu.monitor.base[1] DEBUG ZADD (2 items): wotemu:system:mishmash_error.2.rqm1uyraoplsp9alqcaayebh9
mishmash_error.2.rqm1uyraopls@manager1    | 2020-12-29 16:12:17 mishmash_error.2.rqm1uyraoplsp9alqcaayebh9 wotemu.utils[1] DEBUG /usr/bin/cgget -v -r cpuacct.usage /: b'/:\n8084256157\n\n'
mishmash_error.2.rqm1uyraopls@manager1    | 2020-12-29 16:12:17 mishmash_error.2.rqm1uyraoplsp9alqcaayebh9 wotemu.utils[1] DEBUG /usr/bin/cgget -v -r cpu.cfs_period_us /: b'/:\n100000\n\n'
mishmash_error.2.rqm1uyraopls@manager1    | 2020-12-29 16:12:17 mishmash_error.2.rqm1uyraoplsp9alqcaayebh9 wotemu.utils[1] DEBUG /usr/bin/cgget -v -r cpu.cfs_quota_us /: b'/:\n-1\n\n'
mishmash_error.2.rqm1uyraopls@manager1    | 2020-12-29 16:12:17 mishmash_error.2.rqm1uyraoplsp9alqcaayebh9 wotemu.utils[1] DEBUG /usr/bin/cgget -v -r memory.usage_in_bytes /: b'/:\n218669056\n\n'
mishmash_error.2.rqm1uyraopls@manager1    | 2020-12-29 16:12:17 mishmash_error.2.rqm1uyraoplsp9alqcaayebh9 wotemu.utils[1] DEBUG /usr/bin/cgget -v -r memory.limit_in_bytes /: b'/:\n9223372036854771712\n\n'
mishmash_error.2.rqm1uyraopls@manager1    | 2020-12-29 16:12:22 mishmash_error.2.rqm1uyraoplsp9alqcaayebh9 wotemu.utils[1] DEBUG /usr/bin/cgget -v -r cpuacct.usage /: b'/:\n8148814875\n\n'
mishmash_error.2.rqm1uyraopls@manager1    | 2020-12-29 16:12:22 mishmash_error.2.rqm1uyraoplsp9alqcaayebh9 wotemu.utils[1] DEBUG /usr/bin/cgget -v -r cpu.cfs_period_us /: b'/:\n100000\n\n'
mishmash_error.2.rqm1uyraopls@manager1    | 2020-12-29 16:12:22 mishmash_error.2.rqm1uyraoplsp9alqcaayebh9 wotemu.utils[1] DEBUG /usr/bin/cgget -v -r cpu.cfs_quota_us /: b'/:\n-1\n\n'
mishmash_error.2.rqm1uyraopls@manager1    | 2020-12-29 16:12:22 mishmash_error.2.rqm1uyraoplsp9alqcaayebh9 wotemu.utils[1] DEBUG /usr/bin/cgget -v -r memory.usage_in_bytes /: b'/:\n219353088\n\n'
mishmash_error.2.rqm1uyraopls@manager1    | 2020-12-29 16:12:22 mishmash_error.2.rqm1uyraoplsp9alqcaayebh9 wotemu.utils[1] DEBUG /usr/bin/cgget -v -r memory.limit_in_bytes /: b'/:\n9223372036854771712\n\n'
mishmash_error.2.rqm1uyraopls@manager1    | 2020-12-29 16:12:22 mishmash_error.2.rqm1uyraoplsp9alqcaayebh9 wotemu.monitor.base[1] DEBUG ZADD (2 items): wotemu:system:mishmash_error.2.rqm1uyraoplsp9alqcaayebh9
mishmash_error.2.rqm1uyraopls@manager1    | 2020-12-29 16:12:26 mishmash_error.2.rqm1uyraoplsp9alqcaayebh9 wotemu.cli.app[1] ERROR WoT app error: Exception('Error raised at 2020-12-29 16:12:26.304113 UTC')
mishmash_error.2.rqm1uyraopls@manager1    | 2020-12-29 16:12:26 mishmash_error.2.rqm1uyraoplsp9alqcaayebh9 wotemu.cli.app[1] INFO Cancelling WoT app task: <Task finished name='Task-4' coro=<app() done, defined at /usr/local/lib/python3.8/dist-packages/wotemu/apps/error.py:9> exception=Exception('Error raised at 2020-12-29 16:12:26.304113 UTC')>
mishmash_error.2.rqm1uyraopls@manager1    | 2020-12-29 16:12:26 mishmash_error.2.rqm1uyraoplsp9alqcaayebh9 wotemu.cli.app[1] WARNING Error during WoT app cancelation
mishmash_error.2.rqm1uyraopls@manager1    | Traceback (most recent call last):
mishmash_error.2.rqm1uyraopls@manager1    |   File "/usr/local/lib/python3.8/dist-packages/wotemu/cli/app.py", line 163, in _stop
mishmash_error.2.rqm1uyraopls@manager1    |     await asyncio.wait_for(app_task, _TIMEOUT)
mishmash_error.2.rqm1uyraopls@manager1    |   File "/usr/lib/python3.8/asyncio/tasks.py", line 483, in wait_for
mishmash_error.2.rqm1uyraopls@manager1    |     return fut.result()
mishmash_error.2.rqm1uyraopls@manager1    |   File "/usr/local/lib/python3.8/dist-packages/wotemu/apps/error.py", line 19, in app
mishmash_error.2.rqm1uyraopls@manager1    |     raise Exception(f"Error raised at {now} UTC")
mishmash_error.2.rqm1uyraopls@manager1    | Exception: Error raised at 2020-12-29 16:12:26.304113 UTC
mishmash_error.2.rqm1uyraopls@manager1    | 2020-12-29 16:12:26 mishmash_error.2.rqm1uyraoplsp9alqcaayebh9 wotemu.cli.app[1] DEBUG Shutting down Servient: <wotpy.wot.servient.Servient object at 0x7fdef96cb550>
mishmash_error.2.rqm1uyraopls@manager1    | 2020-12-29 16:12:26 mishmash_error.2.rqm1uyraoplsp9alqcaayebh9 wotemu.monitor.base[1] DEBUG Stopping node monitor
mishmash_error.2.rqm1uyraopls@manager1    | 2020-12-29 16:12:26 mishmash_error.2.rqm1uyraoplsp9alqcaayebh9 wotemu.monitor.system[1] DEBUG Cancelled system usage task
mishmash_error.2.rqm1uyraopls@manager1    | 2020-12-29 16:12:26 mishmash_error.2.rqm1uyraoplsp9alqcaayebh9 wotemu.monitor.packet[1] DEBUG Cancelled Task for: <SpawnProcess name='PysharkCapture-eth0' pid=86 parent=1 started daemon>
mishmash_error.2.rqm1uyraopls@manager1    | 2020-12-29 16:12:26 mishmash_error.2.rqm1uyraoplsp9alqcaayebh9 wotemu.monitor.packet[1] DEBUG Setting stop event for: <SpawnProcess name='PysharkCapture-eth0' pid=86 parent=1 started daemon>
mishmash_error.2.rqm1uyraopls@manager1    | 2020-12-29 16:12:26 mishmash_error.2.rqm1uyraoplsp9alqcaayebh9 wotemu.monitor.packet[1] DEBUG Waiting 5.0 secs for exit: <SpawnProcess name='PysharkCapture-eth0' pid=86 parent=1 started daemon>
mishmash_error.2.rqm1uyraopls@manager1    | 2020-12-29 16:12:31 mishmash_error.2.rqm1uyraoplsp9alqcaayebh9 wotemu.monitor.packet[1] WARNING <SpawnProcess name='PysharkCapture-eth0' pid=86 parent=1 started daemon> did not terminate with stop event
mishmash_error.2.rqm1uyraopls@manager1    | 2020-12-29 16:12:31 mishmash_error.2.rqm1uyraoplsp9alqcaayebh9 wotemu.monitor.packet[1] INFO Terminating process: <SpawnProcess name='PysharkCapture-eth0' pid=86 parent=1 started daemon>
mishmash_error.2.rqm1uyraopls@manager1    | 2020-12-29 16:12:31 mishmash_error.2.rqm1uyraoplsp9alqcaayebh9 wotemu.monitor.packet[1] DEBUG Waiting 5.0 secs for exit: <SpawnProcess name='PysharkCapture-eth0' pid=86 parent=1 started daemon>
mishmash_error.2.rqm1uyraopls@manager1    | 2020-12-29 16:12:31 mishmash_error.2.rqm1uyraoplsp9alqcaayebh9 wotemu.monitor.base[1] DEBUG Closed Redis connection
mishmash_error.2.rqm1uyraopls@manager1    | 2020-12-29 16:12:31 mishmash_error.2.rqm1uyraoplsp9alqcaayebh9 wotemu.cli.app[1] DEBUG Closing Redis
mishmash_error.2.rqm1uyraopls@manager1    | 2020-12-29 16:12:31 mishmash_error.2.rqm1uyraoplsp9alqcaayebh9 wotemu.cli.app[1] DEBUG Stopping loop
mishmash_error.2.rqm1uyraopls@manager1    | 2020-12-29 16:12:31 mishmash_error.2.rqm1uyraoplsp9alqcaayebh9 wotemu.cli.app[1] DEBUG Closing loop
mishmash_error.2.rqm1uyraopls@manager1    | 2020-12-29 16:12:31 mishmash_error.2.rqm1uyraoplsp9alqcaayebh9 wotemu.cli.app[1] WARNING Exiting with code: 1