mishmash_error.1.laai7hcz3jrdw48k91z7usshv

The task was shut down prematurely (before the stack was manually stopped)
It seems there was an error during the task execution
Task details
Desired state
shutdown
Node ID
xabg2jtix07dgcn2y30ri5x8m
Service ID
qoio2zh6mw32tqom1leobewsq
Task ID
laai7hcz3jrdw48k91z7usshv
Container ID
59ea3376efa26b4d60eb330af3e51d32383ff06c85f250a6d3596f2a32059857
Created at
2020-12-29T16:06:21.734046+00:00
Updated at
2020-12-29T16:10:57.980647+00:00
Started at
2020-12-29T16:07:06.447095+00:00
Memory limit (MB)
3944.539
Logs
Snapshot of the most recent log entries
mishmash_error.1.laai7hcz3jrd@manager1    | 2020-12-29 16:10:15 mishmash_error.1.laai7hcz3jrdw48k91z7usshv wotemu.utils[1] DEBUG /usr/bin/cgget -v -r memory.limit_in_bytes /: b'/:\n9223372036854771712\n\n'
mishmash_error.1.laai7hcz3jrd@manager1    | 2020-12-29 16:10:15 mishmash_error.1.laai7hcz3jrdw48k91z7usshv wotemu.monitor.base[1] DEBUG ZADD (2 items): wotemu:system:mishmash_error.1.laai7hcz3jrdw48k91z7usshv
mishmash_error.1.laai7hcz3jrd@manager1    | 2020-12-29 16:10:20 mishmash_error.1.laai7hcz3jrdw48k91z7usshv wotemu.utils[1] DEBUG /usr/bin/cgget -v -r cpuacct.usage /: b'/:\n7544200436\n\n'
mishmash_error.1.laai7hcz3jrd@manager1    | 2020-12-29 16:10:20 mishmash_error.1.laai7hcz3jrdw48k91z7usshv wotemu.utils[1] DEBUG /usr/bin/cgget -v -r cpu.cfs_period_us /: b'/:\n100000\n\n'
mishmash_error.1.laai7hcz3jrd@manager1    | 2020-12-29 16:10:20 mishmash_error.1.laai7hcz3jrdw48k91z7usshv wotemu.utils[1] DEBUG /usr/bin/cgget -v -r cpu.cfs_quota_us /: b'/:\n-1\n\n'
mishmash_error.1.laai7hcz3jrd@manager1    | 2020-12-29 16:10:20 mishmash_error.1.laai7hcz3jrdw48k91z7usshv wotemu.utils[1] DEBUG /usr/bin/cgget -v -r memory.usage_in_bytes /: b'/:\n153464832\n\n'
mishmash_error.1.laai7hcz3jrd@manager1    | 2020-12-29 16:10:20 mishmash_error.1.laai7hcz3jrdw48k91z7usshv wotemu.utils[1] DEBUG /usr/bin/cgget -v -r memory.limit_in_bytes /: b'/:\n9223372036854771712\n\n'
mishmash_error.1.laai7hcz3jrd@manager1    | 2020-12-29 16:10:25 mishmash_error.1.laai7hcz3jrdw48k91z7usshv wotemu.utils[1] DEBUG /usr/bin/cgget -v -r cpuacct.usage /: b'/:\n7602738116\n\n'
mishmash_error.1.laai7hcz3jrd@manager1    | 2020-12-29 16:10:25 mishmash_error.1.laai7hcz3jrdw48k91z7usshv wotemu.utils[1] DEBUG /usr/bin/cgget -v -r cpu.cfs_period_us /: b'/:\n100000\n\n'
mishmash_error.1.laai7hcz3jrd@manager1    | 2020-12-29 16:10:25 mishmash_error.1.laai7hcz3jrdw48k91z7usshv wotemu.utils[1] DEBUG /usr/bin/cgget -v -r cpu.cfs_quota_us /: b'/:\n-1\n\n'
mishmash_error.1.laai7hcz3jrd@manager1    | 2020-12-29 16:10:25 mishmash_error.1.laai7hcz3jrdw48k91z7usshv wotemu.utils[1] DEBUG /usr/bin/cgget -v -r memory.usage_in_bytes /: b'/:\n152981504\n\n'
mishmash_error.1.laai7hcz3jrd@manager1    | 2020-12-29 16:10:25 mishmash_error.1.laai7hcz3jrdw48k91z7usshv wotemu.utils[1] DEBUG /usr/bin/cgget -v -r memory.limit_in_bytes /: b'/:\n9223372036854771712\n\n'
mishmash_error.1.laai7hcz3jrd@manager1    | 2020-12-29 16:10:25 mishmash_error.1.laai7hcz3jrdw48k91z7usshv wotemu.monitor.base[1] DEBUG ZADD (2 items): wotemu:system:mishmash_error.1.laai7hcz3jrdw48k91z7usshv
mishmash_error.1.laai7hcz3jrd@manager1    | 2020-12-29 16:10:30 mishmash_error.1.laai7hcz3jrdw48k91z7usshv wotemu.utils[1] DEBUG /usr/bin/cgget -v -r cpuacct.usage /: b'/:\n7661370594\n\n'
mishmash_error.1.laai7hcz3jrd@manager1    | 2020-12-29 16:10:30 mishmash_error.1.laai7hcz3jrdw48k91z7usshv wotemu.utils[1] DEBUG /usr/bin/cgget -v -r cpu.cfs_period_us /: b'/:\n100000\n\n'
mishmash_error.1.laai7hcz3jrd@manager1    | 2020-12-29 16:10:30 mishmash_error.1.laai7hcz3jrdw48k91z7usshv wotemu.utils[1] DEBUG /usr/bin/cgget -v -r cpu.cfs_quota_us /: b'/:\n-1\n\n'
mishmash_error.1.laai7hcz3jrd@manager1    | 2020-12-29 16:10:30 mishmash_error.1.laai7hcz3jrdw48k91z7usshv wotemu.utils[1] DEBUG /usr/bin/cgget -v -r memory.usage_in_bytes /: b'/:\n152965120\n\n'
mishmash_error.1.laai7hcz3jrd@manager1    | 2020-12-29 16:10:30 mishmash_error.1.laai7hcz3jrdw48k91z7usshv wotemu.utils[1] DEBUG /usr/bin/cgget -v -r memory.limit_in_bytes /: b'/:\n9223372036854771712\n\n'
mishmash_error.1.laai7hcz3jrd@manager1    | 2020-12-29 16:10:35 mishmash_error.1.laai7hcz3jrdw48k91z7usshv wotemu.utils[1] DEBUG /usr/bin/cgget -v -r cpuacct.usage /: b'/:\n7717438945\n\n'
mishmash_error.1.laai7hcz3jrd@manager1    | 2020-12-29 16:10:35 mishmash_error.1.laai7hcz3jrdw48k91z7usshv wotemu.utils[1] DEBUG /usr/bin/cgget -v -r cpu.cfs_period_us /: b'/:\n100000\n\n'
mishmash_error.1.laai7hcz3jrd@manager1    | 2020-12-29 16:10:35 mishmash_error.1.laai7hcz3jrdw48k91z7usshv wotemu.utils[1] DEBUG /usr/bin/cgget -v -r cpu.cfs_quota_us /: b'/:\n-1\n\n'
mishmash_error.1.laai7hcz3jrd@manager1    | 2020-12-29 16:10:35 mishmash_error.1.laai7hcz3jrdw48k91z7usshv wotemu.utils[1] DEBUG /usr/bin/cgget -v -r memory.usage_in_bytes /: b'/:\n153079808\n\n'
mishmash_error.1.laai7hcz3jrd@manager1    | 2020-12-29 16:10:35 mishmash_error.1.laai7hcz3jrdw48k91z7usshv wotemu.utils[1] DEBUG /usr/bin/cgget -v -r memory.limit_in_bytes /: b'/:\n9223372036854771712\n\n'
mishmash_error.1.laai7hcz3jrd@manager1    | 2020-12-29 16:10:35 mishmash_error.1.laai7hcz3jrdw48k91z7usshv wotemu.monitor.base[1] DEBUG ZADD (2 items): wotemu:system:mishmash_error.1.laai7hcz3jrdw48k91z7usshv
mishmash_error.1.laai7hcz3jrd@manager1    | 2020-12-29 16:10:40 mishmash_error.1.laai7hcz3jrdw48k91z7usshv wotemu.utils[1] DEBUG /usr/bin/cgget -v -r cpuacct.usage /: b'/:\n7774593938\n\n'
mishmash_error.1.laai7hcz3jrd@manager1    | 2020-12-29 16:10:40 mishmash_error.1.laai7hcz3jrdw48k91z7usshv wotemu.utils[1] DEBUG /usr/bin/cgget -v -r cpu.cfs_period_us /: b'/:\n100000\n\n'
mishmash_error.1.laai7hcz3jrd@manager1    | 2020-12-29 16:10:40 mishmash_error.1.laai7hcz3jrdw48k91z7usshv wotemu.utils[1] DEBUG /usr/bin/cgget -v -r cpu.cfs_quota_us /: b'/:\n-1\n\n'
mishmash_error.1.laai7hcz3jrd@manager1    | 2020-12-29 16:10:40 mishmash_error.1.laai7hcz3jrdw48k91z7usshv wotemu.utils[1] DEBUG /usr/bin/cgget -v -r memory.usage_in_bytes /: b'/:\n152997888\n\n'
mishmash_error.1.laai7hcz3jrd@manager1    | 2020-12-29 16:10:40 mishmash_error.1.laai7hcz3jrdw48k91z7usshv wotemu.utils[1] DEBUG /usr/bin/cgget -v -r memory.limit_in_bytes /: b'/:\n9223372036854771712\n\n'
mishmash_error.1.laai7hcz3jrd@manager1    | 2020-12-29 16:10:45 mishmash_error.1.laai7hcz3jrdw48k91z7usshv wotemu.utils[1] DEBUG /usr/bin/cgget -v -r cpuacct.usage /: b'/:\n7830595605\n\n'
mishmash_error.1.laai7hcz3jrd@manager1    | 2020-12-29 16:10:45 mishmash_error.1.laai7hcz3jrdw48k91z7usshv wotemu.utils[1] DEBUG /usr/bin/cgget -v -r cpu.cfs_period_us /: b'/:\n100000\n\n'
mishmash_error.1.laai7hcz3jrd@manager1    | 2020-12-29 16:10:45 mishmash_error.1.laai7hcz3jrdw48k91z7usshv wotemu.utils[1] DEBUG /usr/bin/cgget -v -r cpu.cfs_quota_us /: b'/:\n-1\n\n'
mishmash_error.1.laai7hcz3jrd@manager1    | 2020-12-29 16:10:45 mishmash_error.1.laai7hcz3jrdw48k91z7usshv wotemu.utils[1] DEBUG /usr/bin/cgget -v -r memory.usage_in_bytes /: b'/:\n152928256\n\n'
mishmash_error.1.laai7hcz3jrd@manager1    | 2020-12-29 16:10:45 mishmash_error.1.laai7hcz3jrdw48k91z7usshv wotemu.utils[1] DEBUG /usr/bin/cgget -v -r memory.limit_in_bytes /: b'/:\n9223372036854771712\n\n'
mishmash_error.1.laai7hcz3jrd@manager1    | 2020-12-29 16:10:45 mishmash_error.1.laai7hcz3jrdw48k91z7usshv wotemu.monitor.base[1] DEBUG ZADD (2 items): wotemu:system:mishmash_error.1.laai7hcz3jrdw48k91z7usshv
mishmash_error.1.laai7hcz3jrd@manager1    | 2020-12-29 16:10:49 mishmash_error.1.laai7hcz3jrdw48k91z7usshv wotemu.cli.app[1] ERROR WoT app error: Exception('Error raised at 2020-12-29 16:10:49.014855 UTC')
mishmash_error.1.laai7hcz3jrd@manager1    | 2020-12-29 16:10:49 mishmash_error.1.laai7hcz3jrdw48k91z7usshv wotemu.cli.app[1] INFO Cancelling WoT app task: <Task finished name='Task-4' coro=<app() done, defined at /usr/local/lib/python3.8/dist-packages/wotemu/apps/error.py:9> exception=Exception('Error raised at 2020-12-29 16:10:49.014855 UTC')>
mishmash_error.1.laai7hcz3jrd@manager1    | 2020-12-29 16:10:49 mishmash_error.1.laai7hcz3jrdw48k91z7usshv wotemu.cli.app[1] WARNING Error during WoT app cancelation
mishmash_error.1.laai7hcz3jrd@manager1    | Traceback (most recent call last):
mishmash_error.1.laai7hcz3jrd@manager1    |   File "/usr/local/lib/python3.8/dist-packages/wotemu/cli/app.py", line 163, in _stop
mishmash_error.1.laai7hcz3jrd@manager1    |     await asyncio.wait_for(app_task, _TIMEOUT)
mishmash_error.1.laai7hcz3jrd@manager1    |   File "/usr/lib/python3.8/asyncio/tasks.py", line 483, in wait_for
mishmash_error.1.laai7hcz3jrd@manager1    |     return fut.result()
mishmash_error.1.laai7hcz3jrd@manager1    |   File "/usr/local/lib/python3.8/dist-packages/wotemu/apps/error.py", line 19, in app
mishmash_error.1.laai7hcz3jrd@manager1    |     raise Exception(f"Error raised at {now} UTC")
mishmash_error.1.laai7hcz3jrd@manager1    | Exception: Error raised at 2020-12-29 16:10:49.014855 UTC
mishmash_error.1.laai7hcz3jrd@manager1    | 2020-12-29 16:10:49 mishmash_error.1.laai7hcz3jrdw48k91z7usshv wotemu.cli.app[1] DEBUG Shutting down Servient: <wotpy.wot.servient.Servient object at 0x7f76d145e730>
mishmash_error.1.laai7hcz3jrd@manager1    | 2020-12-29 16:10:49 mishmash_error.1.laai7hcz3jrdw48k91z7usshv wotemu.monitor.base[1] DEBUG Stopping node monitor
mishmash_error.1.laai7hcz3jrd@manager1    | 2020-12-29 16:10:49 mishmash_error.1.laai7hcz3jrdw48k91z7usshv wotemu.monitor.system[1] DEBUG Cancelled system usage task
mishmash_error.1.laai7hcz3jrd@manager1    | 2020-12-29 16:10:49 mishmash_error.1.laai7hcz3jrdw48k91z7usshv wotemu.monitor.packet[1] DEBUG Cancelled Task for: <SpawnProcess name='PysharkCapture-eth0' pid=85 parent=1 started daemon>
mishmash_error.1.laai7hcz3jrd@manager1    | 2020-12-29 16:10:49 mishmash_error.1.laai7hcz3jrdw48k91z7usshv wotemu.monitor.packet[1] DEBUG Setting stop event for: <SpawnProcess name='PysharkCapture-eth0' pid=85 parent=1 started daemon>
mishmash_error.1.laai7hcz3jrd@manager1    | 2020-12-29 16:10:49 mishmash_error.1.laai7hcz3jrdw48k91z7usshv wotemu.monitor.packet[1] DEBUG Waiting 5.0 secs for exit: <SpawnProcess name='PysharkCapture-eth0' pid=85 parent=1 started daemon>
mishmash_error.1.laai7hcz3jrd@manager1    | 2020-12-29 16:10:54 mishmash_error.1.laai7hcz3jrdw48k91z7usshv wotemu.monitor.packet[1] WARNING <SpawnProcess name='PysharkCapture-eth0' pid=85 parent=1 started daemon> did not terminate with stop event
mishmash_error.1.laai7hcz3jrd@manager1    | 2020-12-29 16:10:54 mishmash_error.1.laai7hcz3jrdw48k91z7usshv wotemu.monitor.packet[1] INFO Terminating process: <SpawnProcess name='PysharkCapture-eth0' pid=85 parent=1 started daemon>
mishmash_error.1.laai7hcz3jrd@manager1    | 2020-12-29 16:10:54 mishmash_error.1.laai7hcz3jrdw48k91z7usshv wotemu.monitor.packet[1] DEBUG Waiting 5.0 secs for exit: <SpawnProcess name='PysharkCapture-eth0' pid=85 parent=1 started daemon>
mishmash_error.1.laai7hcz3jrd@manager1    | 2020-12-29 16:10:54 mishmash_error.1.laai7hcz3jrdw48k91z7usshv wotemu.monitor.base[1] DEBUG Closed Redis connection
mishmash_error.1.laai7hcz3jrd@manager1    | 2020-12-29 16:10:54 mishmash_error.1.laai7hcz3jrdw48k91z7usshv wotemu.cli.app[1] DEBUG Closing Redis
mishmash_error.1.laai7hcz3jrd@manager1    | 2020-12-29 16:10:54 mishmash_error.1.laai7hcz3jrdw48k91z7usshv wotemu.cli.app[1] DEBUG Stopping loop
mishmash_error.1.laai7hcz3jrd@manager1    | 2020-12-29 16:10:54 mishmash_error.1.laai7hcz3jrdw48k91z7usshv wotemu.cli.app[1] DEBUG Closing loop
mishmash_error.1.laai7hcz3jrd@manager1    | 2020-12-29 16:10:54 mishmash_error.1.laai7hcz3jrdw48k91z7usshv wotemu.cli.app[1] WARNING Exiting with code: 1