mishmash_error.2.v9tyvhh8f6h13g08b7xrvk3p2

The task was shut down prematurely (before the stack was manually stopped)
It seems there was an error during the task execution
Task details
Desired state
shutdown
Node ID
xabg2jtix07dgcn2y30ri5x8m
Service ID
qoio2zh6mw32tqom1leobewsq
Task ID
v9tyvhh8f6h13g08b7xrvk3p2
Container ID
ed3f24691cab4119e2536dbdc24dd60f06aee1ba6e9ba8e1a44c71f6a0a90a3c
Created at
2020-12-29T16:06:21.734158+00:00
Updated at
2020-12-29T16:07:34.492662+00:00
Started at
2020-12-29T16:07:10.228699+00:00
Memory limit (MB)
3944.539
Logs
Snapshot of the most recent log entries
mishmash_error.2.v9tyvhh8f6h1@manager1    |          'lo': [{'address': '127.0.0.1',
mishmash_error.2.v9tyvhh8f6h1@manager1    |                  'broadcast': None,
mishmash_error.2.v9tyvhh8f6h1@manager1    |                  'family': 2,
mishmash_error.2.v9tyvhh8f6h1@manager1    |                  'netmask': '255.0.0.0',
mishmash_error.2.v9tyvhh8f6h1@manager1    |                  'ptp': None},
mishmash_error.2.v9tyvhh8f6h1@manager1    |                 {'address': '00:00:00:00:00:00',
mishmash_error.2.v9tyvhh8f6h1@manager1    |                  'broadcast': None,
mishmash_error.2.v9tyvhh8f6h1@manager1    |                  'family': 17,
mishmash_error.2.v9tyvhh8f6h1@manager1    |                  'netmask': None,
mishmash_error.2.v9tyvhh8f6h1@manager1    |                  'ptp': None}]},
mishmash_error.2.v9tyvhh8f6h1@manager1    |  'networks_cidr': {'wifi': ['10.0.12.0/24']},
mishmash_error.2.v9tyvhh8f6h1@manager1    |  'process': {'1': {'name': 'wotemu', 'username': 'root'}},
mishmash_error.2.v9tyvhh8f6h1@manager1    |  'python_version': '3.8.5',
mishmash_error.2.v9tyvhh8f6h1@manager1    |  'service_vips': {'wifi': '10.0.12.17'},
mishmash_error.2.v9tyvhh8f6h1@manager1    |  'task_id': 'v9tyvhh8f6h13g08b7xrvk3p2',
mishmash_error.2.v9tyvhh8f6h1@manager1    |  'time': 1609258030.2286994,
mishmash_error.2.v9tyvhh8f6h1@manager1    |  'uname': {'machine': 'x86_64',
mishmash_error.2.v9tyvhh8f6h1@manager1    |            'node': 'mishmash_error.2.v9tyvhh8f6h13g08b7xrvk3p2',
mishmash_error.2.v9tyvhh8f6h1@manager1    |            'processor': 'x86_64',
mishmash_error.2.v9tyvhh8f6h1@manager1    |            'release': '4.15.0-121-generic',
mishmash_error.2.v9tyvhh8f6h1@manager1    |            'system': 'Linux',
mishmash_error.2.v9tyvhh8f6h1@manager1    |            'version': '#123-Ubuntu SMP Mon Oct 5 16:16:40 UTC 2020'}}
mishmash_error.2.v9tyvhh8f6h1@manager1    | 2020-12-29 16:07:10 mishmash_error.2.v9tyvhh8f6h13g08b7xrvk3p2 wotemu.utils[1] DEBUG /usr/bin/cgget -v -r cpuacct.usage /: b'/:\n3933468041\n\n'
mishmash_error.2.v9tyvhh8f6h1@manager1    | 2020-12-29 16:07:10 mishmash_error.2.v9tyvhh8f6h13g08b7xrvk3p2 wotemu.monitor.packet[1] DEBUG Starting LiveCapture on interface eth0 with display filter: tcp.port==1883 or tcp.port==80 or tcp.port==81 or tcp.port==5683 or udp.port==5683
mishmash_error.2.v9tyvhh8f6h1@manager1    | 2020-12-29 16:07:15 mishmash_error.2.v9tyvhh8f6h13g08b7xrvk3p2 wotemu.utils[1] DEBUG /usr/bin/cgget -v -r cpuacct.usage /: b'/:\n4424332369\n\n'
mishmash_error.2.v9tyvhh8f6h1@manager1    | 2020-12-29 16:07:15 mishmash_error.2.v9tyvhh8f6h13g08b7xrvk3p2 wotemu.utils[1] DEBUG /usr/bin/cgget -v -r cpu.cfs_period_us /: b'/:\n100000\n\n'
mishmash_error.2.v9tyvhh8f6h1@manager1    | 2020-12-29 16:07:16 mishmash_error.2.v9tyvhh8f6h13g08b7xrvk3p2 wotemu.utils[1] DEBUG /usr/bin/cgget -v -r cpu.cfs_quota_us /: b'/:\n-1\n\n'
mishmash_error.2.v9tyvhh8f6h1@manager1    | 2020-12-29 16:07:16 mishmash_error.2.v9tyvhh8f6h13g08b7xrvk3p2 wotemu.utils[1] DEBUG /usr/bin/cgget -v -r memory.usage_in_bytes /: b'/:\n121233408\n\n'
mishmash_error.2.v9tyvhh8f6h1@manager1    | 2020-12-29 16:07:16 mishmash_error.2.v9tyvhh8f6h13g08b7xrvk3p2 wotemu.utils[1] DEBUG /usr/bin/cgget -v -r memory.limit_in_bytes /: b'/:\n9223372036854771712\n\n'
mishmash_error.2.v9tyvhh8f6h1@manager1    | 2020-12-29 16:07:22 mishmash_error.2.v9tyvhh8f6h13g08b7xrvk3p2 wotemu.utils[1] DEBUG /usr/bin/cgget -v -r cpuacct.usage /: b'/:\n5044024285\n\n'
mishmash_error.2.v9tyvhh8f6h1@manager1    | 2020-12-29 16:07:22 mishmash_error.2.v9tyvhh8f6h13g08b7xrvk3p2 wotemu.utils[1] DEBUG /usr/bin/cgget -v -r cpu.cfs_period_us /: b'/:\n100000\n\n'
mishmash_error.2.v9tyvhh8f6h1@manager1    | 2020-12-29 16:07:22 mishmash_error.2.v9tyvhh8f6h13g08b7xrvk3p2 wotemu.utils[1] DEBUG /usr/bin/cgget -v -r cpu.cfs_quota_us /: b'/:\n-1\n\n'
mishmash_error.2.v9tyvhh8f6h1@manager1    | 2020-12-29 16:07:22 mishmash_error.2.v9tyvhh8f6h13g08b7xrvk3p2 wotemu.utils[1] DEBUG /usr/bin/cgget -v -r memory.usage_in_bytes /: b'/:\n201777152\n\n'
mishmash_error.2.v9tyvhh8f6h1@manager1    | 2020-12-29 16:07:23 mishmash_error.2.v9tyvhh8f6h13g08b7xrvk3p2 wotemu.utils[1] DEBUG /usr/bin/cgget -v -r memory.limit_in_bytes /: b'/:\n9223372036854771712\n\n'
mishmash_error.2.v9tyvhh8f6h1@manager1    | 2020-12-29 16:07:23 mishmash_error.2.v9tyvhh8f6h13g08b7xrvk3p2 wotemu.monitor.base[1] DEBUG ZADD (2 items): wotemu:system:mishmash_error.2.v9tyvhh8f6h13g08b7xrvk3p2
mishmash_error.2.v9tyvhh8f6h1@manager1    | 2020-12-29 16:07:27 mishmash_error.2.v9tyvhh8f6h13g08b7xrvk3p2 wotemu.cli.app[1] ERROR WoT app error: Exception('Error raised at 2020-12-29 16:07:27.839719 UTC')
mishmash_error.2.v9tyvhh8f6h1@manager1    | 2020-12-29 16:07:27 mishmash_error.2.v9tyvhh8f6h13g08b7xrvk3p2 wotemu.cli.app[1] INFO Cancelling WoT app task: <Task finished name='Task-4' coro=<app() done, defined at /usr/local/lib/python3.8/dist-packages/wotemu/apps/error.py:9> exception=Exception('Error raised at 2020-12-29 16:07:27.839719 UTC')>
mishmash_error.2.v9tyvhh8f6h1@manager1    | 2020-12-29 16:07:27 mishmash_error.2.v9tyvhh8f6h13g08b7xrvk3p2 wotemu.cli.app[1] WARNING Error during WoT app cancelation
mishmash_error.2.v9tyvhh8f6h1@manager1    | Traceback (most recent call last):
mishmash_error.2.v9tyvhh8f6h1@manager1    |   File "/usr/local/lib/python3.8/dist-packages/wotemu/cli/app.py", line 163, in _stop
mishmash_error.2.v9tyvhh8f6h1@manager1    |     await asyncio.wait_for(app_task, _TIMEOUT)
mishmash_error.2.v9tyvhh8f6h1@manager1    |   File "/usr/lib/python3.8/asyncio/tasks.py", line 483, in wait_for
mishmash_error.2.v9tyvhh8f6h1@manager1    |     return fut.result()
mishmash_error.2.v9tyvhh8f6h1@manager1    |   File "/usr/local/lib/python3.8/dist-packages/wotemu/apps/error.py", line 19, in app
mishmash_error.2.v9tyvhh8f6h1@manager1    |     raise Exception(f"Error raised at {now} UTC")
mishmash_error.2.v9tyvhh8f6h1@manager1    | Exception: Error raised at 2020-12-29 16:07:27.839719 UTC
mishmash_error.2.v9tyvhh8f6h1@manager1    | 2020-12-29 16:07:27 mishmash_error.2.v9tyvhh8f6h13g08b7xrvk3p2 wotemu.cli.app[1] DEBUG Shutting down Servient: <wotpy.wot.servient.Servient object at 0x7f871caf1730>
mishmash_error.2.v9tyvhh8f6h1@manager1    | 2020-12-29 16:07:27 mishmash_error.2.v9tyvhh8f6h13g08b7xrvk3p2 wotemu.monitor.base[1] DEBUG Stopping node monitor
mishmash_error.2.v9tyvhh8f6h1@manager1    | 2020-12-29 16:07:27 mishmash_error.2.v9tyvhh8f6h13g08b7xrvk3p2 wotemu.monitor.system[1] DEBUG Cancelled system usage task
mishmash_error.2.v9tyvhh8f6h1@manager1    | 2020-12-29 16:07:27 mishmash_error.2.v9tyvhh8f6h13g08b7xrvk3p2 wotemu.monitor.packet[1] DEBUG Cancelled Task for: <SpawnProcess name='PysharkCapture-eth0' pid=85 parent=1 started daemon>
mishmash_error.2.v9tyvhh8f6h1@manager1    | 2020-12-29 16:07:27 mishmash_error.2.v9tyvhh8f6h13g08b7xrvk3p2 wotemu.monitor.packet[1] DEBUG Setting stop event for: <SpawnProcess name='PysharkCapture-eth0' pid=85 parent=1 started daemon>
mishmash_error.2.v9tyvhh8f6h1@manager1    | 2020-12-29 16:07:27 mishmash_error.2.v9tyvhh8f6h13g08b7xrvk3p2 wotemu.monitor.packet[1] DEBUG Waiting 5.0 secs for exit: <SpawnProcess name='PysharkCapture-eth0' pid=85 parent=1 started daemon>
mishmash_error.2.v9tyvhh8f6h1@manager1    | 2020-12-29 16:07:32 mishmash_error.2.v9tyvhh8f6h13g08b7xrvk3p2 wotemu.monitor.packet[1] WARNING <SpawnProcess name='PysharkCapture-eth0' pid=85 parent=1 started daemon> did not terminate with stop event
mishmash_error.2.v9tyvhh8f6h1@manager1    | 2020-12-29 16:07:32 mishmash_error.2.v9tyvhh8f6h13g08b7xrvk3p2 wotemu.monitor.packet[1] INFO Terminating process: <SpawnProcess name='PysharkCapture-eth0' pid=85 parent=1 started daemon>
mishmash_error.2.v9tyvhh8f6h1@manager1    | 2020-12-29 16:07:32 mishmash_error.2.v9tyvhh8f6h13g08b7xrvk3p2 wotemu.monitor.packet[1] DEBUG Waiting 5.0 secs for exit: <SpawnProcess name='PysharkCapture-eth0' pid=85 parent=1 started daemon>
mishmash_error.2.v9tyvhh8f6h1@manager1    | 2020-12-29 16:07:33 mishmash_error.2.v9tyvhh8f6h13g08b7xrvk3p2 wotemu.monitor.base[1] DEBUG Closed Redis connection
mishmash_error.2.v9tyvhh8f6h1@manager1    | 2020-12-29 16:07:33 mishmash_error.2.v9tyvhh8f6h13g08b7xrvk3p2 wotemu.cli.app[1] DEBUG Closing Redis
mishmash_error.2.v9tyvhh8f6h1@manager1    | 2020-12-29 16:07:33 mishmash_error.2.v9tyvhh8f6h13g08b7xrvk3p2 wotemu.cli.app[1] DEBUG Stopping loop
mishmash_error.2.v9tyvhh8f6h1@manager1    | 2020-12-29 16:07:33 mishmash_error.2.v9tyvhh8f6h13g08b7xrvk3p2 wotemu.cli.app[1] DEBUG Closing loop
mishmash_error.2.v9tyvhh8f6h1@manager1    | 2020-12-29 16:07:33 mishmash_error.2.v9tyvhh8f6h13g08b7xrvk3p2 wotemu.cli.app[1] WARNING Exiting with code: 1