Continuous disconnects

Hi, This development device (C001) typically disconnects and then reconnects a few seconds later, once a day or so: c0010c2a69f0039c. However, for the past several days it has been disconnecting every 10 or 12 minutes, with the log showing an error message like the following:

2024-09-29T13:12:36.398 +00:00 [Device] ERROR: 1727615547 - Unexpected Disconnect
2024-09-29T13:21:16.980 +00:00 [Status] Device disconnected

Nothing in its configuration or environment has changed.

Hi Robert,

There’s some containerisation work being done on dev servers at the moment, it might be a temporary side effect of that. I’ve passed on your observation to the cloud team.

Thanks,
Phil

Thanks Phil, it is behaving normally now.

Now there is new behavior- sometimes it disconnects and, instead of reconnecting after a few seconds, it does nothing, and requires HW reboot to connect again. This has happened twice in the last 48 hours.

Can you provide rough timestamps for those two events?

If it happens again, can you wait 10 minutes before power cycling it? It might be snoozing for 9 minutes between failed connection attempts.

We’ve deployed some configuration changes to the dev servers that initially seem to have helped.

Let’s see how the device behaves over the next day or two.

Hi Phil,
Here is some logging data:

Typical behavior:

2024-10-19T01:21:31.819 +00:00 [Status] Device disconnected
2024-10-19T01:21:32.302 +00:00 [Agent] device says it is connected
2024-10-19T01:21:32.276 +00:00 [Device] ERROR: 1729300883 - Unexpected Disconnect

Disconnected but did not reconnect:

2024-10-19T01:31:20.857 +00:00 [Status] Device disconnected

Device manually repowered:

2024-10-19T01:38:33.519 +00:00 [Status] Device connected

Back to typical behavior:

2024-10-19T01:39:10.576 +00:00 [Status] Device disconnected
2024-10-19T01:39:11.064 +00:00 [Agent] device says it is connected
2024-10-19T01:39:11.027 +00:00 [Device] ERROR: 1729301918 - Unexpected Disconnect

Typical behavior:

2024-10-20T01:14:12.523 +00:00 [Status] Device disconnected
2024-10-20T01:14:12.976 +00:00 [Device] ERROR: 1729386843 - Unexpected Disconnect
2024-10-20T01:14:13.003 +00:00 [Agent] device says it is connected

Delay of ~9 minutes:

2024-10-20T01:23:58.496 +00:00 [Status] Device disconnected
2024-10-20T01:32:35.816 +00:00 [Device] ERROR: 1729387945 - Unexpected Disconnect
2024-10-20T01:32:35.817 +00:00 [Agent] device says it is connected

Note:

for the incident at 2024-10-19T01:31:20.857, the
disconnect may have occurred at about the same time
as the receipt by the device of a message from the
agent telling it to turn some lights on (the failure
of the lights to go on was the motivation for rebooting
the device).

I will add some more logging by the device to
better document this behavior, i.e., have it write
to the log when it receives msg from agent.

We are seeing many fewer reconnects for your device now.

Would you say it is back to behaving normally?

Hi Phil,

Yes, it does look as though things are back to normal behavior.

Thanks again for your help with this,
Robert

This topic was automatically closed after 60 days. New replies are no longer allowed.