MikroTik

Posted: **Wed May 04, 2022 3:41 pm**

Hello,

I have an issue with my quite new CCR2004-1G-12S+2XS the fail led start to show up and the fan are weirdly cycling from low speed to high speed.
The router continue to work properly though I did not notice any latency or slow network speed when in fail state

I have in logs this only, nothing else special.

PSU1 entered state FAIL

I try to use the PSU2 only or both PSU plug but the result is the same after few minutes / hour.
I try to
I do not understand why it start to happen without any configuration change or update.

I was in 6.49 when the issue started and I tried to upgrade to 7.2 to see if that fixes the issue with no success.
So the router is in version 7.2 now
RouterOS: 7.2.1

Video of the router failing: https://youtu.be/eKwU5_6RIUw

Do you have any clue on that issue ?

Posted: **Tue Sep 20, 2022 2:36 pm**

Hello,

i have the same error.

 sep/16 05:32:48 system,error,critical router rebooted without proper shutdown, probably power outage
 sep/16 05:32:48 health,warning PSU2 entered state FAIL
 sep/16 05:32:50 pppoe,ppp,info Drosselcom: initializing...
 sep/16 05:32:50 pppoe,ppp,info Drosselcom: connecting...
 sep/16 05:32:51 interface,info sfp1_vlan7 link up
 sep/16 05:32:51 pppoe,ppp,info Drosselcom: terminating...
 sep/16 05:32:51 pppoe,ppp,info Drosselcom: disconnected
 sep/16 05:32:51 pppoe,ppp,info Drosselcom: initializing...
 sep/16 05:32:51 pppoe,ppp,info Drosselcom: connecting...
 sep/16 05:32:51 interface,info sfp11_vlan10 link up
 sep/16 05:32:51 interface,info sfp12_vlan20 link up
 sep/16 05:32:51 pppoe,ppp,info Drosselcom: terminating...
 sep/16 05:32:51 pppoe,ppp,info Drosselcom: disconnected
 sep/16 05:32:51 pppoe,ppp,info Drosselcom: initializing...
 sep/16 05:32:51 pppoe,ppp,info Drosselcom: connecting...
 sep/16 05:32:51 pppoe,ppp,info Drosselcom: terminating...
 sep/16 05:32:51 pppoe,ppp,info Drosselcom: disconnected
 sep/16 05:32:51 pppoe,ppp,info Drosselcom: initializing...
 sep/16 05:32:51 pppoe,ppp,info Drosselcom: connecting...
 sep/16 05:32:51 pppoe,ppp,info Drosselcom: terminating...
 sep/16 05:32:51 pppoe,ppp,info Drosselcom: disconnected
 sep/16 05:32:51 pppoe,ppp,info Drosselcom: initializing...
 sep/16 05:32:51 pppoe,ppp,info Drosselcom: connecting...
 sep/16 05:32:51 pppoe,ppp,info Drosselcom: terminating...
 sep/16 05:32:51 pppoe,ppp,info Drosselcom: disconnected
 sep/16 05:32:51 pppoe,ppp,info Drosselcom: initializing...
 sep/16 05:32:51 pppoe,ppp,info Drosselcom: connecting...
 sep/16 05:32:52 interface,info sfp-sfpplus9 link up (speed 1G, full duplex)
 sep/16 05:32:53 health,info PSU2 returned to state OK
 sep/16 05:32:55 interface,info sfp-sfpplus10 link up (speed 10G, full duplex)
 sep/16 05:32:55 interface,info sfp-sfpplus11 link up (speed 10G, full duplex)
 sep/16 05:32:55 interface,info sfp-sfpplus12 link up (speed 10G, full duplex)
 sep/16 05:33:01 pppoe,ppp,info Drosselcom: terminating... - disconnected
 sep/16 05:33:01 pppoe,ppp,info Drosselcom: disconnected
 sep/16 05:33:01 pppoe,ppp,info Drosselcom: initializing...
 sep/16 05:33:01 pppoe,ppp,info Drosselcom: connecting...
 sep/16 05:33:11 pppoe,ppp,info Drosselcom: terminating... - disconnected
 sep/16 05:33:11 pppoe,ppp,info Drosselcom: disconnected
 sep/16 05:33:11 pppoe,ppp,info Drosselcom: initializing...
 sep/16 05:33:11 pppoe,ppp,info Drosselcom: connecting...
 sep/16 05:33:21 pppoe,ppp,info Drosselcom: terminating... - disconnected
 sep/16 05:33:21 pppoe,ppp,info Drosselcom: disconnected
 sep/16 05:33:22 pppoe,ppp,info Drosselcom: initializing...
 sep/16 05:33:22 pppoe,ppp,info Drosselcom: connecting...
 sep/16 05:33:32 pppoe,ppp,info Drosselcom: terminating... - disconnected
 sep/16 05:33:32 pppoe,ppp,info Drosselcom: disconnected
 sep/16 05:33:34 pppoe,ppp,info Drosselcom: initializing...
 sep/16 05:33:34 pppoe,ppp,info Drosselcom: connecting...
 sep/16 05:33:40 interface,info sfp1 link up (speed 2.5G, full duplex)
 sep/16 05:33:44 pppoe,ppp,info Drosselcom: terminating... - disconnected
 sep/16 05:33:44 pppoe,ppp,info Drosselcom: disconnected
 sep/16 05:33:47 pppoe,ppp,info Drosselcom: initializing...
 sep/16 05:33:47 pppoe,ppp,info Drosselcom: connecting...
 sep/16 05:33:57 pppoe,ppp,info Drosselcom: terminating... - disconnected
 sep/16 05:33:57 pppoe,ppp,info Drosselcom: disconnected
 sep/16 05:33:59 system,info,account user admin logged in from 10.0.2.1 via web
 sep/16 05:34:04 pppoe,ppp,info Drosselcom: initializing...
 sep/16 05:34:04 pppoe,ppp,info Drosselcom: connecting...
 sep/16 05:34:14 pppoe,ppp,info Drosselcom: terminating... - disconnected
 sep/16 05:34:14 pppoe,ppp,info Drosselcom: disconnected
 sep/16 05:34:24 pppoe,ppp,info Drosselcom: initializing...
 sep/16 05:34:24 pppoe,ppp,info Drosselcom: connecting...
 sep/16 05:34:25 pppoe,ppp,info Drosselcom: authenticated
 sep/16 05:34:25 pppoe,ppp,info Drosselcom: connected
 sep/16 12:44:10 system,critical,info cloud change time Sep/16/2022 05:36:38 => Sep/16/2022 12:44:10
 sep/16 20:36:55 system,info,account user admin logged out from 10.0.2.1 via web
 sep/17 15:11:26 system,info,account user admin logged in from 10.0.2.1 via web
 sep/17 18:51:47 system,info,account user admin logged out from 10.0.2.1 via web
 sep/19 11:16:55 system,info,account user admin logged in from 10.0.2.1 via web
 sep/19 13:40:05 system,info,account user admin logged out from 10.0.2.1 via web
 10:53:59 health,warning PSU1 entered state FAIL
 10:54:55 health,warning PSU2 entered state FAIL
 12:41:58 system,info,account user admin logged in from 10.0.2.1 via web
 12:42:05 system,error,critical login failure for user admin from 10.0.2.1 via web
 12:42:07 system,info,account user admin logged in from 10.0.2.1 via web
 12:42:10 system,info,account user admin logged in from 10.0.2.1 via web
 12:42:15 system,info,account user admin logged in from 10.0.2.1 via web
 12:42:36 system,error,critical login failure for user root from 10.0.2.1 via ssh
 12:42:43 system,info,account user admin logged in from 10.0.2.1 via ssh
 12:43:32 system,info,account user admin logged in from 10.0.2.1 via web
 12:43:38 system,error,critical login failure for user admin from 10.0.2.1 via web
 12:43:39 system,info,account user admin logged in from 10.0.2.1 via web
 12:43:45 system,info,account user admin logged in from 10.0.2.1 via web
 12:44:32 system,info,account user admin logged out from 10.0.2.1 via web
 12:45:02 system,info,account user admin logged out from 10.0.2.1 via web
 
 > /interface/print
action timed out - try again, if error continues contact MikroTik support and send a supout file (13)

Info: I removed all DHCP messages from the log.

Here is some more information that helps to explain this a bit:
- The error occurs only when a GPON module is used
- The UI and the console can only be used sometimes in case of an error (In the current example the login takes forever and a print to interfaces or the like is not possible)
- Both power supplies work even after the message, the system is also not crashed
- Rarely the error occurs that single interfaces have no link
- However, after the error message, establishing a new connection is usually impossible
- Data of the GPON SFP is not readable
In this case, both power supplies come from one busbar. None of the other connected systems has problems with the power supply. (I have unfortunately only one circuit in the cabinet)
Since the suspicion suggests it could come from the GPON SFP, I have replaced this with others, even changed the manufacturer.
- HUAWEI MA5671A
- Alcatel G-010S-P

Now to my guess, either it is a bug in the firmware or what I can well imagine, that by power fluctuations in the network such messages are Produziert. However, it has not even happened that the message is "taken back" from the system.
The only time I've heard such a message is when I don't plug in the 2nd connector fast enough when starting the switches. As seen in the log above.

Firmeware: 7.5 - stable
Sorry for my bad english.

Posted: **Fri Sep 23, 2022 12:59 pm**

I tried to create a "supout file" over several days, but:

> system sup-output name=supout.rif


action timed out - try again, if error continues contact MikroTik support and send a supout file (13)

https://wiki.mikrotik.com/wiki/Manual:S ... utput_File

Posted: **Thu Sep 29, 2022 7:22 pm**

Same here. Since today, same symptoms, with ROS 7.5

Posted: **Thu Jan 19, 2023 8:20 pm**

My CCR2004-16G-2S+ have exactly the same issue. My gpon (G-010S-A) doesn't work when plugged in (PPPOE can't connect, zero TX/RX on the SFP interface). I have to go to the SFP interface and turn off the auto-negotiation, then force the speed to 1G or 2.5G. After click on the apply, the PPPoE works. But after about few seconds, both PSU1 and PSU2 enter failure status. (network still works).
System/health print shows a below,
temperature n/a
cpu-temperature 49
sfp-temperature n/a
fan1-speed n/a
fan2-speed n/a
board-temperature1 0
board-temperature2 0
psu1-state fail
psu2-state fail

I can reproduce this issue every single time. Now I'm using an SPF-ethernet converter instead of plugging the GPON into Mikrotik to avoid this issue. Please help to fix it. Thanks.

Posted: **Sun Apr 09, 2023 3:15 pm**

I have the same issue with Alcatel G-010S-P plugged in. [Edit : remove HUAWEI MA5671A because this GPON stick is not impacted by issue, only with G-010S-P]
I tested ROS 7.7 and ROS 7.9rc2 still the same problem

 00:58:11 health,warning PSU1 entered state FAIL
 00:58:30 snmp,warning timeout while waiting for program 24
 00:59:00 snmp,warning timeout while waiting for program 20
 01:05:30 snmp,warning timeout while waiting for program 23
 01:09:35 snmp,warning timeout while waiting for program 20
 01:10:05 snmp,warning timeout while waiting for program 24
 01:20:30 snmp,warning timeout while waiting for program 20
 01:21:00 snmp,warning timeout while waiting for program 24
 01:24:30 snmp,warning timeout while waiting for program 23
 01:31:30 snmp,warning timeout while waiting for program 20
 01:32:00 snmp,warning timeout while waiting for program 24
 01:38:30 snmp,warning timeout while waiting for program 23
 01:42:30 snmp,warning timeout while waiting for program 20
 01:43:00 snmp,warning timeout while waiting for program 24
 01:53:30 snmp,warning timeout while waiting for program 20
 01:54:00 snmp,warning timeout while waiting for program 24
 01:55:30 snmp,warning timeout while waiting for program 23
 02:04:30 snmp,warning timeout while waiting for program 20
 02:05:00 snmp,warning timeout while waiting for program 24
 02:11:30 snmp,warning timeout while waiting for program 23
 02:15:30 snmp,warning timeout while waiting for program 20
 02:16:00 snmp,warning timeout while waiting for program 24
 02:24:30 snmp,warning timeout while waiting for program 23
 02:26:30 snmp,warning timeout while waiting for program 20
 02:27:21 snmp,warning timeout while waiting for program 24
 02:37:30 snmp,warning timeout while waiting for program 20
 02:38:00 snmp,warning timeout while waiting for program 24
 02:48:30 snmp,warning timeout while waiting for program 20
 02:49:00 snmp,warning timeout while waiting for program 24
 02:52:30 snmp,warning timeout while waiting for program 23
 02:59:30 snmp,warning timeout while waiting for program 20
 03:00:00 snmp,warning timeout while waiting for program 24
 03:09:30 snmp,warning timeout while waiting for program 23
 03:10:30 snmp,warning timeout while waiting for program 20
 03:11:00 snmp,warning timeout while waiting for program 24
 03:21:30 snmp,warning timeout while waiting for program 20
 03:22:00 snmp,warning timeout while waiting for program 24
 03:23:30 snmp,warning timeout while waiting for program 23
 03:32:30 snmp,warning timeout while waiting for program 20
 03:33:00 snmp,warning timeout while waiting for program 24
 03:43:30 snmp,warning timeout while waiting for program 24
 03:44:00 snmp,warning timeout while waiting for program 20
 03:46:30 snmp,warning timeout while waiting for program 23
 03:54:36 snmp,warning timeout while waiting for program 20
 03:55:36 snmp,warning timeout while waiting for program 44
 03:56:06 snmp,warning timeout while waiting for program 24
 04:03:30 snmp,warning timeout while waiting for program 23
 04:05:30 snmp,warning timeout while waiting for program 20
 04:07:30 snmp,warning timeout while waiting for program 24
 04:16:30 snmp,warning timeout while waiting for program 20
 04:17:00 snmp,warning timeout while waiting for program 23
 04:18:30 snmp,warning timeout while waiting for program 24
 04:27:30 snmp,warning timeout while waiting for program 20
 04:28:30 snmp,warning timeout while waiting for program 23
 04:29:00 snmp,warning timeout while waiting for program 24
 04:33:02 interface,warning sfp-sfpplus1 module auto-initialization failed, try forced-mode
 04:33:14 interface,warning sfp-sfpplus3 module auto-initialization failed, try forced-mode
 04:33:17 interface,warning sfp-sfpplus5 module auto-initialization failed, try forced-mode
 04:33:24 interface,warning sfp-sfpplus7 module auto-initialization failed, try forced-mode
 04:33:34 interface,warning sfp-sfpplus9 module auto-initialization failed, try forced-mode
 04:37:53 interface,warning sfp-sfpplus11 module auto-initialization failed, try forced-mode
 04:37:53 interface,warning sfp-sfpplus12 module auto-initialization failed, try forced-mode
 04:38:30 snmp,warning timeout while waiting for program 20
 04:39:30 snmp,warning timeout while waiting for program 24
 04:49:30 snmp,warning timeout while waiting for program 20
 04:50:16 snmp,warning timeout while waiting for program 24
 05:00:30 snmp,warning timeout while waiting for program 20
 05:01:00 snmp,warning timeout while waiting for program 24
 05:11:30 snmp,warning timeout while waiting for program 20
 05:12:22 snmp,warning timeout while waiting for program 24
 05:22:30 snmp,warning timeout while waiting for program 20
 05:23:00 snmp,warning timeout while waiting for program 24
 05:33:30 snmp,warning timeout while waiting for program 20
 05:34:00 snmp,warning timeout while waiting for program 24
 05:44:30 snmp,warning timeout while waiting for program 20
 05:45:00 snmp,warning timeout while waiting for program 24
 05:48:30 snmp,warning timeout while waiting for program 23
 05:55:30 snmp,warning timeout while waiting for program 20
 05:56:00 snmp,warning timeout while waiting for program 24
 06:01:30 snmp,warning timeout while waiting for program 23
 06:06:30 snmp,warning timeout while waiting for program 20
 06:07:00 snmp,warning timeout while waiting for program 24
 06:17:30 snmp,warning timeout while waiting for program 20
 06:18:00 snmp,warning timeout while waiting for program 24
 06:28:30 snmp,warning timeout while waiting for program 20
 06:29:25 snmp,warning timeout while waiting for program 24
 06:39:30 snmp,warning timeout while waiting for program 20
 06:40:07 snmp,warning timeout while waiting for program 24
 06:50:30 snmp,warning timeout while waiting for program 20
 06:51:00 snmp,warning timeout while waiting for program 24
 07:01:30 snmp,warning timeout while waiting for program 20
 07:02:00 snmp,warning timeout while waiting for program 24
 07:12:30 snmp,warning timeout while waiting for program 20
 07:13:00 snmp,warning timeout while waiting for program 24
 07:23:30 snmp,warning timeout while waiting for program 20
 07:24:15 snmp,warning timeout while waiting for program 24
 07:30:30 snmp,warning timeout while waiting for program 23
 07:34:30 snmp,warning timeout while waiting for program 20
 07:35:00 snmp,warning timeout while waiting for program 24
 07:45:12 interface,info sfp-sfpplus10 link down
 07:45:17 health,info PSU1 returned to state OK
 07:52:24 system,info supout.rif file created by admin

When I unplugged the sfp module, I can access winbox again to create supout.rif

Posted: **Sat Dec 02, 2023 3:08 am**

Hi,
The problem is replicated on CCR2116-12G-4S+ , it seems that a solution has not been found yet.
What I noticed, that happens from time to time.

Has anyone found a solution?

Thank you!

Posted: **Mon Dec 25, 2023 5:12 am**

CCR2004-1G-12S+2XS | ROS 7.14 beta3 (2023/12/25)

Also fail with that GPON Sticks, It seems that the authorities have forgotten their promises.

- Huawei | MA5671A
- Nokia (aka: Alcatellucent) | G-010-S-A
- Alcatellucent | G-010-S-P

ref：viewtopic.php?t=186200#p935565

MikroTik

CCR2004-1G-12S+2XS - PSU1 and PSU2 enter in fail

CCR2004-1G-12S+2XS - PSU1 and PSU2 enter in fail

Re: CCR2004-1G-12S+2XS - PSU1 and PSU2 enter in fail

Re: CCR2004-1G-12S+2XS - PSU1 and PSU2 enter in fail

Re: CCR2004-1G-12S+2XS - PSU1 and PSU2 enter in fail

Re: CCR2004-1G-12S+2XS - PSU1 and PSU2 enter in fail

Re: CCR2004-1G-12S+2XS - PSU1 and PSU2 enter in fail

Re: CCR2004-1G-12S+2XS - PSU1 and PSU2 enter in fail

Re: CCR2004-1G-12S+2XS - PSU1 and PSU2 enter in fail