Page 1 of 1

CCR1009-8G-1S-1S just bailed in a really weird way

Posted: Tue Jun 10, 2014 8:16 pm
by Rowan
Hi All,

So I've been setting up WiFi for an event in the UK for the last few days now. Literally just left site and the client rings up telling me no one can login through the hotspot.

Using CCR1009-8G-1S-1S on RouterOS v6.13

I've got everything connecting to RB450 in office with pptp. So I get in and find I cannot login using winbox, user/password is incorrect!

I thought I'd just check the webgui and it logs straight in!!

So something critical has happened. No idea what. As during config stage I deleted normal admin account and added my own. Standard.

The problems go on...

Usermanager database is corrupt.
Cannot perform file backup.
Reset user/password only for winbox to shut and to find that the password is reset again! (nothing in log to indicate change)
Cannot check drive.
Stores are missing usermanager.

I can add users to hotspot for now so can bypass usermanager.

I'm worried that a portion of the drive has gone down. Problem is I'm not at site now and I'm worried if I try to reinstall user manager that the whole unit may not come back to life.

Any ideas? I'm stumped.

Re: CCR1009-8G-1S-1S just bailed in a really weird way

Posted: Tue Jun 10, 2014 8:35 pm
by Rowan
Username and password has reset again! How can this happen?

Re: CCR1009-8G-1S-1S just bailed in a really weird way

Posted: Tue Jun 10, 2014 9:04 pm
by jarda
Can be faulty nand. Have you seen store remounting/reactivation messages in the log? check the error percentage of the inner flash. Maybe netinstall with format could help for a while. Keeping store on usb disk is also unreliable.

Re: CCR1009-8G-1S-1S just bailed in a really weird way

Posted: Tue Jun 10, 2014 9:08 pm
by Rowan
Yes I just observed the usermanager store re-appear :(

Re: CCR1009-8G-1S-1S just bailed in a really weird way

Posted: Thu Jun 12, 2014 3:20 pm
by normis
Please contact support with full admin access over SSH/FTP. This sounds like a NAND issue, but we must check.

Re: CCR1009-8G-1S-1S just bailed in a really weird way

Posted: Thu Jun 12, 2014 3:32 pm
by Rowan
Hi Normis,

Agreed it seems like a NAND issue. This router is in service at an Event. For the moment it's still routing. It's going to be tricky for me to do any servicing to it until after the event is over! Thanks for advice though I'll get in contact with support.

CCR1009-8G-1S-1S just bailed in a really weird way

Posted: Fri Jun 13, 2014 3:26 pm
by cbrown
I had the same exact thing happen with the same router yesterday.

I will email with access shortly but I will replace the router tonight because I have to leave for a week.

Re: CCR1009-8G-1S-1S just bailed in a really weird way

Posted: Fri Jun 13, 2014 3:50 pm
by sergejs
cbrown,
thank you very much for the remote access. We will see what we can do.

Re: CCR1009-8G-1S-1S just bailed in a really weird way

Posted: Sat Jun 14, 2014 4:29 pm
by Shiro
I have a few issues with my CCR1009-8G-1S-1S.

One issue is the sd card slot, sometimes the usermanager store on that medium disappear, in winbox i can see that usermanager store is on state backup and not active. sometimes it set itself to active, sometimes a reboot helps, i tried two different sd card brands.

Another issue is the flash in the CCR itself, 3 days ago i got a filesystem corruption on the CCR in runtime. I tried to log into my CCR and it told me my username/password is wrong. I did a reboot over the display menu, after that the CCR hangs on kernel loading, on the serial console i saw a kernel panic.

I tried a netinstall with preserve configuration and netinstall told me cant mount filesystem because it is corrupted. I had todo a fresh install.

No issues after that, but i have a bad feeling about a fileystem corruption in runtime.


Update: i enabled store loggin on my CCR, i see that at random intervalls the message "adding new drive: micro-sd (/dev/mmcblk0)) appears, after that i see a message "web-proxy: activation finished successfully".

20:20:18 store,debug adding new drive: micro-sd (/dev/mmcblk0)
20:20:18 store,debug web-proxy2: disk setup finished successfully
20:20:18 store,debug user-manager1: disk setup finished successfully
20:20:18 store,debug activating store for web-proxy2
20:20:18 store,debug web-proxy2: activation finished successfully
20:25:17 store,debug adding new drive: micro-sd (/dev/mmcblk0)
20:25:17 store,debug web-proxy2: disk setup finished successfully
20:25:17 store,debug user-manager1: disk setup finished successfully
20:25:18 store,debug activating store for web-proxy2
20:25:18 store,debug web-proxy2: activation finished successfully
20:26:05 store,debug adding new drive: micro-sd (/dev/mmcblk0)
20:26:05 store,debug web-proxy2: disk setup finished successfully
20:26:05 store,debug user-manager1: disk setup finished successfully
20:30:18 store,debug adding new drive: micro-sd (/dev/mmcblk0)
20:30:18 store,debug web-proxy2: disk setup finished successfully
20:30:18 store,debug user-manager1: disk setup finished successfully
20:30:18 store,debug activating store for web-proxy2
20:30:18 store,debug web-proxy2: activation finished successfully
20:33:20 store,debug adding new drive: micro-sd (/dev/mmcblk0)
20:33:20 store,debug web-proxy2: disk setup finished successfully
20:33:20 store,debug user-manager1: disk setup finished successfully
20:33:20 store,debug activating store for web-proxy2
20:33:20 store,debug web-proxy2: activation finished successfully
20:35:18 store,debug adding new drive: micro-sd (/dev/mmcblk0)
20:35:18 store,debug web-proxy2: disk setup finished successfully
20:35:18 store,debug user-manager1: disk setup finished successfully
20:35:18 store,debug activating store for web-proxy2
20:35:18 store,debug web-proxy2: activation finished successfully
20:36:05 store,debug adding new drive: micro-sd (/dev/mmcblk0)
20:36:05 store,debug web-proxy2: disk setup finished successfully
20:36:05 store,debug user-manager1: disk setup finished successfully
20:40:18 store,debug adding new drive: micro-sd (/dev/mmcblk0)
20:40:18 store,debug web-proxy2: disk setup finished successfully
20:40:18 store,debug user-manager1: disk setup finished successfully
20:40:18 store,debug activating store for web-proxy2
20:40:18 store,debug web-proxy2: activation finished successfully
20:45:17 store,debug adding new drive: micro-sd (/dev/mmcblk0)
20:45:17 store,debug web-proxy2: disk setup finished successfully
20:45:17 store,debug user-manager1: disk setup finished successfully
20:45:17 store,debug activating store for web-proxy2
20:45:17 store,debug web-proxy2: activation finished successfully
20:46:05 store,debug adding new drive: micro-sd (/dev/mmcblk0)
20:46:05 store,debug web-proxy2: disk setup finished successfully
20:46:05 store,debug user-manager1: disk setup finished successfully

Re: CCR1009-8G-1S-1S just bailed in a really weird way

Posted: Wed Jul 09, 2014 6:02 am
by drno
Just had the same thing happen as cbrown and the original poster. Doesn't appear to be any rhyme or reason to exactly when it happens. I am running the latest ROS with zero problems other than this. Another thing to note when this happens I also loose all of my settings under the tools\email which is how I knew something was up as I stopped seeing my log emails.

Re: CCR1009-8G-1S-1S just bailed in a really weird way

Posted: Wed Jul 09, 2014 6:20 am
by Belgarion186
Just had the same thing happen as cbrown and the original poster. Doesn't appear to be any rhyme or reason to exactly when it happens. I am running the latest ROS with zero problems other than this. Another thing to note when this happens I also loose all of my settings under the tools\email which is how I knew something was up as I stopped seeing my log emails.
I believe the next ROS update (6.16) should have a fix for that :

tilera - improved handling of bad blocks in nand

Re: CCR1009-8G-1S-1S just bailed in a really weird way

Posted: Wed Jul 09, 2014 8:01 am
by IntrusDave
I've had this problem too. Even posted about it and got no response at all:

http://forum.mikrotik.com/viewtopic.php?f=2&t=86330

Re: CCR1009-8G-1S-1S just bailed in a really weird way

Posted: Wed Jul 09, 2014 8:20 am
by normis
Yes, v6.16 should fix this issue

Re: CCR1009-8G-1S-1S just bailed in a really weird way

Posted: Thu Jul 10, 2014 7:59 am
by IntrusDave
I've been having this issue almost daily. Is is possible to get a beta of 6.16?

Re: CCR1009-8G-1S-1S just bailed in a really weird way

Posted: Thu Jul 10, 2014 9:13 am
by bajodel
I've been having this issue almost daily. Is is possible to get a beta of 6.16?
.. go -> http://forum.mikrotik.com/viewtopic.php ... 87#p435687