Ticket #156 (closed defect: worksforme)

Opened 3 years ago

Last modified 3 years ago

Daemon stops indexing after a certain amount of iterations

Reported by: bruno Assigned to: julians
Priority: critical Milestone: 2007.03.23
Component: Daemon Version: 0.1
Keywords: Cc:

Description

I have Earth (r1049) running on two servers (monitoring 3.4TB and 0.6TB approx.). The daemon runs fine and stops after a certain amount of time (I haven't been able to know exactly how many cycles it goes through before stopping but I will keep an eye on it to see if it is consistent).

The console information for the screen where I started the daemon on both servers looks like:

[...]
Updating 59669 directories over 300s...
Updating 59696 directories over 300s...
Updating 59634 directories over 300s...
Updating 59641 directories over 300s...
Updating 59649 directories over 300s...
Updating 59609 directories over 300s...
Updating 59638 directories over 300s...
Updating 59674 directories over 300s...
Updating 59711 directories over 300s...
Updating 59761 directories over 300s...
#

and

[...]
Updating 37670 directories over 300s...
Updating 37672 directories over 300s...
Updating 37682 directories over 300s...
Updating 37700 directories over 300s...
Updating 37700 directories over 300s...
Updating 37702 directories over 300s...
Updating 37703 directories over 300s...
Updating 37704 directories over 300s...
Updating 37704 directories over 300s...
Updating 37704 directories over 300s...
Updating 37705 directories over 300s... 
#

So, no errors, just stops running. I have been redirecting the output with tee so I ran the following over both logs (counting the amount of "Updating ..." messages:

$ cat earth_daemon_SERVER1.log | grep Updating | wc
    294    1470   11760
$ cat earth_daemon_SERVER2.log | grep Updating | wc
    786    3930   31440
$ cat earth_daemon_SERVER1.log | grep Starting | wc
      1       3      29
$ cat earth_daemon_SERVER2.log | grep Starting | wc
      1       3      29

There doesn't seem to be a relation between both but I will count them again when I see a failure.

Change History

03/09/07 11:26:08 changed by julians

Have they been running in development mode and if so, where can I find the logs?

03/09/07 11:30:22 changed by bruno

No, they were running in production mode. I've restarted them so the logs have been overwritten :( But I kept older logs. I will email you the location of those.

03/14/07 17:11:32 changed by julians

Is it correct that the overflowing database was the reason for this problem? If so, can we close this ticket?

I'm still not sure why the daemons would fail silently but I don't see an easy way of reproducing this.

03/14/07 17:16:09 changed by bruno

  • status changed from new to closed.
  • resolution set to worksforme.

Let's do that. If I can reproduce that over the next few days, I will re-open this ticket.

Thanks mate.