• P
    Phillip Weeks

    @phildunlap said in NoSQL Task Queue Full:

    The task queue message is probably incidental to the crash. If you change your spawn threshold / max instances you can see this (force it to have max instances all the time with a low spawn threshold, the messages will go away, but it will probably still crash).

    Phil would you elaborate a little on the above comment, what is considered a low threshold?
    Our situation is similar to the one discussed in this thread in that our systems have a limited number of points < 300 and very lengthy periods 2-5 years on every minute so about 100 million of values a year. I noticed your remark about streaming as opposed to loading the entire period's values in memory, Are there any plans to move in this direction? I have tried your tuning suggestions above and I believe you correctly suggested shortening the time period is the most obvious solution so I modified the run loop script you offered in the other thread so the the period gets divided-up and points processed repediavely and linearly keeping things under control with a RuntimeManager.sleep(5000) thrown in for good luck if the pointsTBW gets out of control. Our system was consistently running out of memory before I read this thread and now that I understand why a little better the result is crashes have been eliminated completely on metapoint regenerations. Combined with your tuning suggestions in this thread, the system works much better and we get hassle-free regeneration over a lengthy periods of a year or more.

    I also remember something discussed in another thread about automatically regenerating the missing metapoints whenever the source data sync runs; Is there any motivation within your collective talents to create this feature?
    Thanks in advance.

    posted in User help read more
  • P
    Phillip Weeks

    So how should I configure the NO SQL settings so these values are not lost? The heap is 10g so I wouldn't think memory limitation is the issue. When I rerun the sync over the same period the PointsTBW does not increase above 100 and the sync completes quickly.

    0_1518835842101_c467cb36-09ba-4b3d-9008-c86a8df4c988-image.png

    posted in Mango Automation read more
  • P
    Phillip Weeks

    OK thanks Phil, I might restart it and see if the error continues and I won't worry about it.

    posted in Mango Automation read more
  • P
    Phillip Weeks

    OK that make more sense. Thanks for the quick response.

    posted in Mango Automation read more
  • P
    Phillip Weeks

    I re-synced a year of historical data from the ES to our cloud (about 4 million pointvalues) and although the sync finished several hours ago and the cloud does show the values synced in charts, the points to be written is still hovering > 200,000 and I am wondering how long to expect before this number returns to its normal level around 200 - 500. Shouldn't this be completed after a couple hours?

    posted in Mango Automation read more
  • P
    Phillip Weeks

    It doesn't happen on every poll . I did initially change the file permissions so it wasn't that causing it and the data is updating however the update seems sporadic as well.

    0_1518814477205_95e4a864-2113-48ba-b975-84d1f0bb6817-image.png

    posted in Mango Automation read more
  • P
    Phillip Weeks

    On our new ES we are getting this error. There does not appear to be a reason I can find.

    'MangoES System': File not found: /opt/info/systemInfo.txt (No such file or directory)

    yet the file is where it should be and has the following inside:with today's date.
    ##########CPU############
    CPU UserSpace Load: 0.2
    CPU Kernel Load: 0.6
    CPU Total Load: 0.8
    CPU0 Temp: 51.0
    CPU1 Temp: 54.0
    CPU2 Temp: 55.0
    CPU3 Temp: 54.0
    CPU4 Temp: 49.0
    ##########RAM############
    Physical Memory Total: 1991
    Physical Memory Used: 1372
    Physical Memory Free: 618
    Swap Memory Total: 0
    Swap Memory Used: 0
    Swap Memory Free: 0
    ########DISK##########
    Disk Name: /dev/mmcblk0p2
    Disk Total Size: 7149
    Disk Space Used: 1947
    Disk Space Left: 4820
    Disk Percent Used: 29%
    ########SYSTEMTIME############
    SystemTime: Thu Feb 15 20:23:02 MST 2018

    posted in Mango Automation read more
  • P
    Phillip Weeks

    So after many additions and changes to the dashboards side menu I finally made an error and was forced to reset the menu to its default. Is there a procedure to backup and to restore this menu structure in the event it happens again?

    posted in Dashboard Designer & Custom AngularJS Pages read more

Looks like your connection to Mango Automation Forum was lost, please wait while we try to reconnect.