NetXMS Support Forum

I am now in with the admin account, but other accounts still get refused.

Best regards,
Adrian

Hello Victor,

Thanks for the fast response.

I never changed the admin password, but anyway i did the nxdbmgr resetadmin, now i have "connection refused: connect" (check attached). One thing i lied (or just forgot), we already updated to 2.0.7 server. I replaced nxmc.war file with new one freshly downloaded from the site, but still got the error.

Everything else seems to be working fine, we are getting the email notifications and everything.

Best regards,
Adrian

Hello Team,

We have a serious problem with the console. I cannot reach it using the web console or the console application.

We had a problem with disk space and we were forced to create new partition, move the database (not very gracefully) and run again the services. Everything ended well with working database and services, but the console is giving "access denied". I tried everything as far as my knowledge goes, unfortunately i couldn't make it work. I even replaced the old nxmc.war file newly downloaded (version 2.0.6, same as my server version). Anyway the console is still giving me access denied with any user i try to log in (even usr: admin pass: netxms).

Any help will be appreciated

Best regards,
Adrian

Hello Victor ,

Yes they are related to same zones and are monitored through same agent.

Best regards,
Adrian

Hello ,

Check if the header of the startup script is full. I notice that the ubuntu script is not with the full header (see attachment). you can copy the header from one of the other scripts and it runs fine or use the script for ubuntu (if you are using debian) and other way around if you are using ubuntu.

Hope this help.

Best regards,
Adrian

i have a simple script to run nxdbmgr check and "nxdbmgr check -f" is doing the job. I am using ubuntu as a host.

Best regards,
Adrian

Hello team ,

Another issue with the database we have.
In the logs we are observing a lot of these:

root@nms3:~# tail -f /var/log/netxms | grep 128994
[13-Nov-2016 09:57:41.336] [DEBUG] AgentConnectionEx::processBulkCollectedData: cannot find DCI with ID 128994 on node R7-******* [58915] (element 421)
[13-Nov-2016 09:58:06.033] [DEBUG] AgentConnectionEx::processBulkCollectedData: cannot find DCI with ID 128994 on node R112-******* [57842] (element 327)
[13-Nov-2016 09:58:20.910] [DEBUG] AgentConnectionEx::processBulkCollectedData: cannot find DCI with ID 128994 on node R10-******* [54272] (element 547)
[13-Nov-2016 09:58:36.890] [DEBUG] AgentConnectionEx::processBulkCollectedData: cannot find DCI with ID 128994 on node R200-******* [63335] (element 519)
[13-Nov-2016 09:58:55.141] [DEBUG] AgentConnectionEx::processBulkCollectedData: cannot find DCI with ID 128994 on node R112-******* [57842] (element 404)
[13-Nov-2016 09:59:10.085] [DEBUG] AgentConnectionEx::processBulkCollectedData: cannot find DCI with ID 128994 on node DRC-******* [58147] (element 633)
[13-Nov-2016 09:59:29.620] [DEBUG] AgentConnectionEx::processBulkCollectedData: cannot find DCI with ID 128994 on node R10-******* [54272] (element 719)

it seems that netxms is looking for this DCI on different nodes when the DCI actually is created and belong to another node.

sqlite> select * from dc_config where dci_id = 128994;
3095327485888869043|128994|1|1|ServiceCheck.Custom(***.***.***.*** ,8000)|300|1479021648|0|00000000-0000-0000-0000-000000000000|0
sqlite> select * from dc_queue where dci_id = 128994;
3095327485888869043|128994|1|1|00000000-0000-0000-0000-000000000000|1479022548|0|0
3095327485888869043|128994|1|1|00000000-0000-0000-0000-000000000000|1479022848|0|0
3095327485888869043|128994|1|1|00000000-0000-0000-0000-000000000000|1479023148|0|0
3095327485888869043|128994|1|1|00000000-0000-0000-0000-000000000000|1479023448|0|0
3095327485888869043|128994|1|1|00000000-0000-0000-0000-000000000000|1479023748|0|0
3095327485888869043|128994|1|1|00000000-0000-0000-0000-000000000000|1479024048|0|0

This is happening for a lot of DCI's for different clients and i cannot find out why, any ideas?

Best regards,
Adrian

Hello Team ,

I am observing the following issue. Starting the netxmsd in the logs i can see a lot of these massages:

[14-Nov-2016 14:14:08.701] [ERROR] Inconsistent database: interface 6321 linked to non-existing node 6302
[14-Nov-2016 14:14:08.702] [ERROR] Failed to load interface object with id 6321 from database
[14-Nov-2016 14:14:08.703] [ERROR] Inconsistent database: interface 6382 linked to non-existing node 6372
[14-Nov-2016 14:14:08.704] [ERROR] Failed to load interface object with id 6382 from database
[14-Nov-2016 14:14:08.706] [ERROR] Inconsistent database: interface 6384 linked to non-existing node 6375
[14-Nov-2016 14:14:08.707] [ERROR] Failed to load interface object with id 6384 from database

[13-Nov-2016 09:21:09.508] [ERROR] Inconsistent database: container object 3602 has reference to non-existing child object 6294
[13-Nov-2016 09:21:09.508] [ERROR] Inconsistent database: container object 3602 has reference to non-existing child object 6295
[13-Nov-2016 09:21:09.508] [ERROR] Inconsistent database: container object 3602 has reference to non-existing child object 6302
[13-Nov-2016 09:21:09.508] [ERROR] Inconsistent database: container object 3602 has reference to non-existing child object 6372


Checked this and these are already deleted nodes, but obviously netxms is still trying to monitor the interfaces and some other object related to the already deleted nodes.
I ran the following:

service netxmsd stop
mysqlcheck --auto-repair netxms -u root –p (just in case)
nxdbmgr check (this fixed some inconsistencies)
service netxmsd start

Unfortunately i am still seeing the same errors. I ran nxdbmgr couple more times, but with no success. I checked and these are for real deleted nodes, so i am looking for a way to clear up the database from unneeded objects (related with deleted nodes).

I am using NetXMS server version 2.0.6 on debian host.

Another question is if there is a good practice to delete nodes/conteiners so they don't leave unparented child objects.

Best Regards,
Adrian

Hey Victor, Tomas,

I installed jdk8, but still have the issue.

Following Tomas advise it seems that nothing is listening on port 8080:

tcp        0      0 127.0.0.1:8005          0.0.0.0:*               LISTEN      8568/java
tcp        0      0 0.0.0.0:3817            0.0.0.0:*               LISTEN      2679/ytlinsdr
tcp        0      0 0.0.0.0:22              0.0.0.0:*               LISTEN      3095/sshd
tcp        0      0 0.0.0.0:25              0.0.0.0:*               LISTEN      3899/master
tcp        0      0 0.0.0.0:4700            0.0.0.0:*               LISTEN      2245/nxagentd
tcp6       0      0 :::80                   :::*                    LISTEN      2781/apache2
tcp6       0      0 :::22                   :::*                    LISTEN      3095/sshd
tcp6       0      0 :::25                   :::*                    LISTEN      3899/master
tcp6       0      0 :::443                  :::*                    LISTEN      8568/java
tcp6       0      0 :::4700                 :::*                    LISTEN      2245/nxagentd


And i get "connection refused" Trying to connect to the web application using the IPaddress:8080/nxmc.

Any idea what could be causing this behavior and how to make it listen to 8080 port ?

Thanks,

Best regards,
Adrian

Hi Tomas, team,

it is the default installation of tomcat7 and i never changed a thing in it's configuration.

there is the tomcat7 log:

Oct 17, 2016 12:00:39 PM org.apache.coyote.AbstractProtocol init
INFO: Initializing ProtocolHandler ["http-apr-443"]
Oct 17, 2016 12:00:39 PM org.apache.catalina.startup.Catalina load
INFO: Initialization processed in 6995 ms
Oct 17, 2016 12:00:39 PM org.apache.catalina.core.StandardService startInternal
INFO: Starting service Catalina
Oct 17, 2016 12:00:39 PM org.apache.catalina.core.StandardEngine startInternal
INFO: Starting Servlet Engine: Apache Tomcat/7.0.28
Oct 17, 2016 12:00:39 PM org.apache.catalina.startup.HostConfig deployWAR
INFO: Deploying web application archive /var/lib/tomcat7/webapps/nxmc.war
Oct 17, 2016 12:00:56 PM org.apache.catalina.startup.HostConfig deployDirectory
INFO: Deploying web application directory /var/lib/tomcat7/webapps/ROOT
Oct 17, 2016 12:00:56 PM org.apache.coyote.AbstractProtocol start
INFO: Starting ProtocolHandler ["http-apr-443"]
Oct 17, 2016 12:00:56 PM org.apache.catalina.startup.Catalina start
INFO: Server startup in 17541 ms
Oct 17, 2016 12:10:37 PM org.apache.catalina.startup.HostConfig checkResources
INFO: Undeploying context [/nxmc]
Oct 17, 2016 12:10:38 PM org.apache.catalina.startup.HostConfig deployWAR
INFO: Deploying web application archive /var/lib/tomcat7/webapps/nxmc.war

Seems that the archive was deployed just fine, but still i get the error.

Best regards,
Adrian

Hello Team ,

I have an issue with the web console. I upgraded my 2.0.6 test server to 2.1-M1 and it works, the console manager is working also, but the web application is not.

i get the error:

Not Found

The requested URL /nxmc/ was not found on this server.

Apache/2.2.22 (Debian) Server at 10.10.10.73 Port 80

I just replaced the war files as it is in the admin guide. Java and tomcat7 are running. Getting in the apache error log i can see :

[Mon Oct 17 13:30:08 2016] [error] [client 10.11.10.149] File does not exist: /var/www/nxmc

Why tomcat7 is searching for nxmc folder in /var/www, i know this is the documentroot, but before the upgrade it was working perfectly fine.

Changing the decumentroot in /etc/apache2/sites-enable/ doesn't solve the issue.

Any ideas ?

Thanks,

Best regards,
Adrian

Hello Victor,

I am looking at the logs from the server, but i am not sure for what massage to look for. I tried to search for the ip address of the agent or with connection, disconnect and so on as key words, but with no success. I am checking also by time stamp, but still can't find anything about disconnection, still from one point on, the server says:

         boot time set to 1472549691 from SNMP
    unable to get agent uptime
    unable to get system location

To be honest the issue is getting worse and worse. I observed that it is not just one agent with this issue.

I need help/guidance.

Best regards,
Adrian

I thought this could be the reason.

Thanks Tomas.

Hello Team ,

I am trying to monitor the temperature of our mikrotik devices, i found this oid:

.1.3.6.1.4.1.14988.1.1.3.10.0

, but i get the following alarm:

Status of DCI 118698 (SNMP: .1.3.6.1.4.1.14988.1.1.3.10.0) changed to UNSUPPORTED

Also attached screenshot from netxms and messege from the snmpwalk from the agent itself:

root@cnr-srv-11:~# snmpwalk -v2c -c ************* 172.16.1.134 .1.3.6.1.4.1.14988.1.1.3.10.0
iso.3.6.1.4.1.14988.1.1.3.10.0 = No Such Object available on this agent at this OID

Is this possible or am i doing something wrong, the devices on which i tested this are: RouterOS RB951G-2HnD.

Best regards,
Adrian

Hello Viktor ,

This is happening at the moment:

[03-Oct-2016 09:16:32.467] [DEBUG] [session:16] Message receiving error (MSGRECV_CLOSED)
[03-Oct-2016 09:16:32.468] [DEBUG] [session:16] Session with 78.130.143.30 closed
[03-Oct-2016 09:16:32.468] [DEBUG] [session:12] Message receiving error (MSGRECV_CLOSED)
[03-Oct-2016 09:16:32.468] [DEBUG] [session:12] Session with 78.130.143.30 closed
[03-Oct-2016 09:16:32.473] [DEBUG] [session:15] Message receiving error (MSGRECV_CLOSED)
[03-Oct-2016 09:16:32.473] [DEBUG] [session:15] Session with 78.130.143.30 closed
[03-Oct-2016 09:16:32.476] [DEBUG] [session:9] Message receiving error (MSGRECV_CLOSED)
[03-Oct-2016 09:16:32.476] [DEBUG] [session:9] Session with 78.130.143.30 closed
[03-Oct-2016 09:16:32.479] [DEBUG] [session:20] Message receiving error (MSGRECV_CLOSED)
[03-Oct-2016 09:16:32.480] [DEBUG] [session:20] Session with 78.130.143.30 closed
[03-Oct-2016 09:16:32.485] [DEBUG] [session:17] Message receiving error (MSGRECV_CLOSED)
[03-Oct-2016 09:16:32.485] [DEBUG] [session:17] Session with 78.130.143.30 closed
[03-Oct-2016 09:16:32.487] [DEBUG] [session:21] Message receiving error (MSGRECV_CLOSED)
[03-Oct-2016 09:16:32.487] [DEBUG] [session:21] Session with 78.130.143.30 closed
[03-Oct-2016 09:16:32.497] [DEBUG] [session:18] Message receiving error (MSGRECV_CLOSED)
[03-Oct-2016 09:16:32.497] [DEBUG] [session:18] Session with 78.130.143.30 closed
[03-Oct-2016 09:16:32.507] [DEBUG] [session:10] Message receiving error (MSGRECV_CLOSED)
[03-Oct-2016 09:16:32.507] [DEBUG] [session:19] Message receiving error (MSGRECV_CLOSED)
[03-Oct-2016 09:16:32.508] [DEBUG] [session:10] Session with 78.130.143.30 closed
[03-Oct-2016 09:16:32.508] [DEBUG] [session:19] Session with 78.130.143.30 closed
[03-Oct-2016 09:16:32.513] [DEBUG] [session:13] Message receiving error (MSGRECV_CLOSED)
[03-Oct-2016 09:16:32.513] [DEBUG] [session:13] Session with 78.130.143.30 closed
[03-Oct-2016 09:16:32.548] [DEBUG] [session:22] Message receiving error (MSGRECV_CLOSED)
[03-Oct-2016 09:16:32.548] [DEBUG] [session:22] Session with 78.130.143.30 closed
[03-Oct-2016 09:16:32.566] [DEBUG] [session:7] Message receiving error (MSGRECV_CLOSED)
[03-Oct-2016 09:16:32.566] [DEBUG] [session:7] Session with 78.130.143.30 closed
[03-Oct-2016 09:16:33.520] [DEBUG] [session:1] Received message CMD_GET_PARAMETER


It seems that the agent and netxms server cannot connect to each other, usually there are a lot of ReconciliationThreads, but in this situation:

[03-Oct-2016 09:19:33.211] [DEBUG] ReconciliationThread: 35 records to be sent in bulk mode
[03-Oct-2016 09:19:33.248] [DEBUG] ReconciliationThread: 35 records sent
[03-Oct-2016 09:20:03.303] [DEBUG] ReconciliationThread: 93 records to be sent in bulk mode
[03-Oct-2016 09:20:03.411] [DEBUG] ReconciliationThread: 93 records sent
[03-Oct-2016 09:20:33.463] [DEBUG] ReconciliationThread: 31 records to be sent in bulk mode
[03-Oct-2016 09:20:33.486] [DEBUG] ReconciliationThread: 31 records sent

When the agent is working normally there are a lot more records sent,for this reason we have increased DataReconciliationBlockSize to 8000 to solve an issue in the past, the DataReconciliationTimeout is set to 20000.

Best regards,
Adrian