Hi
There seems to be very little information on the Internet or Appdynamics documentation on troubleshooting agent registration issues.
I'm trying to register a new server agent on Linux with Appdynamics I get a very obscure registration error when running the agent:
---
[UriConfigPoller] 20 Apr 2017 10:57:21,118 DEBUG UriConfigProvider - Checking uri file:/opt/appdynamics/conf/ to see if it is readable.
[system-thread-0] 20 Apr 2017 10:57:21,160 DEBUG RegistrationTask - Running registration task
[system-thread-0] 20 Apr 2017 10:57:21,168 WARN RegistrationTask - Encountered error during registration. Will retry in 60 seconds.
[system-thread-0] 20 Apr 2017 10:57:21,168 DEBUG RegistrationTask - Encountered error during registration.
com.appdynamics.voltron.rest.client.NonRestExcepti on: Method: SimMachinesAgentService#registerMachine(SimMachine MinimalDto) - Result: 401 Unauthorized - content:
---
The agent I'm using was generated from the Appdynamics enterprise dashboard and uploaded to the linux server.
Things I've checked:
- Network connectivity: packet flow at tcp level is fine between agent and server.
- Licensing: Licensing is valid
- hostname/unique agent id: as a test , set manually using the result of "hostname" command.
There seem to be no other appdynamics guides on how to troubleshoot this in further detail. Past forum posts seem to yield low quality answers.
More complete debug log dump as follows:
----
[UriConfigPoller] 20 Apr 2017 10:56:51,117 DEBUG UriConfigProvider - Checking uri file:/opt/appdynamics/conf/logging/log4j.xml to see if it is readable.
[UriConfigPoller] 20 Apr 2017 10:56:51,117 DEBUG UriConfigProvider - Checking uri file:/opt/appdynamics/conf/logging/ to see if it is readable.
[UriConfigPoller] 20 Apr 2017 10:56:51,117 DEBUG UriConfigProvider - Checking uri file:/opt/appdynamics/conf/controller-info.xml to see if it is readable.
[UriConfigPoller] 20 Apr 2017 10:56:51,117 DEBUG UriConfigProvider - Checking uri file:/opt/appdynamics/conf/ to see if it is readable.
[UriConfigPoller] 20 Apr 2017 10:57:21,117 DEBUG UriConfigProvider - Checking uri file:/opt/appdynamics/conf/logging/log4j.xml to see if it is readable.
[UriConfigPoller] 20 Apr 2017 10:57:21,118 DEBUG UriConfigProvider - Checking uri file:/opt/appdynamics/conf/logging/ to see if it is readable.
[UriConfigPoller] 20 Apr 2017 10:57:21,118 DEBUG UriConfigProvider - Checking uri file:/opt/appdynamics/conf/controller-info.xml to see if it is readable.
[UriConfigPoller] 20 Apr 2017 10:57:21,118 DEBUG UriConfigProvider - Checking uri file:/opt/appdynamics/conf/ to see if it is readable.
[system-thread-0] 20 Apr 2017 10:57:21,160 DEBUG RegistrationTask - Running registration task
[system-thread-0] 20 Apr 2017 10:57:21,168 WARN RegistrationTask - Encountered error during registration. Will retry in 60 seconds.
[system-thread-0] 20 Apr 2017 10:57:21,168 DEBUG RegistrationTask - Encountered error during registration.
com.appdynamics.voltron.rest.client.NonRestExcepti on: Method: SimMachinesAgentService#registerMachine(SimMachine MinimalDto) - Result: 401 Unauthorized - content:
at com.appdynamics.voltron.rest.client.VoltronErrorDe coder.decode(VoltronErrorDecoder.java:62)
at feign.SynchronousMethodHandler.executeAndDecode(Sy nchronousMethodHandler.java:126)
at feign.SynchronousMethodHandler.invoke(SynchronousM ethodHandler.java:74)
at feign.ReflectiveFeign$FeignInvocationHandler.invok e(ReflectiveFeign.java:97)
at com.sun.proxy.$Proxy80.registerMachine(Unknown Source)
at com.appdynamics.agent.sim.registration.Registratio nTask.run(RegistrationTask.java:124)
at java.util.concurrent.Executors$RunnableAdapter.cal l(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(Future Task.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$S cheduledFutureTask.access$301(ScheduledThreadPoolE xecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$S cheduledFutureTask.run(ScheduledThreadPoolExecutor .java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker( ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run (ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
[UriConfigPoller] 20 Apr 2017 10:57:51,118 DEBUG UriConfigProvider - Checking uri file:/opt/appdynamics/conf/logging/log4j.xml to see if it is readable.
[UriConfigPoller] 20 Apr 2017 10:57:51,118 DEBUG UriConfigProvider - Checking uri file:/opt/appdynamics/conf/logging/ to see if it is readable.
[UriConfigPoller] 20 Apr 2017 10:57:51,118 DEBUG UriConfigProvider - Checking uri file:/opt/appdynamics/conf/controller-info.xml to see if it is readable.
[UriConfigPoller] 20 Apr 2017 10:57:51,118 DEBUG UriConfigProvider - Checking uri file:/opt/appdynamics/conf/ to see if it is readable.
[UriConfigPoller] 20 Apr 2017 10:58:21,119 DEBUG UriConfigProvider - Checking uri file:/opt/appdynamics/conf/logging/log4j.xml to see if it is readable.
[UriConfigPoller] 20 Apr 2017 10:58:21,119 DEBUG UriConfigProvider - Checking uri file:/opt/appdynamics/conf/logging/ to see if it is readable.
[UriConfigPoller] 20 Apr 2017 10:58:21,119 DEBUG UriConfigProvider - Checking uri file:/opt/appdynamics/conf/controller-info.xml to see if it is readable.
[UriConfigPoller] 20 Apr 2017 10:58:21,119 DEBUG UriConfigProvider - Checking uri file:/opt/appdynamics/conf/ to see if it is readable.
[system-thread-0] 20 Apr 2017 10:58:21,160 DEBUG RegistrationTask - Running registration task
[system-thread-0] 20 Apr 2017 10:58:21,169 WARN RegistrationTask - Encountered error during registration. Will retry in 60 seconds.
[system-thread-0] 20 Apr 2017 10:58:21,169 DEBUG RegistrationTask - Encountered error during registration.
com.appdynamics.voltron.rest.client.NonRestExcepti on: Method: SimMachinesAgentService#registerMachine(SimMachine MinimalDto) - Result: 401 Unauthorized - content:
at com.appdynamics.voltron.rest.client.VoltronErrorDe coder.decode(VoltronErrorDecoder.java:62)
at feign.SynchronousMethodHandler.executeAndDecode(Sy nchronousMethodHandler.java:126)
at feign.SynchronousMethodHandler.invoke(SynchronousM ethodHandler.java:74)
at feign.ReflectiveFeign$FeignInvocationHandler.invok e(ReflectiveFeign.java:97)
at com.sun.proxy.$Proxy80.registerMachine(Unknown Source)
at com.appdynamics.agent.sim.registration.Registratio nTask.run(RegistrationTask.java:124)
at java.util.concurrent.Executors$RunnableAdapter.cal l(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(Future Task.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$S cheduledFutureTask.access$301(ScheduledThreadPoolE xecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$S cheduledFutureTask.run(ScheduledThreadPoolExecutor .java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker( ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run (ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
---
Troubleshooting notes:
Trying to register a new agent with the controller fails, even though I am using a superuser account to generate the agent zip file and I have more than 50 agent licenses (i've also disabled SIM on the agent side):
Logs on the agent show:
[system-thread-0] 22 Apr 2017 14:19:06,786 WARN RegistrationTask - Encountered error during registration. Will retry in 60 seconds.
[system-thread-0] 22 Apr 2017 14:19:06,786 DEBUG RegistrationTask - Encountered error during registration.
com.appdynamics.voltron.rest.client.NonRestExcepti on: Method: SimMachinesAgentService#registerMachine(SimMachine MinimalDto) - Result: 401 Unauthorized - content:
at com.appdynamics.voltron.rest.client.VoltronErrorDe coder.decode(VoltronErrorDecoder.java:62)
at feign.SynchronousMethodHandler.executeAndDecode(Sy nchronousMethodHandler.java:126)
at feign.SynchronousMethodHandler.invoke(SynchronousM ethodHandler.java:74)
at feign.ReflectiveFeign$FeignInvocationHandler.invok e(ReflectiveFeign.java:97)
at com.sun.proxy.$Proxy80.registerMachine(Unknown Source)
at com.appdynamics.agent.sim.registration.Registratio nTask.run(RegistrationTask.java:124)
at java.util.concurrent.Executors$RunnableAdapter.cal l(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(Future Task.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$S cheduledFutureTask.access$301(ScheduledThreadPoolE xecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$S cheduledFutureTask.run(ScheduledThreadPoolExecutor .java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker( ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run (ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
---
NOTE: registration also fails if SSL is turned off and non-https port is used to connect to the controller.
Additional data point, in the controller logs I see these entries, suggesting some kind of authentication error between agent and controller:
---
[#|2017-04-22T14:50:57.556+0000|INFO|glassfish 4.1|com.singularity.ee.controller.auth.AuthRealm|_ ThreadID=55;_ThreadName=http-listener-1(4);_TimeMi llis=1492872657556;_LevelValue=800;|Invalid account singularity-agent@customer1_ xyxyxyxyxyxyxyxyxyxyxyxyxy |#]
[#|2017-04-22T14:50:57.556+0000|INFO|glassfish 4.1|javax.enterprise.system.core.security|_ThreadI D=55;_ThreadName=http-listener-1(4);_TimeMillis=14 92872657556;_LevelValue=800;_MessageID=NCLS-SECURI TY-05046;|Audit: Authentication refused for [singularity-agent@customer1_xyxyxyxyxyxyxyxyxyxyx yxyxy].|#]
[#|2017-04-22T14:50:57.556+0000|INFO|glassfish 4.1|javax.enterprise.system.core.security.com.sun. enterprise.security.jmac.callback|_ThreadID=55;_Th readName=http-listener-1(4);_TimeMillis=1492872657 556;_LevelValue=800;|jmac.loginfail|#]
----
However, this agent was built through the UI and there is no indication of a user or credentials that may be needed ..
... View more