AppWorx, Dollar Universe and Sysload Community

Hi Team,

Kindly help us in fixing the issue that we are getting while launching the QA instance of Applications Manager UC4 and getting the error : 

RMI connection falilure on Applications Manager V8 Awe -5009

When we checked the error log and tried to restart the RMI Server its giving the error :

rmiserver did not start at /appworx/home/appwrx1q/data/inst.pl line 5461.

When we checked the file and tried to see the logs we did not made any changes but eventually the Server had got hung and we had to force close :

Now when we type the awstat command we are even unable to see teh Agent status and now the error is coming as :

Bareword found where operator expected at /appworx/home/appwrx1q/data/inst.pl line 1, near "2008 by"
(Missing operator before by?)
syntax error at /appworx/home/appwrx1q/data/inst.pl line 1, near "2008 by UC4 "
syntax error at /appworx/home/appwrx1q/data/inst.pl line 58, near "}"

I am hereby ttaching the RMI Server logs and error screenshots.

Please do help us with this issue as we have some tasks aligned to perform.

Regards,

Mohd Zain Akbar

Hello Mohd,

The error can be seen if the RMI does not properly start. It is best to stop all processes by running:

1. stopso all

2. stopso awcomm

3. delete the contents of the /appworx/home/appwrx1q/log directory

4. startso all

5. If the RMI does not start, review the RmiServer.log or RmiServer<timestamp>.log that is newly created.

6. Searching logs for either "AwE-" or "ORA-" is an easy way to see what error is occurring.

Lastly, awstat is a legacy command and it is recommended that you run "awexe node" instead. If awexe node command throws and error, it is because the RMI or Agentservice process did not properly start in which log files above should be review in addition to the AgentService.log and AgentService<timestamp>.log created during startup.

Regards,

Hi Mohd_Akbar,

I don't see the attached rmi log you mentioned on this community post.  Were you able to resolve the issue with maoph01 suggestion?  Or if you still have the issue, consider completely stopping all the processes and enabling debug and start it up (the rmi / agent services log should show what it is attempting to do upon startup).

If you need to attached logs on the community post, click on the "Use advanced editor"

and it will take you to a new page with a "Attach" button, right above the Add Reply / Cancel Button.

Hi Lule/maoph01,

I am getting the error :  ORA-28000: the account is locked in RMI Server logs frequently and have got the account unlocked as well still facing the same issue.

Please find attached the RMI Server logs:

Wed Mar 27 14:32:38 CDT 2019 RmiServer starting
Initializing JCE
Data decrypted Initialized JCE
JCE Initialized successfully 820
Applications Manager RMI Server
Copyright (C) 1999-2012 UC4 Software Inc. All Rights Reserved.
Release: v8.0_P9_27363_27428 Build: 27428 Wed Jun 13 21:51:48 PDT 2012
RA Framework 4.3.0 v8.0_P9_27363_27428 Build: 27417 Wed Jun 13 21:50:51 PDT 2012

Java VM: Sun Microsystems Inc. 1.6.0_31

Wed Mar 27 14:32:38 CDT 2019

ErrorMsg: AwE-5001 Database Query Error (3/27/19 2:32 PM)
Details: getConnection
null
java.sql.SQLException: ORA-28000: the account is locked

at oracle.jdbc.dbaccess.DBError.throwSqlException(DBError.java:134)
at oracle.jdbc.ttc7.TTIoer.processError(TTIoer.java:289)
at oracle.jdbc.ttc7.O3log.receive2nd(O3log.java:510)
at oracle.jdbc.ttc7.TTC7Protocol.logon(TTC7Protocol.java:279)
at oracle.jdbc.driver.OracleConnection.<init>(OracleConnection.java:368)
at oracle.jdbc.driver.OracleDriver.getConnectionInstance(OracleDriver.java:549)
at oracle.jdbc.driver.OracleDriver.connect(OracleDriver.java:349)
at java.sql.DriverManager.getConnection(Unknown Source)
at java.sql.DriverManager.getConnection(Unknown Source)
at com.appworx.server.sql.AxConnectionPool.A(AxConnectionPool.java:373)
at com.appworx.server.sql.DBAccess.getConnection(DBAccess.java:1502)
at com.appworx.server.sql.CommonDB.A(CommonDB.java:564)
at com.appworx.server.sql.CommonDB.A(CommonDB.java:540)
at com.appworx.server.sql.CommonDB.getSqlData(CommonDB.java:182)
at com.appworx.server.data.MasterDB.<init>(MasterDB.java:214)
at com.appworx.server.data.MasterDB.<init>(MasterDB.java:189)
at com.appworx.server.data.Master.<init>(Master.java:207)
at com.appworx.server.data.AxRmiServer.ł(AxRmiServer.java:3011)
at com.appworx.server.data.AxRmiServer.setupMasters(AxRmiServer.java:2864)
at com.appworx.server.data.AxRmiServer.main(AxRmiServer.java:916)
------------- System Properties ----------------------
-- listing properties --
AGENT=DEVCORP1
java.runtime.name=Java(TM) SE Runtime Environment
sun.boot.library.path=/appworx/home/appwrx1d/jre/lib/i386
java.vm.version=20.6-b01
java.vm.vendor=Sun Microsystems Inc.
java.vendor.url=http://java.sun.com/
path.separator=:
java.vm.name=Java HotSpot(TM) Client VM
file.encoding.pkg=sun.io
OsType=UNIX
user.country=US
sun.java.launcher=SUN_STANDARD
sun.os.patch.level=unknown
java.vm.specification.name=Java Virtual Machine Specification
user.dir=/appworx/home/appwrx1d/web/classes
java.runtime.version=1.6.0_31-b04
java.awt.graphicsenv=sun.awt.X11GraphicsEnvironment
java.endorsed.dirs=/appworx/home/appwrx1d/jre/lib/endorsed
os.arch=i386
java.io.tmpdir=/tmp
line.separator=

java.vm.specification.vendor=Sun Microsystems Inc.
os.name=Linux
sun.jnu.encoding=UTF-8
java.library.path=/appworx/home/appwrx1d/jre/lib/i386/c...
java.specification.name=Java Platform API Specification
java.class.version=50.0
sun.management.compiler=HotSpot Client Compiler
os.version=2.6.18-404.0.0.0.1.el5
user.home=/appworx/home/appwrx1d
user.timezone=America/Chicago
java.awt.printerjob=sun.print.PSPrinterJob
file.encoding=UTF-8
java.specification.version=1.6
AW_HOME=/appworx/home/appwrx1d
user.name=appwrx1d
java.class.path=.:/appworx/home/appwrx1d/web/classes/...
java.vm.specification.version=1.0
sun.arch.data.model=32
java.home=/appworx/home/appwrx1d/jre
sun.java.command=com.appworx.server.data.AxRmiServer
java.specification.vendor=Sun Microsystems Inc.
user.language=en
java.vm.info=mixed mode
java.version=1.6.0_31
java.ext.dirs=/appworx/home/appwrx1d/jre/lib/ext:/u...
sun.boot.class.path=/appworx/home/appwrx1d/jre/lib/resour...
java.vendor=Sun Microsystems Inc.
file.separator=/
java.vendor.url.bug=http://java.sun.com/cgi-bin/bugreport...
sun.cpu.endian=little
sun.io.unicode.encoding=UnicodeLittle
java.rmi.server.hostname=10.10.9.203
sun.cpu.isalist=
------------- System Properties ------ END -----------

------------- Default Properties ----------------------
-- listing properties --
PreCalculateRowLevels=true
RMIRegistryPortNumber=1099
AlertExtensions=
AMCollWS=10
DesktopBackground=jdesktopsplash
ExitPage=../Intro.html
jmsDestinationName=appworx
SocketRetryCount=2
DistributorPort=0
StatusChangeRetryInterval=1
OutMgrMaxRows=200
FileViewerSize=32
jmsConnetionFactory=ConnectionFactory
OutputScanThreads=2
CheckStartingInterval=0
UserLanguageFiles=false
ConditionDeferredPoleTime=60
RMISocketTimeout=300
Debug=false
forecastDate=MM-dd-yyyy hh:mm a
EventLog=Event.log
WaitForConnectionTime=300
ChainBuilderRowOffset=20
AdditionalPrintOptions=false
ldapUrlCharDelimiter=;
GetAgentSocketRetryCount=20
ClientDailyActivityFrequency=1
ShowMemoryInterval=0
jDateFormatMacro=MM-dd-yyyy
MaxPooledConnections=50
APIServerName=AxAPIServer
LogTimeFormat=HH:mm:ss
SplashImage=splash.png
jmsFactoryClass=org.exolab.jms.jndi.InitialContextFac...
JobCheckInterval=0
SQLDebug=false
AMDistUpdate=10
DatabaseIdleTimeout=30
LdapInitialContextClass=com.sun.jndi.ldap.LdapCtxFactory
FileViewerFont=Monospaced
NoErrorMsgProperties=false
jTimeOffset=HH:mm:ss
jDateFormatMicro=HH:mm:ss z
SSL=on
HistoryRetentionTime=30
development=false
DuringConditionPoleTime=60
ClientRMIPortNumber=0
RMIServerName=AxRmiServer
ServerLogMode=file
JobUpdateLimit=200
MinPooledConnections=1
LocalHost=false
GetAgentSocketRetryInterval=10
jmsMessageFilter=
PredTransactionQueueLimit=1000
Labels=none
HistoryPurgeTimeInterval=30
ProcessFlowRequestor=false
ServerDailyActivityFrequency=1
predAnalysisAddjobThreadCount=1
BeforeConditionRecheckInterval=30
predAnalysisChangeJobThreadCount=1
DebugClockFormat=HH:mm:ss.S
AMClientPoll=10
RMIHostID=null
StartAgentThreads=10
ClientServerClockFormat=MM-dd-yyyy HH:mm:ss z
UpdateIntv=3
DriverClassName=oracle.jdbc.driver.OracleDriver
DriverUrl=jdbc:oracle:thin:@{host}:{port}:{sid}
SpawnJobThreads=5
DebugClockDisplay=true
DisableInMemoryUpdate=true
------------- Default Properties ----- END -----------

------------- Options.Properties ----------------------
-- listing properties --
RMIHostID=10.10.9.203
ExitPage=../Intro.html
jDateFormatMacro=MM-dd-yyyy
SocketTimeout=60
ServerLogMode=file
LogonPage=../Main.html
jDateFormatMicro=HH:mm:ss z
MainPage=../Main.html
JdbcPortNumber=1669
SSL=On
FileViewerSize=32
dbDateFormatMacro=mm-dd-yyyy
ServerLogRetentionDays=7
Debug=false
DriverClassName=oracle.jdbc.driver.OracleDriver
DriverName=jdbc:oracle:thin
Client_WXP91119LT04B28=172.16.254.39
dbDateFormatMicro=hh24:mi:ss
NextURL=../Main.html
RMIRegistryPortNumber=2099
------------- Options.Properties ----- END ------------

------------- awenv.ini Defaults ----------------------
-- listing properties --
default.logfilezipsize=50
default.masteragentencryption=YES
oracle.net.encryption_types_client=DES40C, DES56C, RC4_40, RC4_56
default.cpuusageheadertofield=id
default.agentclientport=0
oae.runtimeextensiontimeout=30
default.logdirectorypurgesize=500
default.write_max_tries=15
default.socketconnecttimeout=30
default.awcomm_port=2136
default.connect_max_tries=50
default.client_connect_max_tries=2
default.serverlogretentiondays=7
default.password_encryption=AES
default.spoolfilescanstring=File
default.connect_wait=240000
default.as400defaultspoolfilename=QPJOBLOG
default.sendrequestretrytimeinterval=10
square_brackets=[]
default.read_max_tries=2
default.heartbeatcheckintervaltime=60
default.write_wait=30
default.heartbeatresponsewaittime=120
default.ftpsftpthreads=2
default.masterserverport=0
default.radebuglevel=0
default.square_brackets=[]
default.directdbconnection=false
default.serviceworkercount=7
default.responsetimeout=60
default.wrksysstscpustring=% CPU used
default.mvsmasterserverport=-1
default.agentsqltimeout=120
default.cpuusagetimeinterval=10
default.masterconnectretry=60
default.client_connect_sleep=10
default.vmstatheaderlinenumber=8
default.connect_sleep=5000
oracle.net.crypto_checksum_types_client=MD5
default.updateagenttimeout=0
default.awexeretries=3
default.read_sleep=10
------------- awenv.ini Defaults ----- END -----------

------------- awenv.ini Default Section Values ----------------------
-- listing properties --
master=DEVCORP1
db_port=1669
old_agent=DEVCORP1
directdbconnection=Y
rmi=Yes
tz=US/Indiana-Starke
agent=DEVCORP1
tomcatserverport=0
db_sid=devops1
aw_home=/appworx/home/appwrx1d
default.AW_HOME=/appworx/home/appwrx1d
webservices=Y
masteragentencryption=Yes
master_ip_address=10.10.9.203
ostype=UNIX
db_ip=10.10.9.112
awcomm_port=2150
------------- awenv.ini Default Section Values ----- END ------------

ErrorMsg: AwE-5001 Database Query Error (3/27/19 2:32 PM)
Details: null
java.sql.SQLException: ORA-28000: the account is locked

at oracle.jdbc.dbaccess.DBError.throwSqlException(DBError.java:134)
at oracle.jdbc.ttc7.TTIoer.processError(TTIoer.java:289)
at oracle.jdbc.ttc7.O3log.receive2nd(O3log.java:510)
at oracle.jdbc.ttc7.TTC7Protocol.logon(TTC7Protocol.java:279)
at oracle.jdbc.driver.OracleConnection.<init>(OracleConnection.java:368)
at oracle.jdbc.driver.OracleDriver.getConnectionInstance(OracleDriver.java:549)
at oracle.jdbc.driver.OracleDriver.connect(OracleDriver.java:349)
at java.sql.DriverManager.getConnection(Unknown Source)
at java.sql.DriverManager.getConnection(Unknown Source)
at com.appworx.server.sql.AxConnectionPool.A(AxConnectionPool.java:373)
at com.appworx.server.sql.DBAccess.getConnection(DBAccess.java:1502)
at com.appworx.server.sql.CommonDB.A(CommonDB.java:564)
at com.appworx.server.sql.CommonDB.A(CommonDB.java:540)
at com.appworx.server.sql.CommonDB.getSqlData(CommonDB.java:182)
at com.appworx.server.data.MasterDB.<init>(MasterDB.java:214)
at com.appworx.server.data.MasterDB.<init>(MasterDB.java:189)
at com.appworx.server.data.Master.<init>(Master.java:207)
at com.appworx.server.data.AxRmiServer.ł(AxRmiServer.java:3011)
at com.appworx.server.data.AxRmiServer.setupMasters(AxRmiServer.java:2864)
at com.appworx.server.data.AxRmiServer.main(AxRmiServer.java:916)

Kindly assist us on this issue on priority as we need to test in DEV Environment.

Regards,

Akbar