Question

Server is hung on runing of recreateindexesforclass utility

Hi All,

We are adding additional columns to index table from work class blob. So We are running recreateindexesforclass utility on production existing data . But is system is hanging for 10 k records also. In log trace we could see issue in recreateindexesforinstance activity step 2.

ThreadMonitor W WSVR0605W: Thread "WebContainer : 4" (xxxxx) has been active for 628772 milliseconds and may be hung. There is/are 1 thread(s) in total in the server that may be hung

We would like to know the possible root cause.

Thanks,

Deva.

***Updated by moderator: Lochan to tag SR to post***

Group Tags

Correct Answer
December 26, 2018 - 2:11pm

Upon reviewing the associated SR, I see that HFIX-36906 was provided.

Did that resolve this for you?

Comments

Keep up to date on this post and subscribe to comments

October 15, 2018 - 5:44am

Hello,

Are you doing it with the landing page or with PRPCUtils?

October 15, 2018 - 5:54am
Response to MarcLasserre_GCS

from designerstudio

October 15, 2018 - 6:32am

Hi Deva,

Did you get a chance to look at thred-dump that may have been generated in the rules logs.
Issue might be with connectivity if I have to take a guess.

Regards,
Ujjwal

October 15, 2018 - 10:27am
Response to UjjwalShukla_GCS

Thanks for response. We could see below log snippet from  thread dump. But we could not root to DB team as we are not sure what is the excact issue . Please share your thoguhts on this .

 

"WebContainer : 1" Id=458 in RUNNABLE (running in native)
BlockedCount : 70, BlockedTime : -1, WaitedCount : 269108, WaitedTime : -1
    at java.net.SocketInputStream.socketRead0(Native Method)
    at java.net.SocketInputStream.read(SocketInputStream.java:165)
    at java.net.SocketInputStream.read(SocketInputStream.java:134)
    at oracle.net.ns.Packet.receive(Packet.java:311)
    at oracle.net.ns.DataPacket.receive(DataPacket.java:105)
    at oracle.net.ns.NetInputStream.getNextPacket(NetInputStream.java:305)
    at oracle.net.ns.NetInputStream.read(NetInputStream.java:249)
    at oracle.net.ns.NetInputStream.read(NetInputStream.java:171)
    at oracle.net.ns.NetInputStream.read(NetInputStream.java:89)
    at oracle.jdbc.driver.T4CSocketInputStreamWrapper.readNextPacket(T4CSocketInputStreamWrapper.java:123)
    at oracle.jdbc.driver.T4CSocketInputStreamWrapper.read(T4CSocketInputStreamWrapper.java:79)
    at oracle.jdbc.driver.T4CMAREngineStream.unmarshalUB1(T4CMAREngineStream.java:426)
    at oracle.jdbc.driver.T4CTTIfun.receive(T4CTTIfun.java:390)
    at oracle.jdbc.driver.T4CTTIfun.doRPC(T4CTTIfun.java:249)
    at oracle.jdbc.driver.T4C8Oall.doOALL(T4C8Oall.java:566)
    at oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:215)
    at oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:58)
    at oracle.jdbc.driver.T4CPreparedStatement.executeForRows(T4CPreparedStatement.java:943)
    at oracle.jdbc.driver.OracleStatement.executeMaybeDescribe(OracleStatement.java:929)
    at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1034)
    at oracle.jdbc.driver.OraclePreparedStatement.executeInternal(OraclePreparedStatement.java:3820)
    at oracle.jdbc.driver.OraclePreparedStatement.executeQuery(OraclePreparedStatement.java:3867)
      - locked oracle.jdbc.driver.T4CConnection@cf38e949
    at oracle.jdbc.driver.OraclePreparedStatementWrapper.executeQuery(OraclePreparedStatementWrapper.java:1502)
    at com.ibm.ws.rsadapter.jdbc.WSJdbcPreparedStatement.pmiExecuteQuery(WSJdbcPreparedStatement.java:1220)
    at com.ibm.ws.rsadapter.jdbc.WSJdbcPreparedStatement.executeQuery(WSJdbcPreparedStatement.java:738)
    at com.pega.pegarules.data.internal.store.DatabasePreparedStatementImpl.executeQuery(DatabasePreparedStatementImpl.java:395)
    at com.pega.pegarules.data.internal.access.Opener$1.getResultPageFromDatabase(Opener.java:753)
    at com.pega.pegarules.data.internal.access.Opener$1.action(Opener.java:721)
    at com.pega.pegarules.data.internal.access.Opener$1.action(Opener.java:718)
    at com.pega.pegarules.data.internal.store.DataStoreManager.readInTransaction(DataStoreManager.java:70)
    at com.pega.pegarules.data.internal.access.Opener.openData(Opener.java:789)
    at com.pega.pegarules.data.internal.access.Opener.open(Opener.java:2221)
    at com.pega.pegarules.data.internal.access.DatabaseImpl.open(DatabaseImpl.java:2508)

 

Thanks,

Deva 

October 16, 2018 - 1:27am

Hi Deva,

Thanks for filtering out the runnable thread for me!
Yes from this its clear that there are issues with Slow DB Here.

Regards,
Ujjwal

 

October 16, 2018 - 3:51am
Response to UjjwalShukla_GCS

Hi Ujjwal,

Thanks for your reply. We are also getting lot of PEGA0019 alerts. We have already raised SR-59819.

Can you please have look.

Thanks,
Deva. 

 

November 30, 2018 - 2:03pm
Response to Deva_Prathapaneni

Hi @Deva_Prathapaneni,

While going through our posts that have SRs on them, I looked up your SR referenced here: SR-59819 and that SR is from 2011. Could you verify for me the SR that you raised on this please?

Thank you!

Marissa | Community Moderator | Pegasystems Inc.

December 2, 2018 - 4:20am
Response to MarissaRogers

Hi,

Please find below SR.

SR-C59819: Pega0019 alerts on production , while using Mashup

December 10, 2018 - 11:19am

Has this issue been resolved? Could you post the solution please, if the above has been resolved?

December 10, 2018 - 11:46am

We have completed Utility with very less records but issue what we have raised in SR still persists. We did not got root cause of PEGA0019 yet.

December 26, 2018 - 2:11pm

Upon reviewing the associated SR, I see that HFIX-36906 was provided.

Did that resolve this for you?

Marissa | Community Moderator | Pegasystems Inc.