Uploaded image for project: 'CloverDX'
  1. CloverDX
  2. CLO-19148

Graphs longer than 10 minutes fail in RunGraph

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: rel-5-8-0
    • Component/s: None
    • Security Level: Users (General product issues)
    • QA Testing:
      UNDECIDED
    • Sprint:
      Blue Sprint 105, Blue Sprint 106

      Description

      I think there's an issue when executing graphs longer than 10 minutes in RunGraph component.

      The graph fails at the 10 minute mark.

      It probably fails due to default 10 minute timeout between core and worker.

       

      2019-12-05 14:26:20,954 ERROR 39677 [WatchDog_39677] Component [xxxxxxxxxxxxxxxxxxxxx] finished with status ERROR.
      Could not access HTTP invoker remote service at [http://127.0.0.1:10500/clover/serverAuthorityProxyApi]; nested exception is java.net.SocketTimeoutException: Read timed out
      2019-12-05 14:26:20,977 ERROR 39677 [WatchDog_39677] Error details:
      org.jetel.exception.JetelRuntimeException: Component [xxxxxxxxxxxxxxxxxxxxxx] finished with status ERROR.
      at org.jetel.graph.Node.createNodeException(Node.java:655)
      at org.jetel.graph.Node.run(Node.java:620)
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
      at java.lang.Thread.run(Thread.java:748)
      Caused by: org.springframework.remoting.RemoteAccessException: Could not access HTTP invoker remote service at [http://127.0.0.1:10500/clover/serverAuthorityProxyApi]; nested exception is java.net.SocketTimeoutException: Read timed out
      at org.springframework.remoting.httpinvoker.HttpInvokerClientInterceptor.convertHttpInvokerAccessException(HttpInvokerClientInterceptor.java:231)
      at org.springframework.remoting.httpinvoker.HttpInvokerClientInterceptor.invoke(HttpInvokerClientInterceptor.java:157)
      at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)
      at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:212)
      at com.sun.proxy.$Proxy73.executeGraphSync(Unknown Source)
      at com.cloveretl.server.worker.runtime.WorkerAuthorityProxy.executeGraphSync(Main:244)
      at org.jetel.component.RunGraph.runGraphThisInstance(RunGraph.java:522)
      at org.jetel.component.RunGraph.runSingleGraph(RunGraph.java:407)
      at org.jetel.component.RunGraph.execute(RunGraph.java:283)
      at org.jetel.graph.Node.run(Node.java:580)
      ... 3 more
      Caused by: java.net.SocketTimeoutException: Read timed out
      at java.net.SocketInputStream.socketRead0(Native Method)
      at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
      at java.net.SocketInputStream.read(SocketInputStream.java:171)
      at java.net.SocketInputStream.read(SocketInputStream.java:141)
      at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:137)
      at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:153)
      at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:282)
      at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
      at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
      at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
      at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
      at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
      at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
      at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
      at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
      at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
      at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
      at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
      at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
      at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
      at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:108)
      at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
      at org.springframework.remoting.httpinvoker.HttpComponentsHttpInvokerRequestExecutor.executeHttpPost(HttpComponentsHttpInvokerRequestExecutor.java:309)
      at org.springframework.remoting.httpinvoker.HttpComponentsHttpInvokerRequestExecutor.doExecuteRequest(HttpComponentsHttpInvokerRequestExecutor.java:194)
      at org.springframework.remoting.httpinvoker.AbstractHttpInvokerRequestExecutor.executeRequest(AbstractHttpInvokerRequestExecutor.java:140)
      at org.springframework.remoting.httpinvoker.HttpInvokerClientInterceptor.executeRequest(HttpInvokerClientInterceptor.java:206)
      at org.springframework.remoting.httpinvoker.HttpInvokerClientInterceptor.executeRequest(HttpInvokerClientInterceptor.java:188)
      at org.springframework.remoting.httpinvoker.HttpInvokerClientInterceptor.invoke(HttpInvokerClientInterceptor.java:154)
      ... 11 more 
      2019-12-05 14:26:20,978 INFO 39677 [WatchDog_39677] Execution of phase [0] finished with error - elapsed time (sec): 600
      2019-12-05 14:26:20,978 ERROR 39677 [WatchDog_39677] Phase finished with error - stopping job run
      2019-12-05 14:26:20,978 INFO 39677 [WatchDog_39677] WatchDog finished - total execution time: 600 sec 

        Attachments

          Issue Links

            Activity

              People

              Assignee:
              salamonp Pavel Salamon
              Reporter:
              salamonp Pavel Salamon
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: