Uploaded image for project: 'CloverDX'
  1. CloverDX
  2. CLO-6675

Performance issue when using wildcards in ListFiles

    XMLWordPrintable

    Details

    • Branch:
    • QA Testing:
      Graph automated test
    • QA Test Identification:
      ListFiles_SFTP_wildcard_CLO-6675.grf
    • OTRS_Ticket_ID:
      2015062510000066

      Description

      There is a directory on koule sftp containing 1000 files. I use ListFiles to list those files. The final processing time depends on which File URL I set.

      sftp://[email protected]/root/tst/*.txt
      This takes 463 seconds to list the files

      sftp://[email protected]/root/tst
      This takes 1 second to do the same.

      Reading all those files using the wildcard syntax takes 76 seconds.

      Fix this, please or at least warn users in our documentation that there is a performance issue.

      Test jobflow and a working ssh private key are attached.

        Attachments

        1. ssh.jbf
          4 kB
        2. tst.key
          2 kB

          Issue Links

            Activity

              People

              Assignee:
              krivanekm Milan Krivanek
              Reporter:
              imriskal Lubos Imriska
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0 minutes
                  0m
                  Logged:
                  Time Spent - 1 hour
                  1h