[CLO-2238] Update Apache Commons IO library - CloverDX Issue Tracker

XML

Word

Printable

Details

Type: Improvement
Status: Closed
Priority: Minor
Resolution: Fixed
Affects Version/s: rel-3-5-0-M2
Fix Version/s: rel-3-5-0
Component/s: Designer, Engine, Server
Labels:
- release-notes

Branch:
- trunk-3-5
QA Testing:

UNDECIDED
Additional information:
Hide

The old library causes problems with Hadoop in Cloudera 4.4:

java.lang.NoSuchMethodError: org.apache.commons.io.IOUtils.closeQuietly(Ljava/io/Closeable;)V at org.apache.hadoop.hdfs.DFSInputStream.getBlockReader(DFSInputStream.java:1094) at org.apache.hadoop.hdfs.DFSInputStream.blockSeekTo(DFSInputStream.java:538) at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:750) at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:794) at java.io.DataInputStream.read(DataInputStream.java:149) at java.io.DataInputStream.read(DataInputStream.java:149) at java.nio.channels.Channels$ReadableByteChannelImpl.read(Channels.java:385) at sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:273) at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:325) at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:177) at org.jetel.data.parser.SimpleDataParser.fill(SimpleDataParser.java:394) at org.jetel.data.parser.SimpleDataParser.readField(SimpleDataParser.java:313) at org.jetel.data.parser.SimpleDataParser.parseNext(SimpleDataParser.java:274) at org.jetel.data.parser.SimpleDataParser.getNext(SimpleDataParser.java:173) at org.jetel.util.MultiFileReader.getNext(MultiFileReader.java:432) at org.jetel.component.DataReader.execute(DataReader.java:268) at org.jetel.graph.Node.run(Node.java:498) ... 3 more
Show
The old library causes problems with Hadoop in Cloudera 4.4: java.lang.NoSuchMethodError: org.apache.commons.io.IOUtils.closeQuietly(Ljava/io/Closeable;)V at org.apache.hadoop.hdfs.DFSInputStream.getBlockReader(DFSInputStream.java:1094) at org.apache.hadoop.hdfs.DFSInputStream.blockSeekTo(DFSInputStream.java:538) at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:750) at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:794) at java.io.DataInputStream.read(DataInputStream.java:149) at java.io.DataInputStream.read(DataInputStream.java:149) at java.nio.channels.Channels$ReadableByteChannelImpl.read(Channels.java:385) at sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:273) at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:325) at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:177) at org.jetel.data.parser.SimpleDataParser.fill(SimpleDataParser.java:394) at org.jetel.data.parser.SimpleDataParser.readField(SimpleDataParser.java:313) at org.jetel.data.parser.SimpleDataParser.parseNext(SimpleDataParser.java:274) at org.jetel.data.parser.SimpleDataParser.getNext(SimpleDataParser.java:173) at org.jetel.util.MultiFileReader.getNext(MultiFileReader.java:432) at org.jetel.component.DataReader.execute(DataReader.java:268) at org.jetel.graph.Node.run(Node.java:498) ... 3 more

Description

Currently, we use commons-io-1.4.jar, but the latest version is 2.4.

The library should be binary and source compatible up to version 2.2 (except for bugfixes), only the required Java version has changed from JDK 1.3 to JDK 1.5 (in 2.2) or JDK 1.6 (in 2.4). Versions 2.3+ are no longer source compatible, because some methods were overloaded to accept charset both as a String and as a Charset instance. That means that calls where null literal is passed as the charset are ambiguous.

So I think we should either update to 2.2 or 2.4.

See http://commons.apache.org/proper/commons-io/upgradeto2_4.html.

Attachments

Activity

People

Assignee:: Milan Krivanek (Inactive)

Reporter:: Milan Krivanek (Inactive)

Votes:: 0 Vote for this issue

Watchers:: 0 Start watching this issue

Dates

Created:: 2013-10-17 11:43

Updated:: 2019-09-24 13:08

Resolved:: 2013-11-27 14:22

Time Tracking

Estimated:

Remaining:

Logged: