You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hadoop FileSystem supports a concat operation for some implementations (notably HDFS) that can efficiently merge files. (In HDFS it takes advantage of variable block sizes, which avoids the need to rewrite the file.)
SAMFileMerger#mergeParts() could take advantage of this operation if the target filesystem supports it.
The text was updated successfully, but these errors were encountered:
The disableFastConcat flag is necessary because the fast file merger can fail if the underlying file system is encrypted, or any number of undocumented invariants are not met.
Hadoop FileSystem supports a concat operation for some implementations (notably HDFS) that can efficiently merge files. (In HDFS it takes advantage of variable block sizes, which avoids the need to rewrite the file.)
SAMFileMerger#mergeParts()
could take advantage of this operation if the target filesystem supports it.The text was updated successfully, but these errors were encountered: