Skip to content

Commit 6619cb1

Browse files
authored
Populate file set property in CopyableFile for IcebergFileStreamExtractor (#4161)
1 parent 663929c commit 6619cb1

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

gobblin-data-management/src/main/java/org/apache/gobblin/data/management/copy/iceberg/IcebergFileStreamExtractor.java

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -150,6 +150,7 @@ public Iterator<FileAwareInputStream> downloadFile(String filePath) throws IOExc
150150
sourcePath.getParent(), PathUtils.getRootPathChild(sourcePath), copyConfiguration);
151151
// Build CopyableFile using cached targetFs and copyConfiguration (initialized once in constructor)
152152
CopyableFile copyableFile = CopyableFile.fromOriginAndDestination(originFs, originStatus, destinationPath, this.copyConfiguration)
153+
.fileSet(workUnit.getProp(ConfigurationKeys.DATASET_URN_KEY))
153154
.datasetOutputPath(targetFs.getUri().getPath())
154155
.ancestorsOwnerAndPermission(ancestorOwnerAndPermissionList)
155156
.build();

0 commit comments

Comments
 (0)