newPipeline.getComponentsBuilder().putAllTransforms(newTransforms); viewTransforms.forEach(newPipeline.getComponentsBuilder()::removeTransforms); viewOutputsToInputs.keySet().forEach(newPipeline.getComponentsBuilder()::removePcollections); newPipeline.clearRootTransformIds(); newPipeline.addAllRootTransformIds( pipeline .getRootTransformIdsList() .filter(id -> !viewTransforms.contains(id)) .collect(Collectors.toList())); return newPipeline.build();
Components.Builder newPipelineComponents = newPipeline.getComponentsBuilder(); newPipeline.clearRootTransformIds(); for (String rootId : p.getRootTransformIdsList()) { if (!feedSDFIds.contains(rootId)) { newPipeline.addRootTransformIds(rootId); return newPipeline.build();
Pipeline res = Pipeline.newBuilder() .setComponents(fusedComponents) .addAllRootTransformIds(rootTransformIds) .build();
GreedyPipelineFuser.fuse(Pipeline.newBuilder().setComponents(components).build());
.build(); FusedPipeline fused = GreedyPipelineFuser.fuse(Pipeline.newBuilder().setComponents(components).build());
.build(); FusedPipeline fused = GreedyPipelineFuser.fuse(Pipeline.newBuilder().setComponents(components).build());
Pipeline impulse = Pipeline.newBuilder() .addRootTransformIds(impulse1Transform.getUniqueName()) .addRootTransformIds(impulse2Transform.getUniqueName()) .addRootTransformIds(flattenTransform.getUniqueName()) .setComponents( Components.newBuilder() .putCoders("coder", Coder.newBuilder().build()) .putTransforms(impulse2Transform.getUniqueName(), impulse2Transform) .build()) .build(); FusedPipeline fused = GreedyPipelineFuser.fuse(impulse);
GreedyPipelineFuser.fuse( Pipeline.newBuilder() .addRootTransformIds("impulse") .addRootTransformIds("compositeMultiLang") .setComponents(components) .build());
Pipeline pipeline = Pipeline.newBuilder() .addRootTransformIds(inputTransform.getId()) .addRootTransformIds(groupByKeyOnly.getId()) .setComponents( builder .putTransforms(inputTransform.getId(), inputTransform.getTransform()) .putPcollections(values.getId(), values.getPCollection()) .putPcollections(groupedKvs.getId(), groupedKvs.getPCollection())) .build();
.build(); FusedPipeline fused = GreedyPipelineFuser.fuse(Pipeline.newBuilder().setComponents(components).build());
.build(); FusedPipeline fused = GreedyPipelineFuser.fuse(Pipeline.newBuilder().setComponents(components).build());
RunnerApi.Pipeline p = Pipeline.newBuilder() .addAllRootTransformIds(ImmutableList.of("first", "second")) .setComponents( Components.newBuilder() .putTransforms( "coder", Coder.newBuilder().setSpec(SdkFunctionSpec.getDefaultInstance()).build())) .build();
.build(); FusedPipeline fused = GreedyPipelineFuser.fuse(Pipeline.newBuilder().setComponents(components).build());
PortableGraph.forPipeline( RunnerApi.Pipeline.newBuilder() .addRootTransformIds(source.getId()) .addRootTransformIds(flatten.getId()) .setComponents( RunnerApi.Components.newBuilder() .putTransforms(source.getId(), source.getTransform()) .putTransforms(flatten.getId(), flatten.getTransform()) .putPcollections(flattened.getId(), flattened.getPCollection())) .build());
.build(); FusedPipeline fused = GreedyPipelineFuser.fuse(Pipeline.newBuilder().setComponents(components).build());
GreedyPipelineFuser.fuse(Pipeline.newBuilder().setComponents(components).build());
RunnerApi.Pipeline p = Pipeline.newBuilder() .addAllRootTransformIds(ImmutableList.of("first", "second")) .setComponents( Components.newBuilder() .putTransforms( "coder", Coder.newBuilder().setSpec(SdkFunctionSpec.getDefaultInstance()).build())) .build();
.build(); FusedPipeline fused = GreedyPipelineFuser.fuse(Pipeline.newBuilder().setComponents(components).build());
RunnerApi.Pipeline res = RunnerApi.Pipeline.newBuilder() .setComponents(components.toComponents()) .addAllRootTransformIds(rootIds) .build(); if (!useDeprecatedViewTransforms) {
Pipeline p = Pipeline.newBuilder() .addRootTransformIds("root") .setComponents( Components.newBuilder() .putTransforms( .setSpec(FunctionSpec.newBuilder().setUrn("beam:inner")) .build())) .build();