Skip to content

Pattern 4

2025-12-02 12:46:03.579 | DEBUG    | cwl_loader:load_cwl_from_location:228 - Loading CWL document from ../cwl-workflow/pattern-4.cwl...

2025-12-02 12:46:03.580 | DEBUG    | cwl_loader:_load_cwl_from_stream:231 - Reading stream from ../cwl-workflow/pattern-4.cwl...

2025-12-02 12:46:03.601 | DEBUG    | cwl_loader:load_cwl_from_stream:203 - CWL data of type <class 'ruamel.yaml.comments.CommentedMap'> successfully loaded from stream

2025-12-02 12:46:03.602 | DEBUG    | cwl_loader:load_cwl_from_yaml:130 - Updating the model from version 'v1.0' to version 'v1.2'...

2025-12-02 12:46:03.603 | DEBUG    | cwl_loader:load_cwl_from_yaml:141 - Raw CWL document successfully updated to v1.2!

2025-12-02 12:46:03.603 | DEBUG    | cwl_loader:load_cwl_from_yaml:145 - Parsing the raw CWL document to the CWL Utils DOM...

2025-12-02 12:46:03.676 | DEBUG    | cwl_loader:load_cwl_from_yaml:158 - Raw CWL document successfully parsed to the CWL Utils DOM!

2025-12-02 12:46:03.676 | DEBUG    | cwl_loader:load_cwl_from_yaml:160 - Dereferencing the steps[].run...

2025-12-02 12:46:03.678 | DEBUG    | cwl_loader:_on_process:78 - Checking if ../cwl-workflow/pattern-4.cwl#clt must be externally imported...

2025-12-02 12:46:03.678 | DEBUG    | cwl_loader:_on_process:82 - run_url: ../cwl-workflow/pattern-4.cwl - uri: ../cwl-workflow/pattern-4.cwl

2025-12-02 12:46:03.679 | DEBUG    | cwl_loader:load_cwl_from_yaml:167 - steps[].run successfully dereferenced! Dereferencing the FQNs...

2025-12-02 12:46:03.679 | DEBUG    | cwl_loader:load_cwl_from_yaml:171 - CWL document successfully dereferenced! Now verifying steps[].run integrity...

2025-12-02 12:46:03.680 | DEBUG    | cwl_loader:load_cwl_from_yaml:175 - All steps[].run link are resolvable!

2025-12-02 12:46:03.680 | DEBUG    | cwl_loader:load_cwl_from_yaml:178 - Sorting Process instances by dependencies....

2025-12-02 12:46:03.681 | DEBUG    | cwl_loader:load_cwl_from_yaml:180 - Sorting process is over.

2025-12-02 12:46:03.681 | DEBUG    | cwl_loader:_load_cwl_from_stream:240 - Stream from ../cwl-workflow/pattern-4.cwl successfully load!

Application Package Pattern 4¶

The CWL includes:

one input parameter of type Directory
two output parameters of type Directory

This scenario takes as input an acquisition, applies two algorithms and generates two outputs.

Implementation: process the NDVI and NDWI taking as input a Landsat-8/9 acquisition. The output include two STAC Catalogs, each with a single STAC Item

No description has been provided for this image

Inputs¶

Id	Type	Label	Doc
`aoi`	`string`	area of interest	area of interest as a bounding box
`epsg`	`string`	EPSG code	EPSG code
`item`	`Directory`	Landsat-8/9 acquisition reference	Landsat-8/9 acquisition reference

Steps¶

Id	Runs	Label	Doc
`step`	`#clt`	None	None

Outputs¶

Id	Type	Label	Doc
`ndvi`	`Directory`	NDVI vegetation index	NDVI vegetation index
`ndwi`	`Directory`	NDWI vegetation index	NDWI vegetation index

Data flow management¶

2025-12-02 12:46:04.331 | DEBUG    | cwl_loader:load_cwl_from_location:228 - Loading CWL document from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/develop/templates/stage-in.cwl...

2025-12-02 12:46:04.366 | DEBUG    | cwl_loader:_load_cwl_from_stream:231 - Reading stream from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/develop/templates/stage-in.cwl...

2025-12-02 12:46:04.372 | DEBUG    | cwl_loader:load_cwl_from_stream:203 - CWL data of type <class 'ruamel.yaml.comments.CommentedMap'> successfully loaded from stream

2025-12-02 12:46:04.373 | DEBUG    | cwl_loader:load_cwl_from_yaml:130 - Updating the model from version 'v1.0' to version 'v1.2'...

2025-12-02 12:46:04.373 | DEBUG    | cwl_loader:load_cwl_from_yaml:141 - Raw CWL document successfully updated to v1.2!

2025-12-02 12:46:04.374 | DEBUG    | cwl_loader:load_cwl_from_yaml:145 - Parsing the raw CWL document to the CWL Utils DOM...

2025-12-02 12:46:04.533 | DEBUG    | cwl_loader:load_cwl_from_yaml:158 - Raw CWL document successfully parsed to the CWL Utils DOM!

2025-12-02 12:46:04.534 | DEBUG    | cwl_loader:load_cwl_from_yaml:160 - Dereferencing the steps[].run...

2025-12-02 12:46:04.534 | DEBUG    | cwl_loader:load_cwl_from_yaml:167 - steps[].run successfully dereferenced! Dereferencing the FQNs...

2025-12-02 12:46:04.535 | DEBUG    | cwl_loader:load_cwl_from_yaml:171 - CWL document successfully dereferenced! Now verifying steps[].run integrity...

2025-12-02 12:46:04.535 | DEBUG    | cwl_loader:load_cwl_from_yaml:175 - All steps[].run link are resolvable!

2025-12-02 12:46:04.536 | DEBUG    | cwl_loader:load_cwl_from_yaml:178 - Sorting Process instances by dependencies....

2025-12-02 12:46:04.536 | DEBUG    | cwl_loader:load_cwl_from_yaml:180 - Sorting process is over.

2025-12-02 12:46:04.537 | DEBUG    | cwl_loader:_load_cwl_from_stream:240 - Stream from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/develop/templates/stage-in.cwl successfully load!

2025-12-02 12:46:04.537 | DEBUG    | cwl_loader:load_cwl_from_location:228 - Loading CWL document from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/develop/templates/stage-in-file.cwl...

2025-12-02 12:46:04.571 | DEBUG    | cwl_loader:_load_cwl_from_stream:231 - Reading stream from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/develop/templates/stage-in-file.cwl...

2025-12-02 12:46:04.576 | DEBUG    | cwl_loader:load_cwl_from_stream:203 - CWL data of type <class 'ruamel.yaml.comments.CommentedMap'> successfully loaded from stream

2025-12-02 12:46:04.577 | DEBUG    | cwl_loader:load_cwl_from_yaml:130 - Updating the model from version 'v1.0' to version 'v1.2'...

2025-12-02 12:46:04.577 | DEBUG    | cwl_loader:load_cwl_from_yaml:141 - Raw CWL document successfully updated to v1.2!

2025-12-02 12:46:04.578 | DEBUG    | cwl_loader:load_cwl_from_yaml:145 - Parsing the raw CWL document to the CWL Utils DOM...

2025-12-02 12:46:04.738 | DEBUG    | cwl_loader:load_cwl_from_yaml:158 - Raw CWL document successfully parsed to the CWL Utils DOM!

2025-12-02 12:46:04.739 | DEBUG    | cwl_loader:load_cwl_from_yaml:160 - Dereferencing the steps[].run...

2025-12-02 12:46:04.739 | DEBUG    | cwl_loader:load_cwl_from_yaml:167 - steps[].run successfully dereferenced! Dereferencing the FQNs...

2025-12-02 12:46:04.740 | DEBUG    | cwl_loader:load_cwl_from_yaml:171 - CWL document successfully dereferenced! Now verifying steps[].run integrity...

2025-12-02 12:46:04.740 | DEBUG    | cwl_loader:load_cwl_from_yaml:175 - All steps[].run link are resolvable!

2025-12-02 12:46:04.740 | DEBUG    | cwl_loader:load_cwl_from_yaml:178 - Sorting Process instances by dependencies....

2025-12-02 12:46:04.741 | DEBUG    | cwl_loader:load_cwl_from_yaml:180 - Sorting process is over.

2025-12-02 12:46:04.741 | DEBUG    | cwl_loader:_load_cwl_from_stream:240 - Stream from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/develop/templates/stage-in-file.cwl successfully load!

2025-12-02 12:46:04.742 | DEBUG    | cwl_loader:load_cwl_from_location:228 - Loading CWL document from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/develop/templates/stage-out.cwl...

2025-12-02 12:46:04.775 | DEBUG    | cwl_loader:_load_cwl_from_stream:231 - Reading stream from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/develop/templates/stage-out.cwl...

2025-12-02 12:46:04.784 | DEBUG    | cwl_loader:load_cwl_from_stream:203 - CWL data of type <class 'ruamel.yaml.comments.CommentedMap'> successfully loaded from stream

2025-12-02 12:46:04.784 | DEBUG    | cwl_loader:load_cwl_from_yaml:130 - Updating the model from version 'v1.0' to version 'v1.2'...

2025-12-02 12:46:04.785 | DEBUG    | cwl_loader:load_cwl_from_yaml:141 - Raw CWL document successfully updated to v1.2!

2025-12-02 12:46:04.785 | DEBUG    | cwl_loader:load_cwl_from_yaml:145 - Parsing the raw CWL document to the CWL Utils DOM...

2025-12-02 12:46:04.961 | DEBUG    | cwl_loader:load_cwl_from_yaml:158 - Raw CWL document successfully parsed to the CWL Utils DOM!

2025-12-02 12:46:04.961 | DEBUG    | cwl_loader:load_cwl_from_yaml:160 - Dereferencing the steps[].run...

2025-12-02 12:46:04.962 | DEBUG    | cwl_loader:load_cwl_from_yaml:167 - steps[].run successfully dereferenced! Dereferencing the FQNs...

2025-12-02 12:46:04.962 | DEBUG    | cwl_loader:load_cwl_from_yaml:171 - CWL document successfully dereferenced! Now verifying steps[].run integrity...

2025-12-02 12:46:04.963 | DEBUG    | cwl_loader:load_cwl_from_yaml:175 - All steps[].run link are resolvable!

2025-12-02 12:46:04.963 | DEBUG    | cwl_loader:load_cwl_from_yaml:178 - Sorting Process instances by dependencies....

2025-12-02 12:46:04.964 | DEBUG    | cwl_loader:load_cwl_from_yaml:180 - Sorting process is over.

2025-12-02 12:46:04.964 | DEBUG    | cwl_loader:_load_cwl_from_stream:240 - Stream from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/develop/templates/stage-out.cwl successfully load!

2025-12-02 12:46:04.964 | INFO     | eoap_cwlwrap.types:_validate_stage_in:281 - Validating stage-in 'my-asthonishing-stage-in-directory'...

2025-12-02 12:46:04.965 | INFO     | eoap_cwlwrap.types:_validate_stage_in:303 - stage-in 'my-asthonishing-stage-in-directory' is valid

2025-12-02 12:46:04.965 | INFO     | eoap_cwlwrap.types:_validate_stage_in:281 - Validating stage-in 'my-asthonishing-stage-in-file'...

2025-12-02 12:46:04.966 | INFO     | eoap_cwlwrap.types:_validate_stage_in:303 - stage-in 'my-asthonishing-stage-in-file' is valid

2025-12-02 12:46:04.966 | INFO     | eoap_cwlwrap.types:validate_stage_out:339 - Validating stage-out 'my-super-stage-out'...

2025-12-02 12:46:04.967 | INFO     | eoap_cwlwrap.types:validate_stage_out:361 - stage-out 'my-super-stage-out' is valid

2025-12-02 12:46:04.967 | INFO     | eoap_cwlwrap:_build_orchestrator_workflow:101 - Building the CWL Orchestrator Workflow...

2025-12-02 12:46:04.968 | INFO     | eoap_cwlwrap:_build_orchestrator_workflow:130 - Analyzing pattern-4 inputs...

2025-12-02 12:46:04.968 | INFO     | eoap_cwlwrap:_build_orchestrator_workflow:146 - * pattern-4/aoi: string

2025-12-02 12:46:04.969 | INFO     | eoap_cwlwrap:_build_orchestrator_workflow:146 - * pattern-4/epsg: string

2025-12-02 12:46:04.969 | INFO     | eoap_cwlwrap:_build_orchestrator_workflow:146 - * pattern-4/item: Directory

2025-12-02 12:46:04.970 | INFO     | eoap_cwlwrap:_build_orchestrator_workflow:159 -   Directory type detected, creating a related 'directory_stage_in_0'...

2025-12-02 12:46:04.970 | INFO     | eoap_cwlwrap:_build_orchestrator_workflow:161 -   Converting Directory to URL-compatible type...

2025-12-02 12:46:04.971 | INFO     | eoap_cwlwrap:_build_orchestrator_workflow:165 -   Directory converted to https://raw.githubusercontent.com/eoap/schemas/main/string_format.yaml#URI

2025-12-02 12:46:04.971 | INFO     | eoap_cwlwrap:_build_orchestrator_workflow:206 -   Connecting 'app/item' to 'directory_stage_in_0' output...

2025-12-02 12:46:04.972 | INFO     | eoap_cwlwrap:_build_orchestrator_workflow:257 - Analyzing pattern-4 outputs...

2025-12-02 12:46:04.972 | INFO     | eoap_cwlwrap:_build_orchestrator_workflow:263 - * pattern-4/ndvi: Directory

2025-12-02 12:46:04.973 | INFO     | eoap_cwlwrap:_build_orchestrator_workflow:268 -   Directory type detected, creating a related 'stage_out_0'...

2025-12-02 12:46:04.973 | INFO     | eoap_cwlwrap:_build_orchestrator_workflow:270 -   Converting Directory to URL-compatible type...

2025-12-02 12:46:04.973 | INFO     | eoap_cwlwrap:_build_orchestrator_workflow:274 -   Directory converted to https://raw.githubusercontent.com/eoap/schemas/main/string_format.yaml#URI

2025-12-02 12:46:04.975 | INFO     | eoap_cwlwrap:_build_orchestrator_workflow:315 -   Connecting 'app/ndvi' to 'stage_out_0' output...

2025-12-02 12:46:04.975 | INFO     | eoap_cwlwrap:_build_orchestrator_workflow:263 - * pattern-4/ndwi: Directory

2025-12-02 12:46:04.976 | INFO     | eoap_cwlwrap:_build_orchestrator_workflow:268 -   Directory type detected, creating a related 'stage_out_1'...

2025-12-02 12:46:04.976 | INFO     | eoap_cwlwrap:_build_orchestrator_workflow:270 -   Converting Directory to URL-compatible type...

2025-12-02 12:46:04.976 | INFO     | eoap_cwlwrap:_build_orchestrator_workflow:274 -   Directory converted to https://raw.githubusercontent.com/eoap/schemas/main/string_format.yaml#URI

2025-12-02 12:46:04.978 | INFO     | eoap_cwlwrap:_build_orchestrator_workflow:315 -   Connecting 'app/ndwi' to 'stage_out_1' output...

2025-12-02 12:46:04.978 | INFO     | eoap_cwlwrap:_build_orchestrator_workflow:390 - Orchestrator Workflow built in 0.0112 seconds

No description has been provided for this image

Workflow components diagram¶

No description has been provided for this image

Inputs¶

Id	Type	Label	Doc
`aoi`	`string`	area of interest - pattern-4/aoi	area of interest as a bounding box - This parameter is derived from pattern-4/aoi
`epsg`	`string`	EPSG code - pattern-4/epsg	EPSG code - This parameter is derived from pattern-4/epsg
`another_input`	`string`	Another Input - my-asthonishing-stage-in-directory/another_input	An additional input for demonstration purposes - This parameter is derived from my-asthonishing-stage-in-directory/another_input
`item`	`https://raw.githubusercontent.com/eoap/schemas/main/string_format.yaml#URI`	Landsat-8/9 acquisition reference - pattern-4/item	Landsat-8/9 acquisition reference - This parameter is derived from pattern-4/item
`s3_bucket`	`string`	my-super-stage-out/s3_bucket	This parameter is derived from: my-super-stage-out/s3_bucket
`sub_path`	`string`	my-super-stage-out/sub_path	This parameter is derived from: my-super-stage-out/sub_path
`aws_access_key_id`	`string`	my-super-stage-out/aws_access_key_id	This parameter is derived from: my-super-stage-out/aws_access_key_id
`aws_secret_access_key`	`string`	my-super-stage-out/aws_secret_access_key	This parameter is derived from: my-super-stage-out/aws_secret_access_key
`region_name`	`string`	my-super-stage-out/region_name	This parameter is derived from: my-super-stage-out/region_name
`endpoint_url`	`string`	my-super-stage-out/endpoint_url	This parameter is derived from: my-super-stage-out/endpoint_url

Steps¶

Id	Runs	Label	Doc
`directory_stage_in_0`	`#my-asthonishing-stage-in-directory`	None	None
`app`	`#pattern-4`	None	None
`stage_out_0`	`#my-super-stage-out`	None	None
`stage_out_1`	`#my-super-stage-out`	None	None

Outputs¶

Id	Type	Label	Doc
`ndvi`	`https://raw.githubusercontent.com/eoap/schemas/main/string_format.yaml#URI`	NDVI vegetation index	NDVI vegetation index
`ndwi`	`https://raw.githubusercontent.com/eoap/schemas/main/string_format.yaml#URI`	NDWI vegetation index	NDWI vegetation index

Execution¶

Inputs¶

{
  "aoi": "-118.985,38.432,-118.183,38.938",
  "epsg": "EPSG:4326",
  "item": {
    "class": "https://raw.githubusercontent.com/eoap/schemas/main/url.yaml#URL",
    "value": "https://planetarycomputer.microsoft.com/api/stac/v1/collections/landsat-c2-l2/items/LC08_L2SP_042033_20231007_02_T1"
  }
}

Outputs¶

{
    "ndvi": {
        "value": "s3://my-bucket/my/sub/path-wgb1ts/catalog.json",
        "type": "https://raw.githubusercontent.com/eoap/schemas/main/string_format.yaml#URI"
    },
    "ndwi": {
        "value": "s3://my-bucket/my/sub/path-t0bbsf/catalog.json",
        "type": "https://raw.githubusercontent.com/eoap/schemas/main/string_format.yaml#URI"
    }
}