Skip to content

Pattern 8

2025-12-02 12:47:54.138 | DEBUG    | cwl_loader:load_cwl_from_location:228 - Loading CWL document from ../cwl-workflow/pattern-8.cwl...

2025-12-02 12:47:54.139 | DEBUG    | cwl_loader:_load_cwl_from_stream:231 - Reading stream from ../cwl-workflow/pattern-8.cwl...

2025-12-02 12:47:54.162 | DEBUG    | cwl_loader:load_cwl_from_stream:203 - CWL data of type <class 'ruamel.yaml.comments.CommentedMap'> successfully loaded from stream

2025-12-02 12:47:54.162 | DEBUG    | cwl_loader:load_cwl_from_yaml:130 - Updating the model from version 'v1.0' to version 'v1.2'...

2025-12-02 12:47:54.163 | DEBUG    | cwl_loader:load_cwl_from_yaml:141 - Raw CWL document successfully updated to v1.2!

2025-12-02 12:47:54.163 | DEBUG    | cwl_loader:load_cwl_from_yaml:145 - Parsing the raw CWL document to the CWL Utils DOM...

2025-12-02 12:47:54.236 | DEBUG    | cwl_loader:load_cwl_from_yaml:158 - Raw CWL document successfully parsed to the CWL Utils DOM!

2025-12-02 12:47:54.237 | DEBUG    | cwl_loader:load_cwl_from_yaml:160 - Dereferencing the steps[].run...

2025-12-02 12:47:54.237 | DEBUG    | cwl_loader:_on_process:78 - Checking if ../cwl-workflow/pattern-8.cwl#clt must be externally imported...

2025-12-02 12:47:54.238 | DEBUG    | cwl_loader:_on_process:82 - run_url: ../cwl-workflow/pattern-8.cwl - uri: ../cwl-workflow/pattern-8.cwl

2025-12-02 12:47:54.239 | DEBUG    | cwl_loader:load_cwl_from_yaml:167 - steps[].run successfully dereferenced! Dereferencing the FQNs...

2025-12-02 12:47:54.239 | DEBUG    | cwl_loader:load_cwl_from_yaml:171 - CWL document successfully dereferenced! Now verifying steps[].run integrity...

2025-12-02 12:47:54.240 | DEBUG    | cwl_loader:load_cwl_from_yaml:175 - All steps[].run link are resolvable!

2025-12-02 12:47:54.240 | DEBUG    | cwl_loader:load_cwl_from_yaml:178 - Sorting Process instances by dependencies....

2025-12-02 12:47:54.241 | DEBUG    | cwl_loader:load_cwl_from_yaml:180 - Sorting process is over.

2025-12-02 12:47:54.241 | DEBUG    | cwl_loader:_load_cwl_from_stream:240 - Stream from ../cwl-workflow/pattern-8.cwl successfully load!

Application Package Pattern 8¶

The CWL includes:

one input parameter of type Directory
one output parameter of type Directory?

This scenario takes as input an acquisition, applies an algorithm and may or may not generate and output

Implementation: detects water bodies using the Normalized Difference Water Index (NDWI) and Otsu thresholding.

No description has been provided for this image

Inputs¶

Id	Type	Label	Doc
`aoi`	`string`	area of interest	area of interest as a bounding box
`epsg`	`string`	EPSG code	EPSG code
`bands`	`string[]`	bands used for the NDWI	bands used for the NDWI
`item`	`Directory`	Landsat-8/9 acquisition reference	Landsat-8/9 acquisition reference
`produce_output`	`boolean`	Flag to produce the output	Flag to produce the output

Steps¶

Id	Runs	Label	Doc
`step`	`#clt`	None	None

Outputs¶

Id	Type	Label	Doc
`water_bodies`	`[ null, Directory ]`	Water bodies detected	Water bodies detected based on the NDWI and otsu threshold

Data flow management¶

2025-12-02 12:47:55.013 | DEBUG    | cwl_loader:load_cwl_from_location:228 - Loading CWL document from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/develop/templates/stage-in.cwl...

2025-12-02 12:47:55.082 | DEBUG    | cwl_loader:_load_cwl_from_stream:231 - Reading stream from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/develop/templates/stage-in.cwl...

2025-12-02 12:47:55.088 | DEBUG    | cwl_loader:load_cwl_from_stream:203 - CWL data of type <class 'ruamel.yaml.comments.CommentedMap'> successfully loaded from stream

2025-12-02 12:47:55.089 | DEBUG    | cwl_loader:load_cwl_from_yaml:130 - Updating the model from version 'v1.0' to version 'v1.2'...

2025-12-02 12:47:55.090 | DEBUG    | cwl_loader:load_cwl_from_yaml:141 - Raw CWL document successfully updated to v1.2!

2025-12-02 12:47:55.091 | DEBUG    | cwl_loader:load_cwl_from_yaml:145 - Parsing the raw CWL document to the CWL Utils DOM...

2025-12-02 12:47:55.245 | DEBUG    | cwl_loader:load_cwl_from_yaml:158 - Raw CWL document successfully parsed to the CWL Utils DOM!

2025-12-02 12:47:55.245 | DEBUG    | cwl_loader:load_cwl_from_yaml:160 - Dereferencing the steps[].run...

2025-12-02 12:47:55.246 | DEBUG    | cwl_loader:load_cwl_from_yaml:167 - steps[].run successfully dereferenced! Dereferencing the FQNs...

2025-12-02 12:47:55.247 | DEBUG    | cwl_loader:load_cwl_from_yaml:171 - CWL document successfully dereferenced! Now verifying steps[].run integrity...

2025-12-02 12:47:55.247 | DEBUG    | cwl_loader:load_cwl_from_yaml:175 - All steps[].run link are resolvable!

2025-12-02 12:47:55.248 | DEBUG    | cwl_loader:load_cwl_from_yaml:178 - Sorting Process instances by dependencies....

2025-12-02 12:47:55.248 | DEBUG    | cwl_loader:load_cwl_from_yaml:180 - Sorting process is over.

2025-12-02 12:47:55.249 | DEBUG    | cwl_loader:_load_cwl_from_stream:240 - Stream from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/develop/templates/stage-in.cwl successfully load!

2025-12-02 12:47:55.250 | DEBUG    | cwl_loader:load_cwl_from_location:228 - Loading CWL document from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/develop/templates/stage-in-file.cwl...

2025-12-02 12:47:55.335 | DEBUG    | cwl_loader:_load_cwl_from_stream:231 - Reading stream from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/develop/templates/stage-in-file.cwl...

2025-12-02 12:47:55.341 | DEBUG    | cwl_loader:load_cwl_from_stream:203 - CWL data of type <class 'ruamel.yaml.comments.CommentedMap'> successfully loaded from stream

2025-12-02 12:47:55.341 | DEBUG    | cwl_loader:load_cwl_from_yaml:130 - Updating the model from version 'v1.0' to version 'v1.2'...

2025-12-02 12:47:55.342 | DEBUG    | cwl_loader:load_cwl_from_yaml:141 - Raw CWL document successfully updated to v1.2!

2025-12-02 12:47:55.342 | DEBUG    | cwl_loader:load_cwl_from_yaml:145 - Parsing the raw CWL document to the CWL Utils DOM...

2025-12-02 12:47:55.505 | DEBUG    | cwl_loader:load_cwl_from_yaml:158 - Raw CWL document successfully parsed to the CWL Utils DOM!

2025-12-02 12:47:55.506 | DEBUG    | cwl_loader:load_cwl_from_yaml:160 - Dereferencing the steps[].run...

2025-12-02 12:47:55.507 | DEBUG    | cwl_loader:load_cwl_from_yaml:167 - steps[].run successfully dereferenced! Dereferencing the FQNs...

2025-12-02 12:47:55.507 | DEBUG    | cwl_loader:load_cwl_from_yaml:171 - CWL document successfully dereferenced! Now verifying steps[].run integrity...

2025-12-02 12:47:55.507 | DEBUG    | cwl_loader:load_cwl_from_yaml:175 - All steps[].run link are resolvable!

2025-12-02 12:47:55.508 | DEBUG    | cwl_loader:load_cwl_from_yaml:178 - Sorting Process instances by dependencies....

2025-12-02 12:47:55.508 | DEBUG    | cwl_loader:load_cwl_from_yaml:180 - Sorting process is over.

2025-12-02 12:47:55.509 | DEBUG    | cwl_loader:_load_cwl_from_stream:240 - Stream from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/develop/templates/stage-in-file.cwl successfully load!

2025-12-02 12:47:55.509 | DEBUG    | cwl_loader:load_cwl_from_location:228 - Loading CWL document from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/develop/templates/stage-out.cwl...

2025-12-02 12:47:55.579 | DEBUG    | cwl_loader:_load_cwl_from_stream:231 - Reading stream from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/develop/templates/stage-out.cwl...

2025-12-02 12:47:55.588 | DEBUG    | cwl_loader:load_cwl_from_stream:203 - CWL data of type <class 'ruamel.yaml.comments.CommentedMap'> successfully loaded from stream

2025-12-02 12:47:55.589 | DEBUG    | cwl_loader:load_cwl_from_yaml:130 - Updating the model from version 'v1.0' to version 'v1.2'...

2025-12-02 12:47:55.589 | DEBUG    | cwl_loader:load_cwl_from_yaml:141 - Raw CWL document successfully updated to v1.2!

2025-12-02 12:47:55.590 | DEBUG    | cwl_loader:load_cwl_from_yaml:145 - Parsing the raw CWL document to the CWL Utils DOM...

2025-12-02 12:47:55.768 | DEBUG    | cwl_loader:load_cwl_from_yaml:158 - Raw CWL document successfully parsed to the CWL Utils DOM!

2025-12-02 12:47:55.768 | DEBUG    | cwl_loader:load_cwl_from_yaml:160 - Dereferencing the steps[].run...

2025-12-02 12:47:55.769 | DEBUG    | cwl_loader:load_cwl_from_yaml:167 - steps[].run successfully dereferenced! Dereferencing the FQNs...

2025-12-02 12:47:55.769 | DEBUG    | cwl_loader:load_cwl_from_yaml:171 - CWL document successfully dereferenced! Now verifying steps[].run integrity...

2025-12-02 12:47:55.770 | DEBUG    | cwl_loader:load_cwl_from_yaml:175 - All steps[].run link are resolvable!

2025-12-02 12:47:55.770 | DEBUG    | cwl_loader:load_cwl_from_yaml:178 - Sorting Process instances by dependencies....

2025-12-02 12:47:55.771 | DEBUG    | cwl_loader:load_cwl_from_yaml:180 - Sorting process is over.

2025-12-02 12:47:55.771 | DEBUG    | cwl_loader:_load_cwl_from_stream:240 - Stream from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/develop/templates/stage-out.cwl successfully load!

2025-12-02 12:47:55.772 | INFO     | eoap_cwlwrap.types:_validate_stage_in:281 - Validating stage-in 'my-asthonishing-stage-in-directory'...

2025-12-02 12:47:55.772 | INFO     | eoap_cwlwrap.types:_validate_stage_in:303 - stage-in 'my-asthonishing-stage-in-directory' is valid

2025-12-02 12:47:55.773 | INFO     | eoap_cwlwrap.types:_validate_stage_in:281 - Validating stage-in 'my-asthonishing-stage-in-file'...

2025-12-02 12:47:55.773 | INFO     | eoap_cwlwrap.types:_validate_stage_in:303 - stage-in 'my-asthonishing-stage-in-file' is valid

2025-12-02 12:47:55.774 | INFO     | eoap_cwlwrap.types:validate_stage_out:339 - Validating stage-out 'my-super-stage-out'...

2025-12-02 12:47:55.774 | INFO     | eoap_cwlwrap.types:validate_stage_out:361 - stage-out 'my-super-stage-out' is valid

2025-12-02 12:47:55.775 | INFO     | eoap_cwlwrap:_build_orchestrator_workflow:101 - Building the CWL Orchestrator Workflow...

2025-12-02 12:47:55.775 | INFO     | eoap_cwlwrap:_build_orchestrator_workflow:130 - Analyzing pattern-8 inputs...

2025-12-02 12:47:55.776 | INFO     | eoap_cwlwrap:_build_orchestrator_workflow:146 - * pattern-8/aoi: string

2025-12-02 12:47:55.777 | INFO     | eoap_cwlwrap:_build_orchestrator_workflow:146 - * pattern-8/epsg: string

2025-12-02 12:47:55.777 | INFO     | eoap_cwlwrap:_build_orchestrator_workflow:146 - * pattern-8/bands: string[]

2025-12-02 12:47:55.778 | INFO     | eoap_cwlwrap:_build_orchestrator_workflow:146 - * pattern-8/item: Directory

2025-12-02 12:47:55.781 | INFO     | eoap_cwlwrap:_build_orchestrator_workflow:159 -   Directory type detected, creating a related 'directory_stage_in_0'...

2025-12-02 12:47:55.781 | INFO     | eoap_cwlwrap:_build_orchestrator_workflow:161 -   Converting Directory to URL-compatible type...

2025-12-02 12:47:55.782 | INFO     | eoap_cwlwrap:_build_orchestrator_workflow:165 -   Directory converted to https://raw.githubusercontent.com/eoap/schemas/main/string_format.yaml#URI

2025-12-02 12:47:55.783 | INFO     | eoap_cwlwrap:_build_orchestrator_workflow:206 -   Connecting 'app/item' to 'directory_stage_in_0' output...

2025-12-02 12:47:55.783 | INFO     | eoap_cwlwrap:_build_orchestrator_workflow:146 - * pattern-8/produce_output: boolean

2025-12-02 12:47:55.784 | INFO     | eoap_cwlwrap:_build_orchestrator_workflow:257 - Analyzing pattern-8 outputs...

2025-12-02 12:47:55.784 | INFO     | eoap_cwlwrap:_build_orchestrator_workflow:263 - * pattern-8/water_bodies: [ null, Directory ]

2025-12-02 12:47:55.785 | INFO     | eoap_cwlwrap:_build_orchestrator_workflow:268 -   Directory type detected, creating a related 'stage_out_0'...

2025-12-02 12:47:55.785 | INFO     | eoap_cwlwrap:_build_orchestrator_workflow:270 -   Converting [ null, Directory ] to URL-compatible type...

2025-12-02 12:47:55.786 | INFO     | eoap_cwlwrap:_build_orchestrator_workflow:274 -   [ null, Directory ] converted to [ null, https://raw.githubusercontent.com/eoap/schemas/main/string_format.yaml#URI ]

2025-12-02 12:47:55.787 | INFO     | eoap_cwlwrap:_build_orchestrator_workflow:306 -   Nullable detected, 'when' required for stac_catalog:app/water_bodies

2025-12-02 12:47:55.789 | INFO     | eoap_cwlwrap:_build_orchestrator_workflow:315 -   Connecting 'app/water_bodies' to 'stage_out_0' output...

2025-12-02 12:47:55.790 | INFO     | eoap_cwlwrap:_build_orchestrator_workflow:390 - Orchestrator Workflow built in 0.0153 seconds

No description has been provided for this image

Workflow components diagram¶

No description has been provided for this image

Inputs¶

Id	Type	Label	Doc
`aoi`	`string`	area of interest - pattern-8/aoi	area of interest as a bounding box - This parameter is derived from pattern-8/aoi
`epsg`	`string`	EPSG code - pattern-8/epsg	EPSG code - This parameter is derived from pattern-8/epsg
`bands`	`string[]`	bands used for the NDWI - pattern-8/bands	bands used for the NDWI - This parameter is derived from pattern-8/bands
`another_input`	`string`	Another Input - my-asthonishing-stage-in-directory/another_input	An additional input for demonstration purposes - This parameter is derived from my-asthonishing-stage-in-directory/another_input
`item`	`https://raw.githubusercontent.com/eoap/schemas/main/string_format.yaml#URI`	Landsat-8/9 acquisition reference - pattern-8/item	Landsat-8/9 acquisition reference - This parameter is derived from pattern-8/item
`produce_output`	`boolean`	Flag to produce the output - pattern-8/produce_output	Flag to produce the output - This parameter is derived from pattern-8/produce_output
`s3_bucket`	`string`	my-super-stage-out/s3_bucket	This parameter is derived from: my-super-stage-out/s3_bucket
`sub_path`	`string`	my-super-stage-out/sub_path	This parameter is derived from: my-super-stage-out/sub_path
`aws_access_key_id`	`string`	my-super-stage-out/aws_access_key_id	This parameter is derived from: my-super-stage-out/aws_access_key_id
`aws_secret_access_key`	`string`	my-super-stage-out/aws_secret_access_key	This parameter is derived from: my-super-stage-out/aws_secret_access_key
`region_name`	`string`	my-super-stage-out/region_name	This parameter is derived from: my-super-stage-out/region_name
`endpoint_url`	`string`	my-super-stage-out/endpoint_url	This parameter is derived from: my-super-stage-out/endpoint_url

Steps¶

Id	Runs	Label	Doc
`directory_stage_in_0`	`#my-asthonishing-stage-in-directory`	None	None
`app`	`#pattern-8`	None	None
`stage_out_0`	`#my-super-stage-out`	None	None

Outputs¶

Id	Type	Label	Doc
`water_bodies`	`[ null, https://raw.githubusercontent.com/eoap/schemas/main/string_format.yaml#URI ]`	Water bodies detected	Water bodies detected based on the NDWI and otsu threshold

Execution¶

Inputs¶

{
  "aoi": "-118.985,38.432,-118.183,38.938",
  "epsg": "EPSG:4326",
  "bands": [
    "green",
    "nir08"
  ],
  "item": {
    "class": "https://raw.githubusercontent.com/eoap/schemas/main/url.yaml#URL",
    "value": "https://planetarycomputer.microsoft.com/api/stac/v1/collections/landsat-c2-l2/items/LC08_L2SP_042033_20231007_02_T1"
  },
  "produce_output": true
}

Outputs¶

{
    "water_bodies": {
        "value": "s3://my-bucket/my/sub/path-8rgt4x/catalog.json",
        "type": "https://raw.githubusercontent.com/eoap/schemas/main/string_format.yaml#URI"
    }
}