Pattern 11
2025-12-02 12:43:29.615 | DEBUG | cwl_loader:load_cwl_from_location:228 - Loading CWL document from ../cwl-workflow/pattern-11.cwl...
2025-12-02 12:43:29.616 | DEBUG | cwl_loader:_load_cwl_from_stream:231 - Reading stream from ../cwl-workflow/pattern-11.cwl...
2025-12-02 12:43:29.639 | DEBUG | cwl_loader:load_cwl_from_stream:203 - CWL data of type <class 'ruamel.yaml.comments.CommentedMap'> successfully loaded from stream
2025-12-02 12:43:29.640 | DEBUG | cwl_loader:load_cwl_from_yaml:130 - Updating the model from version 'v1.0' to version 'v1.2'...
2025-12-02 12:43:29.640 | DEBUG | cwl_loader:load_cwl_from_yaml:141 - Raw CWL document successfully updated to v1.2!
2025-12-02 12:43:29.641 | DEBUG | cwl_loader:load_cwl_from_yaml:145 - Parsing the raw CWL document to the CWL Utils DOM...
2025-12-02 12:43:29.709 | DEBUG | cwl_loader:load_cwl_from_yaml:158 - Raw CWL document successfully parsed to the CWL Utils DOM!
2025-12-02 12:43:29.709 | DEBUG | cwl_loader:load_cwl_from_yaml:160 - Dereferencing the steps[].run...
2025-12-02 12:43:29.710 | DEBUG | cwl_loader:_on_process:78 - Checking if ../cwl-workflow/pattern-11.cwl#clt must be externally imported...
2025-12-02 12:43:29.710 | DEBUG | cwl_loader:_on_process:82 - run_url: ../cwl-workflow/pattern-11.cwl - uri: ../cwl-workflow/pattern-11.cwl
2025-12-02 12:43:29.710 | DEBUG | cwl_loader:load_cwl_from_yaml:167 - steps[].run successfully dereferenced! Dereferencing the FQNs...
2025-12-02 12:43:29.711 | DEBUG | cwl_loader:load_cwl_from_yaml:171 - CWL document successfully dereferenced! Now verifying steps[].run integrity...
2025-12-02 12:43:29.711 | DEBUG | cwl_loader:load_cwl_from_yaml:175 - All steps[].run link are resolvable!
2025-12-02 12:43:29.712 | DEBUG | cwl_loader:load_cwl_from_yaml:178 - Sorting Process instances by dependencies....
2025-12-02 12:43:29.712 | DEBUG | cwl_loader:load_cwl_from_yaml:180 - Sorting process is over.
2025-12-02 12:43:29.712 | DEBUG | cwl_loader:_load_cwl_from_stream:240 - Stream from ../cwl-workflow/pattern-11.cwl successfully load!
Application Package Pattern-11¶
This pattern uses as input a File and a Directory
Inputs¶
| Id | Type | Label | Doc |
|---|---|---|---|
aoi |
string |
area of interest | area of interest as a bounding box |
epsg |
string |
EPSG code | EPSG code |
bands |
string[] |
bands used for the NDWI | bands used for the NDWI |
item |
Directory |
Landsat-8/9 acquisition reference | Landsat-8/9 acquisition reference |
dem |
File |
Digital Elevation Model (DEM) | Digital Elevation Model (DEM) geotiff |
Steps¶
| Id | Runs | Label | Doc |
|---|---|---|---|
step |
#clt |
None | None |
Outputs¶
| Id | Type | Label | Doc |
|---|---|---|---|
water_bodies |
Directory |
Water bodies detected | Water bodies detected based on the NDWI and otsu threshold |
Data flow management¶
2025-12-02 12:43:30.373 | DEBUG | cwl_loader:load_cwl_from_location:228 - Loading CWL document from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/develop/templates/stage-in.cwl...
2025-12-02 12:43:30.407 | DEBUG | cwl_loader:_load_cwl_from_stream:231 - Reading stream from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/develop/templates/stage-in.cwl...
2025-12-02 12:43:30.413 | DEBUG | cwl_loader:load_cwl_from_stream:203 - CWL data of type <class 'ruamel.yaml.comments.CommentedMap'> successfully loaded from stream
2025-12-02 12:43:30.414 | DEBUG | cwl_loader:load_cwl_from_yaml:130 - Updating the model from version 'v1.0' to version 'v1.2'...
2025-12-02 12:43:30.414 | DEBUG | cwl_loader:load_cwl_from_yaml:141 - Raw CWL document successfully updated to v1.2!
2025-12-02 12:43:30.415 | DEBUG | cwl_loader:load_cwl_from_yaml:145 - Parsing the raw CWL document to the CWL Utils DOM...
2025-12-02 12:43:30.571 | DEBUG | cwl_loader:load_cwl_from_yaml:158 - Raw CWL document successfully parsed to the CWL Utils DOM!
2025-12-02 12:43:30.571 | DEBUG | cwl_loader:load_cwl_from_yaml:160 - Dereferencing the steps[].run...
2025-12-02 12:43:30.572 | DEBUG | cwl_loader:load_cwl_from_yaml:167 - steps[].run successfully dereferenced! Dereferencing the FQNs...
2025-12-02 12:43:30.572 | DEBUG | cwl_loader:load_cwl_from_yaml:171 - CWL document successfully dereferenced! Now verifying steps[].run integrity...
2025-12-02 12:43:30.574 | DEBUG | cwl_loader:load_cwl_from_yaml:175 - All steps[].run link are resolvable!
2025-12-02 12:43:30.574 | DEBUG | cwl_loader:load_cwl_from_yaml:178 - Sorting Process instances by dependencies....
2025-12-02 12:43:30.575 | DEBUG | cwl_loader:load_cwl_from_yaml:180 - Sorting process is over.
2025-12-02 12:43:30.575 | DEBUG | cwl_loader:_load_cwl_from_stream:240 - Stream from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/develop/templates/stage-in.cwl successfully load!
2025-12-02 12:43:30.576 | DEBUG | cwl_loader:load_cwl_from_location:228 - Loading CWL document from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/develop/templates/stage-in-file.cwl...
2025-12-02 12:43:30.609 | DEBUG | cwl_loader:_load_cwl_from_stream:231 - Reading stream from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/develop/templates/stage-in-file.cwl...
2025-12-02 12:43:30.615 | DEBUG | cwl_loader:load_cwl_from_stream:203 - CWL data of type <class 'ruamel.yaml.comments.CommentedMap'> successfully loaded from stream
2025-12-02 12:43:30.615 | DEBUG | cwl_loader:load_cwl_from_yaml:130 - Updating the model from version 'v1.0' to version 'v1.2'...
2025-12-02 12:43:30.616 | DEBUG | cwl_loader:load_cwl_from_yaml:141 - Raw CWL document successfully updated to v1.2!
2025-12-02 12:43:30.617 | DEBUG | cwl_loader:load_cwl_from_yaml:145 - Parsing the raw CWL document to the CWL Utils DOM...
2025-12-02 12:43:30.773 | DEBUG | cwl_loader:load_cwl_from_yaml:158 - Raw CWL document successfully parsed to the CWL Utils DOM!
2025-12-02 12:43:30.774 | DEBUG | cwl_loader:load_cwl_from_yaml:160 - Dereferencing the steps[].run...
2025-12-02 12:43:30.774 | DEBUG | cwl_loader:load_cwl_from_yaml:167 - steps[].run successfully dereferenced! Dereferencing the FQNs...
2025-12-02 12:43:30.775 | DEBUG | cwl_loader:load_cwl_from_yaml:171 - CWL document successfully dereferenced! Now verifying steps[].run integrity...
2025-12-02 12:43:30.775 | DEBUG | cwl_loader:load_cwl_from_yaml:175 - All steps[].run link are resolvable!
2025-12-02 12:43:30.775 | DEBUG | cwl_loader:load_cwl_from_yaml:178 - Sorting Process instances by dependencies....
2025-12-02 12:43:30.776 | DEBUG | cwl_loader:load_cwl_from_yaml:180 - Sorting process is over.
2025-12-02 12:43:30.776 | DEBUG | cwl_loader:_load_cwl_from_stream:240 - Stream from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/develop/templates/stage-in-file.cwl successfully load!
2025-12-02 12:43:30.777 | DEBUG | cwl_loader:load_cwl_from_location:228 - Loading CWL document from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/develop/templates/stage-out.cwl...
2025-12-02 12:43:30.810 | DEBUG | cwl_loader:_load_cwl_from_stream:231 - Reading stream from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/develop/templates/stage-out.cwl...
2025-12-02 12:43:30.819 | DEBUG | cwl_loader:load_cwl_from_stream:203 - CWL data of type <class 'ruamel.yaml.comments.CommentedMap'> successfully loaded from stream
2025-12-02 12:43:30.819 | DEBUG | cwl_loader:load_cwl_from_yaml:130 - Updating the model from version 'v1.0' to version 'v1.2'...
2025-12-02 12:43:30.820 | DEBUG | cwl_loader:load_cwl_from_yaml:141 - Raw CWL document successfully updated to v1.2!
2025-12-02 12:43:30.820 | DEBUG | cwl_loader:load_cwl_from_yaml:145 - Parsing the raw CWL document to the CWL Utils DOM...
2025-12-02 12:43:31.004 | DEBUG | cwl_loader:load_cwl_from_yaml:158 - Raw CWL document successfully parsed to the CWL Utils DOM!
2025-12-02 12:43:31.005 | DEBUG | cwl_loader:load_cwl_from_yaml:160 - Dereferencing the steps[].run...
2025-12-02 12:43:31.005 | DEBUG | cwl_loader:load_cwl_from_yaml:167 - steps[].run successfully dereferenced! Dereferencing the FQNs...
2025-12-02 12:43:31.006 | DEBUG | cwl_loader:load_cwl_from_yaml:171 - CWL document successfully dereferenced! Now verifying steps[].run integrity...
2025-12-02 12:43:31.006 | DEBUG | cwl_loader:load_cwl_from_yaml:175 - All steps[].run link are resolvable!
2025-12-02 12:43:31.007 | DEBUG | cwl_loader:load_cwl_from_yaml:178 - Sorting Process instances by dependencies....
2025-12-02 12:43:31.008 | DEBUG | cwl_loader:load_cwl_from_yaml:180 - Sorting process is over.
2025-12-02 12:43:31.009 | DEBUG | cwl_loader:_load_cwl_from_stream:240 - Stream from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/develop/templates/stage-out.cwl successfully load!
2025-12-02 12:43:31.010 | INFO | eoap_cwlwrap.types:_validate_stage_in:281 - Validating stage-in 'my-asthonishing-stage-in-directory'...
2025-12-02 12:43:31.010 | INFO | eoap_cwlwrap.types:_validate_stage_in:303 - stage-in 'my-asthonishing-stage-in-directory' is valid
2025-12-02 12:43:31.010 | INFO | eoap_cwlwrap.types:_validate_stage_in:281 - Validating stage-in 'my-asthonishing-stage-in-file'...
2025-12-02 12:43:31.011 | INFO | eoap_cwlwrap.types:_validate_stage_in:303 - stage-in 'my-asthonishing-stage-in-file' is valid
2025-12-02 12:43:31.011 | INFO | eoap_cwlwrap.types:validate_stage_out:339 - Validating stage-out 'my-super-stage-out'...
2025-12-02 12:43:31.012 | INFO | eoap_cwlwrap.types:validate_stage_out:361 - stage-out 'my-super-stage-out' is valid
2025-12-02 12:43:31.012 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:101 - Building the CWL Orchestrator Workflow...
2025-12-02 12:43:31.013 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:130 - Analyzing pattern-11 inputs...
2025-12-02 12:43:31.013 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:146 - * pattern-11/aoi: string
2025-12-02 12:43:31.014 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:146 - * pattern-11/epsg: string
2025-12-02 12:43:31.014 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:146 - * pattern-11/bands: string[]
2025-12-02 12:43:31.015 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:146 - * pattern-11/item: Directory
2025-12-02 12:43:31.015 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:159 - Directory type detected, creating a related 'directory_stage_in_0'...
2025-12-02 12:43:31.016 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:161 - Converting Directory to URL-compatible type...
2025-12-02 12:43:31.016 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:165 - Directory converted to https://raw.githubusercontent.com/eoap/schemas/main/string_format.yaml#URI
2025-12-02 12:43:31.017 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:206 - Connecting 'app/item' to 'directory_stage_in_0' output...
2025-12-02 12:43:31.018 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:146 - * pattern-11/dem: File
2025-12-02 12:43:31.018 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:159 - File type detected, creating a related 'file_stage_in_0'...
2025-12-02 12:43:31.018 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:161 - Converting File to URL-compatible type...
2025-12-02 12:43:31.019 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:165 - File converted to https://raw.githubusercontent.com/eoap/schemas/main/string_format.yaml#URI
2025-12-02 12:43:31.019 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:206 - Connecting 'app/dem' to 'file_stage_in_0' output...
2025-12-02 12:43:31.020 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:257 - Analyzing pattern-11 outputs...
2025-12-02 12:43:31.020 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:263 - * pattern-11/water_bodies: Directory
2025-12-02 12:43:31.021 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:268 - Directory type detected, creating a related 'stage_out_0'...
2025-12-02 12:43:31.021 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:270 - Converting Directory to URL-compatible type...
2025-12-02 12:43:31.021 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:274 - Directory converted to https://raw.githubusercontent.com/eoap/schemas/main/string_format.yaml#URI
2025-12-02 12:43:31.023 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:315 - Connecting 'app/water_bodies' to 'stage_out_0' output...
2025-12-02 12:43:31.023 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:390 - Orchestrator Workflow built in 0.0112 seconds
Workflow components diagram¶
Inputs¶
| Id | Type | Label | Doc |
|---|---|---|---|
aoi |
string |
area of interest - pattern-11/aoi | area of interest as a bounding box - This parameter is derived from pattern-11/aoi |
epsg |
string |
EPSG code - pattern-11/epsg | EPSG code - This parameter is derived from pattern-11/epsg |
bands |
string[] |
bands used for the NDWI - pattern-11/bands | bands used for the NDWI - This parameter is derived from pattern-11/bands |
another_input |
string |
Another Input - my-asthonishing-stage-in-directory/another_input | An additional input for demonstration purposes - This parameter is derived from my-asthonishing-stage-in-directory/another_input |
item |
https://raw.githubusercontent.com/eoap/schemas/main/string_format.yaml#URI |
Landsat-8/9 acquisition reference - pattern-11/item | Landsat-8/9 acquisition reference - This parameter is derived from pattern-11/item |
another_input |
string |
Another Input - my-asthonishing-stage-in-file/another_input | An additional input for demonstration purposes - This parameter is derived from my-asthonishing-stage-in-file/another_input |
dem |
https://raw.githubusercontent.com/eoap/schemas/main/string_format.yaml#URI |
Digital Elevation Model (DEM) - pattern-11/dem | Digital Elevation Model (DEM) geotiff - This parameter is derived from pattern-11/dem |
s3_bucket |
string |
my-super-stage-out/s3_bucket | This parameter is derived from: my-super-stage-out/s3_bucket |
sub_path |
string |
my-super-stage-out/sub_path | This parameter is derived from: my-super-stage-out/sub_path |
aws_access_key_id |
string |
my-super-stage-out/aws_access_key_id | This parameter is derived from: my-super-stage-out/aws_access_key_id |
aws_secret_access_key |
string |
my-super-stage-out/aws_secret_access_key | This parameter is derived from: my-super-stage-out/aws_secret_access_key |
region_name |
string |
my-super-stage-out/region_name | This parameter is derived from: my-super-stage-out/region_name |
endpoint_url |
string |
my-super-stage-out/endpoint_url | This parameter is derived from: my-super-stage-out/endpoint_url |
Steps¶
| Id | Runs | Label | Doc |
|---|---|---|---|
directory_stage_in_0 |
#my-asthonishing-stage-in-directory |
None | None |
file_stage_in_0 |
#my-asthonishing-stage-in-file |
None | None |
app |
#pattern-11 |
None | None |
stage_out_0 |
#my-super-stage-out |
None | None |
Outputs¶
| Id | Type | Label | Doc |
|---|---|---|---|
water_bodies |
https://raw.githubusercontent.com/eoap/schemas/main/string_format.yaml#URI |
Water bodies detected | Water bodies detected based on the NDWI and otsu threshold |
Execution¶
Inputs¶
{
"aoi": "-118.985,38.432,-118.183,38.938",
"epsg": "EPSG:4326",
"bands": [
"green",
"nir08"
],
"item": {
"class": "https://raw.githubusercontent.com/eoap/schemas/main/url.yaml#URL",
"value": "https://planetarycomputer.microsoft.com/api/stac/v1/collections/landsat-c2-l2/items/LC08_L2SP_042033_20231007_02_T1"
},
"dem": {
"class": "https://raw.githubusercontent.com/eoap/schemas/main/url.yaml#URL",
"value": "https://elevationeuwest.blob.core.windows.net/copernicus-dem/COP30_hh/Copernicus_DSM_COG_10_N38_00_W119_00_DEM.tif"
}
}
Error: No such object: ghcr.io/eoap/application-package-patterns/vegetation-indexes:0.1.1
Outputs¶
{
"water_bodies": {
"value": "s3://my-bucket/my/sub/path-0wdlto/catalog.json",
"type": "https://raw.githubusercontent.com/eoap/schemas/main/string_format.yaml#URI"
}
}