Pattern 9
2025-12-02 12:48:19.005 | DEBUG | cwl_loader:load_cwl_from_location:228 - Loading CWL document from ../cwl-workflow/pattern-9.cwl...
2025-12-02 12:48:19.006 | DEBUG | cwl_loader:_load_cwl_from_stream:231 - Reading stream from ../cwl-workflow/pattern-9.cwl...
2025-12-02 12:48:19.028 | DEBUG | cwl_loader:load_cwl_from_stream:203 - CWL data of type <class 'ruamel.yaml.comments.CommentedMap'> successfully loaded from stream
2025-12-02 12:48:19.028 | DEBUG | cwl_loader:load_cwl_from_yaml:130 - Updating the model from version 'v1.0' to version 'v1.2'...
2025-12-02 12:48:19.029 | DEBUG | cwl_loader:load_cwl_from_yaml:141 - Raw CWL document successfully updated to v1.2!
2025-12-02 12:48:19.029 | DEBUG | cwl_loader:load_cwl_from_yaml:145 - Parsing the raw CWL document to the CWL Utils DOM...
2025-12-02 12:48:19.093 | DEBUG | cwl_loader:load_cwl_from_yaml:158 - Raw CWL document successfully parsed to the CWL Utils DOM!
2025-12-02 12:48:19.094 | DEBUG | cwl_loader:load_cwl_from_yaml:160 - Dereferencing the steps[].run...
2025-12-02 12:48:19.094 | DEBUG | cwl_loader:_on_process:78 - Checking if ../cwl-workflow/pattern-9.cwl#clt must be externally imported...
2025-12-02 12:48:19.095 | DEBUG | cwl_loader:_on_process:82 - run_url: ../cwl-workflow/pattern-9.cwl - uri: ../cwl-workflow/pattern-9.cwl
2025-12-02 12:48:19.096 | DEBUG | cwl_loader:load_cwl_from_yaml:167 - steps[].run successfully dereferenced! Dereferencing the FQNs...
2025-12-02 12:48:19.097 | DEBUG | cwl_loader:load_cwl_from_yaml:171 - CWL document successfully dereferenced! Now verifying steps[].run integrity...
2025-12-02 12:48:19.097 | DEBUG | cwl_loader:load_cwl_from_yaml:175 - All steps[].run link are resolvable!
2025-12-02 12:48:19.097 | DEBUG | cwl_loader:load_cwl_from_yaml:178 - Sorting Process instances by dependencies....
2025-12-02 12:48:19.098 | DEBUG | cwl_loader:load_cwl_from_yaml:180 - Sorting process is over.
2025-12-02 12:48:19.098 | DEBUG | cwl_loader:_load_cwl_from_stream:240 - Stream from ../cwl-workflow/pattern-9.cwl successfully load!
Application Package Pattern 9¶
The CWL includes:
- one input parameter of type
Directory - output parameter of type
Directory[]?
This scenario takes as input an acquisition, applies an algorithm and may or may not generate outputs
Inputs¶
| Id | Type | Label | Doc |
|---|---|---|---|
aoi |
string |
area of interest | area of interest as a bounding box |
epsg |
string |
EPSG code | EPSG code |
indexes |
string[] |
indexes | indexes to compute |
item |
Directory |
Landsat-8/9 acquisition reference | Landsat-8/9 acquisition reference |
Steps¶
| Id | Runs | Label | Doc |
|---|---|---|---|
step |
#clt |
None | None |
Outputs¶
| Id | Type | Label | Doc |
|---|---|---|---|
vegetation_indexes |
[ null, Directory[] ] |
Vegetation indexes | Vegetation indexes |
Data flow management¶
2025-12-02 12:48:19.762 | DEBUG | cwl_loader:load_cwl_from_location:228 - Loading CWL document from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/develop/templates/stage-in.cwl...
2025-12-02 12:48:19.796 | DEBUG | cwl_loader:_load_cwl_from_stream:231 - Reading stream from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/develop/templates/stage-in.cwl...
2025-12-02 12:48:19.802 | DEBUG | cwl_loader:load_cwl_from_stream:203 - CWL data of type <class 'ruamel.yaml.comments.CommentedMap'> successfully loaded from stream
2025-12-02 12:48:19.802 | DEBUG | cwl_loader:load_cwl_from_yaml:130 - Updating the model from version 'v1.0' to version 'v1.2'...
2025-12-02 12:48:19.803 | DEBUG | cwl_loader:load_cwl_from_yaml:141 - Raw CWL document successfully updated to v1.2!
2025-12-02 12:48:19.804 | DEBUG | cwl_loader:load_cwl_from_yaml:145 - Parsing the raw CWL document to the CWL Utils DOM...
2025-12-02 12:48:19.963 | DEBUG | cwl_loader:load_cwl_from_yaml:158 - Raw CWL document successfully parsed to the CWL Utils DOM!
2025-12-02 12:48:19.964 | DEBUG | cwl_loader:load_cwl_from_yaml:160 - Dereferencing the steps[].run...
2025-12-02 12:48:19.964 | DEBUG | cwl_loader:load_cwl_from_yaml:167 - steps[].run successfully dereferenced! Dereferencing the FQNs...
2025-12-02 12:48:19.965 | DEBUG | cwl_loader:load_cwl_from_yaml:171 - CWL document successfully dereferenced! Now verifying steps[].run integrity...
2025-12-02 12:48:19.965 | DEBUG | cwl_loader:load_cwl_from_yaml:175 - All steps[].run link are resolvable!
2025-12-02 12:48:19.966 | DEBUG | cwl_loader:load_cwl_from_yaml:178 - Sorting Process instances by dependencies....
2025-12-02 12:48:19.966 | DEBUG | cwl_loader:load_cwl_from_yaml:180 - Sorting process is over.
2025-12-02 12:48:19.967 | DEBUG | cwl_loader:_load_cwl_from_stream:240 - Stream from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/develop/templates/stage-in.cwl successfully load!
2025-12-02 12:48:19.967 | DEBUG | cwl_loader:load_cwl_from_location:228 - Loading CWL document from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/develop/templates/stage-in-file.cwl...
2025-12-02 12:48:20.002 | DEBUG | cwl_loader:_load_cwl_from_stream:231 - Reading stream from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/develop/templates/stage-in-file.cwl...
2025-12-02 12:48:20.008 | DEBUG | cwl_loader:load_cwl_from_stream:203 - CWL data of type <class 'ruamel.yaml.comments.CommentedMap'> successfully loaded from stream
2025-12-02 12:48:20.008 | DEBUG | cwl_loader:load_cwl_from_yaml:130 - Updating the model from version 'v1.0' to version 'v1.2'...
2025-12-02 12:48:20.009 | DEBUG | cwl_loader:load_cwl_from_yaml:141 - Raw CWL document successfully updated to v1.2!
2025-12-02 12:48:20.010 | DEBUG | cwl_loader:load_cwl_from_yaml:145 - Parsing the raw CWL document to the CWL Utils DOM...
2025-12-02 12:48:20.157 | DEBUG | cwl_loader:load_cwl_from_yaml:158 - Raw CWL document successfully parsed to the CWL Utils DOM!
2025-12-02 12:48:20.158 | DEBUG | cwl_loader:load_cwl_from_yaml:160 - Dereferencing the steps[].run...
2025-12-02 12:48:20.158 | DEBUG | cwl_loader:load_cwl_from_yaml:167 - steps[].run successfully dereferenced! Dereferencing the FQNs...
2025-12-02 12:48:20.159 | DEBUG | cwl_loader:load_cwl_from_yaml:171 - CWL document successfully dereferenced! Now verifying steps[].run integrity...
2025-12-02 12:48:20.160 | DEBUG | cwl_loader:load_cwl_from_yaml:175 - All steps[].run link are resolvable!
2025-12-02 12:48:20.160 | DEBUG | cwl_loader:load_cwl_from_yaml:178 - Sorting Process instances by dependencies....
2025-12-02 12:48:20.160 | DEBUG | cwl_loader:load_cwl_from_yaml:180 - Sorting process is over.
2025-12-02 12:48:20.161 | DEBUG | cwl_loader:_load_cwl_from_stream:240 - Stream from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/develop/templates/stage-in-file.cwl successfully load!
2025-12-02 12:48:20.161 | DEBUG | cwl_loader:load_cwl_from_location:228 - Loading CWL document from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/develop/templates/stage-out.cwl...
2025-12-02 12:48:20.194 | DEBUG | cwl_loader:_load_cwl_from_stream:231 - Reading stream from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/develop/templates/stage-out.cwl...
2025-12-02 12:48:20.203 | DEBUG | cwl_loader:load_cwl_from_stream:203 - CWL data of type <class 'ruamel.yaml.comments.CommentedMap'> successfully loaded from stream
2025-12-02 12:48:20.204 | DEBUG | cwl_loader:load_cwl_from_yaml:130 - Updating the model from version 'v1.0' to version 'v1.2'...
2025-12-02 12:48:20.204 | DEBUG | cwl_loader:load_cwl_from_yaml:141 - Raw CWL document successfully updated to v1.2!
2025-12-02 12:48:20.205 | DEBUG | cwl_loader:load_cwl_from_yaml:145 - Parsing the raw CWL document to the CWL Utils DOM...
2025-12-02 12:48:20.374 | DEBUG | cwl_loader:load_cwl_from_yaml:158 - Raw CWL document successfully parsed to the CWL Utils DOM!
2025-12-02 12:48:20.375 | DEBUG | cwl_loader:load_cwl_from_yaml:160 - Dereferencing the steps[].run...
2025-12-02 12:48:20.375 | DEBUG | cwl_loader:load_cwl_from_yaml:167 - steps[].run successfully dereferenced! Dereferencing the FQNs...
2025-12-02 12:48:20.376 | DEBUG | cwl_loader:load_cwl_from_yaml:171 - CWL document successfully dereferenced! Now verifying steps[].run integrity...
2025-12-02 12:48:20.376 | DEBUG | cwl_loader:load_cwl_from_yaml:175 - All steps[].run link are resolvable!
2025-12-02 12:48:20.377 | DEBUG | cwl_loader:load_cwl_from_yaml:178 - Sorting Process instances by dependencies....
2025-12-02 12:48:20.377 | DEBUG | cwl_loader:load_cwl_from_yaml:180 - Sorting process is over.
2025-12-02 12:48:20.377 | DEBUG | cwl_loader:_load_cwl_from_stream:240 - Stream from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/develop/templates/stage-out.cwl successfully load!
2025-12-02 12:48:20.378 | INFO | eoap_cwlwrap.types:_validate_stage_in:281 - Validating stage-in 'my-asthonishing-stage-in-directory'...
2025-12-02 12:48:20.378 | INFO | eoap_cwlwrap.types:_validate_stage_in:303 - stage-in 'my-asthonishing-stage-in-directory' is valid
2025-12-02 12:48:20.379 | INFO | eoap_cwlwrap.types:_validate_stage_in:281 - Validating stage-in 'my-asthonishing-stage-in-file'...
2025-12-02 12:48:20.379 | INFO | eoap_cwlwrap.types:_validate_stage_in:303 - stage-in 'my-asthonishing-stage-in-file' is valid
2025-12-02 12:48:20.380 | INFO | eoap_cwlwrap.types:validate_stage_out:339 - Validating stage-out 'my-super-stage-out'...
2025-12-02 12:48:20.380 | INFO | eoap_cwlwrap.types:validate_stage_out:361 - stage-out 'my-super-stage-out' is valid
2025-12-02 12:48:20.380 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:101 - Building the CWL Orchestrator Workflow...
2025-12-02 12:48:20.381 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:130 - Analyzing pattern-9 inputs...
2025-12-02 12:48:20.382 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:146 - * pattern-9/aoi: string
2025-12-02 12:48:20.382 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:146 - * pattern-9/epsg: string
2025-12-02 12:48:20.383 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:146 - * pattern-9/indexes: string[]
2025-12-02 12:48:20.383 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:146 - * pattern-9/item: Directory
2025-12-02 12:48:20.384 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:159 - Directory type detected, creating a related 'directory_stage_in_0'...
2025-12-02 12:48:20.384 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:161 - Converting Directory to URL-compatible type...
2025-12-02 12:48:20.386 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:165 - Directory converted to https://raw.githubusercontent.com/eoap/schemas/main/string_format.yaml#URI
2025-12-02 12:48:20.387 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:206 - Connecting 'app/item' to 'directory_stage_in_0' output...
2025-12-02 12:48:20.388 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:257 - Analyzing pattern-9 outputs...
2025-12-02 12:48:20.388 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:263 - * pattern-9/vegetation_indexes: [ null, Directory[] ]
2025-12-02 12:48:20.388 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:268 - Directory type detected, creating a related 'stage_out_0'...
2025-12-02 12:48:20.389 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:270 - Converting [ null, Directory[] ] to URL-compatible type...
2025-12-02 12:48:20.389 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:274 - [ null, Directory[] ] converted to [ null, https://raw.githubusercontent.com/eoap/schemas/main/string_format.yaml#URI[] ]
2025-12-02 12:48:20.391 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:295 - Array detected, scatter required for stac_catalog:app/vegetation_indexes
2025-12-02 12:48:20.391 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:306 - Nullable detected, 'when' required for stac_catalog:app/vegetation_indexes
2025-12-02 12:48:20.392 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:315 - Connecting 'app/vegetation_indexes' to 'stage_out_0' output...
2025-12-02 12:48:20.392 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:390 - Orchestrator Workflow built in 0.0120 seconds
Workflow components diagram¶
Inputs¶
| Id | Type | Label | Doc |
|---|---|---|---|
aoi |
string |
area of interest - pattern-9/aoi | area of interest as a bounding box - This parameter is derived from pattern-9/aoi |
epsg |
string |
EPSG code - pattern-9/epsg | EPSG code - This parameter is derived from pattern-9/epsg |
indexes |
string[] |
indexes - pattern-9/indexes | indexes to compute - This parameter is derived from pattern-9/indexes |
another_input |
string |
Another Input - my-asthonishing-stage-in-directory/another_input | An additional input for demonstration purposes - This parameter is derived from my-asthonishing-stage-in-directory/another_input |
item |
https://raw.githubusercontent.com/eoap/schemas/main/string_format.yaml#URI |
Landsat-8/9 acquisition reference - pattern-9/item | Landsat-8/9 acquisition reference - This parameter is derived from pattern-9/item |
s3_bucket |
string |
my-super-stage-out/s3_bucket | This parameter is derived from: my-super-stage-out/s3_bucket |
sub_path |
string |
my-super-stage-out/sub_path | This parameter is derived from: my-super-stage-out/sub_path |
aws_access_key_id |
string |
my-super-stage-out/aws_access_key_id | This parameter is derived from: my-super-stage-out/aws_access_key_id |
aws_secret_access_key |
string |
my-super-stage-out/aws_secret_access_key | This parameter is derived from: my-super-stage-out/aws_secret_access_key |
region_name |
string |
my-super-stage-out/region_name | This parameter is derived from: my-super-stage-out/region_name |
endpoint_url |
string |
my-super-stage-out/endpoint_url | This parameter is derived from: my-super-stage-out/endpoint_url |
Steps¶
| Id | Runs | Label | Doc |
|---|---|---|---|
directory_stage_in_0 |
#my-asthonishing-stage-in-directory |
None | None |
app |
#pattern-9 |
None | None |
stage_out_0 |
#my-super-stage-out |
None | None |
Outputs¶
| Id | Type | Label | Doc |
|---|---|---|---|
vegetation_indexes |
[ null, https://raw.githubusercontent.com/eoap/schemas/main/string_format.yaml#URI[] ] |
Vegetation indexes | Vegetation indexes |
Execution¶
Inputs¶
{
"aoi": "-118.985,38.432,-118.183,38.938",
"epsg": "EPSG:4326",
"indexes": [
"ndvi",
"none"
],
"item": {
"class": "https://raw.githubusercontent.com/eoap/schemas/main/url.yaml#URL",
"value": "https://planetarycomputer.microsoft.com/api/stac/v1/collections/landsat-c2-l2/items/LC08_L2SP_042033_20231007_02_T1"
}
}
Outputs¶
{
"vegetation_indexes": [
{
"value": "s3://my-bucket/my/sub/path-pyvpz3/catalog.json",
"type": "https://raw.githubusercontent.com/eoap/schemas/main/string_format.yaml#URI"
},
null
]
}