Pattern 9
2025-09-08 11:02:17.939 | DEBUG | cwl_loader:load_cwl_from_location:196 - Loading CWL document from ../cwl-workflow/pattern-9.cwl...
2025-09-08 11:02:17.940 | DEBUG | cwl_loader:_load_cwl_from_stream:199 - Reading stream from ../cwl-workflow/pattern-9.cwl...
2025-09-08 11:02:17.956 | DEBUG | cwl_loader:load_cwl_from_stream:173 - CWL data of type <class 'ruamel.yaml.comments.CommentedMap'> successfully loaded from stream
2025-09-08 11:02:17.956 | DEBUG | cwl_loader:load_cwl_from_yaml:124 - Updating the model of type 'CommentedMap' to version 'v1.2'...
2025-09-08 11:02:17.961 | DEBUG | cwl_loader:load_cwl_from_yaml:135 - Raw CWL document successfully updated to v1.2! Now converting to the CWL model...
2025-09-08 11:02:17.969 | DEBUG | cwl_loader:load_cwl_from_yaml:143 - Raw CWL document successfully updated to v1.2! Now dereferencing the FQNs...
2025-09-08 11:02:17.970 | DEBUG | cwl_loader:_clean_process:66 - Cleaning Workflow pattern-9...
2025-09-08 11:02:17.970 | DEBUG | cwl_loader:_clean_process:66 - Cleaning CommandLineTool clt...
2025-09-08 11:02:17.971 | DEBUG | cwl_loader:load_cwl_from_yaml:151 - CWL document successfully dereferenced!
2025-09-08 11:02:17.971 | DEBUG | cwl_loader:_load_cwl_from_stream:207 - Stream from ../cwl-workflow/pattern-9.cwl successfully load!
Application Package Pattern 9¶
The CWL includes:
- one input parameter of type
Directory
- output parameter of type
Directory[]?
This scenario takes as input an acquisition, applies an algorithm and may or may not generate outputs
Inputs¶
Id | Type | Label | Doc |
---|---|---|---|
aoi |
string |
area of interest | area of interest as a bounding box |
epsg |
string |
EPSG code | EPSG code |
indexes |
string[] |
indexes | indexes to compute |
item |
Directory |
Landsat-8/9 acquisition reference | Landsat-8/9 acquisition reference |
Steps¶
Id | Runs | Label | Doc |
---|---|---|---|
step |
#clt |
None | None |
Outputs¶
Id | Type | Label | Doc |
---|---|---|---|
vegetation_indexes |
[ null, Directory[] ] |
Vegetation indexes | Vegetation indexes |
Data flow management¶
2025-09-08 11:02:18.660 | DEBUG | cwl_loader:load_cwl_from_location:196 - Loading CWL document from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/develop/templates/stage-in.cwl...
2025-09-08 11:02:18.695 | DEBUG | cwl_loader:_load_cwl_from_stream:199 - Reading stream from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/develop/templates/stage-in.cwl...
2025-09-08 11:02:18.702 | DEBUG | cwl_loader:load_cwl_from_stream:173 - CWL data of type <class 'ruamel.yaml.comments.CommentedMap'> successfully loaded from stream
2025-09-08 11:02:18.702 | DEBUG | cwl_loader:load_cwl_from_yaml:124 - Updating the model of type 'CommentedMap' to version 'v1.2'...
2025-09-08 11:02:18.703 | DEBUG | cwl_loader:load_cwl_from_yaml:135 - Raw CWL document successfully updated to v1.2! Now converting to the CWL model...
2025-09-08 11:02:18.851 | DEBUG | cwl_loader:load_cwl_from_yaml:143 - Raw CWL document successfully updated to v1.2! Now dereferencing the FQNs...
2025-09-08 11:02:18.852 | DEBUG | cwl_loader:_clean_process:66 - Cleaning CommandLineTool my-asthonishing-stage-in-directory...
2025-09-08 11:02:18.853 | DEBUG | cwl_loader:load_cwl_from_yaml:151 - CWL document successfully dereferenced!
2025-09-08 11:02:18.853 | DEBUG | cwl_loader:_load_cwl_from_stream:207 - Stream from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/develop/templates/stage-in.cwl successfully load!
2025-09-08 11:02:18.853 | DEBUG | cwl_loader:load_cwl_from_location:196 - Loading CWL document from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/develop/templates/stage-in-file.cwl...
2025-09-08 11:02:18.884 | DEBUG | cwl_loader:_load_cwl_from_stream:199 - Reading stream from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/develop/templates/stage-in-file.cwl...
2025-09-08 11:02:18.890 | DEBUG | cwl_loader:load_cwl_from_stream:173 - CWL data of type <class 'ruamel.yaml.comments.CommentedMap'> successfully loaded from stream
2025-09-08 11:02:18.890 | DEBUG | cwl_loader:load_cwl_from_yaml:124 - Updating the model of type 'CommentedMap' to version 'v1.2'...
2025-09-08 11:02:18.891 | DEBUG | cwl_loader:load_cwl_from_yaml:135 - Raw CWL document successfully updated to v1.2! Now converting to the CWL model...
2025-09-08 11:02:19.023 | DEBUG | cwl_loader:load_cwl_from_yaml:143 - Raw CWL document successfully updated to v1.2! Now dereferencing the FQNs...
2025-09-08 11:02:19.023 | DEBUG | cwl_loader:_clean_process:66 - Cleaning CommandLineTool my-asthonishing-stage-in-file...
2025-09-08 11:02:19.024 | DEBUG | cwl_loader:load_cwl_from_yaml:151 - CWL document successfully dereferenced!
2025-09-08 11:02:19.025 | DEBUG | cwl_loader:_load_cwl_from_stream:207 - Stream from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/develop/templates/stage-in-file.cwl successfully load!
2025-09-08 11:02:19.026 | DEBUG | cwl_loader:load_cwl_from_location:196 - Loading CWL document from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/develop/templates/stage-out.cwl...
2025-09-08 11:02:19.059 | DEBUG | cwl_loader:_load_cwl_from_stream:199 - Reading stream from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/develop/templates/stage-out.cwl...
2025-09-08 11:02:19.069 | DEBUG | cwl_loader:load_cwl_from_stream:173 - CWL data of type <class 'ruamel.yaml.comments.CommentedMap'> successfully loaded from stream
2025-09-08 11:02:19.069 | DEBUG | cwl_loader:load_cwl_from_yaml:124 - Updating the model of type 'CommentedMap' to version 'v1.2'...
2025-09-08 11:02:19.070 | DEBUG | cwl_loader:load_cwl_from_yaml:135 - Raw CWL document successfully updated to v1.2! Now converting to the CWL model...
2025-09-08 11:02:19.215 | DEBUG | cwl_loader:load_cwl_from_yaml:143 - Raw CWL document successfully updated to v1.2! Now dereferencing the FQNs...
2025-09-08 11:02:19.216 | DEBUG | cwl_loader:_clean_process:66 - Cleaning CommandLineTool my-super-stage-out...
2025-09-08 11:02:19.217 | DEBUG | cwl_loader:load_cwl_from_yaml:151 - CWL document successfully dereferenced!
2025-09-08 11:02:19.217 | DEBUG | cwl_loader:_load_cwl_from_stream:207 - Stream from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/develop/templates/stage-out.cwl successfully load!
2025-09-08 11:02:19.218 | INFO | eoap_cwlwrap.types:_validate_stage_in:273 - Validating stage-in 'my-asthonishing-stage-in-directory'...
2025-09-08 11:02:19.219 | INFO | eoap_cwlwrap.types:_validate_stage_in:295 - stage-in 'my-asthonishing-stage-in-directory' is valid
2025-09-08 11:02:19.219 | INFO | eoap_cwlwrap.types:_validate_stage_in:273 - Validating stage-in 'my-asthonishing-stage-in-file'...
2025-09-08 11:02:19.220 | INFO | eoap_cwlwrap.types:_validate_stage_in:295 - stage-in 'my-asthonishing-stage-in-file' is valid
2025-09-08 11:02:19.220 | INFO | eoap_cwlwrap.types:validate_stage_out:331 - Validating stage-out 'my-super-stage-out'...
2025-09-08 11:02:19.221 | INFO | eoap_cwlwrap.types:validate_stage_out:353 - stage-out 'my-super-stage-out' is valid
2025-09-08 11:02:19.221 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:90 - Building the CWL Orchestrator Workflow...
2025-09-08 11:02:19.222 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:119 - Analyzing pattern-9 inputs...
2025-09-08 11:02:19.223 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:135 - * pattern-9/aoi: string
2025-09-08 11:02:19.223 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:135 - * pattern-9/epsg: string
2025-09-08 11:02:19.224 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:135 - * pattern-9/indexes: string[]
2025-09-08 11:02:19.224 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:135 - * pattern-9/item: Directory
2025-09-08 11:02:19.225 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:148 - Directory type detected, creating a related 'directory_stage_in_0'...
2025-09-08 11:02:19.225 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:150 - Converting Directory to URL-compatible type...
2025-09-08 11:02:19.226 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:154 - Directory converted to https://raw.githubusercontent.com/eoap/schemas/main/string_format.yaml#URI
2025-09-08 11:02:19.226 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:195 - Connecting 'app/item' to 'directory_stage_in_0' output...
2025-09-08 11:02:19.227 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:246 - Analyzing pattern-9 outputs...
2025-09-08 11:02:19.227 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:252 - * pattern-9/vegetation_indexes: [ null, Directory[] ]
2025-09-08 11:02:19.228 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:257 - Directory type detected, creating a related 'stage_out_0'...
2025-09-08 11:02:19.228 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:259 - Converting [ null, Directory[] ] to URL-compatible type...
2025-09-08 11:02:19.229 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:263 - [ null, Directory[] ] converted to [ null, https://raw.githubusercontent.com/eoap/schemas/main/string_format.yaml#URI[] ]
2025-09-08 11:02:19.230 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:284 - Array detected, scatter required for stac_catalog:app/vegetation_indexes
2025-09-08 11:02:19.231 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:295 - Nullable detected, 'when' required for stac_catalog:app/vegetation_indexes
2025-09-08 11:02:19.234 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:304 - Connecting 'app/vegetation_indexes' to 'stage_out_0' output...
2025-09-08 11:02:19.235 | INFO | eoap_cwlwrap:_build_orchestrator_workflow:379 - Orchestrator Workflow built in 0.0133 seconds
Workflow components diagram¶
Inputs¶
Id | Type | Label | Doc |
---|---|---|---|
aoi |
string |
area of interest - pattern-9/aoi | area of interest as a bounding box - This parameter is derived from pattern-9/aoi |
epsg |
string |
EPSG code - pattern-9/epsg | EPSG code - This parameter is derived from pattern-9/epsg |
indexes |
string[] |
indexes - pattern-9/indexes | indexes to compute - This parameter is derived from pattern-9/indexes |
another_input |
string |
Another Input - my-asthonishing-stage-in-directory/another_input | An additional input for demonstration purposes - This parameter is derived from my-asthonishing-stage-in-directory/another_input |
item |
https://raw.githubusercontent.com/eoap/schemas/main/string_format.yaml#URI |
Landsat-8/9 acquisition reference - pattern-9/item | Landsat-8/9 acquisition reference - This parameter is derived from pattern-9/item |
s3_bucket |
string |
my-super-stage-out/s3_bucket | This parameter is derived from: my-super-stage-out/s3_bucket |
sub_path |
string |
my-super-stage-out/sub_path | This parameter is derived from: my-super-stage-out/sub_path |
aws_access_key_id |
string |
my-super-stage-out/aws_access_key_id | This parameter is derived from: my-super-stage-out/aws_access_key_id |
aws_secret_access_key |
string |
my-super-stage-out/aws_secret_access_key | This parameter is derived from: my-super-stage-out/aws_secret_access_key |
region_name |
string |
my-super-stage-out/region_name | This parameter is derived from: my-super-stage-out/region_name |
endpoint_url |
string |
my-super-stage-out/endpoint_url | This parameter is derived from: my-super-stage-out/endpoint_url |
Steps¶
Id | Runs | Label | Doc |
---|---|---|---|
directory_stage_in_0 |
#my-asthonishing-stage-in-directory |
None | None |
app |
#pattern-9 |
None | None |
stage_out_0 |
#my-super-stage-out |
None | None |
Outputs¶
Id | Type | Label | Doc |
---|---|---|---|
vegetation_indexes |
[ null, https://raw.githubusercontent.com/eoap/schemas/main/string_format.yaml#URI[] ] |
Vegetation indexes | Vegetation indexes |
Execution¶
Inputs¶
{
"aoi": "-118.985,38.432,-118.183,38.938",
"epsg": "EPSG:4326",
"indexes": [
"ndvi",
"none"
],
"item": {
"class": "https://raw.githubusercontent.com/eoap/schemas/main/url.yaml#URL",
"value": "https://planetarycomputer.microsoft.com/api/stac/v1/collections/landsat-c2-l2/items/LC08_L2SP_042033_20231007_02_T1"
}
}
Outputs¶
{
"vegetation_indexes": [
{
"value": "s3://my-bucket/my/sub/path-3ptyy5/catalog.json",
"type": "https://raw.githubusercontent.com/eoap/schemas/main/string_format.yaml#URI"
},
null
]
}