Pattern 10
Application Package Pattern 10¶
This pattern shows how to flatten an array of array of Directory
Inputs¶
| Id | Type | Label | Doc |
|---|---|---|---|
aoi |
string | area of interest | area of interest as a bounding box |
epsg |
string | EPSG code | EPSG code |
indexes |
Array of string | indexes | indexes to compute |
items |
Array of Directory | Landsat-8/9 acquisition reference | Landsat-8/9 acquisition reference |
Steps¶
| Id | Runs | Label | Doc |
|---|---|---|---|
subworkflow |
file:///#vegetation_indexes | None | None |
flatten |
file:///#flatten_array | None | None |
Outputs¶
| Id | Type | Label | Doc |
|---|---|---|---|
vegetation_indexes |
Array of Directory | Vegetation indexes | Vegetation indexes from Landsat-8/9 acquisitions |
Data flow management¶
Loading CWL document from ../cwl-workflow/pattern-10.cwl... Raw CWL document successfully loaded from ../cwl-workflow/pattern-10.cwl! Now updating the model to v1.2... Raw CWL document successfully updated! Now converting to the CWL model... Raw CWL document successfully updated! Now dereferencing the FQNs... Cleaning Workflow pattern-10... Cleaning Workflow vegetation_indexes... Cleaning CommandLineTool clt... Cleaning ExpressionTool flatten_array... CWL document successfully dereferenced! Loading CWL document from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/main/templates/stage-in.cwl... Raw CWL document successfully loaded from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/main/templates/stage-in.cwl! Now updating the model to v1.2... Raw CWL document successfully updated! Now converting to the CWL model...
Raw CWL document successfully updated! Now dereferencing the FQNs... Cleaning CommandLineTool my-asthonishing-stage-in-directory... CWL document successfully dereferenced! Loading CWL document from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/main/templates/stage-in-file.cwl... Raw CWL document successfully loaded from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/main/templates/stage-in-file.cwl! Now updating the model to v1.2... Raw CWL document successfully updated! Now converting to the CWL model... Raw CWL document successfully updated! Now dereferencing the FQNs... Cleaning CommandLineTool my-asthonishing-stage-in-file... CWL document successfully dereferenced! Loading CWL document from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/main/cwl-workflow/pattern-10.cwl...
Raw CWL document successfully loaded from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/main/cwl-workflow/pattern-10.cwl! Now updating the model to v1.2... Raw CWL document successfully updated! Now converting to the CWL model... Raw CWL document successfully updated! Now dereferencing the FQNs... Cleaning Workflow pattern-10... Cleaning Workflow vegetation_indexes... Cleaning CommandLineTool clt... Cleaning ExpressionTool flatten_array... CWL document successfully dereferenced! Loading CWL document from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/main/templates/stage-out.cwl... Raw CWL document successfully loaded from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/main/templates/stage-out.cwl! Now updating the model to v1.2... Raw CWL document successfully updated! Now converting to the CWL model...
Raw CWL document successfully updated! Now dereferencing the FQNs... Cleaning CommandLineTool my-super-stage-out... CWL document successfully dereferenced! Validating stage-in 'my-asthonishing-stage-in-directory'... stage-in 'my-asthonishing-stage-in-directory' is valid Validating stage-in 'my-asthonishing-stage-in-file'... stage-in 'my-asthonishing-stage-in-file' is valid Validating stage-out 'my-super-stage-out'... stage-out 'my-super-stage-out' is valid Building the CWL Orchestrator Workflow... Analyzing pattern-10 inputs... * pattern-10/aoi: string * pattern-10/epsg: string * pattern-10/indexes: string[] * pattern-10/items: Directory[] Directory type detected, creating a related 'directory_stage_in_0'... Converting Directory[] to URL-compatible type... Directory[] converted to https://raw.githubusercontent.com/eoap/schemas/main/string_format.yaml#URI[] Array detected, 'scatter' required for reference:items Connecting 'app/items' to 'directory_stage_in_0' output... Analyzing pattern-10 outputs... * pattern-10/vegetation_indexes: Directory[] Directory type detected, creating a related 'stage_out_0'... Converting Directory[] to URL-compatible type... Directory[] converted to https://raw.githubusercontent.com/eoap/schemas/main/string_format.yaml#URI[] Array detected, scatter required for stac_catalog:app/vegetation_indexes Connecting 'app/vegetation_indexes' to 'stage_out_0' output... Orchestrator Workflow built in 0.0019 seconds
Inputs¶
| Id | Type | Label | Doc |
|---|---|---|---|
aoi |
string | area of interest - pattern-10/aoi | area of interest as a bounding box - This parameter is derived from pattern-10/aoi |
epsg |
string | EPSG code - pattern-10/epsg | EPSG code - This parameter is derived from pattern-10/epsg |
indexes |
Array of string | indexes - pattern-10/indexes | indexes to compute - This parameter is derived from pattern-10/indexes |
another_input |
string | Another Input - my-asthonishing-stage-in-directory/another_input | An additional input for demonstration purposes - This parameter is derived from my-asthonishing-stage-in-directory/another_input |
items |
Array of https://raw.githubusercontent.com/eoap/schemas/main/string_format.yaml#URI | Landsat-8/9 acquisition reference - pattern-10/items | Landsat-8/9 acquisition reference - This parameter is derived from pattern-10/items |
s3_bucket |
string | my-super-stage-out/s3_bucket | This parameter is derived from: my-super-stage-out/s3_bucket |
sub_path |
string | my-super-stage-out/sub_path | This parameter is derived from: my-super-stage-out/sub_path |
aws_access_key_id |
string | my-super-stage-out/aws_access_key_id | This parameter is derived from: my-super-stage-out/aws_access_key_id |
aws_secret_access_key |
string | my-super-stage-out/aws_secret_access_key | This parameter is derived from: my-super-stage-out/aws_secret_access_key |
region_name |
string | my-super-stage-out/region_name | This parameter is derived from: my-super-stage-out/region_name |
endpoint_url |
string | my-super-stage-out/endpoint_url | This parameter is derived from: my-super-stage-out/endpoint_url |
Steps¶
| Id | Runs | Label | Doc |
|---|---|---|---|
directory_stage_in_0 |
file:///#my-asthonishing-stage-in-directory | None | None |
app |
file:///#pattern-10 | None | None |
stage_out_0 |
file:///#my-super-stage-out | None | None |
Outputs¶
| Id | Type | Label | Doc |
|---|---|---|---|
vegetation_indexes |
Array of https://raw.githubusercontent.com/eoap/schemas/main/string_format.yaml#URI | Vegetation indexes | Vegetation indexes from Landsat-8/9 acquisitions |