Pattern 5
Application Package Pattern 5¶
The CWL includes:
- one input parameter of type
Directory - scatter on an output parameter of type
Directory[]
This scenario takes as input an acquisition, applies an algorithm and generates several outputs
Implementation: process the NDVI and NDWI taking as input a Landsat-8/9 acquisition and generating a stack of STAC Catalogs
Inputs¶
| Id | Type | Label | Doc |
|---|---|---|---|
aoi |
string | area of interest | area of interest as a bounding box |
epsg |
string | EPSG code | EPSG code |
indexes |
Array of string | indexes | indexes to compute |
item |
Directory | Landsat-8/9 acquisition reference | Landsat-8/9 acquisition reference |
Steps¶
| Id | Runs | Label | Doc |
|---|---|---|---|
step |
file:///#clt | None | None |
Outputs¶
| Id | Type | Label | Doc |
|---|---|---|---|
vegetation_indexes |
Array of Directory | Vegetation indexes | Vegetation indexes from Landsat-8/9 acquisitions |
Data flow management¶
Loading CWL document from ../cwl-workflow/pattern-5.cwl... Raw CWL document successfully loaded from ../cwl-workflow/pattern-5.cwl! Now updating the model to v1.2... Raw CWL document successfully updated! Now converting to the CWL model... Raw CWL document successfully updated! Now dereferencing the FQNs... Cleaning Workflow pattern-5... Cleaning CommandLineTool clt... CWL document successfully dereferenced! Loading CWL document from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/main/templates/stage-in.cwl... Raw CWL document successfully loaded from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/main/templates/stage-in.cwl! Now updating the model to v1.2... Raw CWL document successfully updated! Now converting to the CWL model...
Raw CWL document successfully updated! Now dereferencing the FQNs... Cleaning CommandLineTool my-asthonishing-stage-in-directory... CWL document successfully dereferenced! Loading CWL document from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/main/templates/stage-in-file.cwl... Raw CWL document successfully loaded from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/main/templates/stage-in-file.cwl! Now updating the model to v1.2... Raw CWL document successfully updated! Now converting to the CWL model...
Raw CWL document successfully updated! Now dereferencing the FQNs... Cleaning CommandLineTool my-asthonishing-stage-in-file... CWL document successfully dereferenced! Loading CWL document from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/main/cwl-workflow/pattern-5.cwl... Raw CWL document successfully loaded from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/main/cwl-workflow/pattern-5.cwl! Now updating the model to v1.2... Raw CWL document successfully updated! Now converting to the CWL model... Raw CWL document successfully updated! Now dereferencing the FQNs... Cleaning Workflow pattern-5... Cleaning CommandLineTool clt... CWL document successfully dereferenced! Loading CWL document from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/main/templates/stage-out.cwl... Raw CWL document successfully loaded from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/main/templates/stage-out.cwl! Now updating the model to v1.2... Raw CWL document successfully updated! Now converting to the CWL model...
Raw CWL document successfully updated! Now dereferencing the FQNs... Cleaning CommandLineTool my-super-stage-out... CWL document successfully dereferenced! Validating stage-in 'my-asthonishing-stage-in-directory'... stage-in 'my-asthonishing-stage-in-directory' is valid Validating stage-in 'my-asthonishing-stage-in-file'... stage-in 'my-asthonishing-stage-in-file' is valid Validating stage-out 'my-super-stage-out'... stage-out 'my-super-stage-out' is valid Building the CWL Orchestrator Workflow... Analyzing pattern-5 inputs... * pattern-5/aoi: string * pattern-5/epsg: string * pattern-5/indexes: string[] * pattern-5/item: Directory Directory type detected, creating a related 'directory_stage_in_0'... Converting Directory to URL-compatible type... Directory converted to https://raw.githubusercontent.com/eoap/schemas/main/string_format.yaml#URI Connecting 'app/item' to 'directory_stage_in_0' output... Analyzing pattern-5 outputs... * pattern-5/vegetation_indexes: Directory[] Directory type detected, creating a related 'stage_out_0'... Converting Directory[] to URL-compatible type... Directory[] converted to https://raw.githubusercontent.com/eoap/schemas/main/string_format.yaml#URI[] Array detected, scatter required for stac_catalog:app/vegetation_indexes Connecting 'app/vegetation_indexes' to 'stage_out_0' output... Orchestrator Workflow built in 0.0023 seconds
Inputs¶
| Id | Type | Label | Doc |
|---|---|---|---|
aoi |
string | area of interest - pattern-5/aoi | area of interest as a bounding box - This parameter is derived from pattern-5/aoi |
epsg |
string | EPSG code - pattern-5/epsg | EPSG code - This parameter is derived from pattern-5/epsg |
indexes |
Array of string | indexes - pattern-5/indexes | indexes to compute - This parameter is derived from pattern-5/indexes |
another_input |
string | Another Input - my-asthonishing-stage-in-directory/another_input | An additional input for demonstration purposes - This parameter is derived from my-asthonishing-stage-in-directory/another_input |
item |
https://raw.githubusercontent.com/eoap/schemas/main/string_format.yaml#URI | Landsat-8/9 acquisition reference - pattern-5/item | Landsat-8/9 acquisition reference - This parameter is derived from pattern-5/item |
s3_bucket |
string | my-super-stage-out/s3_bucket | This parameter is derived from: my-super-stage-out/s3_bucket |
sub_path |
string | my-super-stage-out/sub_path | This parameter is derived from: my-super-stage-out/sub_path |
aws_access_key_id |
string | my-super-stage-out/aws_access_key_id | This parameter is derived from: my-super-stage-out/aws_access_key_id |
aws_secret_access_key |
string | my-super-stage-out/aws_secret_access_key | This parameter is derived from: my-super-stage-out/aws_secret_access_key |
region_name |
string | my-super-stage-out/region_name | This parameter is derived from: my-super-stage-out/region_name |
endpoint_url |
string | my-super-stage-out/endpoint_url | This parameter is derived from: my-super-stage-out/endpoint_url |
Steps¶
| Id | Runs | Label | Doc |
|---|---|---|---|
directory_stage_in_0 |
file:///#my-asthonishing-stage-in-directory | None | None |
app |
file:///#pattern-5 | None | None |
stage_out_0 |
file:///#my-super-stage-out | None | None |
Outputs¶
| Id | Type | Label | Doc |
|---|---|---|---|
vegetation_indexes |
Array of https://raw.githubusercontent.com/eoap/schemas/main/string_format.yaml#URI | Vegetation indexes | Vegetation indexes from Landsat-8/9 acquisitions |