Pattern 4
Application Package Pattern 4¶
The CWL includes:
- one input parameter of type
Directory - two output parameters of type
Directory
This scenario takes as input an acquisition, applies two algorithms and generates two outputs.
Implementation: process the NDVI and NDWI taking as input a Landsat-8/9 acquisition. The output include two STAC Catalogs, each with a single STAC Item
Inputs¶
| Id | Type | Label | Doc |
|---|---|---|---|
aoi |
string | area of interest | area of interest as a bounding box |
epsg |
string | EPSG code | EPSG code |
item |
Directory | Landsat-8/9 acquisition reference | Landsat-8/9 acquisition reference |
Steps¶
| Id | Runs | Label | Doc |
|---|---|---|---|
step |
file:///#clt | None | None |
Outputs¶
| Id | Type | Label | Doc |
|---|---|---|---|
ndvi |
Directory | NDVI vegetation index | NDVI vegetation index |
ndwi |
Directory | NDWI vegetation index | NDWI vegetation index |
Data flow management¶
Loading CWL document from ../cwl-workflow/pattern-4.cwl... Raw CWL document successfully loaded from ../cwl-workflow/pattern-4.cwl! Now updating the model to v1.2... Raw CWL document successfully updated! Now converting to the CWL model... Raw CWL document successfully updated! Now dereferencing the FQNs... Cleaning Workflow pattern-4... Cleaning CommandLineTool clt... CWL document successfully dereferenced! Loading CWL document from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/main/templates/stage-in.cwl... Raw CWL document successfully loaded from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/main/templates/stage-in.cwl! Now updating the model to v1.2... Raw CWL document successfully updated! Now converting to the CWL model... Raw CWL document successfully updated! Now dereferencing the FQNs... Cleaning CommandLineTool my-asthonishing-stage-in-directory... CWL document successfully dereferenced! Loading CWL document from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/main/templates/stage-in-file.cwl...
Raw CWL document successfully loaded from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/main/templates/stage-in-file.cwl! Now updating the model to v1.2... Raw CWL document successfully updated! Now converting to the CWL model... Raw CWL document successfully updated! Now dereferencing the FQNs... Cleaning CommandLineTool my-asthonishing-stage-in-file... CWL document successfully dereferenced! Loading CWL document from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/main/cwl-workflow/pattern-4.cwl...
Raw CWL document successfully loaded from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/main/cwl-workflow/pattern-4.cwl! Now updating the model to v1.2... Raw CWL document successfully updated! Now converting to the CWL model... Raw CWL document successfully updated! Now dereferencing the FQNs... Cleaning Workflow pattern-4... Cleaning CommandLineTool clt... CWL document successfully dereferenced! Loading CWL document from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/main/templates/stage-out.cwl... Raw CWL document successfully loaded from https://raw.githubusercontent.com/eoap/application-package-patterns/refs/heads/main/templates/stage-out.cwl! Now updating the model to v1.2... Raw CWL document successfully updated! Now converting to the CWL model...
Raw CWL document successfully updated! Now dereferencing the FQNs... Cleaning CommandLineTool my-super-stage-out... CWL document successfully dereferenced! Validating stage-in 'my-asthonishing-stage-in-directory'... stage-in 'my-asthonishing-stage-in-directory' is valid Validating stage-in 'my-asthonishing-stage-in-file'... stage-in 'my-asthonishing-stage-in-file' is valid Validating stage-out 'my-super-stage-out'... stage-out 'my-super-stage-out' is valid Building the CWL Orchestrator Workflow... Analyzing pattern-4 inputs... * pattern-4/aoi: string * pattern-4/epsg: string * pattern-4/item: Directory Directory type detected, creating a related 'directory_stage_in_0'... Converting Directory to URL-compatible type... Directory converted to https://raw.githubusercontent.com/eoap/schemas/main/string_format.yaml#URI Connecting 'app/item' to 'directory_stage_in_0' output... Analyzing pattern-4 outputs... * pattern-4/ndvi: Directory Directory type detected, creating a related 'stage_out_0'... Converting Directory to URL-compatible type... Directory converted to https://raw.githubusercontent.com/eoap/schemas/main/string_format.yaml#URI Connecting 'app/ndvi' to 'stage_out_0' output... * pattern-4/ndwi: Directory Directory type detected, creating a related 'stage_out_1'... Converting Directory to URL-compatible type... Directory converted to https://raw.githubusercontent.com/eoap/schemas/main/string_format.yaml#URI Connecting 'app/ndwi' to 'stage_out_1' output... Orchestrator Workflow built in 0.0026 seconds
Inputs¶
| Id | Type | Label | Doc |
|---|---|---|---|
aoi |
string | area of interest - pattern-4/aoi | area of interest as a bounding box - This parameter is derived from pattern-4/aoi |
epsg |
string | EPSG code - pattern-4/epsg | EPSG code - This parameter is derived from pattern-4/epsg |
another_input |
string | Another Input - my-asthonishing-stage-in-directory/another_input | An additional input for demonstration purposes - This parameter is derived from my-asthonishing-stage-in-directory/another_input |
item |
https://raw.githubusercontent.com/eoap/schemas/main/string_format.yaml#URI | Landsat-8/9 acquisition reference - pattern-4/item | Landsat-8/9 acquisition reference - This parameter is derived from pattern-4/item |
s3_bucket |
string | my-super-stage-out/s3_bucket | This parameter is derived from: my-super-stage-out/s3_bucket |
sub_path |
string | my-super-stage-out/sub_path | This parameter is derived from: my-super-stage-out/sub_path |
aws_access_key_id |
string | my-super-stage-out/aws_access_key_id | This parameter is derived from: my-super-stage-out/aws_access_key_id |
aws_secret_access_key |
string | my-super-stage-out/aws_secret_access_key | This parameter is derived from: my-super-stage-out/aws_secret_access_key |
region_name |
string | my-super-stage-out/region_name | This parameter is derived from: my-super-stage-out/region_name |
endpoint_url |
string | my-super-stage-out/endpoint_url | This parameter is derived from: my-super-stage-out/endpoint_url |
Steps¶
| Id | Runs | Label | Doc |
|---|---|---|---|
directory_stage_in_0 |
file:///#my-asthonishing-stage-in-directory | None | None |
app |
file:///#pattern-4 | None | None |
stage_out_0 |
file:///#my-super-stage-out | None | None |
stage_out_1 |
file:///#my-super-stage-out | None | None |
Outputs¶
| Id | Type | Label | Doc |
|---|---|---|---|
ndvi |
https://raw.githubusercontent.com/eoap/schemas/main/string_format.yaml#URI | NDVI vegetation index | NDVI vegetation index |
ndwi |
https://raw.githubusercontent.com/eoap/schemas/main/string_format.yaml#URI | NDWI vegetation index | NDWI vegetation index |