-
Notifications
You must be signed in to change notification settings - Fork 5
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
* minor changes * pin pip version * chore: add readme * chore: review * chore: review * Update README.md --------- Co-authored-by: Alex Kanitz <[email protected]>
- Loading branch information
Showing
8 changed files
with
7,519 additions
and
7 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,11 +1,179 @@ | ||
# proWES | ||
|
||
[![Apache License](https://img.shields.io/badge/license-Apache%202.0-blue.svg?style=flat)](http://www.apache.org/licenses/LICENSE-2.0) | ||
[![Build Status](https://travis-ci.com/elixir-cloud-aai/proWES.svg?branch=dev)](https://travis-ci.com/elixir-cloud-aai/proWES) | ||
[![Website](https://img.shields.io/website?url=https%3A%2F%2Fprotes.c03.k8s-popup.csc.fi%2Fga4gh%2Ftes%2Fv1%2Fui)](https://protes.c03.k8s-popup.csc.fi/ga4gh/tes/v1/ui/) | ||
[![license][badge-license]][badge-url-license] | ||
[![chat][badge-chat]][badge-url-chat] | ||
[![ci][badge-ci]][badge-url-ci] | ||
|
||
See | ||
[ELIXIR Cloud outline repository](https://github.com/elixir-europe/elixir-cloud-outline) | ||
for details. | ||
## Synopsis | ||
|
||
More info coming soon. | ||
proWES is a robust and scalable [Global Alliance for Genomics and Health | ||
(GA4GH)][res-ga4gh] [Workflow Execution Service (WES) API][res-ga4gh-wes] gateway | ||
that may play a pivotal role in augmenting the capabilities of your GA4GH Cloud | ||
ecosystem by offering flexible middleware injection for effective workflow | ||
deployment across a range of federated workflow management system deployments. | ||
|
||
## Description | ||
|
||
proWES gateway may serve as a crucial component in federated compute networks | ||
based on the GA4GH Cloud ecosystem. Its primary purpose is to provide | ||
centralized features to a federated network of independently operated GA4GH WES | ||
instances. As such, it can serve, for example, as a compatibility layer, a load | ||
balancer workload distribution layer, a public entry point to an enclave of | ||
independent compute nodes, or a means of collecting telemetry. | ||
|
||
When WES requests are received, proWES applies one or more configurable | ||
middlewares before forwarding the requests to appropriate WES instances in | ||
the network. A plugin system makes it easy to write and inject middlewares | ||
tailored to specific requirements, such as for access control, request/response | ||
processing or validation, or the selection of suitable endpoints considering | ||
data use restrictions and client preferences. | ||
|
||
### Built-in middleware plugins | ||
|
||
TBA | ||
|
||
### Implementation notes | ||
|
||
proWES is a [Flask][res-flask] microservice that supports | ||
[OAuth2][res-oauth2]-based authorization out of the box (bearer authentication) | ||
and stores information about incoming and outgoing tasks in a NoSQL database | ||
([MongoDB][res-mongodb]). Based on our [FOCA][res-foca] microservice archetype, | ||
it is highly configurable in a declarative (YAML-based!) manner. Forwarded tasks | ||
are tracked asynchronously via a [RabbitMQ][res-rabbitmq] broker and | ||
[Celery][res-celery] workers that can be easily scaled up. Both a | ||
[Helm][res-helm] chart and a [Docker Compose][res-docker-compose] configuration | ||
are provided for easy deployment in native cloud-based production and | ||
development environments, respectively. | ||
|
||
![proWES-overview][image-prowes-overview] | ||
|
||
## Installation | ||
|
||
For production-grade [Kubernetes][res-kubernetes]-based deployment, see | ||
[separate instructions][docs-deploy]. For testing/development purposes, you can | ||
use the instructions described below. | ||
|
||
### Requirements | ||
|
||
Ensure you have the following software installed: | ||
|
||
* [Docker][res-docker] | ||
* [docker-compose][res-docker-compose] | ||
* [Git][res-git] | ||
|
||
### Prerequisites | ||
|
||
Create data directory and required subdirectories | ||
|
||
```bash | ||
export PROWES_DATA_DIR=/path/to/data/directory | ||
mkdir -p $PROWES_DATA_DIR/{db,specs} | ||
``` | ||
|
||
> **Note:** If the `PROWES_DATA_DIR` environment variable is not set, proWES | ||
> will require the following default directories to be available: | ||
> | ||
> * `../data/pro_wes/db` | ||
> * `../data/pro_wes/specs` | ||
Clone repository | ||
|
||
```bash | ||
git clone https://github.com/elixir-europe/proWES.git | ||
``` | ||
|
||
Traverse to app directory | ||
|
||
```bash | ||
cd proWES | ||
``` | ||
|
||
### Configure (optional) | ||
|
||
The following user-configurable files are available: | ||
|
||
* [app configuration](pro_wes/config/app_config.yaml) | ||
* [deployment configuration](docker-compose.yaml) | ||
|
||
### Deploy | ||
|
||
Build/pull and run services | ||
|
||
```bash | ||
docker-compose up -d --build | ||
``` | ||
|
||
Visit Swagger UI | ||
|
||
```bash | ||
firefox http://localhost:8090/ga4gh/wes/v1/ui | ||
``` | ||
|
||
> **Note:** Host and port may differ if you have changed the configuration or | ||
> use an HTTP server to reroute calls to a different host. | ||
## Contributing | ||
|
||
This project is a community effort and lives off your contributions, be it in | ||
the form of bug reports, feature requests, discussions, ideas, fixes, or other | ||
code changes. Please read [these guidelines][docs-contributing] if you want to | ||
contribute. And please mind the [code of conduct][docs-coc] for all | ||
interactions with the community. | ||
|
||
## Versioning | ||
|
||
The project adopts the [semantic versioning][res-sem-ver] scheme for versioning. | ||
Currently the service is in beta stage, so the API may change and even break | ||
without further notice. However, once we deem the service stable and "feature | ||
complete", the major, minor and patch version will shadow the supported WES | ||
version, with the build version representing proWES-internal updates. | ||
|
||
## License | ||
|
||
This project is covered by the [Apache License 2.0][badge-url-license] also | ||
[shipped with this repository][docs-license]. | ||
|
||
## Contact | ||
|
||
proWES is part of [ELIXIR Cloud & AAI][res-elixir-cloud-aai], a multinational | ||
effort at establishing and implementing FAIR data sharing and promoting | ||
reproducible data analyses and responsible data handling in the life sciences. | ||
|
||
If you have suggestions for or find issue with this app, please use the | ||
[issue tracker][contact-issue-tracker]. If you would like to reach out to us | ||
for anything else, you can join our [Slack board][badge-url-chat], start a | ||
thread in our [Q&A forum][contact-qa], or send us an [email][contact-email]. | ||
|
||
[![GA4GH logo](images/logo-ga4gh.png)](https://www.ga4gh.org/) | ||
[![ELIXIR logo](images/logo-elixir.png)](https://www.elixir-europe.org/) | ||
[![ELIXIR Cloud & AAI logo](images/logo-elixir-cloud.png)](https://elixir-europe.github.io/cloud/) | ||
|
||
[badge-chat]: <https://img.shields.io/static/v1?label=chat&message=Slack&color=ff6994> | ||
[badge-ci]: <https://github.com/elixir-cloud-aai/proWES/actions/workflows/main.yml/badge.svg> | ||
[badge-license]: <https://img.shields.io/badge/license-Apache%202.0-blue.svg> | ||
[badge-url-chat]: <https://join.slack.com/t/elixir-cloud/shared_invite/zt-1uvebyx1e-NcC0Hof2guT9df~haBdQaw> | ||
[badge-url-ci]: <https://github.com/elixir-cloud-aai/proWES/actions/workflows/main.yml> | ||
[badge-url-license]: <http://www.apache.org/licenses/LICENSE-2.0> | ||
[contact-email]: <mailto:[email protected]> | ||
[contact-issue-tracker]: <https://github.com/elixir-cloud-aai/landing-page/issues> | ||
[contact-qa]: <https://github.com/elixir-cloud-aai/elixir-cloud-aai/discussions> | ||
[docs-coc]: <https://github.com/elixir-cloud-aai/elixir-cloud-aai/blob/dev/CODE_OF_CONDUCT.md> | ||
[docs-contributing]: <https://elixir-cloud-aai.github.io/guides/guide-contributor/> | ||
[docs-deploy]: deployment/README.md | ||
[docs-license]: LICENSE | ||
[image-prowes-overview]: <images/overview.svg> | ||
[res-celery]: <http://www.celeryproject.org/> | ||
[res-docker]: <https://www.docker.com/> | ||
[res-docker-compose]: <https://docs.docker.com/compose/> | ||
[res-elixir-cloud-aai]: <https://elixir-cloud.dcc.sib.swiss/> | ||
[res-flask]: <http://flask.pocoo.org/> | ||
[res-foca]: <https://github.com/elixir-cloud-aai/foca> | ||
[res-ga4gh]: <https://www.ga4gh.org/> | ||
[res-ga4gh-wes]: <https://github.com/ga4gh/workflow-execution-service-schemas> | ||
[res-git]: <https://git-scm.com/> | ||
[res-helm]: <https://helm.sh/> | ||
[res-kubernetes]: <https://kubernetes.io/> | ||
[res-mongodb]: <https://www.mongodb.com/> | ||
[res-oauth2]: <https://oauth.net/2/> | ||
[res-rabbitmq]: <https://www.rabbitmq.com/> | ||
[res-sem-ver]: <https://semver.org/> |
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Oops, something went wrong.