Viaducts

Database connections via ducts.

See omniduct documentation for more information.

Install

Please note: This is still in development.

Installing dependency branch

pip install git+git://github.com/foxyblue/omniduct.git@56d64e4dc2ce3cf098e47fa88cbec73931e6a38a
pip install viaducts

Usage

from viaducts import Viaducts

viaducts = Viaducts()

exasol = viaducts['exasol']
exasol.query("SELECT 43;", format='pandas')

Example Config

databases:
  black:
    protocol: postgresql
    host: localhost
    port: 5432
    username: postgres
    password: _env:BLACK_DB_PW
  exasol:
    protocol: exasol
    host:
      - 'localhost:8563'
    username: _env:EXASOL_USER
    password: _env:EXASOL_PASSWORD
    schema: _env:EXASOL_SCHEMA

filesystems:
  local:
    protocol: localfs
    global_writes: True
  s3_company_bucket:
    protocol: s3
    bucket: company-bucket

Supported extensions:

• Support for environment variable extraction, this includes requiring password to be set in env.
• Configuration can be set in multiple yaml files.
• Added support for exasol (Open in PR)
• Connecting to multiple hosts.

Omniducts supports

• Failover.