Skip to content

Commit

Permalink
Docs: update integrations and verified sources pages (#1532)
Browse files Browse the repository at this point in the history
Co-authored-by: Alena Astrakhantseva <[email protected]>
  • Loading branch information
burnash and AstrakhantsevaAA authored Jul 3, 2024
1 parent 7874ded commit 41918a3
Show file tree
Hide file tree
Showing 3 changed files with 41 additions and 11 deletions.
18 changes: 18 additions & 0 deletions docs/website/docs/dlt-ecosystem/index.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,18 @@
---
title: Integrations
description: List of integrations
keywords: ['integrations, sources, destinations']
---
import DocCardList from '@theme/DocCardList';
import Link from '../_book-onboarding-call.md';

Speed up the process of creating data pipelines by using dlt's multiple pre-built sources and destinations:

- Each [dlt verified source](verified-sources) allows you to create [pipelines](../general-usage/pipeline) that extract data from a particular source: a database, a cloud service, or an API.
- [Destinations](destinations) are where you want to load your data. dlt supports a variety of destinations, including databases, data warehouses, and data lakes.

<DocCardList />

:::tip
Most source-destination pairs work seamlessly together. If the merge [write disposition](../general-usage/incremental-loading#choosing-a-write-disposition) is not supported by a destination (for example, [file sytem destination](destinations/filesystem)), dlt will automatically fall back to the [append](../general-usage/incremental-loading#append) write disposition.
:::
27 changes: 21 additions & 6 deletions docs/website/docs/dlt-ecosystem/verified-sources/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,14 +6,29 @@ keywords: ['verified source']
import DocCardList from '@theme/DocCardList';
import Link from '../../_book-onboarding-call.md';

Pick one of our verified sources that we wrote or maintain ourselves. All of them are constantly tested on real data and distributed as simple Python code so they can be easily customized or hacked.
Choose from our collection of verified sources, developed and maintained by the dlt team and community. Each source is rigorously tested against a real API and provided as Python code for easy customization.

* Need more info? [Join our Slack community](https://dlthub.com/community) and ask in the tech help channel or <Link/>.
Planning to use dlt in production and need a source that isn't listed? We're happy to build it for you: <Link />.

Do you plan to run dlt in production and source is missing? We are happy to build it.
* Source missing? [Request a new verified source](https://github.com/dlt-hub/verified-sources/issues/new?template=source-request.md)
* Missing endpoint or a feature? [Request or contribute](https://github.com/dlt-hub/verified-sources/issues/new?template=extend-a-source.md)
### Popular sources

- [SQL databases](sql_database). Supports PostgreSQL, MySQL, MS SQL Server, BigQuery, Redshift, and more.
- [REST API generic source](rest_api). Loads data from REST APIs using declarative configuration.
- [OpenAPI source generator](openapi-generator). Generates a source from an OpenAPI 3.x spec using the REST API source.
- [Cloud and local storage](filesystem). Retrieves data from AWS S3, Google Cloud Storage, Azure Blob Storage, local files, and more.

Otherwise pick a source below:
### Full list of verified sources

<DocCardList />

:::tip
If you're looking for a source that isn't listed and it provides a REST API, be sure to check out our [REST API generic source](rest_api)
source.
:::


### Get help

* Source missing? [Request a new verified source.](https://github.com/dlt-hub/verified-sources/issues/new?template=source-request.md)
* Missing endpoint or a feature? [Request or contribute](https://github.com/dlt-hub/verified-sources/issues/new?template=extend-a-source.md)
* [Join our Slack community](https://dlthub.com/community) and ask in the technical-help channel.
7 changes: 2 additions & 5 deletions docs/website/sidebars.js
Original file line number Diff line number Diff line change
Expand Up @@ -46,11 +46,8 @@ const sidebars = {
type: 'category',
label: 'Integrations',
link: {
type: 'generated-index',
title: 'Integrations',
description: 'dlt fits everywhere where the data flows. check out our curated data sources, destinations and unexpected places where dlt runs',
slug: 'dlt-ecosystem',
keywords: ['getting started'],
type: 'doc',
id: 'dlt-ecosystem/index',
},
items: [
{
Expand Down

0 comments on commit 41918a3

Please sign in to comment.