Welcome to the Verifiable Data Sources repository from UsherLabs, a hub hosting public, verifiable, and tamper-proof data sources powered by innovative technologies such as Airbyte, Streamr, and LogStore. This repository is dedicated to providing public data streams for various applications, ensuring data accuracy and accessibility.
- Integration with Airbyte, Streamr, and LogStore: Leverage these platforms for efficient data streaming and querying.
- Historical Data Querying: Access historical data using LogStore with LSAN tokens.
- Broad Airbyte Connectors Compatibility: Extend functionalities by incorporating any Airbyte connector to channel data into your personalized stream.
To start building more resources in this repository, ensure the following requirements are met:
- Node.js (version 18 or higher)
- Package Manager:
pnpm
Otherwise, if you plan to consume data from one of these sources, you may find the project at Streamr Hub and learn how to query data from it using LogStore.
| Name | Type | Links | Description |
|---|---|---|---|
| Multi-Chain Gas Station | Source | GitHub Streamr Hub Usage Demo |
Track and analyze gas prices across different blockchains. |
| Streamr Destination | Destination | GitHub | Enhanced flexibility in data publishing, inspired by existing Streamr-Airbyte connectors but with specific capabilities added. |
To query historical data using LogStore, it's essential to own and stake LSAN tokens. For detailed instructions, refer to the LogStore Documentation.
To contribute by building a new connector, follow these steps:
-
Clone the repository.
-
Run
pnpm installto install dependencies. -
Build a Docker image for the connector. For example, for the Gas Station source connector:
docker build . --build-arg path=sources/gas-station -t <image-name>
-
Run the Docker image:
docker run <image-name>
- Airbyte Documentation - Learn how to build or use an Airbyte connector.
- LogStore Documentation - Detailed information on using LogStore for data querying.
- Gas Station Project Page at Streamr Hub - List of available streams
Feel free to contribute to this project! Whether adding a new data source, improving existing connectors, or providing feedback, your input is valuable. Visit our GitHub Repository to get started.