Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Feature/add pg source #159

Open
wants to merge 24 commits into
base: pre-release/v0.3.0
Choose a base branch
from
Open

Feature/add pg source #159

wants to merge 24 commits into from
+814 −444

Commits on Sep 14, 2024

  1. new feature: read data from postgres

    @xuzh2024
    xuzh2024 committed Sep 14, 2024
    Configuration menu
    Copy the full SHA
    82408a7 View commit details
    Browse the repository at this point in the history

Commits on Sep 18, 2024

  1. new feature: pg_source_job can use filter to specify required data

    @xuzh2024
    xuzh2024 committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    7040f0c View commit details
    Browse the repository at this point in the history

Commits on Sep 19, 2024

  1. bug fixed and performance optimized

    @xuzh2024
    xuzh2024 committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    2a38c81 View commit details
    Browse the repository at this point in the history

  2. make format

    @xuzh2024
    xuzh2024 committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    88ae9a5 View commit details
    Browse the repository at this point in the history

  3. fix dict_to_dataclass error

    @xuzh2024
    xuzh2024 committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    63c9857 View commit details
    Browse the repository at this point in the history

  4. fix iterator error

    @xuzh2024
    xuzh2024 committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    a86884e View commit details
    Browse the repository at this point in the history

  5. fix iterator error

    @xuzh2024
    xuzh2024 committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    635adae View commit details
    Browse the repository at this point in the history

Commits on Sep 23, 2024

  1. Merge branch 'pre-release/v0.3.0' into feature/add-pg-source

    @xuzh2024
    xuzh2024 authored Sep 23, 2024
    Configuration menu
    Copy the full SHA
    a7e58a9 View commit details
    Browse the repository at this point in the history

Commits on Sep 25, 2024

  1. merged cli load and stream & add limit reader & add param --source-type

    @xuzh2024
    xuzh2024 committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    e17d152 View commit details
    Browse the repository at this point in the history

Commits on Sep 26, 2024

  1. optimize code, set default value to --source-types

    @xuzh2024
    xuzh2024 committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    7de47d9 View commit details
    Browse the repository at this point in the history

  2. optimize code logic, to prevent unexpected error

    @xuzh2024
    xuzh2024 committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    e912aa0 View commit details
    Browse the repository at this point in the history

  3. add partition key to enhance query performance.

    @xuzh2024
    xuzh2024 committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    d43952d View commit details
    Browse the repository at this point in the history

  4. bug fixed

    @xuzh2024
    xuzh2024 committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    dcc0894 View commit details
    Browse the repository at this point in the history

  5. fixed data convert error

    @xuzh2024
    xuzh2024 committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    452b4a2 View commit details
    Browse the repository at this point in the history

Commits on Sep 27, 2024

  1. Changes the sort operation from the database to memory

    @xuzh2024
    xuzh2024 committed Sep 27, 2024
    Configuration menu
    Copy the full SHA
    bd5c5a9 View commit details
    Browse the repository at this point in the history

  2. add logger info

    @xuzh2024
    xuzh2024 committed Sep 27, 2024
    Configuration menu
    Copy the full SHA
    d353502 View commit details
    Browse the repository at this point in the history

  3. fix rpc_limit_reader & parameter required

    @xuzh2024
    xuzh2024 committed Sep 27, 2024
    Configuration menu
    Copy the full SHA
    3e645b8 View commit details
    Browse the repository at this point in the history

  4. fix filter logic

    @xuzh2024
    xuzh2024 committed Sep 27, 2024
    Configuration menu
    Copy the full SHA
    3a23ed4 View commit details
    Browse the repository at this point in the history

Commits on Sep 28, 2024

  1. fix filter logic

    @xuzh2024
    xuzh2024 committed Sep 28, 2024
    Configuration menu
    Copy the full SHA
    53e59a6 View commit details
    Browse the repository at this point in the history

  2. make format

    @xuzh2024
    xuzh2024 committed Sep 28, 2024
    Configuration menu
    Copy the full SHA
    1b17e8e View commit details
    Browse the repository at this point in the history

  3. resolved conflict

    @xuzh2024
    xuzh2024 committed Sep 28, 2024
    Configuration menu
    Copy the full SHA
    fdb95f6 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'pre-release/v0.3.0' into feature/add-pg-source

    @xuzh2024
    xuzh2024 authored Sep 28, 2024
    Configuration menu
    Copy the full SHA
    845f472 View commit details
    Browse the repository at this point in the history

  5. resolved conflict

    @xuzh2024
    xuzh2024 committed Sep 28, 2024
    Configuration menu
    Copy the full SHA
    1cc103b View commit details
    Browse the repository at this point in the history

  6. make format

    @xuzh2024
    xuzh2024 committed Sep 28, 2024
    Configuration menu
    Copy the full SHA
    3f13d10 View commit details
    Browse the repository at this point in the history