Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] support kyuubi as a datasource #3375

Draft
wants to merge 1 commit into
base: dev
Choose a base branch
from

Conversation

JiaLiangC
Copy link
Contributor

Purpose of the pull request

Using Kyuubi as the data source and Dinky in a role similar to Hue, it becomes very convenient to query and develop using various big data engines.

Brief change log

Verify this pull request

This pull request is code cleanup without any test coverage.

(or)

This pull request is already covered by existing tests, such as (please describe tests).

(or)

This change added tests and can be verified as follows:

@Zzm0809 Zzm0809 changed the title Add kyuubi as a datasource [Feature] support kyuubi as a datasource Apr 10, 2024
@Zzm0809 Zzm0809 added the New Feature New feature label Apr 10, 2024
@Zzm0809 Zzm0809 added this to the 1.1.0 milestone Apr 10, 2024
@Zzm0809 Zzm0809 marked this pull request as draft April 23, 2024 08:36
@Pandas886
Copy link
Contributor

Pandas886 commented May 30, 2024

确实是个好功能,十分期待!有个疑问是怎么做不同engine的语法校验(像sparksql和flilnksql),而且不同engine的查询和写入操作如何区分出来(后续得用于executequery和executeupdate)

</dependency>
<dependency>
<groupId>org.apache.hive</groupId>
<artifactId>hive-jdbc</artifactId>
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

kyuubi has its own JDBC driver which is derived from Hive's one, it has zero-deps and fixes many Hive bugs.

public interface KyuubiConstant {

/** 查询所有database */
String QUERY_ALL_DATABASE = " show databases";
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I didn't have a deep look at where it is used, but generally, you should rely on standard JDBC API instead of SQL dialect to retrieve such metadata.

@Zzm0809
Copy link
Contributor

Zzm0809 commented Jun 13, 2024

确实是个好功能,十分期待!有个疑问是怎么做不同engine的语法校验(像sparksql和flilnksql),而且不同engine的查询和写入操作如何区分出来(后续得用于executequery和executeupdate)

这个在 dinky 侧普通数据源任务目前做不了语法校验

@aiwenmo aiwenmo modified the milestones: 1.1.0, 1.3.0 Nov 24, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
New Feature New feature
Projects
Status: Doing
Development

Successfully merging this pull request may close these issues.

5 participants