Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

http数据源加载问题 #68

Open
wangzeyu135798 opened this issue May 16, 2024 · 4 comments
Open

http数据源加载问题 #68

wangzeyu135798 opened this issue May 16, 2024 · 4 comments
Assignees

Comments

@wangzeyu135798
Copy link

image 你好,我通过http的方式加载了一个csv文件,也授权了对应的项目,为什么在项目中找不到这个数据?
@wenkesong-li
Copy link

你好,这个并不是添加样本数据,这个http添加的数据源是给模型发布使用的。

关于模型发布的文档说明:
https://www.secretflow.org.cn/zh-CN/docs/secretpad-all-in-one/latest/gtif7u0il8atxwlo

@wangzeyu135798
Copy link
Author

那也就是说加载项目数据只有解析csv这一种方法是吗?但是对于大数据量文件,比如1亿条数据,感觉加载时间特别慢,有什么好的办法么?

@wenkesong-li
Copy link

你好,目前是这样子的,大数据量吞吐本来就很耗时~

@1139763082
Copy link

那也就是说加载项目数据只有解析csv这一种方法是吗?但是对于大数据量文件,比如1亿条数据,感觉加载时间特别慢,有什么好的办法么?

v1.10.0b1版本可以用oss、odps、mysql数据源支持大数据https://www.secretflow.org.cn/zh-CN/docs/secretpad-all-in-one/v1.10.0b1/deployment_package

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants