Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Visualise and anonymise chats from the AI Assistant #2263

Closed
christad92 opened this issue Jul 5, 2024 · 3 comments
Closed

Visualise and anonymise chats from the AI Assistant #2263

christad92 opened this issue Jul 5, 2024 · 3 comments

Comments

@christad92
Copy link

christad92 commented Jul 5, 2024

We want to be able to view chat logs from users so that we can tune and improve out model. This is a vital and relatively easy to gather form of feedback.

The Apollo service will work out how to save and report chat logs - see OpenFn/apollo#105. There's a lot that needs working out over there but this isn't a Lightning problem.

What Lightning needs to is:

  • Provide an option to users (enabled by default I think) to opt-in to anonymised logging of chats. This should be prominent but not overblown. Maybe it's set at the project level, but the splash/disclaimer page needs to warn people when the chats are being logged (another reason to show the splash once per day at least! Maybe at this point we're back to once per project per day)
  • Add a flag to the payload to opt-in to reporting (details to follow)
  • Provide (or link to) detailed help text explaining what data is saved, and how it is used
@josephjclark
Copy link
Contributor

I am super interested in this but @christad92 @stuartc are we 100% sure we want it in this cycle, and for the first general release? I'm just worried that it's a thorny issue (in terms of privacy and implementation difficulty)

@josephjclark
Copy link
Contributor

Ayo and I: nice to have but not essential for first release

@stuartc stuartc changed the title Anonymously log chats from the AI Assistant to Slack based on User consent Visualise and anonymise chats from the AI Assistant Dec 5, 2024
@josephjclark
Copy link
Contributor

Stu has set me up a metabase view which gives me access to chats. That gives me visibility in the short-term. It's not a perfect solution but it's free and it's done.

I still want a slack integration with a clear privacy notice. I'll create a new issue with a full design in it.

@github-project-automation github-project-automation bot moved this from Backlog to Done in v2 Dec 10, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Done
Development

No branches or pull requests

2 participants