-
Notifications
You must be signed in to change notification settings - Fork 471
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Remove capture page, and from the moment one start speaking, a memory in progress should appear. #606
Comments
The idea here @beastoin is to modify the websocket behavior a little bit.
|
Closed
interesting! lemme 🏄♀️ |
PR: #684 |
beastoin
added a commit
that referenced
this issue
Sep 5, 2024
Issue: #606 **Status:** 🏄♀️ Ready on staging, waiting for review ## Key results - [x] No more Capture Page. User can see the new memory immediately after speaking, in progress, no summary til completed, show in the memory page `p1` - [x] Backend handle create memory logic, when, what, how. Frontend just needs stream audio to Backend, that's all. - [x] No more post-processing request from Frontend. ## Todos - [x] Remove capture page - [x] UI for processing memory on Memory page - [x] Handle create memory logic from Backend - [x] New memory watch - [x] Message event via socket - [x] Backward compatible with the old-app version - [x] Support geolocation, emotional feedback - [x] Handle post-processing logic from Backend - [x] Capture audio frame, rebuild audio wav - [x] Do post-processing - [x] Fix the weird slowlyyyy on talking speed with opus, guess that is the re-frames problem, double check another codec pcm8, pcm16 - [x] Double check `.photos` from Frontend whenever creating new memory in capture page - [x] Maintain the old-logic for OpenGlass on creating new memory - [x] Enhance UX - [ ] Should leave a check on - [x] Mic recording - [x] initiateWebsocket / resetState on provider - [ ] Openglass memory ## Deploy plan - [ ] Deploy backend > api - [ ] Deploy app > ios, android --- <!-- This is an auto-generated comment: release notes by OSS Entelligence.AI --> ### Summary by Entelligence.AI - New Feature: Introduced a new function `getProcessingMemoryById` to retrieve processing memories by ID, enhancing the memory retrieval process. - New Feature: Added support for handling server message events in the WebSocket stream, improving real-time data handling. - New Feature: Implemented a new function `processMemoryContent` that processes messages related to a server memory, providing better memory content management. - Refactor: Adjusted tab navigation and UI elements on the home page for improved user experience. - Refactor: Updated the `process_audio_dg` function in the backend for more efficient transcript segment handling. - New Feature: Introduced a new `LiteTranscriptWidget` class for alternative UI rendering of transcripts. <!-- end of auto-generated comment: release notes by OSS Entelligence.AI -->
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Is your feature request related to a problem? Please describe.
Describe the solution you'd like
This requires the backend to determine when a memory is created.
The text was updated successfully, but these errors were encountered: