Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Friend V2] Friend can speak ($700) #567

Closed
josancamon19 opened this issue Aug 10, 2024 · 3 comments
Closed

[Friend V2] Friend can speak ($700) #567

josancamon19 opened this issue Aug 10, 2024 · 3 comments
Assignees

Comments

@josancamon19
Copy link
Contributor

Is your feature request related to a problem? Please describe.
I want to be able to use the speaker of my Friend Programatically.

Describe the solution you'd like
A speaker characteristic should be made, which you can write bytes to it, and play an audio.

Test it by taking the plugin response text, then using 11Labs or deepgram tts, to play that on the device.

@josancamon19 josancamon19 changed the title [Friend V2] Friend can speak [Friend V2] Friend can speak ($700) Aug 10, 2024
@kodjima33 kodjima33 moved this to Backlog in omi TODO Aug 10, 2024
@josancamon19 josancamon19 added flutter flutter work Paid Bounty 💰 task backend Backend Task (python) and removed backend Backend Task (python) labels Aug 10, 2024
@abls
Copy link

abls commented Aug 10, 2024

Working on this @ hackathon rn

@josancamon19
Copy link
Contributor Author

No progress, unassigning.

@kevvz
Copy link
Collaborator

kevvz commented Aug 19, 2024

20240818_233631.mp4

Im gonna wait until the accelerometer PR is done since my main branch has that code on accident and I can't seem to move anything without destroying that branch

The button PR also works

josancamon19 added a commit that referenced this issue Aug 29, 2024
#567 

This is a rebase of the previous PR.

How to test:
In the firmware_v1.0 file,

Flash the zephyr.uf2 file in the file "build_speaker".
-Then use the script "discover_devices.py" to find the device id of your
Omi device. This is to avoid cases where there are multiple friends
connected at once. If there is more than one friend then just test all
of them.
In the script play_sound_on_friend.py, (in firmware_v1.0)

On line 20 add the device id of your friend. This is to avoid cases
where there is more than one friend nearby.
On line 21 add your Deepgram API key.
Then save and run the script by typing a small string. For example, one
line could be

python3 play_sound_on_friend.py "hello"

Which should get the speaker to say hello. Make sure your device is
connected by USB or you have connected a 3.3V pin to the speaker.

#573 (For now it is disabled
but since this uses very similar code).

A sound should play automatically when you compile and run the
zephyr.uf2 file. Of course this file can be modified to play any haptic
sound provided you enter the appropriate lookup table.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: Done
Development

No branches or pull requests

3 participants