Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Updates modal timeout to 10m #908

Merged
merged 2 commits into from
Sep 22, 2024
Merged

Updates modal timeout to 10m #908

merged 2 commits into from
Sep 22, 2024

Conversation

beastoin
Copy link
Collaborator

@beastoin beastoin commented Sep 22, 2024

Summary by Entelligence.AI


  • Refactor: Adjusted timeout values in the backend configuration and _websocket_util function to improve system performance and reliability. The overall timeout value has been reduced from 19 minutes to 10 minutes, and the soft timeout within the _websocket_util function has been decreased from 30 minutes to 7 minutes. These changes aim to enhance the responsiveness of our services and reduce the likelihood of timeouts during heavy load periods.

Copy link

github-actions bot commented Sep 22, 2024

Image description Entelligence.AI

Walkthrough

The changes primarily focus on adjusting timeout values in the backend configuration and _websocket_util function. The aim is to enhance system performance and reliability by reducing the likelihood of long-running, unresponsive processes.

Changes

Files Summary
backend/main.py, backend/routers/transcribe.py Updated the timeout values in the configuration from 19 minutes to 10 minutes. Also, the soft timeout value in the _websocket_util function was reduced from 30 minutes to 7 minutes.

🎉🤖

With timeouts tuned and set just right,

Our code now runs as swift as light.

No more waiting, no more stall,

Efficiency reigns, we've tackled it all! 🚀


Uplevel your code reviews with Entelligence.AI Pro

Entelligence.AI Pro

If you like this project, please support us by purchasing the Pro version. The Pro version has advanced context, superior noise reduction and several proprietary improvements compared to the open source version. Moreover, Entelligence.AI Pro is free for open source projects.

Copy link

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Image description Entelligence.AI

Commits Files that changed from the base of the PR and between 1e65fd9 and 4367809 commits.
Files selected (2)
  • backend/main.py (1)
  • backend/routers/transcribe.py (1)
Files skipped from review due to trivial changes (1)
  • backend/main.py
Review comments generated (1)
  • Review: 1
  • LGTM: 0

Tips

Chat with Image description Entelligence.AI Bot (@Entelligence.AI)

  • Reply on review comments left by this bot to ask follow-up questions. A review comment is a comment on a diff or a file.
  • Invite the bot into a review comment chain by tagging @Entelligence.AI in a reply.

Code suggestions

  • The bot may make code suggestions, but please review them carefully before committing since the line number ranges may be misaligned.
  • You can edit the comment made by the bot and manually tweak the suggestion if it is slightly off.

Pausing incremental reviews

  • Add @Entelligence.AI: ignore anywhere in the PR description to pause further reviews from the bot.

@@ -132,7 +132,7 @@ async def _websocket_util(
loop = asyncio.get_event_loop()

# Soft timeout, should < MODAL_TIME_OUT - 3m
timeout_seconds = 1800 # 30m
timeout_seconds = 420 # 7m

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Image description Entelligence.AI

The timeout value has been reduced from 30 minutes to 7 minutes. This is a significant reduction and could potentially lead to premature timeouts if the operations being performed are time-consuming. Please ensure that this new timeout value is sufficient for all expected use cases. If there's a specific reason for this change, it would be beneficial to document it in a comment for future reference.

@beastoin beastoin merged commit e1b0bf8 into main Sep 22, 2024
1 check passed
@beastoin beastoin deleted the mazebiwh_modal_timeout_10m branch September 22, 2024 23:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant