Skip to content

Commit

Permalink
Benchmark time reduce (#396)
Browse files Browse the repository at this point in the history
# Description

Benchmark data reduced in order to reduce total benchmarking time (was
more than 20 hours before; and now 5 hours).

# Checklist

- [x] I have performed a self-review of the changes

# To Consider

- Add tests (if functionality is changed)
- Update API reference / tutorials / guides
- Update CONTRIBUTING.md (if devel workflow is changed)
- Update `.ignore` files, scripts (such as `lint`), distribution
manifest (if files are added/deleted)
- Search for references to changed entities in the codebase

---------

Co-authored-by: Roman Zlobin <[email protected]>
  • Loading branch information
pseusys and RLKRo authored Oct 18, 2024
1 parent 214f093 commit f4e4cf4
Showing 1 changed file with 8 additions and 10 deletions.
18 changes: 8 additions & 10 deletions chatsky/utils/db_benchmark/basic_config.py
Original file line number Diff line number Diff line change
Expand Up @@ -96,9 +96,9 @@ class BasicBenchmarkConfig(BenchmarkConfig, frozen=True):
Number of times the contexts will be benchmarked.
Increasing this number decreases standard error of the mean for benchmarked data.
"""
from_dialog_len: int = 300
from_dialog_len: int = 25
"""Starting dialog len of a context."""
to_dialog_len: int = 311
to_dialog_len: int = 50
"""
Final dialog len of a context.
:py:meth:`~.BasicBenchmarkConfig.context_updater` will return contexts
Expand Down Expand Up @@ -177,27 +177,25 @@ def context_updater(self, context: Context) -> Optional[Context]:
basic_configurations = {
"large-misc": BasicBenchmarkConfig(
from_dialog_len=1,
to_dialog_len=50,
to_dialog_len=26,
message_dimensions=(3, 5, 6, 5, 3),
misc_dimensions=(2, 4, 3, 8, 100),
),
"short-messages": BasicBenchmarkConfig(
from_dialog_len=500,
to_dialog_len=550,
message_dimensions=(2, 30),
misc_dimensions=(0, 0),
),
"default": BasicBenchmarkConfig(),
"large-misc--long-dialog": BasicBenchmarkConfig(
from_dialog_len=500,
to_dialog_len=550,
"large-misc-long-dialog": BasicBenchmarkConfig(
from_dialog_len=50,
to_dialog_len=75,
message_dimensions=(3, 5, 6, 5, 3),
misc_dimensions=(2, 4, 3, 8, 100),
),
"very-long-dialog-len": BasicBenchmarkConfig(
context_num=10,
from_dialog_len=10000,
to_dialog_len=10050,
from_dialog_len=1000,
to_dialog_len=1050,
),
"very-long-message-len": BasicBenchmarkConfig(
context_num=10,
Expand Down

0 comments on commit f4e4cf4

Please sign in to comment.