Tasks

[andreasjansson]

Run predictions in separate parallel tasks to speed up test runs.

Fixes #6

---

Important

Introduce parallel task execution and async refactoring to improve prediction performance and testing capabilities, with configuration updates and enhanced CI testing.

• Parallel Task Execution:
  • Introduces parallel task execution using asyncio in main.py and tasks.py.
  • Adds run_tasks() in main.py to manage concurrency with a semaphore.
• Async Refactoring:
  • Refactors boolean(), json_object(), and call() in ai.py to be async.
  • Updates outputs_match() and related functions in match_outputs.py to be async.
  • Refactors predict() and make_predict_inputs() in predict.py to be async.
• Configuration and Defaults:
  • Adds parallel configuration option in config.py with a default of 4.
  • Removes duration from FuzzConfig in config.py.
• Testing and CI:
  • Adds integration-test and end-to-end-test jobs in ci.yaml.
  • Updates test scripts in script/ to support new async tests.
  • Adds async test support in pytest.ini files.
• Miscellaneous:
  • Removes retry.py and replaces its functionality with async_retry() in ai.py.
  • Refactors cog_safe_push() in main.py to use TaskContext from task_context.py.

^{This description was created by for 453c283. It will automatically update as commits are pushed.}