…entation (#2381)

* Initial commit.

* WIP

* [Automated Commit] Format Codebase

* misc

* adding pydantic_typer

* offline WIP

* [Automated Commit] Format Codebase

* [Automated Commit] Format Codebase

* rename the notebook

* clean-up

* [Automated Commit] Format Codebase

* Downgrade from 3.13 to 3.12

* [Automated Commit] Format Codebase

* send the response back to LoadGen one at a time

* Move the ownership of the AsyncOpenAI client into Task, and clean up the client, event loop and the event loop thread

* [Automated Commit] Format Codebase

* fixing typo

* [Automated Commit] Format Codebase

* allowing --settings.min_duration to take in float or int as seconds

* fix lint

* [Automated Commit] Format Codebase

* Parametrize use_token_latencies

* [Automated Commit] Format Codebase

* fix typos

* [Automated Commit] Format Codebase

* update README

---------

Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>

* initial server version

* change description for parameter use_token_latencies

* [Automated Commit] Format Codebase

* changes based on PR comments

* Update submission checker

* Add submission structure description in markdown file

* Add description of placeholders in submission structure

* Update preprocess submission

* Add directory structure samples

* Structure documentation fixes

* Add power to submission structure documentation

* Fixes for preprocessing submission

* To be reverted: point to custom inference branch

* To be reverted: use custom mlc automation branch

* To be reverted: use custom branch for automation and inference repo

* To be reverted: use custom branch for mlcflow and inference repo

* Turn off the action

* To be reverted: custom branches for mlcflow and inference repo

---------

Co-authored-by: ANANDHU S <[email protected]>