Skip to content

vllm.entrypoints.cli.benchmark.iterations

BenchmarkIterationsSubcommand

Bases: BenchmarkSubcommandBase

The iterations subcommand for vllm bench.

Source code in vllm/entrypoints/cli/benchmark/iterations.py 
 9
10
11
12
13
14
15
16
17
18
19
20
21
class BenchmarkIterationsSubcommand(BenchmarkSubcommandBase):
    """The `iterations` subcommand for `vllm bench`."""

    name = "iterations"
    help = "Benchmark prefill/decode phases with precise batch control."

    @classmethod
    def add_cli_args(cls, parser: argparse.ArgumentParser) -> None:
        add_cli_args(parser)

    @staticmethod
    def cmd(args: argparse.Namespace) -> None:
        main(args)