Review of bulk run creation functionality

[wk9874]

No description provided.

[wk9874]

Need to add detail to the README and raise a PR in the docs repo

Also can we add Parquet support?

[wk9874]

A few things left to address

Tested it with >20,000 lines of a metadata CSV file using Will's data and seems to work well!
Also happy with the name of the command now :)

[wk9874]

May want to note here that it expects a dictionary surrounded by quotes

[wk9874]

This should be 40,000 right?

[kzscisoft]

No I used monkeypatch to reduce the threshold for faster test

[wk9874]

I dont think you did...

@pytest.fixture
def create_metadata_csv() -> pathlib.Path:
    N_RUNS: int = 40000

And either way, you should test with > 20k runs in a batch to check the chunking works

[wk9874]

Lots of tests have errors, am working on fixing those

Push no longer seems to work at all after latest commit :/

[wk9874]

Also push_json_runs doesnt support name, but the CLI passes it through anyway, leading to:

        if input_file.suffix == ".json":
>           _folder_ids = simvue_cli.actions.push_json_runs(
                input_file,
                public_visible=public_visible,
                tenant_visible=tenant_visible,
                user_list=user_list,
                **kwargs,
            )
E           TypeError: push_json_runs() got an unexpected keyword argument 'name'