Add commit retry and concurrency validation for writes #8798

Job	Run time
cibw-dev-env-smoke-test	32s
integration-test-gcs	1m 11s
integration-test-adls	1m 34s
lint-and-unit-test (3.13)	38s
lint-and-unit-test (3.11)	1m 16s
lint-and-unit-test (3.10)	57s
lint-and-unit-test (3.12)	1m 9s
integration-test	10m 31s
integration-test-s3	1m 14s
lint-and-unit-test (3.14)	38s
integration-coverage-report	28s
	20m 8s

Provide feedback