May I know the space complexity and the time complexity of the code?

[cheukhin1024]

Are they all O( C x R)?

C: number of columns
R: number of rows

I used your code to transpose a spark data frame and it works, but it takes about 17 hours to transpose one 1000 columns x 252 rows delta table (all data are float data type).