[MINOR][PYTHON][DOCS] Fixed some links in documentation.#57359
[MINOR][PYTHON][DOCS] Fixed some links in documentation.#57359art000109 wants to merge 4 commits into
Conversation
### What changes were proposed in this pull request? Fixed some links in DataFrame and Pandas-On-Spark-DataFrame classes. ### Why are the changes needed? The documentation will be more comprehensive. ### Does this PR introduce any user-facing change? No. This is a documentation-only change. ### How was this patch tested? Manual review. ### Was this patch authored or co-authored using generative AI tooling? No.
art000109
changed the title
| pandas-on-Spark DataFrame that corresponds to pandas DataFrame logically. This holds Spark | ||
| DataFrame internally. | ||
|
|
||
| .. versionadded:: 3.2.0 |
There was a problem hiding this comment.
Was this added 3.2.0? Also, I think versionchanged directive as for the new parameter
There was a problem hiding this comment.
yes, Pandas API was added in SPARK-34849 for 3.2.0
There was a problem hiding this comment.
This API calls the DataFrame.pandas_api function, which was added in version 3.2.0 https://github.com/apache/spark/blob/master/python/pyspark/sql/dataframe.py#L6463
| "DataFrameWriterV2", | ||
| "MergeIntoWriter", | ||
| "DataStreamReader", | ||
| "DataStreamWriter", |
There was a problem hiding this comment.
DataStreamReader / DataStreamWriter technically are not API so we don't need this
There was a problem hiding this comment.
Okay, I've removed that block
| See Also | ||
| -------- | ||
| pyspark.pandas.frame.DataFrame.to_spark | ||
| pyspark.pandas.DataFrame.to_spark |
There was a problem hiding this comment.
This yes we would need thos
| extraction : | ||
| index to check for in array or key to check for in map | ||
|
|
||
| Returns |
There was a problem hiding this comment.
I am documenting them in #57185. Let's avoid those changes for now
There was a problem hiding this comment.
Oh, sorry. I've deleted this block
|
Let's file a JIRA |
2 participants
What changes were proposed in this pull request?
Fixed some links in DataFrame and Pandas-On-Spark-DataFrame classes.
Why are the changes needed?
The documentation will be more comprehensive.
Does this PR introduce any user-facing change?
No. This is a documentation-only change.
How was this patch tested?
Manual review.
Was this patch authored or co-authored using generative AI tooling?
No.