Skip to content

Conversation

@bodhisilberling-2027
Copy link

Add comprehensive docstrings to add_path and read_command functions in pyspark/worker_util.py to improve code documentation and maintainability. The docstrings follow the NumPy style used throughout the PySpark codebase.

What changes were proposed in this pull request?

Why are the changes needed?

Does this PR introduce any user-facing change?

How was this patch tested?

Was this patch authored or co-authored using generative AI tooling?

Add comprehensive docstrings to add_path and read_command functions
in pyspark/worker_util.py to improve code documentation and maintainability.
The docstrings follow the NumPy style used throughout the PySpark codebase.
@github-actions
Copy link

⚠️ Pull Request Title Validation

This pull request title does not contain a JIRA issue ID.

Please update the title to either:

  • Include a JIRA ID: [SPARK-12345] Your description
  • Mark as minor change: [MINOR] Your description

For minor changes that don't require a JIRA ticket (e.g., typo fixes), please prefix the title with [MINOR].


This comment was automatically generated by GitHub Actions

@HyukjinKwon HyukjinKwon changed the title [PYTHON] Add missing docstrings to add_path and read_command functions [MINOR][PYTHON] Add missing docstrings to add_path and read_command functions Jan 20, 2026
@HyukjinKwon
Copy link
Member

cc @gaogaotiantian

serializer : FramedSerializer
The serializer to use for reading the command.
file : IO
The input file to read from.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Technically it's not a file. I know it's named a file, but it's more like a stream.

@gaogaotiantian
Copy link
Contributor

I don't know the repo's policy about such changes. The docs itself is okay. These two methods are pretty self-explained though. add_path's docstring might be a bit more helpful than read_command.

Copy link
Contributor

@allisonwang-db allisonwang-db left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please create a JIRA ticket with type DOC and add it in the PR title.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants