Skip to content

Conversation

ngoldbaum
Copy link
Contributor

@ngoldbaum ngoldbaum commented Jan 28, 2025

Summary

Updates the native library to use PyO3 0.23. This is the first step towards declaring support for the free-threaded interpreter.

I could have gone further in ripping out TryIntoPy in favor of IntoPyObject. If you'd prefer not to leave this project in a state with an unnecessary wrapper trait I'm happy to implement that, I just wanted to make the smallest possible working diff.

Test Plan

This passes the tests for me locally. Let's see if CI spots and issues.

@facebook-github-bot
Copy link

Hi @ngoldbaum!

Thank you for your pull request.

We require contributors to sign our Contributor License Agreement, and yours needs attention.

You currently have a record in our system, but the CLA is no longer valid, and will need to be resubmitted.

Process

In order for us to review and merge your suggested changes, please sign at https://code.facebook.com/cla. If you are contributing on behalf of someone else (eg your employer), the individual CLA may not be sufficient and your employer may need to sign the corporate CLA.

Once the CLA is signed, our tooling will perform checks and validations. Afterwards, the pull request will be tagged with CLA signed. The tagging process may take up to 1 hour after signing. Please give it that time before contacting us about it.

If you have received this in error or have any questions, please contact us at [email protected]. Thanks!

@ngoldbaum
Copy link
Contributor Author

I signed the CLA.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Jan 28, 2025
@facebook-github-bot
Copy link

Thank you for signing our Contributor License Agreement. We can now accept your code for this (and any) Meta Open Source project. Thanks!

}
}

impl TryIntoPy<PyObject> for PyTuple {
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I found that with IntoPyObject that some of these impls aren't needed at all. I didn't look too closely to try to understand why though so there could be something subtle happening.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great, I was hoping to get rid of these.

}() {
Ok(py_err_value) => PyErr::from_value(py_err_value),
Err(e) => e,
}
Copy link
Contributor Author

@ngoldbaum ngoldbaum Jan 28, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Since ultimately we want a PyErr in both the success and error cases, we can make use of a closure that returns a result and ? to avoid unwrap or expect in the new into_pyobject() calls that can return errors and at the same time clean up some unnecessary pre-existing expect use to turn some panics into errors. This is a neat Rust trick, unfortuntely it's only convenient in error handling code.

})
}
}

impl<'a> PyErrArguments for Details {
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Both this and Details are unused and the compiler warns about them.

Copy link
Contributor

@zsol zsol left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM in general, thanks for this. I'd appreciate a followup PR that rips out TryIntoPy completely, but happy to land this as is if we can figure out a way around that unwrap() call

}
}

impl TryIntoPy<PyObject> for PyTuple {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great, I was hoping to get rid of these.

impl TryIntoPy<PyObject> for PyTuple {
fn try_into_py(self, py: Python) -> PyResult<PyObject> {
Ok(self.into_py(py))
PyTuple::new(py, converted).unwrap().into_py_any(py)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Anything we can do to avoid the unwrap() and potential panic here?

zsol added a commit that referenced this pull request Feb 22, 2025
This PR:
1. marks the `libcst.native` module as free-threading-compatible
2. replaces the use of ProcessPoolExecutor with ThreadPoolExecutor if free-threaded CPython is detected at runtime

This depends on #1294 and #1289.
zsol added a commit that referenced this pull request Feb 22, 2025
This PR:
1. marks the `libcst.native` module as free-threading-compatible
2. replaces the use of ProcessPoolExecutor with ThreadPoolExecutor if free-threaded CPython is detected at runtime

This depends on #1294 and #1289.
@zsol zsol changed the title Update for Pyo3 0.23 Update ParserError wrapper to use IntoPyObject Feb 22, 2025
@zsol zsol changed the title Update ParserError wrapper to use IntoPyObject Update for Pyo3 0.23 Feb 22, 2025
@zsol
Copy link
Contributor

zsol commented Feb 22, 2025

Ugh, apologies for the churn, my tools messed with the PR - I did my best to revert my changes

@ngoldbaum
Copy link
Contributor Author

Sorry for the delay here - I accidentally marked the TODO item I had for this as "done". Will try to deal with the unwrap() calls today.

@zsol zsol merged commit 727e433 into Instagram:main Mar 7, 2025
25 checks passed
@zsol
Copy link
Contributor

zsol commented Mar 7, 2025

🎉 thanks!

zsol added a commit that referenced this pull request Mar 7, 2025
This PR:
1. marks the `libcst.native` module as free-threading-compatible
2. replaces the use of ProcessPoolExecutor with ThreadPoolExecutor if free-threaded CPython is detected at runtime

This depends on #1294 and #1289.
ngoldbaum pushed a commit to ngoldbaum/LibCST that referenced this pull request Apr 1, 2025
This PR:
1. marks the `libcst.native` module as free-threading-compatible
2. replaces the use of ProcessPoolExecutor with ThreadPoolExecutor if free-threaded CPython is detected at runtime

This depends on Instagram#1294 and Instagram#1289.
ngoldbaum pushed a commit to ngoldbaum/LibCST that referenced this pull request Apr 8, 2025
This PR:
1. marks the `libcst.native` module as free-threading-compatible
2. replaces the use of ProcessPoolExecutor with ThreadPoolExecutor if free-threaded CPython is detected at runtime

This depends on Instagram#1294 and Instagram#1289.
ngoldbaum pushed a commit to ngoldbaum/LibCST that referenced this pull request Apr 10, 2025
This PR:
1. marks the `libcst.native` module as free-threading-compatible
2. replaces the use of ProcessPoolExecutor with ThreadPoolExecutor if free-threaded CPython is detected at runtime

This depends on Instagram#1294 and Instagram#1289.
zsol added a commit that referenced this pull request May 20, 2025
This PR:
1. marks the `libcst.native` module as free-threading-compatible
2. replaces the use of ProcessPoolExecutor with ThreadPoolExecutor if free-threaded CPython is detected at runtime

This depends on #1294 and #1289.
zsol added a commit that referenced this pull request May 22, 2025
This PR:
1. marks the `libcst.native` module as free-threading-compatible
2. replaces the use of ProcessPoolExecutor with ThreadPoolExecutor if free-threaded CPython is detected at runtime

This depends on #1294 and #1289.
zsol added a commit that referenced this pull request May 22, 2025
This PR:
1. marks the `libcst.native` module as free-threading-compatible
2. replaces the use of ProcessPoolExecutor with ThreadPoolExecutor if free-threaded CPython is detected at runtime

This depends on #1294 and #1289.
zsol added a commit that referenced this pull request May 22, 2025
This PR:
1. marks the `libcst.native` module as free-threading-compatible
2. replaces the use of ProcessPoolExecutor with ThreadPoolExecutor if free-threaded CPython is detected at runtime

This depends on #1294 and #1289.
zsol added a commit that referenced this pull request May 22, 2025
This PR:
1. marks the `libcst.native` module as free-threading-compatible
2. replaces the use of ProcessPoolExecutor with ThreadPoolExecutor if free-threaded CPython is detected at runtime

This depends on #1294 and #1289.
zsol added a commit that referenced this pull request May 22, 2025
This PR:
1. marks the `libcst.native` module as free-threading-compatible
2. replaces the use of ProcessPoolExecutor with ThreadPoolExecutor if free-threaded CPython is detected at runtime

This depends on #1294 and #1289.
zsol added a commit that referenced this pull request May 22, 2025
This PR:
1. marks the `libcst.native` module as free-threading-compatible
2. replaces the use of ProcessPoolExecutor with ThreadPoolExecutor if free-threaded CPython is detected at runtime

This depends on #1294 and #1289.
zsol added a commit that referenced this pull request May 25, 2025
This PR:
1. marks the `libcst.native` module as free-threading-compatible
2. replaces the use of ProcessPoolExecutor with ThreadPoolExecutor if free-threaded CPython is detected at runtime

This depends on #1294 and #1289.
zsol added a commit that referenced this pull request May 25, 2025
This PR:
1. marks the `libcst.native` module as free-threading-compatible
2. replaces the use of ProcessPoolExecutor with ThreadPoolExecutor if free-threaded CPython is detected at runtime

This depends on #1294 and #1289.
zsol added a commit that referenced this pull request May 25, 2025
This PR:
1. marks the `libcst.native` module as free-threading-compatible
2. replaces the use of ProcessPoolExecutor with ThreadPoolExecutor if free-threaded CPython is detected at runtime

This depends on #1294 and #1289.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants