Skip to content

read_parquet Does Not Throw Error for Missing Column #1370

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 6 commits into from
Jun 9, 2022
Merged

read_parquet Does Not Throw Error for Missing Column #1370

merged 6 commits into from
Jun 9, 2022

Conversation

malachi-constant
Copy link
Contributor

Relates

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

@malachi-constant malachi-constant added enhancement New feature or request investigating More investigation is required labels Jun 1, 2022
@malachi-constant malachi-constant self-assigned this Jun 1, 2022
@malachi-constant malachi-constant linked an issue Jun 1, 2022 that may be closed by this pull request
read_parquet Does Not Throw Error for Missing Column #1315
Closed
@malachi-constant
Copy link
Contributor Author

@kukushking Maybe you can help me when you are back next week with this one. I'm worried this is a costly addition to _read_parquet() but it was the only way I could think to check if columns existed per a given pyarrow.parquet.ParquetFile. Although, my pyarrow exp is limited 😄

kukushking
kukushking reviewed Jun 7, 2022
View reviewed changes
@malachi-constant malachi-constant removed the investigating More investigation is required label Jun 7, 2022
@kukushking kukushking merged commit f2d9299 into main Jun 9, 2022
@jaidisido jaidisido deleted the 1315-read_parquet-does-not-throw-error-for-missing-column branch June 10, 2022 08:39
@robert-schmidtke robert-schmidtke mentioned this pull request Jun 29, 2022
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@kukushking kukushking kukushking approved these changes

Assignees

@malachi-constant malachi-constant

Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

read_parquet Does Not Throw Error for Missing Column
2 participants
@malachi-constant @kukushking