Skip to content

CLN: Use WriteDisposition for if_exists=fail/replace/append behavior in to_gbq #118

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
tswast opened this issue Feb 12, 2018 · 1 comment · Fixed by #583
Closed

CLN: Use WriteDisposition for if_exists=fail/replace/append behavior in to_gbq #118

tswast opened this issue Feb 12, 2018 · 1 comment · Fixed by #583
Assignees
@tswast @aribray
Labels
api: bigquery Issues related to the googleapis/python-bigquery-pandas API. type: feature request ‘Nice-to-have’ improvement, new feature or different behavior or design.

Comments

@tswast
Copy link
Collaborator

tswast commented Feb 12, 2018

Now that to_gbq is using load jobs instead of streaming to write to table, it could use the write disposition parameter to perform this behavior.

I believe by doing so we would unlock #43 since using write disposition could replace just one partition, but the current logic of deleting and recreating a table cannot handle partitions.
@tswast tswast changed the title Use WriteDisposition for if_exists=fail/replace/append behavior in to_gbq CLN: Use WriteDisposition for if_exists=fail/replace/append behavior in to_gbq Feb 12, 2018
@tswast tswast added the type: process A process-related concern. May include testing, release, or the like. label Nov 6, 2020
@product-auto-label product-auto-label bot added the api: bigquery Issues related to the googleapis/python-bigquery-pandas API. label Jul 17, 2021
@tswast tswast mentioned this issue Jan 5, 2022
Closed
@tswast tswast self-assigned this Jan 5, 2022
@tswast
Copy link
Collaborator Author

tswast commented Jan 5, 2022

Taking this as part of #453

@tswast tswast mentioned this issue Jan 19, 2022
Closed
2 tasks
@tswast tswast added type: feature request ‘Nice-to-have’ improvement, new feature or different behavior or design. and removed type: process A process-related concern. May include testing, release, or the like. labels Jan 19, 2022
@aribray aribray self-assigned this Oct 19, 2022
This was referenced Oct 25, 2022
Closed
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@tswast tswast

@aribray aribray

Labels
api: bigquery Issues related to the googleapis/python-bigquery-pandas API. type: feature request ‘Nice-to-have’ improvement, new feature or different behavior or design.
Projects
None yet
Milestone
No milestone
2 participants
@tswast @aribray