Skip to content

feat: add streaming.StreamingDataFrame class #864

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 15 commits into from
Jul 31, 2024
Merged

feat: add streaming.StreamingDataFrame class #864

Changes from 1 commit
Commits
Show all changes
15 commits
Select commit Hold shift + click to select a range
0aba6d3
feat: add StreamingDataFrame support
GarrettWu Jul 26, 2024
65bbe69
use setattr for properties
GarrettWu Jul 26, 2024
e787cf3
fix bug
GarrettWu Jul 26, 2024
d7de128
read session from DF
GarrettWu Jul 26, 2024
5cf5f6b
fix docs and tests
GarrettWu Jul 29, 2024
3ceb6f4
fix test
GarrettWu Jul 29, 2024
5be0155
add preview warning
GarrettWu Jul 29, 2024
82d9e62
Merge remote-tracking branch 'github/main' into garrettwu-streaming
GarrettWu Jul 29, 2024
29abff9
resolve comments
GarrettWu Jul 29, 2024
512fbc0
move to streaming.read_gbq_table, add logger
GarrettWu Jul 30, 2024
eebf9c1
fix unit test
GarrettWu Jul 30, 2024
3dc2b7b
Merge remote-tracking branch 'github/main' into garrettwu-streaming
GarrettWu Jul 30, 2024
74c7fc2
fix doc test
GarrettWu Jul 30, 2024
f7d2e15
update notebook
GarrettWu Jul 30, 2024
0ab506b
add back preview warning
GarrettWu Jul 30, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
fix test
  • Loading branch information
@GarrettWu
GarrettWu committed Jul 29, 2024
commit 3ceb6f4a62845e2f067b853c99ad94a518e6e5cc
5 changes: 4 additions & 1 deletion bigframes/session/__init__.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -100,6 +100,7 @@
import bigframes.session._io.bigquery.read_gbq_table as bf_read_gbq_table
import bigframes.session.clients
import bigframes.session.planner
import bigframes.streaming
import bigframes.version

# Avoid circular imports.
Expand Down Expand Up @@ -749,7 +750,9 @@ def read_gbq_table(
filters=filters,
)

def read_gbq_table_streaming(self, table):
def read_gbq_table_streaming(
self, table: str
) -> bigframes.streaming.StreamingDataFrame:
"""Turn a BigQuery table into a StreamingDataFrame.

**Examples:**
Expand Down