feat: convert StreamedResultSet to Pandas Dataframe by Hardikr23 · Pull Request #226 · googleapis/python-spanner

Hardikr23 · 2021-02-08T07:22:10Z

Thank you for opening a Pull Request! Before submitting your PR, there are a few things you can do to make sure it goes smoothly:

Make sure to open an issue as a bug/issue before writing your code! That way we can discuss the change, evaluate designs, and agree on the general idea
Ensure the tests and linter pass
Code coverage does not decrease (if any source code was changed)
Appropriate docs were updated (if necessary)

Fixes googleapis/google-cloud-python#15927 🦕

google-cla · 2021-02-08T07:22:13Z

We found a Contributor License Agreement for you (the sender of this pull request), but were unable to find agreements for all the commit author(s) or Co-authors. If you authored these, maybe you used a different email address in the git commits than was used to sign the CLA (login here to double check)? If these were authored by someone else, then they will need to sign a CLA as well, and confirm that they're okay with these being contributed to Google.
In order to pass this check, please resolve this problem and then comment @googlebot I fixed it.. If the bot doesn't comment, it means it doesn't think anything has changed.

ℹ️ Googlers: Go here for more info.

Hardikr23 · 2021-02-08T07:32:55Z

@tswast Please review the code and let us know your feedback

tswast

You're missing the following:

Unit tests -- show a DataFrame can be created successfully with 0 rows, 1 rows, many rows
System tests -- show that a DataFrame can be created from a real query. (Also with the emulator)
Update setup.py to document the "extras" (optional dependency) on pandas, including which versions of pandas are supported.

google-cla · 2021-02-26T13:42:32Z

We found a Contributor License Agreement for you (the sender of this pull request), but were unable to find agreements for all the commit author(s) or Co-authors. If you authored these, maybe you used a different email address in the git commits than was used to sign the CLA (login here to double check)? If these were authored by someone else, then they will need to sign a CLA as well, and confirm that they're okay with these being contributed to Google.
In order to pass this check, please resolve this problem and then comment @googlebot I fixed it.. If the bot doesn't comment, it means it doesn't think anything has changed.

ℹ️ Googlers: Go here for more info.

google-cla · 2021-02-26T13:52:05Z

We found a Contributor License Agreement for you (the sender of this pull request), but were unable to find agreements for all the commit author(s) or Co-authors. If you authored these, maybe you used a different email address in the git commits than was used to sign the CLA (login here to double check)? If these were authored by someone else, then they will need to sign a CLA as well, and confirm that they're okay with these being contributed to Google.
In order to pass this check, please resolve this problem and then comment @googlebot I fixed it.. If the bot doesn't comment, it means it doesn't think anything has changed.

ℹ️ Googlers: Go here for more info.

google-cla · 2021-02-26T17:49:09Z

We found a Contributor License Agreement for you (the sender of this pull request), but were unable to find agreements for all the commit author(s) or Co-authors. If you authored these, maybe you used a different email address in the git commits than was used to sign the CLA (login here to double check)? If these were authored by someone else, then they will need to sign a CLA as well, and confirm that they're okay with these being contributed to Google.
In order to pass this check, please resolve this problem and then comment @googlebot I fixed it.. If the bot doesn't comment, it means it doesn't think anything has changed.

ℹ️ Googlers: Go here for more info.

Hardikr23 · 2021-03-02T16:25:43Z

@googlebot I fixed it.

google-cla · 2021-03-02T16:25:50Z

We found a Contributor License Agreement for you (the sender of this pull request), but were unable to find agreements for all the commit author(s) or Co-authors. If you authored these, maybe you used a different email address in the git commits than was used to sign the CLA (login here to double check)? If these were authored by someone else, then they will need to sign a CLA as well, and confirm that they're okay with these being contributed to Google.
In order to pass this check, please resolve this problem and then comment @googlebot I fixed it.. If the bot doesn't comment, it means it doesn't think anything has changed.

ℹ️ Googlers: Go here for more info.

tswast

Nits re: license headers

Co-authored-by: Tim Swast <[email protected]>

google-cla · 2021-03-08T11:37:39Z

We found a Contributor License Agreement for you (the sender of this pull request), but were unable to find agreements for all the commit author(s) or Co-authors. If you authored these, maybe you used a different email address in the git commits than was used to sign the CLA (login here to double check)? If these were authored by someone else, then they will need to sign a CLA as well, and confirm that they're okay with these being contributed to Google.
In order to pass this check, please resolve this problem and then comment @googlebot I fixed it.. If the bot doesn't comment, it means it doesn't think anything has changed.

ℹ️ Googlers: Go here for more info.

google-cla · 2021-03-08T11:37:39Z

We found a Contributor License Agreement for you (the sender of this pull request), but were unable to find agreements for all the commit author(s) or Co-authors. If you authored these, maybe you used a different email address in the git commits than was used to sign the CLA (login here to double check)? If these were authored by someone else, then they will need to sign a CLA as well, and confirm that they're okay with these being contributed to Google.
In order to pass this check, please resolve this problem and then comment @googlebot I fixed it.. If the bot doesn't comment, it means it doesn't think anything has changed.

ℹ️ Googlers: Go here for more info.

Co-authored-by: Tim Swast <[email protected]>

google-cla · 2021-03-08T11:38:00Z

We found a Contributor License Agreement for you (the sender of this pull request), but were unable to find agreements for all the commit author(s) or Co-authors. If you authored these, maybe you used a different email address in the git commits than was used to sign the CLA (login here to double check)? If these were authored by someone else, then they will need to sign a CLA as well, and confirm that they're okay with these being contributed to Google.
In order to pass this check, please resolve this problem and then comment @googlebot I fixed it.. If the bot doesn't comment, it means it doesn't think anything has changed.

ℹ️ Googlers: Go here for more info.

google-cla · 2021-03-08T11:38:00Z

We found a Contributor License Agreement for you (the sender of this pull request), but were unable to find agreements for all the commit author(s) or Co-authors. If you authored these, maybe you used a different email address in the git commits than was used to sign the CLA (login here to double check)? If these were authored by someone else, then they will need to sign a CLA as well, and confirm that they're okay with these being contributed to Google.
In order to pass this check, please resolve this problem and then comment @googlebot I fixed it.. If the bot doesn't comment, it means it doesn't think anything has changed.

ℹ️ Googlers: Go here for more info.

google-cla · 2021-03-10T16:37:35Z

We found a Contributor License Agreement for you (the sender of this pull request), but were unable to find agreements for all the commit author(s) or Co-authors. If you authored these, maybe you used a different email address in the git commits than was used to sign the CLA (login here to double check)? If these were authored by someone else, then they will need to sign a CLA as well, and confirm that they're okay with these being contributed to Google.
In order to pass this check, please resolve this problem and then comment @googlebot I fixed it.. If the bot doesn't comment, it means it doesn't think anything has changed.

ℹ️ Googlers: Go here for more info.

larkee · 2021-03-18T07:22:29Z

+        """Creates a pandas DataFrame of all rows in the result set
+
+        :rtype: pandas.DataFrame
+


Suggested change

google-cla · 2021-03-25T17:59:42Z

We found a Contributor License Agreement for you (the sender of this pull request), but were unable to find agreements for all the commit author(s) or Co-authors. If you authored these, maybe you used a different email address in the git commits than was used to sign the CLA (login here to double check)? If these were authored by someone else, then they will need to sign a CLA as well, and confirm that they're okay with these being contributed to Google.
In order to pass this check, please resolve this problem and then comment @googlebot I fixed it.. If the bot doesn't comment, it means it doesn't think anything has changed.

ℹ️ Googlers: Go here for more info.

google-cla · 2021-03-25T18:05:04Z

We found a Contributor License Agreement for you (the sender of this pull request), but were unable to find agreements for all the commit author(s) or Co-authors. If you authored these, maybe you used a different email address in the git commits than was used to sign the CLA (login here to double check)? If these were authored by someone else, then they will need to sign a CLA as well, and confirm that they're okay with these being contributed to Google.
In order to pass this check, please resolve this problem and then comment @googlebot I fixed it.. If the bot doesn't comment, it means it doesn't think anything has changed.

ℹ️ Googlers: Go here for more info.

google-cla · 2021-03-25T18:52:51Z

We found a Contributor License Agreement for you (the sender of this pull request), but were unable to find agreements for all the commit author(s) or Co-authors. If you authored these, maybe you used a different email address in the git commits than was used to sign the CLA (login here to double check)? If these were authored by someone else, then they will need to sign a CLA as well, and confirm that they're okay with these being contributed to Google.
In order to pass this check, please resolve this problem and then comment @googlebot I fixed it.. If the bot doesn't comment, it means it doesn't think anything has changed.

ℹ️ Googlers: Go here for more info.

google-cla · 2021-03-25T19:22:58Z

We found a Contributor License Agreement for you (the sender of this pull request), but were unable to find agreements for all the commit author(s) or Co-authors. If you authored these, maybe you used a different email address in the git commits than was used to sign the CLA (login here to double check)? If these were authored by someone else, then they will need to sign a CLA as well, and confirm that they're okay with these being contributed to Google.
In order to pass this check, please resolve this problem and then comment @googlebot I fixed it.. If the bot doesn't comment, it means it doesn't think anything has changed.

ℹ️ Googlers: Go here for more info.

google-cla · 2021-03-25T19:22:58Z

We found a Contributor License Agreement for you (the sender of this pull request), but were unable to find agreements for all the commit author(s) or Co-authors. If you authored these, maybe you used a different email address in the git commits than was used to sign the CLA (login here to double check)? If these were authored by someone else, then they will need to sign a CLA as well, and confirm that they're okay with these being contributed to Google.
In order to pass this check, please resolve this problem and then comment @googlebot I fixed it.. If the bot doesn't comment, it means it doesn't think anything has changed.

ℹ️ Googlers: Go here for more info.

google-cla · 2021-04-07T15:58:31Z

We found a Contributor License Agreement for you (the sender of this pull request), but were unable to find agreements for all the commit author(s) or Co-authors. If you authored these, maybe you used a different email address in the git commits than was used to sign the CLA (login here to double check)? If these were authored by someone else, then they will need to sign a CLA as well, and confirm that they're okay with these being contributed to Google.
In order to pass this check, please resolve this problem and then comment @googlebot I fixed it.. If the bot doesn't comment, it means it doesn't think anything has changed.

ℹ️ Googlers: Go here for more info.

google-cla · 2021-04-07T16:57:56Z

We found a Contributor License Agreement for you (the sender of this pull request), but were unable to find agreements for all the commit author(s) or Co-authors. If you authored these, maybe you used a different email address in the git commits than was used to sign the CLA (login here to double check)? If these were authored by someone else, then they will need to sign a CLA as well, and confirm that they're okay with these being contributed to Google.
In order to pass this check, please resolve this problem and then comment @googlebot I fixed it.. If the bot doesn't comment, it means it doesn't think anything has changed.

ℹ️ Googlers: Go here for more info.

google-cla · 2021-04-08T18:11:09Z

We found a Contributor License Agreement for you (the sender of this pull request), but were unable to find agreements for all the commit author(s) or Co-authors. If you authored these, maybe you used a different email address in the git commits than was used to sign the CLA (login here to double check)? If these were authored by someone else, then they will need to sign a CLA as well, and confirm that they're okay with these being contributed to Google.
In order to pass this check, please resolve this problem and then comment @googlebot I fixed it.. If the bot doesn't comment, it means it doesn't think anything has changed.

ℹ️ Googlers: Go here for more info.

yaozhang09 · 2023-09-25T23:53:46Z

any update on this feature? ^

chalmerlowe · 2026-03-02T15:14:29Z

Migration Notice: This library is moving to the google-cloud-python monorepo soon.

We closed this PR due to inactivity to ensure a clean migration. Please re-open this work in the new monorepo once the migration is complete!

Hardik Rathod added 2 commits February 8, 2021 12:13

Added feature to return result in pandas-df

483e9fb

Added feature to return result in pandas-df

362c143

Hardikr23 requested a review from a team February 8, 2021 07:22

google-cla Bot added the cla: no This human has *not* signed the Contributor License Agreement. label Feb 8, 2021

product-auto-label Bot added the api: spanner Issues related to the googleapis/python-spanner API. label Feb 8, 2021

Hardikr23 changed the title ~~Feature to Convert StreamedResultSet to Pandas Dataframe~~ feat :Convert StreamedResultSet to Pandas Dataframe Feb 8, 2021

Hardikr23 marked this pull request as draft February 8, 2021 07:29

Hardikr23 marked this pull request as ready for review February 8, 2021 07:33

larkee requested a review from tswast February 15, 2021 11:20

larkee changed the title ~~feat :Convert StreamedResultSet to Pandas Dataframe~~ feat: convert StreamedResultSet to Pandas Dataframe Feb 17, 2021

tswast suggested changes Feb 17, 2021

View reviewed changes

push check

fc5ab60

added unit and system testcases and PR feedback

cb5733a

made changes in test.skip() logic

0aee1d8

tswast reviewed Mar 5, 2021

View reviewed changes

Comment thread tests/system/test_system_pandasDf.py Outdated

Comment thread tests/unit/test__pandas_helpers.py Outdated

Update tests/system/test_system_pandasDf.py

e7a4d4c

Co-authored-by: Tim Swast <[email protected]>

Update tests/unit/test__pandas_helpers.py

537d498

Co-authored-by: Tim Swast <[email protected]>

Merge branch 'master' into master

b4d715e

larkee reviewed Mar 24, 2021

View reviewed changes

hardikPR added 2 commits March 25, 2021 23:03

removed _mod from the imports

be5c241

cosmetic changes done

4057e76

added to_localize()

ad1d039

tswast added the kokoro:force-run Add this label to force Kokoro to re-run the tests. label Mar 25, 2021

Merge branch 'master' into master

f460174

tswast added kokoro:force-run Add this label to force Kokoro to re-run the tests. and removed kokoro:force-run Add this label to force Kokoro to re-run the tests. labels Mar 25, 2021

yoshi-kokoro removed the kokoro:force-run Add this label to force Kokoro to re-run the tests. label Mar 25, 2021

revert grpcio intersphinx change

7906b14

tswast added the kokoro:force-run Add this label to force Kokoro to re-run the tests. label Mar 31, 2021

tswast mentioned this pull request Apr 1, 2021

cleanup spanner connector to delete duplicate code from google-cloud-spanner library GoogleCloudPlatform/professional-services-data-validator#225

Closed

2 tasks

Merge remote-tracking branch 'upstream/master' into Hardikr23/master

f919276

yoshi-kokoro removed the kokoro:force-run Add this label to force Kokoro to re-run the tests. label Apr 7, 2021

add pandas extras to noxfile

0028b7b

tswast added the kokoro:force-run Add this label to force Kokoro to re-run the tests. label Apr 7, 2021

yoshi-kokoro removed the kokoro:force-run Add this label to force Kokoro to re-run the tests. label Apr 7, 2021

move import to more standard location

0104348

blunderbuss-gcf Bot assigned sakthivelmanii Mar 2, 2026

chalmerlowe closed this Mar 2, 2026

		"""Creates a pandas DataFrame of all rows in the result set

		:rtype: pandas.DataFrame

Uh oh!

Conversation

Hardikr23 commented Feb 8, 2021 • edited by tswast Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

google-cla Bot commented Feb 8, 2021

Uh oh!

Hardikr23 commented Feb 8, 2021

Uh oh!

tswast left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

google-cla Bot commented Feb 26, 2021

Uh oh!

google-cla Bot commented Feb 26, 2021

Uh oh!

google-cla Bot commented Feb 26, 2021

Uh oh!

Hardikr23 commented Mar 2, 2021

Uh oh!

google-cla Bot commented Mar 2, 2021

Uh oh!

tswast left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

google-cla Bot commented Mar 8, 2021

Uh oh!

google-cla Bot commented Mar 8, 2021

Uh oh!

google-cla Bot commented Mar 8, 2021

Uh oh!

google-cla Bot commented Mar 8, 2021

Uh oh!

google-cla Bot commented Mar 10, 2021

Uh oh!

Uh oh!

larkee Mar 18, 2021

Choose a reason for hiding this comment

Uh oh!

Hardikr23 Mar 25, 2021

Choose a reason for hiding this comment

Uh oh!

google-cla Bot commented Mar 25, 2021

Uh oh!

google-cla Bot commented Mar 25, 2021

Uh oh!

google-cla Bot commented Mar 25, 2021

Uh oh!

google-cla Bot commented Mar 25, 2021

Uh oh!

google-cla Bot commented Mar 25, 2021

Uh oh!

google-cla Bot commented Apr 7, 2021

Uh oh!

google-cla Bot commented Apr 7, 2021

Uh oh!

google-cla Bot commented Apr 8, 2021

Uh oh!

yaozhang09 commented Sep 25, 2023

Uh oh!

chalmerlowe commented Mar 2, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Hardikr23 commented Feb 8, 2021 •

edited by tswast

Loading