Skip to content

Providing support for streaming dataset results #67

@noahfrn

Description

@noahfrn

Hi there,

I'd like to expose an interface on the java side to access the executeStream method on Datasets, which would let results be streamed as RecordBatches without having to materialise all of the data in memory. Before doing so, I just have a couple of questions:

  • Is this library still active? The last commit at the time of writing is from Sep 2022, so I'd like to make sure that any work we contribute would be reviewed/merged
  • Is there any appetite for this change to be merged?
    Thanks!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions