Skip to content

Consolidates data dir under pinot home - #24

Merged
codefromthecrypt merged 4 commits into
mainfrom
consolidated-data
Sep 3, 2020
Merged

codefromthecrypt merged 4 commits into
mainfrom
consolidated-data

Conversation

@codefromthecrypt

@codefromthecrypt codefromthecrypt commented Sep 3, 2020 •

Copy link
Copy Markdown

This makes working with layers immensely easier and prepares for layering schema

This makes working with layers immensely easier. This is not complete
as I noticed pinot is still looking at var likely due to some variable
we aren't setting.
@codefromthecrypt codefromthecrypt changed the title WIP consolidate data dir under pinot home Consolidates data dir under pinot home Sep 3, 2020
@codefromthecrypt
codefromthecrypt marked this pull request as ready for review September 3, 2020 08:58
Comment thread pinot-servicemanager/Dockerfile Outdated

@codefromthecrypt codefromthecrypt left a comment

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

notes

Comment thread pinot-servicemanager/Dockerfile Outdated
@@ -1,10 +1,8 @@
# Choose libraries we need from Pinot's image.
FROM apachepinot/pinot:0.5.0-SNAPSHOT-a892fb40b-20200829 as install
FROM apachepinot/pinot:0.5.0-rc1 as install

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

latest is rc2 but that's not in docker yet. doesn't matter though except we are closer to final!

# Dockerfile instructions to WORKDIR
set -eu

# Apply one-time deferred configuration that relies on ENV variables

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

pinot seems to require absolute paths, which is annoying. https://apache-pinot.slack.com/archives/CDRCA57FC/p1599123680104000

rootLogger.level=warn
rootLogger.appenderRefs=stdout
rootLogger.appenderRef.stdout.ref=STDOUT
# https://github.com/apache/incubator-pinot/pull/5001

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

somehow this is not in rc1..

Comment thread pinot-servicemanager/Dockerfile Outdated
@codefromthecrypt

Copy link
Copy Markdown
Author

tx @jcchavezs I agree that if we add any non-intuitive special heap arg we should document that

Comment thread pinot-servicemanager/etc/pinot-broker.conf
Comment thread pinot-servicemanager/etc/pinot-controller.conf
kotharironak
kotharironak previously approved these changes Sep 3, 2020

@kotharironak kotharironak left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@codefromthecrypt

Copy link
Copy Markdown
Author

reverted 0.5.0-rc1 as it doesn't have the parallel commit. not sure why rc2 is missing it also

@codefromthecrypt
codefromthecrypt merged commit 193060d into main Sep 3, 2020
@codefromthecrypt
codefromthecrypt deleted the consolidated-data branch September 3, 2020 12:39
@codefromthecrypt

Copy link
Copy Markdown
Author

thanks for the look folks. I'll do the schema thing tomorrow

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants