-
Notifications
You must be signed in to change notification settings - Fork 4
Build system can now support multiple graphs #633
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
Merging to allow development of MOKG ingest in a concise way.
@kevinschaper Finally got around to fixing the comments |
@kevinschaper Can we go ahead and merge this? |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Sorry for sitting on this forever, it would be nice to eventually split out build tooling from graph config, so that we really clearly have two configs and one build system all sitting side by side, but even beyond the mo_kg parts, this is a lot of great improvements
This is a functioning deploy of a version of our build software which can build different graphs using configurations
An example of how this works can be seen in
Where
and
specify which datasets to ingest and which transforms to run respectively. And the command
specifies to merge all of the transformed data to KGX files with the name "mokg".