Skip to main content
Version: 0.10.4

File

For context on getting started with ingestion, check out our metadata ingestion guide.

Setup​

Works with acryl-datahub out of the box.

Capabilities​

Outputs metadata to a file. This can be used to decouple metadata sourcing from the process of pushing it into DataHub, and is particularly useful for debugging purposes. Note that the file source can read files generated by this sink.

Quickstart recipe​

Check out the following recipe to get started with ingestion! See below for full configuration options.

For general pointers on writing and running a recipe, see our main recipe guide.

source:
  # source configs

sink:
  type: file
  config:
    filename: ./path/to/mce/file.json

Config details​

Note that a . is used to denote nested fields in the YAML recipe.

FieldRequiredDefaultDescription
filename✅Path to file to write to.

Questions​

If you've got any questions on configuring this sink, feel free to ping us on our Slack!