How to convert an NDJSON stream to a YAML stream?

[anatoly-scherbakov]

Thank you for the great tool!

I am trying to convert an NDJSON file (also known as JSON Sequence) with the following content to YAML:

{"foo": "bar"}
{"baz": "kaboom"}

I expect to see:

foo: bar
---
baz: kaboom

yq doesn't accept sample.ndjson as a valid input:

$ yq . sample.ndjson 
{"foo": "bar"}
Error: bad file 'sample.ndjson': yaml: line 1: did not find expected <document start>

yq treats JSON as a subset of YAML, but NDJSON isn't such a subset, hence the error. Is there any known compact way to achieve this conversion besides processing each line separately using xargs and then inserting document separators? Thank you!

[mikefarah]

At the moment, that's the only way (using xargs).

I've just started looking into json decoders - and found that go's built in decoder supports NDJSON!

I'll start working on adding a specific json decoder, once it's in you'll need to specify the decoder with a -p flag :)

[mikefarah]

I've added the decoder in v4.27.1 :) Just use -p=json when reading the file