If you're writing out protobufs, isn't the recommended approach to use some record-oriented wrapper? Something like TFRecord. Or is parseDelimitedFrom how that'

If you're writing out protobufs, isn't the recommended approach to use some record-oriented wrapper? Something like TFRecord. Or is parseDelimitedFrom how that's implemented in the first place? But Google must surely have some optimized Java libraries for this given that they use protobufs everywhere. Edit: I found https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/io/TFRecordIO.html https://beam.apache.org/releases/javadoc/current/org/apache/... which given it was developed by google is probably close to what they use. I wonder if the logic from this could be pulled out for use with non-distributed workflows.