Parquet: Reading & Writing

This lesson explains the theory behind reading and writing Parquet records and later demonstrates a Java example to read and write Parquet files.

We'll cover the following

Reading & Writing

Looking back at our schema, we can come up with maximum definition and repetition levels for the various fields in our record.

message Car {
 required string make;
 required int year;
 
 repeated group part {
     required string name;
     optional int life;
     repeated string oem;   
 }
}

The table below explains the rationale behind the maximum values for definition and repetition levels:

Get hands-on with 1400+ tech skills courses.