Streaming File Content

We’ve learned how to read and write in large blocks using os.ReadFile() and os.WriteFile().

This works well when the files are small, which is usually the case when we’re doing DevOps automation. However, sometimes, the files we want to read are very large – in most cases, we wouldn’t want to read a 2 GiB file into memory. In those cases, we want to stream the contents of the file in manageable chunks that we can operate on while keeping memory usage low.