Support for the Arrow IPC Format
The Arrow IPC format defines how to read and write [RecordBatch
]es to/from
a file or stream of bytes. This format can be used to serialize and deserialize
data to files and over the network.
There are two variants of the IPC format:
-
IPC Streaming Format: Supports streaming data sources, implemented by StreamReader and StreamWriter
-
IPC File Format: Supports random access, implemented by FileReader and FileWriter.
See the [reader
] and [writer
] modules for more information.