Storing data in Parquet format on cloud object storage (such as AWS S3) has become mainstream, widely used in scenarios such ...

Cloudera, the project’s co-progenitor, uses Parquet as a native data storage format for its Impala analytics database project, and MapR has added data self-description functions to Parquet.

Databricks introduced Delta back in 2019 as a way to gain transactional integrity with the Parquet data table format for Spark cloud workloads. Over time, Delta evolved to become its own table format ...

With the new Data Lake Export function, AWS is allowing customers to unload data from their Redshift cluster and push it back to S3. Data that’s exported from Redshift to S3 is stored in the Apache ...

Apache Spark 1.6, which shipped yesterday, offers performance enhancements that range from faster processing of the Parquet data format to better overall performance for streaming state management.