Re: Load a csv or a avro?

pá 5. 7. 2024 v 11:08 odesílatel sud <suds1434@gmail.com> napsal:
>
> Hello all,
>
> Its postgres database. We have option of getting files in csv and/or in avro format messages from another system to
loadit into our postgres database. The volume will be 300million messages per day across many files in batches. 
>
> My question was, which format should we chose in regards to faster data loading performance ? and if any other
aspectsto it also should be considered apart from just loading performance? 

We are able to load ~300 million rows per one day using CSV and COPY
functions (https://www.postgresql.org/docs/current/libpq-copy.html#LIBPQ-COPY-SEND).