Added an optional step of compiling
fastavro with
Cython. Just doing that, with no Cython specific code reduced the time of processing 10K records from 2.9sec to 1.7sec. Not bad for that little work.
Also added a
__main__.py so you can use fastavro to process Avro files:
- python -m fastavro weather.avro # Dump records in JSON format
- python -m fastavro --schema weather.avro # Dump schema
No comments:
Post a Comment