Parallel python loaders
Through some elegant dancing around locks, the pandas and parquet loaders now ingest into Raphtory’s underlying graph shards with minimal contention between threads. This has led to an order of magnitude improvement in ingestion speed in several of our use cases!
An example of this can be seen below where the 129 million edges of the Graph500 SF23 dataset are ingested in 25 seconds on a laptop!
Other minor bug fixes
- Don't drop the update in the Cache if the write fails by @ljeub-pometry in #1745
- fix typo in cdf and ccdf functions by @narnolddd in #1748
- More cache writer error handling improvements by @ljeub-pometry in #1747
- fix latest_time for exploded edge on PersistentGraph for edges that are deleted at the same time as created by @ljeub-pometry in #1752
- implementation of temporal rich club by @narnolddd in #1692
- Write-locked graph storage implementation for faster bulk loaders by @ljeub-pometry in #1741
- Release v0.11.3 by @github-actions in #1753
Full Changelog: v0.11.2...v0.11.3
Contributors
narnolddd and ljeub-pometry