Commit Graph

664 Commits

Author SHA1 Message Date
Quentin Machu
cfa960d619 database: Update Cayley to fix slow deletions
subject, predicate, object and labels are not indexed, thus, using a where clause on these fields for the DELETE statement does a full-table scan. Using *_hash columns instead will use the indexes.
2015-11-18 18:53:00 -05:00
Quentin Machu
ac0e68efe7 worker: Add a missing CleanURL 2015-11-18 15:02:07 -05:00
Quentin Machu
915903c1c1 database: Fix to a locking issue with PostgreSQL
It appears that preparing an INSERT statement on PostgreSQL actually makes it expecting to receive INSERTs and thus, it create some kind of locks for it. If instead, you only send him DELETE statements, it will indefinitely wait for an INSERT and hung.
2015-11-17 20:46:29 -05:00
Quentin Machu
8aacc8bfdc database: Ensure that quads in a tx are applied in the desired order. 2015-11-17 15:31:38 -05:00
Quentin Machu
635f4ec76f Merge pull request #11 from Quentin-M/bzr_parsing
updater: Always use `bzr revno` to get Ubuntu db's revision number.
2015-11-16 18:34:41 -05:00
Quentin Machu
2452a8fc48 updater: Always use bzr revno to get Ubuntu db's revision number.
Fixes #7
2015-11-16 18:33:39 -05:00
Quentin Machu
3a1d0602fb database: Use an estimator in Cayley's Size() w/ PostgreSQL 2015-11-16 16:22:16 -05:00
Quentin Machu
f229083e1e database/worker: Remove useless log message 2015-11-16 13:21:06 -05:00
Quentin Machu
9a3bea842d Merge pull request #6 from Quentin-M/reduce_tx
database: reduce pruneLocks/Unlock transaction.
2015-11-16 13:20:19 -05:00
Quentin Machu
b0142e1982 database: reduce pruneLocks/Unlock transaction.
pruneLocks could create deadlocked transactions on PostgreSQL if multiple locks expired and pruneLocks is called by multiple instances. Also adds some logging.
2015-11-16 12:06:42 -05:00
Quentin Machu
8bb6c50f80 Merge pull request #4 from Quentin-M/reduce_tx
database: reduce InsertPackages transaction and ensure locking order.
2015-11-13 18:11:03 -05:00
Quentin Machu
7f1ff8f979 database: reduce InsertPackages transaction
Inserting packages in a single transaction does not actually buy us anything as we often delete quads during an insertion and thus, Cayley could not use COPY and do a single round-trip. Inserting multiple packages in a single transaction actually creates deadlocks when a transaction tries to insert (A,B) and another one tries to insert (B,A).
2015-11-13 18:06:01 -05:00
Jimmy Zelinskie
a10260c80d README: add container badge
[ci skip]
2015-11-13 14:29:24 -05:00
Quentin Machu
3ec262dd51 Initial commit 2015-11-13 14:11:28 -05:00