79af05e67d
pgsql: Fix postgres queries for feature_type
5 years ago
015a79fd5a
Layer: replace arrays with slices
...
The current code is much cleaner because it doesn't use indexes + it
should be more memory efficient.
5 years ago
0c1b80b2ed
pgsql: Implement database queries for detector relationship
...
* Refactor layer and ancestry
* Add tests
* Fix bugs introduced when the queries were moved
6 years ago
9c49d9dc55
pgsql: Move queries to corresponding files
...
Aggregate queries in their corresponding files instead of having the
single file for every queries because the database is more complicated.
6 years ago
e160616723
database: Use LayerWithContent as Layer
6 years ago
5d725e67b0
Replace Ancestry with AncestryWithContent struct in database models
...
As one of the steps to simplifies the codebase, the AncestryWithContent
struct is renamed to Ancestry, and Ancestry is removed. It will cause
the PostAncestry request to be slower.
6 years ago
2827b9342b
Update Database and Worker implementation for layer-wise feature
...
Feature extraction algorithm is changed to associate features with
ancestry layer. Database is updated to keep the relationship.
6 years ago
a5c6400065
database: postgres implementation with tests.
7 years ago
bffa6499b7
added support for detect multiple namespaces in a layer
...
created table layer_namespace to store the many to many unique mapping of layers and namespaces
changed v1 api to provide a list of namespaces for each layer
changed namespace detector to use all registered detectors to detect namespaces
updated tests for multiple namespaces
Fixes #150
7 years ago
9306e99368
converted to structured logging by using logrus
...
changed from capnslog to logrus for logging JSON structured message.
finished issue #383
7 years ago
3e4dc3834f
utils: remove string.go
7 years ago
78cef02fda
pkg: cerrors -> commonerr
7 years ago
033709eaea
add registerable version formats
...
Since we only ever used dpkg, this change shims everything into using
dpkg.
7 years ago
a38fbf6cfe
worker/database: Move upgrade detection logic out of database to worker
8 years ago
e7b960c05b
database: Allow specifying datastore driver by config
...
Fixes #145
8 years ago
363cde29f4
psql: add debug message for duplicate layers
8 years ago
500fc4e407
various: gofmt -s
8 years ago
8fd0aa162b
various: spelling corrections
8 years ago
84319507df
database: use constants to store queries
8 years ago
06531e01c5
database: disable hash/merge joins in FindLayer
...
Our experiments have shown that PostgreSQL 9.4 makes bad
planning decisions about:
- joining the layer tree to feature versions and feature
- joining the feature versions to affected/fixed feature version and vulnerabilities
It would for instance do a merge join between affected feature versions (300 rows, estimated
3000 rows) and fixed in feature version (100k rows). In this case, it is much more
preferred to use a nested loop.
8 years ago
6d2eedf121
api/database: add the layer name that add each feature in getLayer
8 years ago
f0816d2c4d
database: add docs about the interface
8 years ago
d3b14106a9
database: ignore insertLayer collisions to make it truly idempotent
8 years ago
5fdd9d1a07
*: add metadata support along with NVD CVSS
8 years ago
baed60e19b
prometheus: add initial Prometheus support
8 years ago
563b3825d8
database: let handleErrors deal with the not found case
8 years ago
726bd3c0c6
database/api: add layer deletion support
8 years ago
82175dcfe9
*: add missing copyright headers
8 years ago
92b734d0a4
database: remove an useless query in FindLayer
8 years ago
7c70fc1c20
database: add initial vulnerability support
8 years ago
3a786ae020
database: add lock support
8 years ago
6a9cf21fd4
database: log and mask SQL errors
8 years ago
970756cd5a
database: do insert/find layers (with their features and vulnerabilities)
8 years ago
2c150b015e
*: refactor & do initial work towards PostgreSQL implementation
8 years ago
Sida Chen