Commit Graph

154 Commits

Author SHA1 Message Date
D. Berge
4dc1c7df8e Re-export schema template.
No changes to the actual schema.
2020-09-24 15:31:53 +02:00
D. Berge
80324130f9 Return event geometries as GeoJSON 2020-09-24 15:24:47 +02:00
D. Berge
a4ed7f7b62 Return all QC events, not just those with labels 2020-09-23 20:19:13 +02:00
D. Berge
33c23c1239 Return event labels directly from events view.
This speeds up the query by orders of magnitude.
2020-09-23 16:31:55 +02:00
D. Berge
6bab21bce4 Fix QC test definition 2020-09-23 15:45:41 +02:00
D. Berge
ae0052de0c Add id to QC tests.
Each test has to have a unique id, in order that
we can associate results and labels with them and
cope with reorganisation of the QC tree.
2020-09-20 17:00:52 +02:00
D. Berge
94c3ed1584 Update schema.
* Report also schema in projects_summary
* Add notify triggers to events_timed, events_seq
2020-09-14 23:54:48 +02:00
D. Berge
1348eb9a8a Rename QCFail label to QC 2020-09-14 20:45:34 +02:00
D. Berge
c9b9a009af Speed up the events view.
We do this with the help of some denormalisation
and a handy trigger.

Closes #35.
2020-09-14 03:01:55 +02:00
D. Berge
b5b91d41c9 Reset event serial ids after re-import.
When the database is recreated, the sequences
used in the events_timed and events_seq tables
will be at their initial values, which will
almost certainly conflict with existing data
when it is imported via COPY.

With this commit, we set the current value for
those sequences to something usable.

Fixes #33.
2020-09-14 01:36:40 +02:00
D. Berge
da7a977c59 Change definition of Preplot QC objects 2020-09-12 22:25:45 +02:00
D. Berge
13d4771589 Add description of QC tests 2020-09-12 22:07:08 +02:00
D. Berge
52cdc8904b QC: Add gun deltas warning check 2020-09-12 21:22:34 +02:00
D. Berge
69f43c129b Remove spurious line from QC definition 2020-09-12 21:22:13 +02:00
D. Berge
8a5d103754 Fix typo 2020-09-12 20:59:20 +02:00
D. Berge
1d3d202d1f QC: change threshold of inline moving average check 2020-09-12 19:56:34 +02:00
D. Berge
cd76df9329 QC: check inline position shot by shot 2020-09-12 19:56:00 +02:00
D. Berge
5e130c3e42 QC: measure gun not manifold pressure 2020-09-12 19:54:01 +02:00
D. Berge
6d5167c052 Add more QCs 2020-09-12 19:17:14 +02:00
D. Berge
17d8041945 Update standard QC definitions + parameters 2020-09-10 23:36:13 +02:00
D. Berge
8841ffc10b Add QC definitions and parameters for Siddis surveys.
These are incomplete but meant to serve as a starting
point for other projects.
2020-09-10 23:20:58 +02:00
D. Berge
bda11cc22f Add raw_shots_preplots view.
Used by the QC routines.
2020-09-10 20:50:08 +02:00
D. Berge
48f2931a13 Change type of info table value to JSONB 2020-09-10 20:49:39 +02:00
D. Berge
906dcc6a7e Make event id serial rather than plain integer 2020-09-06 14:49:42 +02:00
D. Berge
4eb0a643c7 Merge branch '18-implement-server-push' into 'devel'
Resolve "Implement server push"

Closes #18

See merge request wgp/dougal/software!1
2020-09-06 12:30:33 +00:00
D. Berge
3e949f6185 Add meta fields to schema.
Many tables now have a JSON (jsonb) column to
hold unstructured data.
2020-09-06 13:37:11 +02:00
D. Berge
2a835e0c02 Limit notification payload sizes to 8 Kb 2020-09-06 13:31:36 +02:00
D. Berge
8c6d4e69ac Send notification on real_time_inputs insert 2020-09-04 01:33:18 +02:00
D. Berge
8800666380 Send notification on project insert/update/delete 2020-09-04 01:33:18 +02:00
D. Berge
0cdff4c493 Add notification trigger function to DB 2020-09-04 01:33:18 +02:00
D. Berge
3864dd43f5 Force CRS for header outputs 2020-09-02 08:58:23 +02:00
D. Berge
1a9f04aa98 Add NTBP status information to sequences summary 2020-09-01 12:17:21 +02:00
D. Berge
ef8429cbb0 Update example survey configuration file 2020-09-01 11:00:17 +02:00
D. Berge
41925c3645 Add a navigation header to the default configuration.
This receives data from the navigation system on
UDP port 30000. It will try to parse all known headers.
2020-08-31 14:36:56 +02:00
D. Berge
2cf9c36b2d Add real-time inputs table to DB 2020-08-31 14:36:56 +02:00
D. Berge
242d35ec80 Update schema: add project summary tables 2020-08-26 20:14:07 +02:00
D. Berge
f3e8205adc Update schema: add sequences summary view 2020-08-25 17:59:56 +02:00
D. Berge
a9ad5e1c08 Update schema: add NTBA columns.
NTBA = Not To Be Acquired. We will ignore those lines
and points in our views / queries when considering
missing shots / completion rates.
2020-08-25 17:58:03 +02:00
D. Berge
c3b0212798 Add more label definitions to example survey config 2020-08-25 17:51:19 +02:00
D. Berge
b4b06c8744 Instrument alerts for deferred imports.
In case of errors (or anything else of note), send_alert.py
can be used to push information to a GitLab alerts endpoint.

It is generic enough that it can be used with anything else, though.
2020-08-24 20:02:12 +02:00
D. Berge
1b549655fa Update schema (events).
Some columns have been renamed:

* ts0 → tstamp
* shotNumber → point

The ts1 column from events_timed has been removed.

Labels attached to a sequence / shot without an event
have been removed. All labels are now associated with events.

Changes to event views.
2020-08-22 20:19:39 +02:00
D. Berge
a588bfcb68 Add timed event labels to events view 2020-08-18 10:41:15 +02:00
D. Berge
c3d896a75b Fix typo 2020-08-17 11:22:39 +02:00
D. Berge
218172c821 Fix typo 2020-08-17 11:22:05 +02:00
D. Berge
db4064b806 Add preset event definitions to example survey config 2020-08-17 11:19:41 +02:00
D. Berge
bf1bda0edf Add label definitions to example survey config 2020-08-17 11:19:01 +02:00
D. Berge
4c710a1c62 Modify details of example survey configuration file 2020-08-17 11:17:38 +02:00
D. Berge
2ee9b0cac8 Add midnight shot synthetic event.
It inserts `LDSP` and `FDSP` labels, if those exist
in the `labels` table, on the last and first shotpoints
of the day when a sequence is shot through midnight.

The server timezone is always set to UTC so the midnight
shot implicitly refers to UTC through this.
2020-08-13 23:44:25 +02:00
D. Berge
8ea220d09e Add info on etc/db files 2020-08-12 14:24:10 +02:00
D. Berge
c7b6f259cb Add btree_gist extension to database template 2020-08-12 14:02:40 +02:00