Aaltronav/dougal-software
1
0
Fork 0
mirror of https://gitlab.com/wgp/dougal/software.git synced 2025-12-06 13:17:08 +00:00
Code Issues Packages Projects Releases Activity
1,284 Commits 63 Branches 12 Tags
302642f88d4d231d37a8f22114cef8a3a10038cd
Commit Graph

174 Commits

Author SHA1 Message Date
D. Berge
df3a0b4c50 Be explicit about what type of data is being QC'ed. 
The source deviation QCs now tell the user whether raw
or final data is being QC'ed.
 2021-05-07 21:29:39 +02:00
D. Berge
f87aa08246 Check if gun data missing for entire line. 
The `sequences` object now carries the attribute
`has_smsrc_data`, a boolean which is true iff
there is at least one `smsrc` record in the raw
shots metadata.

This is used by:

1. A new sequence-wise test which reports if gun
   data is missing for the entire sequence.

2. The individual `missing_gun_data` test which
   is inhibited if `has_smsrc_data` for the
   corresponding sequence is false.

Closes #93.
 2021-05-07 14:04:48 +02:00
D. Berge
0fdb42c593 Do not import files that have just been modified. 
We now check that a file is at least a few seconds old
before attempting to import it.

The actual minimum age can be configured in etc/config.yaml or
else is defaults to 10 seconds.

The idea is that this should give the OS enough time to fully
write the file before we import it.

The timestamp being looked at is the modification time.

Fixes #92.
 2021-05-07 13:50:32 +02:00
D. Berge
250ffe243d Fix JWT token time to live. 
Now half an hour.
 2020-10-23 14:49:52 +02:00
D. Berge
ab8a66bdcf Set JWT default options 2020-10-11 17:58:41 +02:00
D. Berge
6e7ba82ed3 Add planner elements to DB schema 2020-10-09 13:54:45 +02:00
D. Berge
739cf4b9ec Add missing triggers in preplot, raw and final tables 2020-10-06 19:19:35 +02:00
D. Berge
afa34867f5 Modify functions accessing file_data to return jsonb. 
Following schema change in 2d270cdef9.
 2020-10-04 05:13:17 +02:00
D. Berge
3de7d5d334 Re-export schema template. 
No changes, it merely shuffles the position of raw_lines
in the export.
 2020-10-04 04:07:50 +02:00
D. Berge
3c215e9973 Fix error with definition of missing_final_points view 2020-10-04 04:06:15 +02:00
D. Berge
362d9dc1a5 Re-export schema template. 
No changes, it merely shuffles the position of raw_lines
in the export.
 2020-10-04 03:37:20 +02:00
D. Berge
1249c976ef Add views related to missing shots and outstanding production 2020-10-04 03:33:23 +02:00
D. Berge
2d270cdef9 Change file_data column type from JSON to JSONB 2020-10-04 01:22:42 +02:00
D. Berge
198d0072d4 Show sequence remarks + NTBP status on map. 
Closes #50.
 2020-10-02 17:58:44 +02:00
D. Berge
11a5020004 Remove old QCs when importing final shots. 
When final shots are inserted, updated or
deleted, the corresponding QC info (which
is always held in raw_shots.meta->'qc')
is deleted.

If applicable, it will be recreated on the
next QC run.
 2020-10-02 17:30:42 +02:00
D. Berge
c12c2a3861 Update events view. 
Searches for timed events geometry within
the event's own metadata.
 2020-09-30 22:49:01 +02:00
D. Berge
21439fdd3e Associate a position with timed events if possible. 
When inserting or updating a timed event, a trigger
searches the real time events table for a position
close (within one minute) of the event time and
adds it to the event's metadata.
 2020-09-30 22:45:50 +02:00
D. Berge
78adb2bef7 Make set_survey argument case insensitive 2020-09-26 22:53:48 +02:00
D. Berge
77aae68603 Include project ID in DB notifications 2020-09-25 18:27:59 +02:00
D. Berge
9470f41f4b Fix lookup of timed event labels. 
Fixes #44.
 2020-09-24 15:32:25 +02:00
D. Berge
4dc1c7df8e Re-export schema template. 
No changes to the actual schema.
 2020-09-24 15:31:53 +02:00
D. Berge
80324130f9 Return event geometries as GeoJSON 2020-09-24 15:24:47 +02:00
D. Berge
a4ed7f7b62 Return all QC events, not just those with labels 2020-09-23 20:19:13 +02:00
D. Berge
33c23c1239 Return event labels directly from events view. 
This speeds up the query by orders of magnitude.
 2020-09-23 16:31:55 +02:00
D. Berge
6bab21bce4 Fix QC test definition 2020-09-23 15:45:41 +02:00
D. Berge
ae0052de0c Add id to QC tests. 
Each test has to have a unique id, in order that
we can associate results and labels with them and
cope with reorganisation of the QC tree.
 2020-09-20 17:00:52 +02:00
D. Berge
94c3ed1584 Update schema. 
* Report also schema in projects_summary
* Add notify triggers to events_timed, events_seq
 2020-09-14 23:54:48 +02:00
D. Berge
1348eb9a8a Rename QCFail label to QC 2020-09-14 20:45:34 +02:00
D. Berge
c9b9a009af Speed up the events view. 
We do this with the help of some denormalisation
and a handy trigger.

Closes #35.
 2020-09-14 03:01:55 +02:00
D. Berge
b5b91d41c9 Reset event serial ids after re-import. 
When the database is recreated, the sequences
used in the events_timed and events_seq tables
will be at their initial values, which will
almost certainly conflict with existing data
when it is imported via COPY.

With this commit, we set the current value for
those sequences to something usable.

Fixes #33.
 2020-09-14 01:36:40 +02:00
D. Berge
da7a977c59 Change definition of Preplot QC objects 2020-09-12 22:25:45 +02:00
D. Berge
13d4771589 Add description of QC tests 2020-09-12 22:07:08 +02:00
D. Berge
52cdc8904b QC: Add gun deltas warning check 2020-09-12 21:22:34 +02:00
D. Berge
69f43c129b Remove spurious line from QC definition 2020-09-12 21:22:13 +02:00
D. Berge
8a5d103754 Fix typo 2020-09-12 20:59:20 +02:00
D. Berge
1d3d202d1f QC: change threshold of inline moving average check 2020-09-12 19:56:34 +02:00
D. Berge
cd76df9329 QC: check inline position shot by shot 2020-09-12 19:56:00 +02:00
D. Berge
5e130c3e42 QC: measure gun not manifold pressure 2020-09-12 19:54:01 +02:00
D. Berge
6d5167c052 Add more QCs 2020-09-12 19:17:14 +02:00
D. Berge
17d8041945 Update standard QC definitions + parameters 2020-09-10 23:36:13 +02:00
D. Berge
8841ffc10b Add QC definitions and parameters for Siddis surveys. 
These are incomplete but meant to serve as a starting
point for other projects.
 2020-09-10 23:20:58 +02:00
D. Berge
bda11cc22f Add raw_shots_preplots view. 
Used by the QC routines.
 2020-09-10 20:50:08 +02:00
D. Berge
48f2931a13 Change type of info table value to JSONB 2020-09-10 20:49:39 +02:00
D. Berge
906dcc6a7e Make event id serial rather than plain integer 2020-09-06 14:49:42 +02:00
D. Berge
4eb0a643c7 Merge branch '18-implement-server-push' into 'devel' 
Resolve "Implement server push"

Closes #18

See merge request wgp/dougal/software!1
 2020-09-06 12:30:33 +00:00
D. Berge
3e949f6185 Add meta fields to schema. 
Many tables now have a JSON (jsonb) column to
hold unstructured data.
 2020-09-06 13:37:11 +02:00
D. Berge
2a835e0c02 Limit notification payload sizes to 8 Kb 2020-09-06 13:31:36 +02:00
D. Berge
8c6d4e69ac Send notification on real_time_inputs insert 2020-09-04 01:33:18 +02:00
D. Berge
8800666380 Send notification on project insert/update/delete 2020-09-04 01:33:18 +02:00
D. Berge
0cdff4c493 Add notification trigger function to DB 2020-09-04 01:33:18 +02:00