jobmeta update

docs/dcu-lineage.md

@@ -0,0 +1,30 @@
+# Data Lineage
+
+The Data Lineage feature is available for SAS 9 installs.  The implementation differs depending on whether the lineage is table level or column level.
+
+## Table Level lineage
+
+Table level lineage is relatively straightforward, and so it is extracted in a single ad-hoc `proc metadata` call and stored in the `DATACTRL.MPE_LINEAGE_TABS` table.  To trigger the population (or refresh) of this table, simply execute the `YOURSERVER/SASStoredProcess/?_program={appLoc}/DataController/admin/refreshtablelineage` service from a browser.
+
+![jobmetadata](img/dcu-jobmeta.png)
+
+This data is stored with SCD2 so it is possible to track changes to lineage over time.
+
+When users execute table level lineage, queries are made against this table, so there is very little metadata impact.
+
+## Column Level lineage
+
+Column level lineage is more complex as it also includes all the different transforms, and calculation logic along the way.  For this reason it is performed at runtime, which means the initial request can take some time if there is a lot of lineage.
+
+After the first request, subsequent lineage requests (for that particular column and direction) are cached in the `DATACTRL.MPE_LINEAGE_COLS` table for faster response times.
+
+If the job is changed and a new diagram is needed, the user can click the 'refresh' checkbox.
+
+## Export Types
+
+Both Table and column level lineage pages allow the following export formats:
+
+* SVG - high res digram format
+* PNG - image format
+* DOT - the graphviz language format used to generate the diagram
+* CSV - a download of all the sources and targets in the diagram

docs/licences.md

@@ -1103,7 +1103,7 @@ Data Controller source licences are extracted automatically from our repo using
 │  ├─ url: http://trentm.com
 │  ├─ path: /Users/allan/git/dcfrontend/node_modules/dashdash
 │  └─ licenseFile: node_modules/dashdash/LICENSE.txt
-├─ datacontroller@3.7.0
+├─ datacontroller@3.8.0
 │  ├─ licenses: UNLICENSED
 │  ├─ private: true
 │  ├─ path: ../dcfrontend

mkdocs.yml

@@ -1,13 +1,14 @@
 site_name: Data Controller for SAS® Product Documentation
 pages:
 - Home: index.md
-- Using Data Controller:
+- User Guide:
     - Overview: dc-overview.md
     - DC User Guide: dc-userguide.md
     - File Uploads: dcu-fileupload.md
     - Table Viewer: dcu-tableviewer.md
+    - Data Lineage: dcu-lineage.md
     - Data Catalog: dcu-datacatalog.md
-- Configuring Data Controller:
+- Configuration:
     - Dates / Datetimes: dcc-dates.md
     - Emails: emails.md
     - Groups: dcc-groups.md
@@ -16,7 +17,7 @@ pages:
     - Selectboxes: dcc-selectbox.md
     - Tables: dcc-tables.md
     - Validations: dcc-validations.md
-- Installing Data Controller:
+- Installation:
     - System Requirements: dci-requirements.md
     - Backend: dci-backend.md
     - Frontend: dci-frontend.md