Reduce the size of the MPE_AUDIT table #4

New Issue

allan · 2023-07-17T13:10:46Z

allan commented

2023-07-17 13:10:46 +00:00

Currently when loading an audit table we include the entire row - including values that have not changed.

This can result in very large audit tables!

To limit the data / volume / keep it manageable, the default option should be to exclude data where MOVE_TYPE="M" and IS_DIFF=0.

We will continue to post the full record for MOVE_TYPE="A" or MOVE_TYPE="D" (added/deleted) so that the table state can still be reproduced from the starting table, or reverted back from a modified table.

Currently when loading an [audit table](https://docs.datacontroller.io/tables/mpe_audit/) we include the entire row - including values that have not changed. This can result in very large audit tables! To limit the data / volume / keep it manageable, the default option should be to _exclude_ data where `MOVE_TYPE="M" and IS_DIFF=0`. We will continue to post the full record for `MOVE_TYPE="A" or MOVE_TYPE="D"` (added/deleted) so that the table state can still be reproduced from the starting table, or reverted back from a modified table.

allan self-assigned this 2023-07-20 15:10:28 +00:00

allan referenced this issue from a commit

2023-07-20 20:30:30 +00:00

fix: reducing audit data volumes. Closes #4

allan referenced a pull request that will close this issue

2023-07-20 20:31:01 +00:00

fix: reducing audit data volumes. Closes #4 #6

allan closed this issue

2023-07-25 08:50:32 +00:00

gitea-actions referenced this issue from a commit

2023-07-25 15:14:53 +00:00

chore(release): 6.1.0 [skip ci]