Parquet data lake - advanced topics

In this section we cover some advanced topics for Parquet data lakes:

1. Backlog processing - process a historical backlog of MDF files
2. Device specific DBC - add device specific DBC decoding
3. Trip summaries - add trip summary tables to your data lake
4. Calculated signals - add calculated signal tables to your data lake
5. Signal alerts - add event tables to your data lake and trigger email alerts
6. External database - write decoded data to external database (instead of data lake)

Enabler: Some of the above rely on customizing your Lambda function.

Note

The above guides (and technical support on them) are intended for advanced users

Note

The guides take outset in Amazon - you can modify them for use locally or in Google/Azure