Skip to content

neptoon.quality_control

data_validation_tables

Classes:

Functions:

FormatCheck

Bases: DataFrameModel

This is the validation table which is used to check that the time series data has been correctly formatted for use in cosmosbase.

When data is read in it must either validate against this format, or it must be pre-formatted using another script into this format.

This initial step checks the column names are as expected and that the data types are as expected.

RawDataSchemaAfterFirstQA

Bases: FormatCheck

This is an extension of the RawDataSchema to check data after the first formatting and validation steps.

relative_humidity_validation

relative_humidity_validation(series)

Check to ensure that relative humidity is given a percentage format (i.e., 20.0%) and not decimal format (i.e., 0.2). Ensures consistany when applying corrections.

check_date_time_removed_and_indexed

check_date_time_removed_and_indexed(df)

Checks that the date_time column has been assigned to index and removed from the dataframe as a column.