perun.processing¶
Processing Module.
Attributes¶
Functions¶
|
Calculate total energy and average power from an energy or power time series. |
|
Calculate total bytes and average bandwidth from a byte counter series. |
|
Calculate metrics based on raw values. |
|
Recursively calculate metrics on the dataNode tree. |
|
Complete region information using sensor data found on the data node (in place op). |
|
Process run and runtime stats in region objects (in place operation). |
|
Extract a time range out of a time series, and interpolate the values at the edges. |
Module Contents¶
- perun.processing.processEnergyData(raw_data: perun.data_model.data.RawData, start: perun.data_model.measurement_type.Number | None = None, end: perun.data_model.measurement_type.Number | None = None) tuple[Any, Any][source]¶
Calculate total energy and average power from an energy or power time series.
Using the start and end parameters the results can be limited to certain areas of the application run.
- perun.processing.processIOData(raw_data: perun.data_model.data.RawData, start: perun.data_model.measurement_type.Number | None = None, end: perun.data_model.measurement_type.Number | None = None) tuple[Any, Any][source]¶
Calculate total bytes and average bandwidth from a byte counter series.
Network and disk IO sensors report a cumulative byte counter. The raw counter values on their own are not very useful, so this function converts them into an IO bandwidth (bytes per second) series, in the same spirit as
processEnergyData(), which turns an energy counter into a power series.Just like
processEnergyData(), when the input is a cumulative byte counter (unitBYTE) this function mutatesraw_datain place: the original cumulative counter is stored inraw_data.alt_values/raw_data.alt_v_mdandraw_data.values/raw_data.v_mdare replaced with the bandwidth series (unitBYTES_PER_SECOND).Using the start and end parameters the results can be limited to certain areas of the application run.
- Parameters:
- Returns:
Tuple with the total number of bytes transferred and the average bandwidth in bytes per second.
- Return type:
tuple[Any, Any]
- perun.processing.processSensorData(sensorData: perun.data_model.data.DataNode) perun.data_model.data.DataNode[source]¶
Calculate metrics based on raw values.
- perun.processing.processDataNode(dataNode: perun.data_model.data.DataNode, perunConfig: configparser.ConfigParser, force_process: bool = False) perun.data_model.data.DataNode[source]¶
Recursively calculate metrics on the dataNode tree.
- perun.processing.processRegionsWithSensorData(regions: list[perun.data_model.data.Region], dataNode: perun.data_model.data.DataNode) None[source]¶
Complete region information using sensor data found on the data node (in place op).
- perun.processing.addRunAndRuntimeInfoToRegion(region: perun.data_model.data.Region) None[source]¶
Process run and runtime stats in region objects (in place operation).
- Parameters:
region (Region) – Region object
- Return type:
None
- perun.processing.getInterpolatedValues(t: numpy.typing.NDArray[numpy.floating], x: numpy.typing.NDArray[numpy.floating], start: perun.data_model.measurement_type.Number, end: perun.data_model.measurement_type.Number) tuple[numpy.typing.NDArray[numpy.floating], numpy.typing.NDArray[numpy.floating]][source]¶
Extract a time range out of a time series, and interpolate the values at the edges.