Can't plot certain measurements with statistics enabled

[andrzej-r]

I was happily using the plotly card for plotting power entities with statistics enabled. Then, I tried doing the same with other measurements (kWh, %, temperature etc) and I found they were not plotted at all. When I disabled statistics for that waveform it got plotted just fine. Any ideas what may be getting wrong or how to debug it? I do not see any error messages.

The code is a bit complicated but for the sake of completeness. The entity that is not plotted (unless I comment out statistic: section) is "SoC" - state of charge of battery in percents. I can see "SoC" showing up in the legend and the unit of axis y2 is changed to "%".

type: custom:plotly-graph
title: Battery
layout:
  hovermode: x unified
  height: 541
  margin:
    t: 50
  xaxis:
    rangeselector:
      'y': 1.1
      buttons:
        - count: 3
          step: hour
        - count: 12
          step: hour
        - count: 1
          step: day
        - count: 3
          step: day
        - count: 7
          step: day
        - count: 1
          step: month
        - count: 1
          step: year
  yaxis:
    fixedrange: true
    nticks: 11
    zeroline: false
    showgrid: true
    range:
      - -5000
      - 5000
  yaxis2:
    fixedrange: true
    nticks: 11
    zeroline: false
    showgrid: false
    range:
      - 0
      - 100
defaults:
  entity:
    line:
      width: 1
      shape: line
    statistic: mean
    period:
      0m: 5minute
      36h: hour
      10d: day
entities:
  - entity: sensor.solar_to_battery
    name: from solar
    yaxis: y1
    stackgroup: charge
  - entity: sensor.ac_charge_power
    name: from grid
    yaxis: y1
    stackgroup: charge
  - entity: sensor.discharge_power
    name: to grid
    yaxis: y1
    stackgroup: discharge
  - entity: sensor.soc
    name: SoC
    yaxis: y2
hours_to_show: 24

[dbuezas]

Hi Andrzej,
you most likely don't have statistics for that sensor. Try using a statistics card to confirm that

[andrzej-r]

I confirm this entity (among many others) is not available for use in the statistics card. I am new to Home Assistant and I was not aware of a distinction between entities with numeric values and entities which provide statistical data.

An obvious follow-up question: how do I fix it? Does it have to be done at an integration level (which I do not control), can I add my own derived MQTT sensor template or is there a way of enabling statistics for an existing entity?

[andrzej-r]

This seems to imply the solution in on the integration side:
https://www.home-assistant.io/more-info/statistics/
https://developers.home-assistant.io/docs/core/entity/sensor/#long-term-statistics

[dbuezas]

Yes, that originally surprised me too. Some times there are statistics but not for all time scales (periods).

I do not know exactly how it is decided what should be stored ad statistics, it may well be on the integration side as you say. I suggest asking in the Home Assistant forum (and if you do, feel free to link it here, I'd be curious to know :) )

[andrzej-r]

I reported the issue here: GivEnergy/giv_tcp#30 Meanwhile, I will try creating a new MQTT sensor and see if that solves the problem.

Talking about aggregation periods, at one point I did notice an issue with 1 day period. I was looking at a plot of solar production (power) averaged (mean) over periods of 1 hour. There was a daily activity in there (non-zero, and generally quite high power output every day lasting at least several hours). When I zoomed out a bit more and the averaging period changed to 1 day I noticed one of the days in the middle of the chart was showing zero average power. I haven't reported this issue here because I can no longer reproduce it - currently results looks consistent across aggregation periods.

[ulliillu]

Hi,
I have to bring this up again.
I checked the daily energy sensors for my two solar power plants for their availability in the statistics chart. Both work fine and periods older than 30 days are displayed (I increased the time to keep more detailed data from 10 to 30 days).

Even the History-Chart says that for older data the long term statistic is being used:

But when I try to display the daily energy in a plotly graph, only the temperature data is displayed for more than 30 days - the rest is just cut off:

If I use:

statistic: mean #or anything else that is allowed
period: hour

nothing is displayed anymore.

Any suggestions what I am doing wrong?

Here is my code:

entities:
  - entity: sensor.hoymiles_hms_xxxxw_t2_flo_60s_ac_daily_energy
    name: HMS-800W-2T Daily Energy
    unit_of_measurement: kWh
    filters:
      - map_y: y/1000
  - entity: sensor.hm_800_yieldday
    name: HM-800 YieldDay
    unit_of_measurement: kWh
    filters:
      - map_y: y/1000
  - entity: sensor.hm_800_temperature
    statistic: mean
    period: hour
    yaxis: y2
    fill: none
hours_to_show: 7d
defaults:
  entity:
    fill: tozeroy
    line:
      width: 1
  yaxes:
    fixedrange: true
    layout: null
    range:
      - 0
      - 6
    dtick: 1
layout:
  yaxis2:
    mirroraxis: true
    fixedrange: true
    range:
      - 0
      - 100
    dtick: 10
  xaxis:
    rangeselector:
      'y': 1.4
      buttons:
        - count: 1
          step: minute
        - count: 1
          step: hour
        - count: 12
          step: hour
        - count: 1
          step: day
        - count: 7
          step: day
        - count: 1
          step: month
        - count: 2
          step: month
        - count: 6
          step: month

[ulliillu]

got it working now:

type: custom:plotly-graph
title: Leistung (W)
entities:
  - entity: sensor.wechselrichter_ac_leistung_2
    name: HMS-800W-2T
    unit_of_measurement: W
  - entity: sensor.hm_800_power
    name: HM-800
    unit_of_measurement: W
  - entity: sensor.wechselrichter_ac_leistung_2
    name: HMS-800W-2T (historisch)
    showlegend: false
    period: hour
    unit_of_measurement: W
    line:
      color: 3B75AF
    filters:
      - filter: x < Date.now() - 1000 * 60 * 60 * 24 * 30
  - entity: sensor.hm_800_power
    name: HM-800 (historisch)
    showlegend: false
    period: hour
    unit_of_measurement: W
    line:
      color: EF8636
    filters:
      - filter: x < Date.now() - 1000 * 60 * 60 * 24 * 30
hours_to_show: 7d
autorange_after_scroll: true
defaults:
  entity:
    line:
      width: 1
    filters:
      - resample: 5m
  yaxes:
    fixedrange: true
    layout: null
    range:
      - 0
      - 900
    dtick: 100
layout:
  xaxis:
    tickformat: '%d'
    tickformatstops:
      - dtickrange:
          - null
          - 82800000 #2 Tage
        value: <i>%a %d %b</i><br><b>%H:%M</b>
      - dtickrange:
          - 82800001 #2 Tag +1ms
          - 5029800000 #1 Monat
        value: <b>%a</b><br>%d %b
      - dtickrange:
          - 5029800001
          - 31557600000
        value: <b>%b</b><br>%Y
    rangeselector:
      'y': 1.1
      buttons:
        - count: 6
          step: hour
        - count: 1
          step: day
        - count: 7
          step: day
        - count: 1
          step: month
        - count: 2
          step: month
  height: 500````