Wednesday 3:40 PM–4:20 PM in Central Park East (#6501a)

Evolving Behavioral Energy Data Science with AMI data and Big Data Processing Framework

Erica Swanson

Audience level:
Novice

Description

The arrival of AMI data quickly brought the amount of energy records the Tendril Platform manages from millions to billions. This exponential increase in data combined with more powerful tools such as Spark have provided more opportunity for advanced data science techniques which means more insights, more meaningful action for our end-users, and an even greater positive impact on the environment.

Abstract

According to the Alliance to Save Energy, the grid of the future assumes universal deployment of advanced metering infrastructure (AMI). Half of all US utility customers already have AMI installed today.

Instead of one monthly meter read (at best) per month per household with legacy systems, AMI data consists of at least 1440 data points per month per household. This quickly brought the amount of energy records the Tendril Platform manages from millions to billions.

The Data team at Tendril has remained on the bleeding edge of technology to handle the breadth of data that flows into our platform, and in 2017 it was time to upgrade our technology stack again to support our customers as they continue to deploy AMI.

I’d like to talk to an audience of Data Scientists, Data Engineers, and Energy nerds about: 1. How the technology stack at Tendril has evolved to accommodate an exponential growth of data that flows into our platform. 2. How are we leveraging AMI data and new tools Spark and Airflow to develop a new suite of products that enable our utility partners to better understand their customers in near-real time as opposed to monthly. 3. What we are working on to optimize treatment around energy savings, customer satisfaction, and cost effectiveness 4. The environmental impact our efforts have had thus far.

Subscribe to Receive PyData Updates

Subscribe