论文标题
智能电表数据处理：用于简单有效的文本处理的展示柜
Smart meter data processing: a showcase for simple and efficient textual processing
论文作者
论文摘要
由于推出了更多的网络物理应用，因此从设备中的数据的生产和收集收集是一种持续的趋势。智能电表由于其在电网上的重要性，是一类这样的设备，其产生的数据需要细致的处理。在本文中，我们使用Unicage，这是一个基于经典Unix壳脚本的数据处理系统，在简单的软件包中提供出色的性能。我们使用此方法来以XML格式处理智能电表数据，并受到真实用例所带来的约束。我们开发了一种解决方案，该解决方案在不到10分钟的时间内解析，验证并执行2700万个XML文件的简单聚合。我们介绍了解决方案及其采用的好处的研究。
The increase in the production and collection of data from devices is an ongoing trend due to the roll-out of more cyber-physical applications. Smart meters, because of their importance in power grids, are a class of such devices whose produced data requires meticulous processing. In this paper, we use Unicage, a data processing system based on classic Unix shell scripting, that delivers excellent performance in a simple package. We use this methodology to process smart meter data in XML format, subjected to the constraints posed by a real use case. We develop a solution that parses, validates and performs a simple aggregation of 27 million XML files in less than 10 minutes. We present a study of the solution as well as the benefits of its adoption.
