论文标题
功能-AS-A-Service绩效评估：多媒体文献综述
Function-as-a-Service Performance Evaluation: A Multivocal Literature Review
论文作者
论文摘要
功能-AS-A-Service（FAAS）是无服务器云计算范式的一种形式，是通过执行事件触发的代码段（即函数）执行的FAAS平台（例如AWS Lambda）来定义的。许多从经验上评估此类FAA平台性能的研究已经开始出现，但是我们目前缺乏对整个领域的全面了解。为了解决这一差距，我们进行了多局文献综述（MLR），涵盖了来自学术（51）和Gray（61）文献的112项研究。我们发现现有工作主要研究AWS Lambda平台，并使用简单功能来测量CPU速度和FAAS平台开销（即容器冷启动）。此外，我们在测试平台配置上发现了学术和工业资源之间的不匹配，发现功能触发器仍未充分研究，并识别HTTP API网关和云存储是最常用的外部服务集成。遵循有关云系统实验的现有指南，我们发现了许多缺陷，威胁了被调查研究中提出的实验的可重复性。最后，我们讨论了文献中的差距，并强调了方法学的建议，这些建议可能有助于改善未来的FAA绩效评估研究。
Function-as-a-Service (FaaS) is one form of the serverless cloud computing paradigm and is defined through FaaS platforms (e.g., AWS Lambda) executing event-triggered code snippets (i.e., functions). Many studies that empirically evaluate the performance of such FaaS platforms have started to appear but we are currently lacking a comprehensive understanding of the overall domain. To address this gap, we conducted a multivocal literature review (MLR) covering 112 studies from academic (51) and grey (61) literature. We find that existing work mainly studies the AWS Lambda platform and focuses on micro-benchmarks using simple functions to measure CPU speed and FaaS platform overhead (i.e., container cold starts). Further, we discover a mismatch between academic and industrial sources on tested platform configurations, find that function triggers remain insufficiently studied, and identify HTTP API gateways and cloud storages as the most used external service integrations. Following existing guidelines on experimentation in cloud systems, we discover many flaws threatening the reproducibility of experiments presented in the surveyed studies. We conclude with a discussion of gaps in literature and highlight methodological suggestions that may serve to improve future FaaS performance evaluation studies.
