论文标题
Sparkgor：基因组数据分析的统一框架
SparkGOR: A unified framework for genomic data analysis
论文作者
论文摘要
动机：我们的目标是将SPARK和GOR的功能结合到一个用于分析大型基因组数据的单个计算框架中。 结果：我们创建了一个关系查询引擎，该引擎将SparkSQL和Gorpipe团结到单个声明的查询框架中。通过允许将SQL表达嵌入GOR中的高级关系语句，并支持SQL中的虚拟关系和嵌套的Gorpipe表达式来实现这一目标。此外，我们已经建立了驱动程序，以使Spark和Gor分别使用和利用其首选的文件格式，Parquet和Gorz，并引入API，以允许将GOR与Spark DataFrames一起使用。 可用性：Gorpipe软件的SparkGor版本是开源的，可在https://gorpipe-website.now.sh和https://github.com/gorpipe上免费获得。
Motivation: Our goal was to combine the capabilities of Spark and GOR into a single computing framework for use in analysis of large scale genome data. Results: We have created a relational query engine that unites SparkSQL and GORpipe into a single declarative query framework. This has been achieved by allowing embedding of SQL expressions into the high-level relational statement syntax in GOR and by supporting virtual relations and nested GORpipe expressions within SQL. Furthermore, we have built drivers to enable Spark and GOR to use and leverage their preferred file formats, Parquet and GORZ respectively, and introduced APIs to allow the use of GOR with Spark dataframes. Availability: The SparkGOR version of the GORpipe software is open-source and freely available at https://gorpipe-website.now.sh and https://github.com/gorpipe.
