GeoSpark---Polygon查询

作者: 一个懒散的人 | 来源:发表于2020-11-26 14:38 被阅读0次

环境idea-2020.1 + gradle-4.9 + scala-2.11

// gradle 的配置

plugins {
    id 'java'
    id 'scala'
}

group 'com.rhb'
version '1.0-SNAPSHOT'

sourceCompatibility = 1.8

repositories {
    maven{ url 'http://maven.aliyun.com/nexus/content/groups/public'}
}

dependencies {
    compile group: 'org.apache.spark', name: 'spark-hive_2.11', version: '2.3.3'
    compile group: 'org.apache.spark', name: 'spark-core_2.11', version: '2.3.3'
    compile group: 'org.apache.spark', name: 'spark-sql_2.11', version: '2.3.3'
    compile group: 'org.apache.spark', name: 'spark-streaming_2.11', version: '2.3.2'
    compile group: 'org.datasyslab', name: 'geospark', version: '1.1.2'
    compile group: 'org.datasyslab', name: 'geospark-sql_2.1', version: '1.1.2'
    compile group: 'com.vividsolutions', name: 'jts', version: '1.13'
}

代码如下:

package GeoSpark

import com.vividsolutions.jts.geom.{Coordinate, Envelope, GeometryFactory}
import org.apache.spark.serializer.KryoSerializer
import org.apache.spark.{SparkConf, SparkContext}
import org.datasyslab.geospark.enums.FileDataSplitter
import org.datasyslab.geospark.serde.GeoSparkKryoRegistrator
import org.datasyslab.geospark.spatialOperator.RangeQuery
import org.datasyslab.geospark.spatialRDD.{PointRDD, PolygonRDD}


object geo_demo2 {

  def main(args: Array[String]): Unit = {
    val conf = new SparkConf().
      setAppName("SpatialRangeQueryApp").setMaster("local[*]").
      set("spark.serializer",classOf[KryoSerializer].getName).
      set("spark.kryo.registrator", classOf[GeoSparkKryoRegistrator].getName)
    implicit val sc = new SparkContext(conf)

    val polygonRDD = createPolygonRDD
    polygonRDD.rawSpatialRDD.rdd.collect().foreach(println(_))


    println("===============================")
//    // 定义Polygon 查询窗口
    val geometryFactory = new GeometryFactory()
    val coordinates = new Array[Coordinate](5)
    coordinates(0) = new Coordinate(-80,0)
    coordinates(1) = new Coordinate(-80,33)
    coordinates(2) = new Coordinate(33,33)
    coordinates(3) = new Coordinate(33,0)
    coordinates(4) = coordinates(0)
    val polygonObject = geometryFactory.createPolygon(coordinates)

    val queryResult = RangeQuery.SpatialRangeQuery(polygonRDD,polygonObject,false,false)
    queryResult.rdd.collect().foreach(println(_))

  }

  def createPolygonRDD(implicit sc:SparkContext):PolygonRDD={
    val polygonRDDInputLocation = "D:\\idea\\polygon.csv"
    val polygonRDDStartOffset = 0
    val polygonRDDEndOffset = 9
    val polygonRDDSplitter = FileDataSplitter.CSV // or use  FileDataSplitter.TSV
    val carryOtherAttributes = true
    val objectRDD = new PolygonRDD(sc, polygonRDDInputLocation, polygonRDDStartOffset, polygonRDDEndOffset, polygonRDDSplitter, carryOtherAttributes)
    objectRDD
  }

}

polygon.csv 数据集

-88.331492,32.324142,-88.331492,32.324142,-88.331492,32.324142,-88.331492,32.324142,-88.331492,32.324142,hotel
-88.175933,32.360763,-88.175933,32.360763,-88.175933,32.360763,-88.175933,32.360763,-88.175933,32.360763,gas
-88.388954,32.357073,-88.388954,32.357073,-88.388954,32.357073,-88.388954,32.357073,-88.388954,32.357073,bar
-88.221102,32.35078,-88.221102,32.35078,-88.221102,32.35078,-88.221102,32.35078,-88.221102,32.35078,restaurant
-78.221102,32.35078,-78.221102,32.35078,-78.221102,32.35078,-78.221102,32.35078,-78.221102,32.35078,restaurant2

输出结果如下:

输入打印:
POLYGON ((-88.331492 32.324142, -88.331492 32.324142, -88.331492 32.324142, -88.331492 32.324142, -88.331492 32.324142))    hotel
POLYGON ((-88.175933 32.360763, -88.175933 32.360763, -88.175933 32.360763, -88.175933 32.360763, -88.175933 32.360763))    hotelgas
POLYGON ((-88.388954 32.357073, -88.388954 32.357073, -88.388954 32.357073, -88.388954 32.357073, -88.388954 32.357073))    hotelgasbar
POLYGON ((-88.221102 32.35078, -88.221102 32.35078, -88.221102 32.35078, -88.221102 32.35078, -88.221102 32.35078)) restaurant
POLYGON ((-78.221102 32.35078, -78.221102 32.35078, -78.221102 32.35078, -78.221102 32.35078, -78.221102 32.35078)) restaurantrestaurant2
===============================
输出打印:
POLYGON ((-78.221102 32.35078, -78.221102 32.35078, -78.221102 32.35078, -78.221102 32.35078, -78.221102 32.35078)) restaurantrestaurant2

Process finished with exit code 0

相关文章

  • GeoSpark---Polygon查询

    环境idea-2020.1 + gradle-4.9 + scala-2.11 代码如下: polygon.csv...

  • 需求查询

    需求查询需求查询需求查询需求查询需求查询需求查询需求查询

  • DML-数据操纵语言

    一、查询 查询指定列 查询所有列 取消相同取值的行 比较查询 多重条件查询 范围查询 集合查询 匹配查询 空值查询...

  • ThinkPHP查询

    查询方式 表达式查询 快捷查询 区间查询 组合查询 统计查询 动态查询 SQL查询 ThikPHP支持原生SQL查...

  • Access查询有哪些

    Access查询有哪些 Access查询分选择查询追加查询更新查询生成表查询交叉表查询联合查询等

  • hibernate中的查询

    HQL 查询所有 条件查询 分页查询 Criteria 查询所有 条件查询 分页查询 查询总记录 原生SQL

  • SQL查询语句1

    复杂查询 = 简单查询 + 限定查询 + 查询排序 + 多表查询 + 分组统计查询 + 子查询。 面对所有的复杂查...

  • mysql数据库中的多表关联查询

    条件查询 查询全部 查询单独信息 条件查询(有范围) 模糊查询 (like) 排序(order by) 查询我们...

  • 11django模型[条件查询]

    字段查询查询mysql数据库日志条件查询1) 查询等2) 模糊查询3) 空查询4) 范围查询5) 比较查询6) 日...

  • Oracel_子查询

    SQL子查询 子查询语法 子查询 (内查询) 在主查询之前一次执行完成。 子查询的结果被主查询(外查询)使用 。 ...

网友评论

    本文标题:GeoSpark---Polygon查询

    本文链接:https://www.haomeiwen.com/subject/sinaiktx.html