Skip to content

Commit ee33284

Browse files
author
Jake Kenneally
committed
updates for Google Cloud Bigtable and keeping documentation current
1 parent 937a202 commit ee33284

20 files changed

+303
-219
lines changed

_config.yml

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -4,6 +4,8 @@ description: Website for GeoMesa
44
#url: "http://geomesa.org"
55
url: "http://localhost:4000"
66
repoUrl: "http://github.com/locationtech/geomesa"
7+
stableVersion: "1.0.0-rc.6"
8+
developmentVersion: "1.0.0-rc.7-SNAPSHOT"
79

810
paginate: 10
911

@@ -34,6 +36,8 @@ authors:
3436
display_name: Jake Kenneally
3537
andrew-and-jake:
3638
display_name: Andrew Annex and Jake Kenneally
39+
chris-and-aannex:
40+
display_name: Chris Eichelberger and Andrew Annex
3741

3842
gems:
3943
- jekyll-redirect-from

_includes/footer.html

Lines changed: 11 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -3,11 +3,22 @@
33
<div class="container">
44
<div class="row">
55
<div class="col-md-12">
6+
<p class="supported-by">The GeoMesa Project is supported by</p>
67
<div class="locationtech">
78
<a href="http://www.locationtech.org">
89
<h3>Locationtech</h3>
910
</a>
1011
</div>
12+
<div class="eclipse">
13+
<a href="http://www.eclipse.org">
14+
<h3>Eclipse</h3>
15+
</a>
16+
</div>
17+
<div class="ccri">
18+
<a href="http://www.ccri.com">
19+
<h3>CCRi</h3>
20+
</a>
21+
</div>
1122
</div>
1223
</div>
1324
</div>

_includes/header.html

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -31,7 +31,7 @@
3131
</head>
3232
<body>
3333
<h1 class="logo">
34-
<a href="/index.html">GeoMesa</a>
34+
<a href="/index.html"></a>
3535
</h1>
3636
<div class="tagline">
3737
<h2>Store, index, query, and transform spatio-temporal data at scale in Accumulo</h2>

_includes/sidebar.html

Lines changed: 10 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -11,12 +11,19 @@ <h3>Get started</h3>
1111
<nav>
1212
<ul class="list-unstyled">
1313
<li><a href="/#downloads">Downloads</a></li>
14+
<li><a href="/geomesa-deployment/">Deployment</a></li>
1415
<li><a href="/#quick-start">Quick start</a></li>
1516
<!-- <li><a href="/documentation/">Read the documentation</a></li> -->
1617
<li><a href="/faq/">FAQ</a></li>
1718
<li><a href="/#support">Report a bug</a></li>
1819
</ul>
1920
</nav>
21+
<h3>Professional Support</h3>
22+
<nav>
23+
<ul class="list-unstyled">
24+
<li><a href="http://www.ccri.com/case-studies/geomesa/">Professional support by CCRi</a></li>
25+
</ul>
26+
</nav>
2027

2128
<h3>Resources</h3>
2229
<nav>
@@ -31,9 +38,11 @@ <h3>Resources</h3>
3138
<h3>Tutorials</h3>
3239
<nav>
3340
<ul class="list-unstyled">
34-
{% for tutorial in site.posts reversed %}
41+
<li><a href="/geomesa-quickstart/">GeoMesa Quick Start</a></li>
42+
{% for tutorial in site.posts reversed limit: 3 %}
3543
<li><a href="{{ tutorial.url }}">{{ tutorial.title }}</a></li>
3644
{% endfor %}
45+
<li><a href="/tutorials/">Additional Tutorials...</a></li>
3746
</ul>
3847
</nav>
3948
</div>

_posts/2014-04-10-geomesa-quickstart.md

Lines changed: 30 additions & 105 deletions
Original file line numberDiff line numberDiff line change
@@ -11,14 +11,13 @@ redirect_from:
1111

1212
### This tutorial will introduce how to:
1313

14-
1. check out and build GeoMesa source
15-
2. write custom Java code using GeoMesa to do the following:
14+
1. write custom Java code using GeoMesa to do the following:
1615
1. create a custom ```FeatureType```
1716
2. prepare a GeoMesa-managed table to accept your new type
1817
3. create a collection of new records
1918
4. write these new records to the GeoMesa-managed table
2019
5. query your data
21-
3. visualize data within GeoServer
20+
2. visualize data within GeoServer
2221
<!--more-->
2322

2423
<div class="callout callout-warning">
@@ -28,29 +27,8 @@ redirect_from:
2827

2928
#### Other prerequisites
3029

31-
Before you begin, you should also have these:
32-
33-
* basic knowledge of GeoTools, GeoServer, and Accumulo
34-
* an Accumulo user that has both create-table and write permissions
35-
* a local copy of the Java Development Kit 1.7.x
36-
* Apache Maven installed
37-
* a GitHub client installed
38-
39-
### DOWNLOAD AND BUILD GEOMESA
40-
41-
Pick a reasonable directory on your machine, and run:
42-
43-
```
44-
git clone https://github.com/locationtech/geomesa.git
45-
```
46-
47-
From that newly-created directory, run
48-
49-
```
50-
mvn clean install
51-
```
52-
53-
NB: This step is only required, because the GeoMesa artifacts have not yet been published to a public Maven repository. With the upcoming 1.0 release of GeoMesa, these artifacts will be available at LocationTech's Nexus server, and this download-and-build step will become obsolete.
30+
Before you begin, it is assumed that at this point you have successfully completed the [GeoMesa-Deployment](/geomesa-deployment/) tutorial.
31+
The deployment tutorial provides instructions for building and deploying GeoMesa to Accumulo and GeoServer, and is a prerequisite to the quickstart.
5432

5533
### DOWNLOAD AND BUILD THE TUTORIAL CODE
5634

@@ -70,19 +48,13 @@ mvn clean install
7048

7149
When this is complete, it should have built a JAR file that contains all of the code you need to run the tutorial.
7250

73-
### INSTALL GEOMESA ACCUMULO ITERATORS
74-
75-
After 'mvn clean install' finishes, you should have a JAR in geomesa-distributed-runtime/target/ named geomesa-distributed-runtime-accumulo1.5-VERSION.jar.
76-
77-
This JAR contains the GeoMesa Accumulo Iterators which are necessary to query GeoMesa. This JAR needs to be copied to $ACCUMULO_HOME/lib/ext on each tablet server.
78-
7951
### RUN THE TUTORIAL
8052

8153
On the command-line, run:
8254

83-
```
55+
{% highlight bash %}
8456
java -cp ./target/geomesa-quickstart-1.0-SNAPSHOT.jar org.geomesa.QuickStart -instanceId somecloud -zookeepers "zoo1:2181,zoo2:2181,zoo3:2181" -user someuser -password somepwd -tableName sometable
85-
```
57+
{% endhighlight %}
8658

8759
where you provide your own values for the following place-holder arguments:
8860

@@ -94,85 +66,38 @@ where you provide your own values for the following place-holder arguments:
9466

9567
You should see output similar to the following (not including some of Maven's output and log4j's warnings):
9668

97-
Creating feature-type (schema): QuickStart
98-
Creating new features
99-
Inserting new features
100-
Submitting query
101-
1. Bierce|640|Sun Sep 14 15:48:25 EDT 2014|POINT (-77.36222958792739 -37.13013846773835)|null
102-
2. Bierce|886|Tue Jul 22 14:12:36 EDT 2014|POINT (-76.59795732474399 -37.18420917493149)|null
103-
3. Bierce|925|Sun Aug 17 23:28:33 EDT 2014|POINT (-76.5621106573523 -37.34321201566148)|null
104-
4. Bierce|589|Sat Jul 05 02:02:15 EDT 2014|POINT (-76.88146600670152 -37.40156607152168)|null
105-
5. Bierce|394|Fri Aug 01 19:55:05 EDT 2014|POINT (-77.42555615743139 -37.26710898726304)|null
106-
6. Bierce|931|Fri Jul 04 18:25:38 EDT 2014|POINT (-76.51304097832912 -37.49406125975311)|null
107-
7. Bierce|322|Tue Jul 15 17:09:42 EDT 2014|POINT (-77.01760098223343 -37.30933767159561)|null
108-
8. Bierce|343|Wed Aug 06 04:59:22 EDT 2014|POINT (-76.66826220670282 -37.44503877750368)|null
109-
9. Bierce|259|Thu Aug 28 15:59:30 EDT 2014|POINT (-76.90122194030118 -37.148525741002466)|null
69+
{% highlight bash %}
70+
Creating feature-type (schema): QuickStart
71+
Creating new features
72+
Inserting new features
73+
Submitting query
74+
1. Bierce|640|Sun Sep 14 15:48:25 EDT 2014|POINT (-77.36222958792739 -37.13013846773835)|null
75+
2. Bierce|886|Tue Jul 22 14:12:36 EDT 2014|POINT (-76.59795732474399 -37.18420917493149)|null
76+
3. Bierce|925|Sun Aug 17 23:28:33 EDT 2014|POINT (-76.5621106573523 -37.34321201566148)|null
77+
4. Bierce|589|Sat Jul 05 02:02:15 EDT 2014|POINT (-76.88146600670152 -37.40156607152168)|null
78+
5. Bierce|394|Fri Aug 01 19:55:05 EDT 2014|POINT (-77.42555615743139 -37.26710898726304)|null
79+
6. Bierce|931|Fri Jul 04 18:25:38 EDT 2014|POINT (-76.51304097832912 -37.49406125975311)|null
80+
7. Bierce|322|Tue Jul 15 17:09:42 EDT 2014|POINT (-77.01760098223343 -37.30933767159561)|null
81+
8. Bierce|343|Wed Aug 06 04:59:22 EDT 2014|POINT (-76.66826220670282 -37.44503877750368)|null
82+
9. Bierce|259|Thu Aug 28 15:59:30 EDT 2014|POINT (-76.90122194030118 -37.148525741002466)|null
83+
{% endhighlight %}
11084

11185
### INSIGHT INTO HOW THE TUTORIAL WORKS
11286

11387
The source code is meant to be accessible for this tutorial, but here is a high-level breakdown of the sections that are relevant:
11488

115-
* lines 3-30: package imports
116-
* lines 65-109: helper code to establish the command-line parser for Accumulo options
117-
* lines 111-118: create a `HashMap` of Accumulo parameters that will be used to fetch a `DataStore`
118-
* lines 120-142: defines the custom `FeatureType` used in the tutorial. There are five fields: Who, What, When, Where, and Why.
119-
* lines 144-192: creates a collection of new features, each of which is initialized to some randomized set of values
120-
* lines 194-201: instructs the `DataStore` to write the collection of new features to the GeoMesa-managed Accumulo table
121-
* lines 203-226: given a set of geometric bounds, temporal bounds, and an optional attribute-only expression, construct a common query language (CQL) filter that embodies these constraints. This filter will be used to query data.
122-
* lines 228-256: query for records; for each, print out the five field (attribute) values
123-
* lines 258-293: this is the main entry point; it collects command-line parameters, builds the `DataStore`, creates and inserts new records, and then kicks off a single query
89+
* lines 3-31: package imports
90+
* lines 65-110: helper code to establish the command-line parser for Accumulo options
91+
* lines 112-119: create a `HashMap` of Accumulo parameters that will be used to fetch a `DataStore`
92+
* lines 121-143: defines the custom `FeatureType` used in the tutorial. There are five fields: Who, What, When, Where, and Why.
93+
* lines 145-193: creates a collection of new features, each of which is initialized to some randomized set of values
94+
* lines 195-202: instructs the `DataStore` to write the collection of new features to the GeoMesa-managed Accumulo table
95+
* lines 204-227: given a set of geometric bounds, temporal bounds, and an optional attribute-only expression, construct a common query language (CQL) filter that embodies these constraints. This filter will be used to query data.
96+
* lines 229-257: query for records; for each, print out the five field (attribute) values
97+
* lines 259-294: this is the main entry point; it collects command-line parameters, builds the `DataStore`, creates and inserts new records, and then kicks off a single query
12498

12599
### VISUALIZE DATA WITH GEOSERVER
126100

127-
You should have an instance of GeoServer, version 2.5.2, running somewhere that has access to your Accumulo instance.
128-
129-
#### Geoserver Setup
130-
131-
Be sure that you have installed the optional [WPS](http://docs.geoserver.org/stable/en/user/extensions/wps/install.html) package installed for your version of GeoServer.
132-
133-
Copy the the `geomesa-plugin-accumulo1.5-1.0.0-rc.4-SNAPSHOT-geoserver-plugin.jar` library file from the GeoMesa directory you built into your GeoServer's library directory.
134-
135-
If you are using tomcat:
136-
137-
{% highlight bash %}
138-
cp geomesa/geomesa-plugin/target/geomesa-plugin-accumulo1.5-1.0.0-rc.4-SNAPSHOT-geoserver-plugin.jar /path/to/tomcat/webapps/geoserver/WEB-INF/lib/
139-
{% endhighlight %}
140-
141-
If you are using GeoServer's built in Jetty web server:
142-
143-
{% highlight bash %}
144-
cp geomesa/geomesa-plugin/target/geomesa-plugin-accumulo1.5-1.0.0-rc.4-SNAPSHOT-geoserver-plugin.jar ~/dev/geoserver-2.5.2/webapps/geoserver/WEB-INF/lib/
145-
{% endhighlight %}
146-
147-
There are additional JARs that are specific to your installation that you will also need to copy to GeoServer's `lib` directory. These may include (the specific JARs
148-
are included only for reference, and only apply if you are using Accumulo 1.5.1 and Hadoop 2.2):
149-
150-
* Accumulo
151-
* accumulo-core-1.5.1.jar
152-
* accumulo-fate-1.5.1.jar
153-
* accumulo-trace-1.5.1.jar
154-
* Zookeeper
155-
* zookeeper-3.4.5.jar
156-
* Hadoop core
157-
* hadoop-auth-2.2.0.jar
158-
* hadoop-client-2.2.0.jar
159-
* hadoop-common-2.2.0.jar
160-
* hadoop-hdfs-2.2.0.jar
161-
* hadoop-mapreduce-client-app-2.2.0.jar
162-
* hadoop-mapreduce-client-common-2.2.0.jar
163-
* hadoop-mapreduce-client-core-2.2.0.jar
164-
* hadoop-mapreduce-client-jobclient-2.2.0.jar
165-
* hadoop-mapreduce-client-shuffle-2.2.0.jar
166-
* Thrift
167-
* libthrift-0.9.1.jar
168-
169-
There are also GeoServer JARs that need to be updated for Accumulo (also in the lib directory):
170-
171-
* commons-configuration: Accumulo requires commons-configuration 1.6 and previous versions should be replaced
172-
* commons-lang: GeoServer ships with commons-lang 2.1, but Accumulo requires replacing that with version 2.4
173-
174-
Restart GeoServer.
175-
176101
#### Register the GeoMesa store with GeoServer
177102

178103
Log into GeoServer using your user and password credentials. Click "Stores" and "Add new Store".

_posts/2014-04-17-geomesa-gdelt-analysis.md

Lines changed: 5 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11
---
2-
title: Map-Reduce Ingest -- GDELT
2+
title: Map-Reduce Ingest
33
author: hunter
44
layout: tutorial
55
redirect_from:
@@ -125,26 +125,22 @@ try {
125125

126126
#### Geoserver Setup
127127

128-
Expand the tar ball below:
129-
130-
{% highlight bash %}
131-
tar -xvf geomesa-dist/target/geomesa-dist-accumulo1.5-1.0.0-SNAPSHOT-distribution.tar.gz
132-
{% endhighlight %}
128+
First, follow the [GeoMesa Deployment Tutorial](/geomesa-deployment/) to download and build GeoMesa.
133129

134130
Deploy the lib/*.jar files to Geoserver.
135131
Do not move the geomesa-distributed-runtime or geomesa-utils jars to Geoserver - they go to the tablet servers.
136-
Be sure to move the GeoMesa Geoserver plugin (geomesa-plugin-accumulo1.5-1.0.0-SNAPSHOT-geoserver-plugin.jar)
132+
Be sure to move the GeoMesa Geoserver plugin (geomesa-plugin-accumulo1.5-{{ site.stableVersion }}-geoserver-plugin.jar)
137133

138134
If you are using tomcat:
139135

140136
{% highlight bash %}
141-
cp geomesa-plugin/target/geomesa-plugin-accumulo1.5-1.0.0-SNAPSHOT-geoserver-plugin.jar /path/to/tomcat/webapps/geoserver/WEB-INF/lib/geomesa-plugin-accumulo1.5-1.0.0-SNAPSHOT-geoserver-plugin.jar
137+
cp geomesa-plugin/target/geomesa-plugin-accumulo1.5-{{ site.stableVersion }}-geoserver-plugin.jar /path/to/tomcat/webapps/geoserver/WEB-INF/lib/geomesa-plugin-accumulo1.5-{{ site.stableVersion }}-geoserver-plugin.jar
142138
{% endhighlight %}
143139

144140
If you are using GeoServer's built in Jetty web server:
145141

146142
{% highlight bash %}
147-
cp geomesa-plugin/target/geomesa-plugin-accumulo1.5-1.0.0-SNAPSHOT-geoserver-plugin.jar ~/dev/geoserver-2.5/webapps/geoserver/WEB-INF/lib/
143+
cp geomesa-plugin/target/geomesa-plugin-accumulo1.5-{{ site.stableVersion }}-geoserver-plugin.jar ~/dev/geoserver-2.5/webapps/geoserver/WEB-INF/lib/
148144
{% endhighlight %}
149145

150146
Your local Accumulo and Zookeepers JARs also need to be available within your GeoServer's `lib` directory.

_posts/2014-05-16-geomesa-osm-analysis.md

Lines changed: 5 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11
---
2-
title: Streaming Ingest -- Open Street Map (OSM)
2+
title: Streaming Ingest
33
author: hunter
44
layout: tutorial
55
redirect_from:
@@ -169,27 +169,23 @@ public void execute(Tuple tuple) {
169169

170170
#### Geoserver Setup
171171

172-
Expand the tar ball below:
173-
174-
{% highlight bash %}
175-
tar -xvf geomesa-dist/target/geomesa-dist-accumulo1.5-1.0.0-SNAPSHOT-distribution.tar.gz
176-
{% endhighlight %}
172+
First, follow the [GeoMesa Deployment Tutorial](/geomesa-deployment/) to download and build GeoMesa.
177173

178174
Deploy the lib/*.jar files to Geoserver: slf4j-api, accumulo-core, guava, hadoop-client
179175

180176
Do not move the geomesa-distributed-runtime or geomesa-utils jars to Geoserver - they go to the tablet servers.
181-
Be sure to move the GeoMesa Geoserver plugin (geomesa-plugin-accumulo1.5-1.0.0-SNAPSHOT-geoserver-plugin.jar)
177+
Be sure to move the GeoMesa Geoserver plugin (geomesa-plugin-accumulo1.5-{{ site.stableVersion }}-geoserver-plugin.jar)
182178

183179
If you are using tomcat:
184180

185181
{% highlight bash %}
186-
cp geomesa-plugin/target/geomesa-plugin-accumulo1.5-1.0.0-SNAPSHOT-geoserver-plugin.jar /path/to/tomcat/webapps/geoserver/WEB-INF/lib/
182+
cp geomesa-plugin/target/geomesa-plugin-accumulo1.5-{{ site.stableVersion }}-geoserver-plugin.jar /path/to/tomcat/webapps/geoserver/WEB-INF/lib/
187183
{% endhighlight %}
188184

189185
If you are using GeoServer's built in Jetty web server:
190186

191187
{% highlight bash %}
192-
cp geomesa-plugin/target/geomesa-plugin-accumulo1.5-1.0.0-SNAPSHOT-geoserver-plugin.jar ~/dev/geoserver-2.5/webapps/geoserver/WEB-INF/lib/
188+
cp geomesa-plugin/target/geomesa-plugin-accumulo1.5-{{ site.stableVersion }}-geoserver-plugin.jar ~/dev/geoserver-2.5/webapps/geoserver/WEB-INF/lib/
193189
{% endhighlight %}
194190

195191
Your local Accumulo and Zookeepers JARs also need to be available within your GeoServer's `lib` directory.

_posts/2014-05-16-geomesa-tubeselect.md

Lines changed: 3 additions & 29 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,5 @@
11
---
2-
title: WPS -- Tube Select
2+
title: WPS Tube Select
33
author: andrew
44
layout: tutorial
55
redirect_from:
@@ -26,35 +26,9 @@ Imagine you are traveling from Washington, DC to New York City and are intereste
2626

2727
Time-interpolated queries are more complex than normal spatial or temporal queries as the input is a sequence of points or lines with an increasing time attribute. Time-interpolated queries are colloquially known as **_tube-selects_**.
2828

29-
### Configuring Geoserver
30-
To get started, install the latest stable release of [2.5.x Geoserver](http://geoserver.org/release/stable/). You'll also need to install the [WPS Plugin](http://docs.geoserver.org/stable/en/user/extensions/wps/install.html). Depending on your hardware, it may be important to set the limits for your WMS plugin to be higher or disable them completely by clicking "WMS" under "Services" on the left side of the admin page of Geoserver. Check with your server administrator to determine the correct settings. For massive queries, the standard 60 second timeout may be too short.
31-
!["Disable limits"](/img/tutorials/2014-05-16-geomesa-tubeselect/wms_limits.png)
29+
### Using the GeoServer Plugin
3230

33-
You'll also need to install the GeoMesa geoserver-plugin. Clone the locationtech/geomesa repo:
34-
{% highlight bash %}
35-
git clone https://github.com/locationtech/geomesa.git
36-
{% endhighlight %}
37-
38-
Build the project, extract the distribution tarball, and copy the plugin to the geoserver lib directory:
39-
{% highlight bash %}
40-
mvn clean install
41-
mkdir /tmp/geomesa-dist
42-
tar -C /tmp/geomesa-dist -xvf geomesa-dist/target/geomesa-dist-accumulo1.5-1.0.0-SNAPSHOT-distribution.tar.gz
43-
cd /tmp/geomesa-dist
44-
cp geoserver/WEB-INF/lib/geomesa-plugin-accumulo1.5-1.0.0-SNAPSHOT-geoserver-plugin.jar $GEOSERVER_HOME/webapps/geoserver/WEB-INF/lib/
45-
{% endhighlight %}
46-
47-
You'll also need to install various provided dependencies that are needed by GeoMesa but are marked provided. This allows your server administrators to manage dependencies and upgrade for bugfixes. We have tried to include all the necessary jars. Be careful that you don't stomp any other dependencies when installing provided jars:
48-
{% highlight bash %}
49-
cd /tmp/geomesa-dist
50-
cp dev/lib/* $GEOSERVER_HOME/webapps/geoserver/WEB-INF/lib
51-
{% endhighlight %}
52-
53-
Start geoserver!
54-
{% highlight bash %}
55-
cd $GEOSERVER_HOME
56-
bin/startup.sh
57-
{% endhighlight %}
31+
To complete this tutorial you will have needed to follow the instructions in the [geomesa-deployment](http://www.geomesa.org/geomesa-deployment/) tutorial first to deploy GeoMesa and the GeoServer Plugin.
5832

5933
Once everything is installed you should see "geomesa:TubeSelect" appear in the [WPS Request Builder](http://docs.geoserver.org/stable/en/user/extensions/wps/requestbuilder.html)
6034
!["geomesa:TubeSelect WPS plugin"](/img/tutorials/2014-05-16-geomesa-tubeselect/wps_builder1.png)

_posts/2014-05-30-geomesa-transformations.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -44,7 +44,7 @@ Although projections can also modify an attribute's value, in this tutorial we w
4444

4545
Before you begin, you should also have these:
4646

47-
* a locally-built version of GeoMesa - see [GeoMesa Quickstart](/geomesa-quickstart/) - (DOWNLOAD AND BUILD GEOMESA)
47+
* a locally-built version of GeoMesa - see [GeoMesa Deployment](/geomesa-deployment/) - (DOWNLOAD AND BUILD GEOMESA)
4848
* an Accumulo user that has appropriate permissions to query your data
4949
* a local copy of the Java Development Kit 1.7.x
5050
* Apache Maven installed

0 commit comments

Comments
 (0)