Skip to content

Commit b97e8df

Browse files
committed
updated flink to 1.14
1 parent 4c7e65e commit b97e8df

File tree

1 file changed

+21
-3
lines changed

1 file changed

+21
-3
lines changed

README.md

Lines changed: 21 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -44,7 +44,7 @@ Install docker-compose:
4444

4545
* HDFS: http://namenode:9870/
4646
* YARN: http://resourcemanager:8088/
47-
* EShttp://elasticsearch:9200/
47+
* ES£ºhttp://elasticsearch:9200/
4848
* Kibana:http://kibana:5601/
4949
* Presto: http://prestodb:9999/
5050
* Hbase: http://hbase-master:16010/
@@ -69,7 +69,7 @@ Note: you have to add the server ip and services (which defined in docker-compos
6969
collection items terminated by '-'
7070
map keys terminated by ':'
7171
location '/user/test'
72-
```
72+
```
7373
</pre>
7474

7575
<pre>
@@ -163,12 +163,30 @@ get 'person','1','info:name'
163163
3. query some data: show schemas; show tables; select * from nodes;
164164
4. you can also verify presto status through web ui: http://your-host-ip:9999
165165
```
166+
167+
## Testing Alluxio
168+
It's pretty simple to test alluxio. Go to http://alluxio-master:19999 to check the status of alluxio. And you can mount HDFS file to alluxio from alluxio client like below:
169+
```
170+
1. docker-compose exec alluxio-master bash
171+
2. alluxio fs mount /alluxio-dir hdfs://namenode:9000/somedir
172+
3. check files from http://alluxio-master:19999 or from alluxio client.
173+
4. alluxio fs ls /alluxio-dir
174+
```
175+
Altnatively, you can test the intergation with flink. Just follow the step:
176+
```
177+
1. docker-compose exec jobmanager bash
178+
2. cd /opt/flink/bin
179+
3. flink run ../examples/batch/WordCount.jar \
180+
--input alluxio://alluxio-master:19998/LICENSE \
181+
--output alluxio://alluxio-master:19998/output
182+
4.
183+
166184
## Run jobs on the docker platform.
167185
168186
For java developers, I provide some tests over the platform. You can fork it from [here](https://github.com/spancer/flink-iceberg-demo), the test project
169187
contains flink jobs with set of components, such as kafka, elasticsearch, iceberg, etc.. Source and sink examples are fully inclued.
170188
171-
## What we've done.
189+
## ToDo
172190
1. ~~Integration flink 1.14~~
173191
2. ~~Integration hive 3.1 (Done)~~
174192
3. ~~Integration hbase 2.2~~

0 commit comments

Comments
 (0)