1
1
Release Notes - Flume - Version v1.2.0
2
2
3
3
** New Feature
4
- * [FLUME-888] - Port Hbase Sink from OG
5
4
* [FLUME-896] - Implement a Durable Memory Channel
6
5
* [FLUME-971] - Create developer guide for Flume NG
7
6
* [FLUME-988] - Client SDK
@@ -10,12 +9,10 @@ Release Notes - Flume - Version v1.2.0
10
9
* [FLUME-1183] - Implement an HBase Sink which supports table level access
11
10
* [FLUME-1215] - Implement Timestamp Interceptor
12
11
* [FLUME-1252] - Asynchronous HBase Sink
13
- * [FLUME-1313] - Implement load balancing channel selector
14
12
15
13
** Improvement
16
14
* [FLUME-828] - LoggerSink representation of the event's body isn't too useful
17
15
* [FLUME-881] - Would be nice if HDFS Sink would automatically choose best writableFormat based on fileType
18
- * [FLUME-975] - Move AvroFlumeEvent and related classes, generated by Avro out of Flume-ng-core to a new sub module, which is not dependant on flume-ng itself
19
16
* [FLUME-979] - ExecSource should optionally restart the command when it exits
20
17
* [FLUME-985] - All HDFS Operations in HDFSEventSink should have a timeout
21
18
* [FLUME-1001] - Support custom processors
@@ -38,28 +35,26 @@ Release Notes - Flume - Version v1.2.0
38
35
* [FLUME-1196] - Allow different HDFS Sinks within the same agent to write to HDFS as different users
39
36
* [FLUME-1198] - Implement a load-balancing sink processor
40
37
* [FLUME-1212] - Flume should pick HBase jars from HBASE_HOME
41
- * [FLUME-1214] - Flume shall inject some default event headers before the event gets processed.
42
38
* [FLUME-1238] - Support active rolling of files created by HDFS Event Sink
43
39
* [FLUME-1242] - Make flume user & dev guides easily editable
44
40
* [FLUME-1275] - Add Regex Serializer for HBaseSink
45
41
* [FLUME-1287] - Add Standalone Example to Docs
46
42
* [FLUME-1330] - Avro Source should not use Fixed thread pool for boss threads when pool size is specified
43
+ * [FLUME-1338] - Produce helpful error message in case that timestamp header is missing when time based bucketing is in use
47
44
* [FLUME-1343] - Improve user guide
48
45
* [FLUME-1345] - Use apache-flume for the artifact instead of flume-ng-dist
49
46
* [FLUME-1351] - Add release version to Flume documentation
50
47
51
48
** Bug
49
+ * [FLUME-862] - AvroSource breaks when config properties changes different service
52
50
* [FLUME-1002] - FailoverSinkProcessor replaces sinks with same priority
53
- * [FLUME-1004] - The SEQ source doesn't seem to stop on a reconfig that should disable it
54
- * [FLUME-1016] - -c, --conf in bin/flume-ng isn't working
55
51
* [FLUME-1017] - syslog classes missing
56
52
* [FLUME-1026] - Document Thread Safety Guarantees
57
53
* [FLUME-1027] - Missing log4j library in Flume distribution
58
54
* [FLUME-1031] - Depricate code generated by Thrift and Avro OG sources that is under com.cloudera package
59
55
* [FLUME-1035] - slf4j error in flume sdk unit tests
60
56
* [FLUME-1036] - Reconfiguration of AVRO or NETCAT source causes port bind exception
61
57
* [FLUME-1037] - NETCAT handler theads terminate under stress test
62
- * [FLUME-1038] - Flume 1.1.0 assemblies are incorrect
63
58
* [FLUME-1040] - Release-Notes says Apache Ivy instead of Apache Flume
64
59
* [FLUME-1041] - maven warns of duplicate dependencies
65
60
* [FLUME-1046] - invoking flume-ng script from bin directory fails
@@ -81,6 +76,7 @@ Release Notes - Flume - Version v1.2.0
81
76
* [FLUME-1108] - FILE_ROLL sink doesn't accept value 0 for unlimited wait time before rolling file
82
77
* [FLUME-1109] - Syslog sources need to be refactored
83
78
* [FLUME-1112] - HDFSCompressedDataStream append does not work
79
+ * [FLUME-1114] - Syslog Sources does not implement maxsize
84
80
* [FLUME-1116] - Extra event created for max payload size of 2500 bytes in Flume syslogtcp source
85
81
* [FLUME-1119] - Remove default ports for syslog sources
86
82
* [FLUME-1121] - Recoverable Memory Channel cannot recover data
@@ -92,16 +88,13 @@ Release Notes - Flume - Version v1.2.0
92
88
* [FLUME-1135] - flume-docs exclude is not sufficient for rat
93
89
* [FLUME-1136] - Remove from executor service does not always remove the runnables from the queue
94
90
* [FLUME-1142] - Seq source fails with multiplexing channel selector
95
- * [FLUME-1145] - Convert Flume User Guide and Flume Developer Guide into a more editor-friendly format
96
91
* [FLUME-1148] - Refactor logging
97
92
* [FLUME-1149] - All sources get same channel list even if configuration is different.
98
93
* [FLUME-1154] - flume-ng script should first try finding java from PATH and then try using bigtop, instead of vice-versa
99
- * [FLUME-1155] - flume-ng script issue with sourcing flume-env.sh
100
94
* [FLUME-1156] - If config file has empty sources, then throws NPE
101
- * [FLUME-1162] - Possible reconfig issue -- setName and setChannel being called before stop
102
95
* [FLUME-1163] - HDFSEventSink leaves .tmp files in place when Flume is stopped
103
96
* [FLUME-1164] - Configure should be called after stopping all events.
104
- * [FLUME-1173 ] - HDFSEventSink can leave orphaned .tmp files
97
+ * [FLUME-1177 ] - Maven deps on flume-ng-configuration module are brought in transitively instead of directly
105
98
* [FLUME-1180] - ChannelSelectorFactory creates incorrect selector for multiplexing selector type
106
99
* [FLUME-1181] - Context must enforce dot-separated prefix for sub-properties.
107
100
* [FLUME-1182] - Syslog source cannot read format correctly from configuration
@@ -120,6 +113,7 @@ Release Notes - Flume - Version v1.2.0
120
113
* [FLUME-1220] - Load balancing channel selector needs to be in the configuration type
121
114
* [FLUME-1221] - ThriftLegacySource doesn't handle fields -> headers conversions for bytebuffers
122
115
* [FLUME-1226] - FailoverRpcClient should check for NULL batch-size property
116
+ * [FLUME-1229] - System.nanoTime incorrectly used in filename for HDFS file rolling
123
117
* [FLUME-1230] - Sink gets initialized even when not active
124
118
* [FLUME-1231] - Deadlock between BucketWriter and LeaseChecker on shutdown
125
119
* [FLUME-1232] - Cannot start agent a 3rd time when using FileChannel
@@ -139,13 +133,15 @@ Release Notes - Flume - Version v1.2.0
139
133
* [FLUME-1284] - Need host interceptor for hdfs bucket path escape sequence
140
134
* [FLUME-1288] - Async hbase sink should throw exception when hbase reports failure and check hbase table correctness
141
135
* [FLUME-1290] - HDFS Sink should accept fileType parameters of arbitrary case
142
- * [FLUME-1294 ] - flume-ng script parses java.library.path incorrectly
136
+ * [FLUME-1297 ] - Flume tests should wait for a few seconds for agent to start.
143
137
* [FLUME-1301] - HDFSCompressedDataStream can lose data
144
138
* [FLUME-1303] - java.library.path value is being truncated at first 'n' char
145
139
* [FLUME-1304] - Allow for faster allocation of checkpoint file.
140
+ * [FLUME-1306] - LoadBalancingRpcClient should catch exception for invalid RpcClient and failover to valid one
146
141
* [FLUME-1309] - Integration tests not included in assembly build artifacts
147
142
* [FLUME-1312] - Host interceptor should support custom headers
148
143
* [FLUME-1314] - File channel log file can grow beyond max size which causes startup failure
144
+ * [FLUME-1315] - Null sink should support batching
149
145
* [FLUME-1316] - AvroSink should be configurable for connect-timeout and request-timeout
150
146
* [FLUME-1317] - Assembly build pulls in target folder from flume-ng-tests
151
147
* [FLUME-1319] - File Channel optimize replay of logs when a checkpoint is present
@@ -158,27 +154,31 @@ Release Notes - Flume - Version v1.2.0
158
154
* [FLUME-1329] - AvroSink can hang during Avro RPC handshake
159
155
* [FLUME-1331] - Start method of components throwing NoClassDefFoundError are not caught
160
156
* [FLUME-1333] - Disable running of saveVersion.sh on Windows
157
+ * [FLUME-1341] - Build fails on jenkins because a file exists in the environment
161
158
* [FLUME-1344] - AvroSink JMX does not report connection created count accurately
162
159
* [FLUME-1346] - Build warning from missing maven-sphinx version in reporting section
163
160
* [FLUME-1347] - Deprecate RecoverableMemoryChannel
164
161
* [FLUME-1348] - Update the documentation, correcting links and removing incubation.
165
162
* [FLUME-1349] - Document Hbase sinks.
166
163
* [FLUME-1352] - Add documentation for HDFS path rounddown.
164
+ * [FLUME-1355] - Improve user guide section about sink processors
165
+ * [FLUME-1356] - Document interceptors
167
166
168
167
** Task
169
168
* [FLUME-840] - Update project committers in pom file
170
169
* [FLUME-991] - Make flume configuration validation component specific at time rather than at runtime
171
170
* [FLUME-1028] - Fix jenkins build after addition of submodule
172
171
* [FLUME-1050] - Update version of surefire plugin
173
172
* [FLUME-1073] - Default Log4j configuration file should have a rolling policy
173
+ * [FLUME-1082] - Add User and dev guide to Flume site
174
174
* [FLUME-1151] - Exclude docs directory from rat
175
+ * [FLUME-1189] - Test ReoverableMemoryChannel throughput versus FileChannel
175
176
* [FLUME-1300] - Update user guide for File Channel
176
177
* [FLUME-1353] - Ensure license headers are consistent
177
178
178
179
** Sub-task
179
180
* [FLUME-748] - Create metric collection infrastructure
180
181
* [FLUME-962] - Failover capability for Client SDK
181
- * [FLUME-968] - Need a library that would allow external tools to parse and validate flume properties file configuration
182
182
* [FLUME-992] - Create configuration stubs for sources, channels, sinks etc
183
183
* [FLUME-999] - Updating init scripts and variables to fit the term agent
184
184
* [FLUME-1052] - Core configuration component
@@ -189,9 +189,6 @@ Release Notes - Flume - Version v1.2.0
189
189
* [FLUME-1107] - Configuration keys for JDBC channel contain redundant prefix.
190
190
* [FLUME-1113] - JDBC Channel invokes size query on every put
191
191
192
- ** Test
193
- * [FLUME-1082] - Add User and dev guide to Flume site
194
-
195
192
----
196
193
197
194
Release Notes - Flume - Version v1.1.0
0 commit comments