聊聊flink的Broadcast State

2018-12-26
阅读 16 分钟
4.4k
flink-core-1.7.0-sources.jar!/org/apache/flink/api/common/state/MapStateDescriptor.java

聊聊flink的AbstractTtlState

2018-12-25
阅读 10 分钟
2.2k
flink-runtime_2.11-1.7.0-sources.jar!/org/apache/flink/runtime/state/internal/InternalKvState.java

聊聊flink的StateTtlConfig

2018-12-24
阅读 17 分钟
4.2k
这里利用builder创建StateTtlConfig,之后通过StateDescriptor的enableTimeToLive方法传递该config

[case51]聊聊flink的StateDescriptor

2018-12-23
阅读 14 分钟
4.6k
flink-core-1.7.0-sources.jar!/org/apache/flink/api/common/functions/RuntimeContext.java

聊聊flink的Managed Keyed State

2018-12-22
阅读 9 分钟
2.8k
flink-core-1.7.0-sources.jar!/org/apache/flink/api/common/state/State.java

聊聊flink的BoundedOutOfOrdernessTimestampExtractor

2018-12-21
阅读 6 分钟
8.4k
flink-streaming-java_2.11-1.7.0-sources.jar!/org/apache/flink/streaming/api/functions/timestamps/BoundedOutOfOrdernessTimestampExtractor.java

聊聊flink的AscendingTimestampExtractor

2018-12-20
阅读 7 分钟
3.7k
flink-streaming-java_2.11-1.7.0-sources.jar!/org/apache/flink/streaming/api/functions/timestamps/AscendingTimestampExtractor.java

聊聊flink的EventTime

2018-12-19
阅读 18 分钟
4.4k
flink-streaming-java_2.11-1.7.0-sources.jar!/org/apache/flink/streaming/api/functions/source/SourceFunction.java

聊聊flink的TimeCharacteristic

2018-12-18
阅读 7 分钟
4.5k
flink-streaming-java_2.11-1.7.0-sources.jar!/org/apache/flink/streaming/api/TimeCharacteristic.java

聊聊flink的FsCheckpointStreamFactory

2018-12-17
阅读 21 分钟
2.6k
flink-runtime_2.11-1.7.0-sources.jar!/org/apache/flink/runtime/state/CheckpointStreamFactory.java

[case50]聊聊flink的FsCheckpointStorage

2018-12-16
阅读 11 分钟
2.1k
flink-runtime_2.11-1.7.0-sources.jar!/org/apache/flink/runtime/state/CheckpointStorage.java

聊聊flink的FsStateBackend

2018-12-15
阅读 18 分钟
2.8k
flink-runtime_2.11-1.7.0-sources.jar!/org/apache/flink/runtime/state/StateBackend.java

聊聊flink的MemCheckpointStreamFactory

2018-12-14
阅读 13 分钟
3.1k
flink-runtime_2.11-1.7.0-sources.jar!/org/apache/flink/runtime/state/CheckpointStreamFactory.java

聊聊flink的MemoryBackendCheckpointStorage

2018-12-13
阅读 12 分钟
2.9k
flink-runtime_2.11-1.7.0-sources.jar!/org/apache/flink/runtime/state/CheckpointStorage.java

聊聊flink的PartitionableListState

2018-12-12
阅读 12 分钟
2.4k
flink-runtime_2.11-1.7.0-sources.jar!/org/apache/flink/runtime/state/DefaultOperatorStateBackend.java

聊聊flink的OperatorStateBackend

2018-12-11
阅读 32 分钟
2.9k
flink-runtime_2.11-1.7.0-sources.jar!/org/apache/flink/runtime/state/OperatorStateBackend.java

聊聊flink的MemoryStateBackend

2018-12-10
阅读 21 分钟
3.4k
flink-runtime_2.11-1.7.0-sources.jar!/org/apache/flink/runtime/state/StateBackend.java

[case49]聊聊flink的checkpoint配置

2018-12-09
阅读 4 分钟
3.8k
使用StreamExecutionEnvironment.enableCheckpointing方法来设置开启checkpoint;具体可以使用enableCheckpointing(long interval),或者enableCheckpointing(long interval, CheckpointingMode mode);interval用于指定checkpoint的触发间隔(单位milliseconds),而CheckpointingMode默认是CheckpointingMode.EXACTLY_ON...

聊聊flink StreamOperator的initializeState方法

2018-12-08
阅读 16 分钟
3.1k
flink-runtime_2.11-1.7.0-sources.jar!/org/apache/flink/runtime/taskmanager/Task.java

聊聊flink的CheckpointScheduler

2018-12-07
阅读 43 分钟
3.6k
flink-runtime_2.11-1.7.0-sources.jar!/org/apache/flink/runtime/checkpoint/CheckpointCoordinatorDeActivator.java

聊聊flink的ListCheckpointed

2018-12-06
阅读 5 分钟
3.9k
CounterSource是一个有状态的RichParallelSourceFunction,它实现了ListCheckpointed接口,snapshotState方法返回了当前的offset,而restoreState方法则根据传入的state来恢复本地的offset;这里要注意,如果要在failure或者recovery的时候达到exactly-once的语义,这里更新offset的时候要使用SourceContext.getCheckpoi...

聊聊flink的CheckpointedFunction

2018-12-05
阅读 8 分钟
8.8k
这个BufferingSink实现了CheckpointedFunction接口,它定义了ListState类型的checkpointedState,以及List结构的bufferedElements

聊聊flink的JDBCOutputFormat

2018-12-04
阅读 19 分钟
5.6k
flink-jdbc_2.11-1.7.0-sources.jar!/org/apache/flink/api/java/io/jdbc/JDBCOutputFormat.java

聊聊flink的TextOutputFormat

2018-12-03
阅读 14 分钟
3.7k
flink-streaming-java_2.11-1.7.0-sources.jar!/org/apache/flink/streaming/api/datastream/DataStream.java

[case48]聊聊flink的SocketClientSink

2018-12-02
阅读 10 分钟
2.7k
flink-streaming-java_2.11-1.7.0-sources.jar!/org/apache/flink/streaming/api/datastream/DataStream.java

聊聊flink的PrintSinkFunction

2018-12-01
阅读 10 分钟
3k
flink-streaming-java_2.11-1.7.0-sources.jar!/org/apache/flink/streaming/api/datastream/DataStream.java

聊聊flink的ParallelIteratorInputFormat

2018-11-30
阅读 13 分钟
2.3k
这里使用ExecutionEnvironment的generateSequence方法创建了带NumberSequenceIterator的ParallelIteratorInputFormat

聊聊flink的InputFormatSourceFunction

2018-11-29
阅读 19 分钟
4.3k
flink-streaming-java_2.11-1.6.2-sources.jar!/org/apache/flink/streaming/api/environment/StreamExecutionEnvironment.java

聊聊flink的RichParallelSourceFunction

2018-11-28
阅读 20 分钟
6.3k
RichParallelSourceFunction实现了ParallelSourceFunction接口,同时继承了AbstractRichFunction

聊聊flink的SourceFunction

2018-11-27
阅读 36 分钟
5.1k
flink-streaming-java_2.11-1.6.2-sources.jar!/org/apache/flink/streaming/api/functions/source/SourceFunction.java