# flume-interceptor

**Repository Path**: py_main/flume-interceptor

## Basic Information

- **Project Name**: flume-interceptor
- **Description**: No description available
- **Primary Language**: Java
- **License**: Not specified
- **Default Branch**: master
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 1
- **Forks**: 0
- **Created**: 2021-12-24
- **Last Updated**: 2022-08-23

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

# flume-interceptor


## flume拦截器实现的功能
### 1、检验日志json格式拦截器，采集时etl清洗
### 2、时间拦截器，解决消费时零点漂移问题

## 使用方法
1、将打好的包（flume-interceptor-1.0-SNAPSHOT-jar-with-dependencies.jar）放入到hadoop102的/opt/module/flume/lib文件夹下面

2、在/opt/module/flume/conf目录下的flume配置文件（如：kafka-flume-hdfs.conf），添加下面配置

json检验拦截器

a1.sources.r1.interceptors.i1.type = com.bigdata.flume.interceptor.ETLInterceptor$Builder

时间拦截器

a1.sources.r1.interceptors.i1.type = com.bigdata.flume.interceptor.TimeStampInterceptor$Builder

3、重启flume