filebeat报错:
dropping too large message of size 1714620.
原因:
kafka对每一条消息的大小进行了限制。
解决
kafka端
修改config/server.properties,添加以下配置
max_message_bytes10000000
replica.fetch.max.bytes10000000修改…
1. 下载和安装
# windows 下载,本文以windows命令演示
https://artifacts.elastic.co/downloads/beats/filebeat/filebeat-6.6.2-windows-x86_64.zip# linux 下载
wget https://artifacts.elastic.co/downloads/beats/filebeat/filebeat-6.6.2-darwin-x86_64.tar.g…
#filebeat
#配置
- input_type: log# Paths that should be crawled and fetched. Glob based paths.paths:- /var/log/**.log- /var/log/**/**.log #filebeat不支持自动匹配目录及子目录ignore_older: 1m #忽略以前文件
output.logstash:# The Logsta…