收集流程 1nxlog => 2logstash => 3elasticsearch
1. nxlog 使用模块 im_file 收集日志文件,开启位置记录功能
2. nxlog 使用模块tcp输出日志
3. logstash 使用input-tcp ,收集日志,并格式化,输出至es
windows上面的nxlog配置文件
nxlog.conf
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
|
## This is a sample configuration file. See the nxlog reference manual about the ## configuration options. It should be installed locally and is also available ## online at http://nxlog.org/nxlog-docs/en/nxlog-reference-manual.html ## Please set the ROOT to the folder your nxlog was installed into, ## otherwise it will not start. #define ROOT C:Program Files
xlog define ROOT C:Program Files (x86)
xlog Moduledir %ROOT%modules CacheDir %ROOT%data Pidfile %ROOT%data
xlog.pid SpoolDir %ROOT%data LogFile %ROOT%data
xlog.log #<Input in> # Module im_msvistalog # For windows 2003 and earlier use the following: # Module im_mseventlog #</Input> <Input testfile> Module im_file File "C:\test\*.log" SavePos TRUE # Include JSON and raw formats # Exec $Message = to_json() + " " + $raw_event; < /Input > <Output out> Module om_tcp Host 10.8.210.29 Port 514 < /Output > <Route 1> Path testfile => out < /Route > |
logstash的启动配置文件
logstash.conf
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
|
input { tcp { port => 514 } } filter { json { source => "message" } } output{ elasticsearch { host => "127.0.0.1" port => "9200" protocol => "http" } }
|