1. Project Overview

A Java distributed log component, supporting billion-level logs, from collection to query, no need to browse logs in files, convenient and fast, supporting query of a call chain log, supporting link tracking, viewing call chain time-consuming situation, in distributed systems, also can query associated logs, can help quickly locate problems, simple and easy to use, no code invasion, query interface friendly, efficient, convenient, as long as you are a Java system, do not do any project modification, plug in directly use, logs do not fall to local disk

2. Open Source License

Licensed under Apache-2.0

3. Screenshots

4. Feature Overview

1. No-code invasion distributed log system, based on log4j, log4j2, logback collection logs, set link ID, convenient query associated logs
2. Based on elasticsearch as query engine
3. High throughput, high query efficiency
4. Full process does not occupy application program local disk space, maintenance-free; for project transparent, does not affect project running
5. No need to modify old projects, plug in directly use, supports dubbo, supports springcloud

Important versions

Version

Content

2.2.2

Based on traceId's log recording, log query, log cache queue redis or kafka

3.0

Add error alarm module, add content combination query function, log division application statistics function

3.1

Add extended field function (MDC), optimize log collection performance, merge UI and server modules, reduce deployment costs

3.2

Major upgrade optimization, old users hurry up to upgrade plumelog-server to 3.2

3.3

When used as a redis queue, different services can use different queues, greatly increasing the throughput of the redis mode

3.4.1

Can configure log compression, redis uses LZ4 compression log, redis uses LZ4 compression type, supports redis cluster mode and sentinel mode

3.5

Added lite mode, lite module, small players can not install redis and es anymore!

3.5.3

Added built-in redis, small players do not want to install redis can try it

• Found a serious bug version, please skip

Version

Bug problem

3.2

Ali Baba spring cloud will appear log cannot upload bug, upgrade to 3.2.1

3.4

Upgrade to 3.4.1 can

5. Tech Stack

1. Architecture

• plumelog-core core component includes log collection end, responsible for collecting logs and pushing to kafka, redis, etc. queues
• plumelog-server responsible for asynchronously writing logs in the queue to elasticsearch
• plumelog-demo based on springboot usage case
• plumelog-lite plumelog embedded integration version, no deployment

2. Usage method

Usage before notice

• plumelog divided into three startup modes, respectively, redis, kafka, lite, plus embedded version plumelog-lite
• lite mode, not dependent on any external middleware directly start using, but performance is limited, one day 10G or less can handle, must be SSD hard disk, suitable for management system class small players
• redis, kafka mode can cluster distributed deployment, suitable for large players, internet companies
• plumelog-lite plumelog embedded integration version, directly pom reference, embedded in the project, self-contained query interface, suitable for single independent small project use, external software best companion