优化内容压缩

* 取消用户设置的压缩级别,现在压缩级别通过系统自动设置
* Pool中的对象命中100万次时自动销毁,避免内存泄漏
* 降低Pool中的对象数量,避免占用太多内存
* 根据系统CPU线程数自动计算压缩级别,避免消耗太多CPU
* zstd限制解码的最大Window
* zstd使用低内存模式
This commit is contained in:
GoEdgeLab
2024-04-16 11:32:38 +08:00
parent 4f66f55152
commit 005e27a63c
21 changed files with 125 additions and 82 deletions

View File

@@ -4,7 +4,6 @@ package compressions
import (
teaconst "github.com/TeaOSLab/EdgeNode/internal/const"
memutils "github.com/TeaOSLab/EdgeNode/internal/utils/mem"
"io"
)
@@ -15,11 +14,8 @@ func init() {
return
}
var maxSize = memutils.SystemMemoryGB() * 256
if maxSize == 0 {
maxSize = 256
}
sharedBrotliReaderPool = NewReaderPool(maxSize, func(reader io.Reader) (Reader, error) {
sharedBrotliReaderPool = NewReaderPool(CalculatePoolSize(), func(reader io.Reader) (Reader, error) {
return newBrotliReader(reader)
})
}