intelmq.bots.experts.deduplicator package

Submodules

intelmq.bots.experts.deduplicator.expert module

Deduplicator expert bot

param redis_cache_host:
 string
param redis_cache_port:
 int
param redis_cache_db:
 int
param redis_cache_ttl:
 int
param redis_cache_password:
 string. default: {None}
param filter_type:
 string [“blacklist”, “whitelist”]
param bypass:boolean default: False
param filter_keys:
 string with multiple keys separated by comma. Please note that time.observation key is never consider by the system because system will always ignore this key.
intelmq.bots.experts.deduplicator.expert.BOT

alias of intelmq.bots.experts.deduplicator.expert.DeduplicatorExpertBot

class intelmq.bots.experts.deduplicator.expert.DeduplicatorExpertBot(*args, **kwargs)

Bases: intelmq.lib.bot.ExpertBot, intelmq.lib.mixins.cache.CacheMixin

Detection and drop exact duplicate messages. Message hashes are cached in the Redis database

bypass = False
filter_keys = None
filter_type = 'blacklist'
init()
process()
redis_cache_db = 6
redis_cache_host = '127.0.0.1'
redis_cache_password = None
redis_cache_port = 6379
redis_cache_ttl = 86400

Module contents