🚀 Try Zilliz Cloud, the fully managed Milvus, for free—experience 10x faster performance! Try Now>>

milvus-logo
LFAI
Home
  • Administration Guide

mq-related Configurations

Milvus supports four MQ: rocksmq(based on RockDB), natsmq(embedded nats-server), Pulsar and Kafka.

You can change your mq by setting mq.type field.

If you don’t set mq.type field as default, there is a note about enabling priority if we config multiple mq in this file.

  1. standalone(local) mode: rocksmq(default) > natsmq > Pulsar > Kafka

  2. cluster mode: Pulsar(default) > Kafka (rocksmq and natsmq is unsupported in cluster mode)

mq.type

Description Default Value
  • Default value: "default"
  • Valid values: [default, pulsar, kafka, rocksmq, natsmq]
  • default

    mq.enablePursuitMode

    Description Default Value
    Default value: "true" true

    mq.pursuitLag

    Description Default Value
    time tick lag threshold to enter pursuit mode, in seconds 10

    mq.pursuitBufferSize

    Description Default Value
    pursuit mode buffer size in bytes 8388608

    mq.pursuitBufferTime

    Description Default Value
    pursuit mode buffer time in seconds 60

    mq.mqBufSize

    Description Default Value
    MQ client consumer buffer length 16

    mq.dispatcher.mergeCheckInterval

    Description Default Value
    the interval time(in seconds) for dispatcher to check whether to merge 1

    mq.dispatcher.targetBufSize

    Description Default Value
    the lenth of channel buffer for targe 16

    mq.dispatcher.maxTolerantLag

    Description Default Value
    Default value: "3", the timeout(in seconds) that target sends msgPack 3

    mq.dispatcher.maxDispatcherNumPerPchannel

    Description Default Value
    The maximum number of dispatchers per physical channel, primarily to limit the number of consumers and prevent performance issues(e.g., during recovery when a large number of channels are watched). 5

    mq.dispatcher.retrySleep

    Description Default Value
    register retry sleep time in seconds 3

    mq.dispatcher.retryTimeout

    Description Default Value
    register retry timeout in seconds 60