【发布时间】:2017-12-27 21:06:30
【问题描述】:
我有以下代码:
type Request = EitherT[IO, Throwable, KkProducerRecordMetadata]
def create(producer: => KkProducerCreator)
: IO[Producer[String, String]]
= IO {
try {
new KafkaProducer[String, String](properties(producer))
} catch {
case e: InstanceAlreadyExistsException => ???
}
}
def send(producer: => IO[Producer[String, String]])
(record: => KkProducerRecord)
: Request = EitherT(for {
p <- producer
m <- IO {
try {
//If MaxBlockMs is not set,
//then after 60s it will throw an exception
val pr = new ProducerRecord[String, String](record.topic, record.key, record.value)
val meta = p.send(pr).get()
p.flush()
Right(KkProducerRecordMetadata(meta.hasOffset,
meta.hasTimestamp,
meta.offset,
meta.partition,
meta.timestamp,
meta.topic))
} catch {
case e: Exception => Left(e)
}
}
} yield m)
def close(producer: => IO[Producer[String, String]])
: IO[Unit]
= producer.map { p =>
p.flush()
p.close()
}
函数create创建一个kafka生产者并包装到IO中,因为它可能产生副作用。
函数send 会将消息发送到kafka,正如您在第一个参数中看到的那样,它需要producer。
我使用的功能如下:
//Creates a producer
private val pSignIn: IO[Producer[String, String]] =
KkProducer.create(KkProducerCreator(sys.env.get("KAFKA_SERVER").get,
"AUTH-SIGNIN-PRODUCER",
List(MaxBlockMsConfig(4000))))
并向kafka发送消息:
KkProducer.send(pSignIn)(KkProducerRecord(AuthTopology.SignInReqTopic,
AuthTopology.SignInKey, a))
如您所见,每次调用 send 函数时,都会创建一个新的 producer 实例,然后我得到一个异常:
javax.management.InstanceAlreadyExistsException: kafka.producer:type=app-info,id=AUTH-SIGNIN-PRODUCER
如何防止生产者以功能方式创建两次?
我正在考虑创建一个生产者地图并将 id 作为键?
会是StateT 的解决方案吗?
【问题讨论】:
标签: scala functional-programming kafka-producer-api