IBM Message Hub Toolkit v1.3.0

The release v1.3.0 is based on Kafka toolkit release v1.3.0 and contains following new features:

• Kafka Client upgrade to version 1.0
• support for SPL float32 data type for key and message
• new operator parameter groupId for the MessageHubConsumer operator. The group ID can now given as a submission time parameter.
• new operator parameter startOffset for the MessageHubConsumer to specify the offset where the operator should start consuming records from.
• The clientId operator parameter is now also available for the MessageHubProducer.

Toolkit documentation (SPL doc) can be found here.

Restrictions:

• The MessageHubConsumer can consume from one topic only when the startOffset parameter is used.

Restrictions compared with the Kafka toolkit v1.3.0

• The MessageHubProducer operator has no parameter consistentRegionPolicy like the KafkaProducer in the Kafka toolkit. The MessageHubProducer always uses the AtLeastOnce policy when it participates in a consistent region. The reason for this is that the Transactional policy of the KafkaProducer requires transaction support on Kafka broker side. The Message Hub cloud service is on Kafka version 0.10.2, which lacks support of transactions. Transactional consistent region policy will be enabled when the Message Hub service supports Kafka transactions.

Following issues are resolved:

#41 - Confusing error message in case of operator misconfiguration
#40 - Reduce toolkit size
various issues resolved with the underlying Kafka toolkit release

Known issues

• When Kafka's group management is enabled (MessageHubConsumer not in consistent region and startPosition parameter unset or Default), the MessageHubConsumer can silently stop consuming messages when committing Kafka offsets fails, see Kafka issue 98. As a workaround, the consumer property enable.auto.commit=true can be used in a consumer property file or app Option.

IBM Message Hub Toolkit v1.2.4

This release is a bugfix release, that is based on the Kafka toolkit v1.2.4, which is also a bugfix release.

Following issues are corrected

• #16 - Release of toolkit is missing icons
• #17 - Incorrect term for Message Hub
• #27 - Toolkit releases should include the samples. In addition to this, the samples now have makefiles to build them
• #30 - MessageHubConsumer startTime does not document time units - corrected in the Kafka toolkit
• #33 - Link to Kafka toolkit in operators's doc is broken
• #38 - Error acquiring permit: null (incorrect handling of InterruptedException seen as false errors) - corrected in Kafka toolkit
• From the Kafka toolkit v1.2.4, this release inherits explicit commit of consumed messages to avoid duplicate tuples by different consumers in failover scenarios within a consumer group - Kafka issue 60.

Known issues (28.06.2018)

• When Kafka's group management is enabled (MessageHubConsumer not in consistent region and startPosition parameter unset or Default), the MessageHubConsumer can silently stop consuming messages when committing Kafka offsets fails, see Kafka issue 98. As a workaround, the consumer property enable.auto.commit=true can be used in a consumer property file or app Option.

IBM Message Hub Toolkit v1.2.3

This version of the Message Hub Toolkit is based on the Kafka Toolkit v1.2.3 that contains fixes for following issues:

Kafka issue 53 (equivalent to #26)
Kafka issue 57
Kafka issue 58
Kafka issue 61
Kafka issue 65

See also the release page of the Kafka toolkit for details.

IBM Message Hub Toolkit v1.2.2

This version of the Message Hub Toolkit is based on Kafka Toolkit v1.2.2. See the release page for details on what is included in this version of the toolkit.

IBM Message Hub Toolkit v1.2.1

This version of the Message Hub Toolkit is based on Kafka Toolkit v1.2.1. See the release page for details on what is included in this version of the toolkit.

IBM Message Hub Toolkit v1.2.0

This version of the Message Hub Toolkit is based on Kafka Toolkit v1.2.0. See the release page for details on what is included in this version of the toolkit.

IBM Message Hub Toolkit v1.1.1

This version of the Message Hub Toolkit is based on Kafka Toolkit v1.1.1. See the release page for details on what is included in this version of the toolkit.

IBM Message Hub Toolkit v1.1.0

This version of the Message Hub Toolkit is based on Kafka Toolkit v1.1.0. See the release page for details on what is included in this version of the toolkit.

Message Hub Toolkit v1.0.1

Fixes Issue #9 - ClassNotFoundException

Message Hub Toolkit v1.0.0

This is the first release of the MessageHub Toolkit. The goal of this toolkit is to make connectivity to the Bluemix MessageHub service as simple as possible and with minimal setup from the user. The toolkit contains the following operators:

• MessageHubConsumer - this operator is used to consume messages from a MessageHub topic
• MessageHubProducer - this operator is used to produce messages to a MessageHub topic

This version of the toolkit is based on v1.0.0 of the Kafka Toolkit (https://github.com/IBMStreams/streamsx.kafka/releases/tag/v1.0.0)