Stack Overflow
Stack Overflow

Questions tagged [message-hub]

Based on Apache Kafka, IBM® Message Hub for Bluemix™ is a scalable, distributed, high throughput message bus to unite your on-premise and off-premise cloud technologies.

Based on Apache Kafka, IBM® Message Hub for Bluemix™ is a scalable, distributed, high throughput message bus to unite your on-premise and off-premise cloud technologies. You can wire microservices together by using open protocols, and you can connect stream data to analytics to realize powerful insights. Check the documentation for more information

98 questions
42
votes
7 answers

When does the Apache Kafka client throw a "Batch Expired" exception?

Using the Apache Kafka Java client (0.9), I'm trying to send a long series of records to the broker using the Kafka Producer class. The asynchronous send method returns immediately for a while, then starts blocking on each call for a short time…
James Thomas
  • 4,055
  • 1
  • 15
  • 26
11
votes
2 answers

Consumer Stuck in Re-join

I've read other threads and I've gotten around the problem by using a new group ID, however I'd like to understand what could cause this. I have a topic with 16 partitions, I've set session.timeout.ms=30000, and max.poll.interval.ms=30000000. I run…
kyl
  • 295
  • 3
  • 13
8
votes
2 answers

Failed to send SSL Close message

I have a thread which once in a while is going to list the topics on the Message Hub. But once in a while, I am getting a :Failed to send SSL Close message. Any ideas? KafkaConsumer consumer = new…
John Chu
  • 81
  • 1
  • 2
5
votes
1 answer

Kafka Streams KTable configuration error on Message Hub

This issue is now solved on Message Hub I am having some trouble creating a KTable in Kafka. I am new to Kafka, which is probably the root of my problem, but I thought I could ask here anyway. I have a project where I would like to keep track of…
jawwe
  • 479
  • 1
  • 3
  • 11
4
votes
1 answer

Error in streaming-analytic service in Bluemix

I followed this tutorial to use the streaming-analytic service in Bluemix to interface with message-hub: …
jd76
  • 107
  • 9
3
votes
1 answer

Kafka Streams cast to string issues with KTable when grouping and aggregating

I have a Kafka stream with incoming messages that looks like sensor_code: x, time: 1526978768, address: Y I want to create a KTable that stores each unique address at each sensor code. KTable KTable numCount = streams …
jawwe
  • 479
  • 1
  • 3
  • 11
3
votes
1 answer

UI console to browse topics on Message Hub

I have a Message Hub instance on Bluemix, and am able to produce / consume messages off it. I was looking for a quick, reasonable way to browse topics / messages to see what's going on. Something along the lines of kafka-topics-ui. I installed…
Deven
  • 111
  • 1
  • 11
3
votes
2 answers

Kafka Recover from Commit Failed Exception

I have an issue where my commit fails because poll() is too long (why this happens I don't know, there was no messages and it was simply read/committing on an empty queue, and my poll-interval is set to hours). Then when it hits read() again it…
kyl
  • 295
  • 3
  • 13
3
votes
1 answer

Kafka enable.auto.commit set to false but poll still fetch "next" messages

I want to tell Kafka when my consumer has successfully processed a record so I have turned auto-commit off by settting enable.auto.commit to false. I have two messages on a topic I am subscribed to at offset zero and one and have created a consumer…
Mike Gorman
  • 169
  • 10
3
votes
1 answer

Can I inject external service VCAP_SERVICES into my app?

If I have a MessageHub service in one space, MY_ANALYTICS_SPACE, and I have an application in another space MY_WEBAPPS_SPACE. These spaces represent two different parts of the organisation and have been designed to be kept separate. However,…
Chris Snow
  • 20,818
  • 29
  • 115
  • 263
3
votes
1 answer

Why kafka-python fails to connect to Bluemix message hub service?

I'm trying to connect to a Bluemix Message Hub instance on http://bluemix.net. This simple script #!/usr/bin/env python from kafka import KafkaProducer from kafka.errors import KafkaError kafka_brokers_sasl = [ …
michele crudele
  • 73
  • 3
3
votes
1 answer

Increase Log size and retention period of Message Hub (Apache Kafka) on IBM Public Bluemix

Is there a way to increase log size of Message Hub (Apache Kafka) from 1 GB (retention.bytes) to 50 GB and log retention from 24 hours on Public Bluemix?
Farhans72
  • 41
  • 1
3
votes
2 answers

With python pure SASL, can we now write python clients to access Message Hub?

The question has been raised before as to if we can use Python to access Message Hub. The answer was generally no until a SASL implementation was written in Python. Now, there is a pure Python SASL called pure-sasl!, is it now possible to call…
Aaron B
  • 143
  • 7
3
votes
1 answer

Why can't I programmatically add and delete topics using the Kafka Administration REST API for Bluemix's Message Hub?

I'm calling the IBM Bluemix Administration API for Message Hub (aka Kafka), as described here. Calling the endpoint https://kafka-admin-prod02.messagehub.services.eu-gb.bluemix.net:443/topics (using an appropriate X-Auth-Token value corresponding to…
Andrew Ferrier
  • 13,902
  • 11
  • 40
  • 73
3
votes
1 answer

Client ID authentication no longer works with Kafka API

Using the Message Hub Kafka interface, I've found that my Bluemix app that was using client.id authentication is getting connections refused by the Kafka brokers. How do I fix this?
Oliver Deakin
  • 209
  • 1
  • 8
1
2 3 4 5 6 7