Questions tagged [amazon-kinesis]

Amazon Kinesis is a fully managed service for real-time processing of streaming data at massive scale.

Amazon Kinesis is a fully managed service for real-time processing of streaming data at massive scale. Amazon Kinesis can collect and process hundreds of terabytes of data per hour from hundreds of thousands of sources, allowing you to easily write applications that process information in real-time, from sources such as web site click-streams, marketing and financial information, manufacturing instrumentation and social media, and operational logs and metering data.

With Amazon Kinesis applications, you can build real-time dashboards, capture exceptions and generate alerts, drive recommendations, and make other real-time business or operational decisions. You can also easily send data to a variety of other services such as Amazon Simple Storage Service (Amazon S3), Amazon DynamoDB, or Amazon Redshift. In a few clicks and a couple of lines of code, you can start building applications which respond to changes in your data stream in seconds, at any scale, while only paying for the resources you use.

Useful links

1434 questions
-1
votes
1 answer

Where to place my JDBC driver file

I'm trying to follow a tutorial from this link: https://github.com/awslabs/amazon-kinesis-connectors Although the tutorial did mention the need for a JDBC driver for Redshift, but it didn't specify where to place the driver file. Currently when I…
-1
votes
3 answers

Can we write an AWS Lambda function to query Kinesis Streams

I have Amazon Kinesis Streams, which has all the click stream data and we want to write an API to query Kinesis Streams. My plan is to create a API gateway which calls an AWS Lambda function that would query Kinesis Streams and return it back. Is…
-1
votes
1 answer

javac error: "Cannot find symbol"

I'm trying to compile java files on an EC2 instance, and am having trouble. I have several JAR files as well that are included in the classpath. The example would be a StockTrade.java (which is a stock trade object), which compiles completely…
-1
votes
1 answer

Spark streaming 1.6.1 is not working with Kinesis asl 1.6.1 and asl 2.0.0-preview

I am trying to run spark streaming job on EMR with Kinesis. Spark 1.6.1 with Kinesis ASL 1.6.1. Writing a plain sample wordcount example. org.apache.spark
RockSolid
  • 420
  • 3
  • 9
-1
votes
2 answers

What AWS technologies should I use in order to do light weight processing in real time before storing the data in Redshift?

I want to create a few HTTP points where mobile clients, servers & IoT devices will be posting data. I may need to preprocess the events & act up on them. Eventually I want to access all the raw data & make queries using Domo, Cloud Business…
-2
votes
2 answers

AWS Firehose delivery to Cross Account Elasticsearch in VPC

I have a Elasticsearch inside the VPC running in account A. I want to deliver logs from Firehose in Account B to the Elasticsearch in Account A. Is it possible? When I try to create delivery stream from AWS CLI I am getting below exception, $:…
-2
votes
1 answer

How does Amazon Kinesis Stream compare to Java Stream?

I have read up and watch some videos on Kinesis Stream and I kind of understand that it allows for data streaming from applications and real time analytics. But how does it relates to the Java Stream because I think with API connection or TCP…
Benjamin
  • 293
  • 1
  • 2
  • 9
-2
votes
1 answer

Error running presto query on kinesis

I am getting following error while running presto query on kinesis. Query 20151031_142753_00003_xxxxx failed: Rate exceeded for stream xxxxx under account xxxxxx. (Service: AmazonKinesis; Status Code: 400; Error Code:…
Rajesh
  • 17
  • 3
-3
votes
1 answer

AWS Kinesis, Is S3 mandatory to be used for kinesis?

Could you please provide some clarity on s3 usage in Kinesis? Thanks, Subham
1 2 3
95
96