Friday, November 15, 2013

New Amazon Web Service Processes Real-Time, Big Data Firehose

Seattle-based Amazon Web Services is looking to make it easier for developers to ingest the firehose of data from web sites, social media feeds, financial transaction data, and more, through a new service it launched Thursday called Amazon Kinesis. Amazon said the new web service is geared at handing the huge amount of real time data being generated at the rate of terabytes of data per hour, and piping it directly to its cloud. Handling those huge and processing those amounts of data is a headache for developers. Amazon said its new service is aimed at providing better, real-time data processing of those streams, rather than being limited by the current batch-style processing being used with Hadoop and other tools.