In this podcast, Deam Wampler discusses fast data, streaming, microservices, and the paradox of choice when it comes to the options available today building data pipelines.
Why listen to this podcast:
* Apache Beam is fast becoming the de-facto standard API for stream processing
* Spark is great for batch processing, but Flink is tackling the low-latency streaming processing market
* Avoid running blocking REST calls from within a stream processing system - have them asynchronously launched and communicate over Kafka queues
* Visibility into telemetry of streaming processing systems is still a new field and under active development
* Running the fast data platform is easily launched on an existing or new Mesosphere DC/OS runtime
More on this: Quick scan our curated show notes on InfoQ http://bit.ly/2BYTMbI
You can also subscribe to the InfoQ newsletter to receive weekly updates on the hottest topics from professional software development. bit.ly/24x3IVq
Subscribe: www.youtube.com/infoq
Like InfoQ on Facebook: bit.ly/2jmlyG8
Follow on Twitter: twitter.com/InfoQ
Follow on LinkedIn: www.linkedin.com/company/infoq
Want to see extented shownotes? Check the landing page on InfoQ: http://bit.ly/2BYTMbI