Category: Hazelcast

Feed: Hazelcast Blog. Author: David Brimley. The latest version of the Hazelcast Management Center (3.10) has just been released and we wanted to share with you some of the improvements that have been made in terms of functionality. The aim was to make it easier and much quicker to answer some common questions about a running cluster. There were two things in particular that were not so easy to do in the old Management Center, finding the largest data structures in a cluster and searching for a data structure by name. The old Management Center used to have a dynamic ... Read More

Feed: Hazelcast Blog. Author: Rafal Leszko. In this blog post, I explain how to set up a Hazelcast cluster using AWS Auto Scaling mechanism. I also give a step-by-step example and justify why other, more trivial solutions may fail. Introduction AWS offers an Auto Scaling feature, which allows to dynamically provision EC2 instances depending on specific metrics (CPU, network traffic, etc.). This feature perfectly fits the needs of a Hazelcast cluster. Hazelcast Requirements Notice that Hazelcast has specific requirements: the number of instances must change by 1 at the time when an instance is launched or terminated, the cluster must ... Read More

Feed: Hazelcast Blog. Author: Emin Demirci. In the first part of the Deploying Hazelcast Jet series, we walk through how to install and deploy Hazelcast Jet on a bare metal machine which leverages a lot of manual steps. Today, we’ll take one more step towards a more modern deployment methodology. We will use Docker containers to show how you can create a Hazelcast Jet cluster with Docker and deploy Hazelcast Jet Jobs on top of it. Docker is the de-facto platform for developers and sysadmins to build, ship, and run distributed applications. Docker Compose is a tool to define and ... Read More

Feed: Hazelcast Blog. Author: Ensar Basri Kahveci. In Hazelcast Jet 0.5, we introduced fault tolerance for streaming computations. Hazelcast Jet periodically takes snapshots of the state of a running job and stores these snapshots in Hazelcast IMaps. In case of a failure, the job is restarted from the last successful snapshot. Hazelcast Jet 0.6 uses the same snapshotting mechanism to enable dynamic scaling of streaming jobs. We added a new method to the job interface: restart(). You can scale out your running jobs easily by adding new Hazelcast Jet nodes into your cluster and calling the new restart method. When ... Read More

Feed: Hazelcast Blog. Author: Vladimir Schreiner. This week, ThoughtWorks released its 18th edition of Technology Radar. As a product manager in a company which develops infrastructure software, I appreciate these overviews as they provide both technical and high-level insight. The current edition discusses Recreating ESB antipatterns with Kafka, something I have experienced personally. Going back in time to the early 2000s, Enterprise Service Bus (ESB) promised to reduce the complexity of enterprise systems by introducing a central service bus – a magical pipe which mediated communication, so that system components could talk to the ESB instead of talking directly to ... Read More

Feed: Hazelcast Blog. Author: Christoph Engelbert. Let me start this post with some wisdom we all have to accept from time to time: Sometimes things just don't work out the way we want them to. Following up is a little write-up of the last couple of months, what happened and what not. It might be just interesting to see what was going on, but I hope it might help a person or two too. TLDR; Since this blog post got way longer than expected, I'm looking for some cool opportunities to help with ;-) Almost 6 months ago I talked ... Read More

Feed: Hazelcast Blog. Author: Josef Cacek. Introduction Hazelcast IMDG 3.10 comes with a new feature – support for Variable Replacers. The replacers allow to use placeholders (Variables) in configuration XML files. You can use Replacers to mask sensitive strings (such as passwords) or to provide values which depend on current environment. There was already a partial support for placeholders before version 3.10, it allows to reference system properties: ${groupName} Hazelcast version 3.10 extends the feature and adds possibility to introduce your own replacer implementations. Variable replacers are classes which implement ConfigReplacer interface: public interface ConfigReplacer { void init(Properties properties); String ... Read More

Feed: Hazelcast Blog. Author: Matko Medenjak. At long last, we are pleased to announce the production-ready release of Hazelcast IMDG 3.10. A lot of effort has been put into making this release the most feature complete and the most stable release so far. Many of these features were driven by the needs of the community. So let me start by introducing some features worth mentioning: Flake ID Generator Many systems require the generation of unique IDs. Although unique ID generation is a relatively easy problem in single-node systems, many problems pop-up in distributed implementations, such as preserving uniqueness, eliminating contention, ... Read More

Feed: Hazelcast Blog. Author: Jaromir Hamala. Part I: Intro Hazelcast Jet supports writing into a number of 3rd party systems, including HDFS, Apache Kafka and others. But what if you want to write into your own system which is not supported by Jet out-of-the-box? Starting with the version 0.6 Jet offers a new simple-to-use API for building custom Sinks and this tutorial will show you how to use it! In this tutorial we are going to build a JDBC sink writing Stock updates to a relational database, but you can apply the same principles for building an arbitrary sink. Part ... Read More

Feed: Hazelcast Blog. Author: Can Gencer. We are happy to announce the release of Hazelcast Jet 0.6! This version brings many new improvements which I will try to squeeze into this blog post. Improved streaming support for Pipeline API With 0.5, Jet introduced a new high-level API for Jet, called Pipelines which offered a convenient way to do distributed data processing using a powerful and expressive DSL. With 0.6, this API is now overhauled and extended to support a more complete set of features, including full streaming support with windowing. Previously, stateful streaming operations such as windowing was only possible ... Read More