Striim CTO Steve Wilkes talks about what hybrid cloud is, what the data considerations are, and why streaming integration is an essential part of a modern data architecture.
The conversation about hybrid-cloud is often related to applications, virtual machines, microservices and how these things are scaled or moved between clouds or on-premise and cloud. However, a bigger consideration is the data.
Striim’s streaming integration platform is perfectly positioned to enable hybrid-cloud use cases.
So what is hybrid cloud? What are the data considerations and why is streaming integration and essential part of this modern data architecture? Well, Gartner defines a hybrid cloud service as a cloud computing service that is composed of some combination of private, public and community cloud services from different service providers. What this means is that if you combine services from multiple clouds or from a cloud with on premise or co-locate in services, then you’re doing hybrid cloud. The conversation about hybrid cloud, they are often related to applications, virtual machines, microservices, and how these things are scaled or move between clouds on premise and cloud. However, a bigger consideration is the data. Almost all hybrid cloud use cases require movement of data in addition to movement and scalability of services. Spinning up additional service instances in the cloud to rapidly and elastically scale is useless if these services can’t access the data they need.
I’ll give you a few examples. Imagine you run a retail website from your private data center, but occasionally you need additional scale like on Cyber Monday. You can spin up additional web servers in the cloud on demand, but need access to your product database. Since this is on premise, there are latency and security issues with the cloud talking to it, so you need read only instances in the cloud. How do you create these cloud databases and ensure the product catalog and inventory are always up to date? Another common use case is using cloud services for elastically scalable analytics. In this case, the data original needs in existence systems on premise needs to be moved to cloud storage databases or data warehouses for analytics. If you want the analytics to always run against the most current data, you need a way to not only transfer the initial on premise data to the cloud, but also ensure any updates are continuously applied.
You may also want to filter, obfuscates or encrypt some of the data for security or privacy purposes. The situation gets even more complex if data originates on one cloud or SaaS application and this be collected and transformed before you deliver it to another, you need integration software they can work with on premise and cloud sources, collect the data continuously, process it and format itbefore delivery into cloud endpoints. Striim’s streaming integration platform is perfectly positioned to enable hybrid cloud use cases. We support the continuous real-time collection of data from our premise and cloud databases, files and messaging systems. Striim can process and format the data in-memory before delivering to AWS. Azure or Google storage, databases, messaging systems, and data warehouses. What’s more, multiple endpoints are targeted in a single data flow assuring your data gets to where you need it, when you need it.
Music: Organic To Synthetic by Punch Deck