Over a million developers have joined DZone.
{{announcement.body}}
{{announcement.title}}

Data Gateway From DigitalOcean to On-premises

DZone's Guide to

Data Gateway From DigitalOcean to On-premises

On-premises connectivity from DigitalOcean is critical for businesses. In this blog, we explain how to access on-premises data using Hybrid Data Pipeline.

· Big Data Zone
Free Resource

Learn best practices according to DataOps. Download the free O'Reilly eBook on building a modern Big Data platform.

On-premises connectivity from DigitalOcean is critical for businesses. In this blog, we explain how to access on-premises data using Hybrid Data Pipeline.

Hybrid Cloud Connectivity Solution for DigitalOcean

With DataDirect Cloud, introduced three years ago, we first brought cloud connectivity to your fingertips with just a few clicks. However, while many customers leveraged it to integrate with cloud and on-premises sources, some wanted to be able to run and control this connectivity for themselves.

We're proud to have recently introduced Hybrid Data Pipeline, which is here to let you do just that. Now, you can host our cloud solution on DigitalOcean or any other cloud.

Hybrid Data Pipeline is our "hostable" version of DataDirect Cloud. You can learn more about both of these products in our cloud connectivity solutions page.

Access to On-premises Data is Critical for a High Performance

DigitalOceanMost organizations today adopt a hybrid strategy when it comes to application deployment or storing data. While they reap the benefits of a low-cost DigitalOcean infrastructure, they also want to keep their sensitive data behind firewalls.

As organizations make this transition from on-premises to DigitalOcean, it becomes increasingly important for the applications migrated/deployed in the cloud to be able to access sensitive data behind the firewall.

Intuit used our solution to create a customer data gateway from Siebel to Salesforce. Likewise, Board leveraged DataDirect Cloud while moving its solution from on-premises to the cloud. In all such scenarios where you want to securely access data behind the firewall, our trusted on-premises connector is essential for your organization.

Secure Firewal Traversal

Host Hybrid Connectivity on DigitalOcean

DataDirect Hybrid Data Pipeline is a lightweight software service that is embedded into a virtual machine running on DigitalOcean. All your applications hosted on the same DigitalOcean cloud can then access data from data sources that are either in the cloud or on-premises. Your applications can use a single standard API—SQL (ODBC, JDBC) or REST (OData)—to access any of the data source types we support, including cloud, SQL, Big Data and NoSQL.

Two Essential Components for On-Premises Access from DigitalOcean

Hybrid Data Pipeline Server

This is the component that an application interfaces to for accessing data and managing the data sources. It is deployed close to the consuming application. It can be on the same machine or on its own machine within the same cloud. It exposes ODBC, JDBC, OData and REST APIs.

On-Premises Connector

This is the component that is installed remotely, typically behind a firewall. It provides the services to securely move data from on-premises data stores residing behind a firewall to the cloud. This module securely connects to the Hybrid Data Pipeline Server without requiring firewall configuration changes using HTTPS. You don’t need the complex SSH tunnels, reverse proxies or any firewall changes.

Tutorials

You can get started by downloading the trial version of Hybrid Data Pipeline. You can then follow the tutorial series drafted by Saikrishna Teja Bobba (@the_dataguy) to run your own hybrid connectivity solution from DigitalOcean:

  1. The first tutorial walks you through the installation of hybrid data pipeline server on DigitalOcean.
  2. After you install the hybrid data pipeline, you can follow the next tutorial to configure the on-premises connector on DigitalOcean.

While no additional components are required to produce OData from your applications, you do need to install an ODBC or JDBC driver if you want to use an ODBC or JDBC API to connect to our Hybrid Data Pipeline server. These tutorials will soon be available. If you have more questions, speak with one of our data connectivity experts.

Find the perfect platform for a scalable self-service model to manage Big Data workloads in the Cloud. Download the free O'Reilly eBook to learn more.

Topics:
server ,cloud solution ,hybrid ,datadirect ,pipeline ,big data

Published at DZone with permission of Nishanth Kadiyala, DZone MVB. See the original article here.

Opinions expressed by DZone contributors are their own.

{{ parent.title || parent.header.title}}

{{ parent.tldr }}

{{ parent.urlSource.name }}