DZone
Thanks for visiting DZone today,
Edit Profile
  • Manage Email Subscriptions
  • How to Post to DZone
  • Article Submission Guidelines
Sign Out View Profile
  • Post an Article
  • Manage My Drafts
Over 2 million developers have joined DZone.
Log In / Join
Refcards Trend Reports
Events Video Library
Refcards
Trend Reports

Events

View Events Video Library

The Latest Deployment Topics

article thumbnail
Interaction With Autonomous Database via Docker Container
In this article, I will show you to access the Autonomous Database service, one of the database services offered on Oracle Cloud infrastructure, through a Docker image.
June 12, 2021
by Emrah Mete
· 12,872 Views · 3 Likes
article thumbnail
Introduction to Feature Flags in CD
In this post, we'll discuss the problems and risks of CD without feature flags, how flags make it easier to implement CD, and more.
June 10, 2021
by Nick Rendall
· 12,001 Views · 2 Likes
article thumbnail
Client-Side Perf Testing Using Lighthouse CI With Puppeteer
Take a look at client-side performance testing using Lighthouse CI with Puppeteer.
June 9, 2021
by Harsha Chandnani
· 15,597 Views · 3 Likes
article thumbnail
From Architecture to an AWS Serverless POC: Architect's Journey
Solution architecture for a financial services client onboarding user journey and patterns to design and develop a Python microservice deployed as an AWS serverless application.
June 9, 2021
by David Shilman
· 11,133 Views · 8 Likes
article thumbnail
User-Friendly API Publishing and Testing With Retrofit
A developer-friendly approach to exporting public APIs is packaging DTOs and endpoint interfaces in an API jar file and using the Retrofit framework to create type-safe clients for integration testing.
June 9, 2021
by Jasper Sprengers
· 7,939 Views · 2 Likes
article thumbnail
Using PGBouncer With CockroachDB
In this article, see to wire PGBouncer to work with CockroachDB.
June 8, 2021
by Artem Ervits DZone Core CORE
· 10,712 Views · 4 Likes
article thumbnail
How to Set Up and Run a (Really Powerful) Free Minecraft Server in the Cloud
Because even Minecraft is better in the cloud.
June 6, 2021
by Todd Sharp
· 11,357 Views · 5 Likes
article thumbnail
AWS Applications Deployment Basics: Setup NGINX
In this post, we will setup NGINX and use it as a reverse proxy in the AWS cloud.
June 6, 2021
by Jawad Hasan Shani DZone Core CORE
· 23,111 Views · 4 Likes
article thumbnail
Reference Architecture: Deploying WSO2 API Manager on Microsoft Azure
I will be discussing how to deploy the WSO2 API Manager on the Azure cloud, and what are different Azure workloads can be used in the solution.
June 6, 2021
by Joy Rathnayake
· 16,160 Views · 1 Like
article thumbnail
Deploy an ASP.NET Core Application in the IBM Cloud Code Engine
Turn your ASP.NET application into a serverless engine.
June 6, 2021
by Deepak Rai
· 10,617 Views · 2 Likes
article thumbnail
How To Use Kubernetes in AI Projects
What are the benefits of using Kubernetes in AI projects? Take a look at real-world use cases where Kubernetes helped optimize AI project performance and costs.
June 6, 2021
by Anton Logvinenko
· 15,324 Views · 4 Likes
article thumbnail
Introduction to Git Flow
Git Flow is an abstract idea of a Git workflow. It is an ideal workflow for release-based software and to maintain multiple versions in production.
June 4, 2021
by Mansi Babbar
· 13,216 Views · 21 Likes
article thumbnail
Get Started With Java Serverless Functions
Quarkus allows you to develop serverless workloads with familiar Java technology.
June 4, 2021
by Daniel Oh DZone Core CORE
· 13,496 Views · 7 Likes
article thumbnail
Route53 With a Private Hosted Zone
A few easy steps to get familiar with Route53 using Private Hosted Zone in AWS. Route53 is an AWS service that provides a mapping between domain names and IP addresses.
June 3, 2021
by Giridhar LV
· 11,454 Views · 3 Likes
article thumbnail
Optimize the Execution Time of Spring Integration Tests
This article covers a multitude of areas on real project data, including time-consuming data, optimization, and integration. Read below for a full tutorial!
June 2, 2021
by shaoyang liu
· 9,754 Views · 2 Likes
article thumbnail
Force MFA for AWS IAM Users
As an AWS administrator, it is your job to make sure users enable MFA. See how to do so in this brief article.
June 1, 2021
by Mohit Nain
· 6,108 Views · 2 Likes
article thumbnail
AWS App Deployment Basics: VPC and PostgreSQL Setup
In this post, we will start by setting up AWS VPC and PostgreSQL instances. Then we try to connect to it via a NodeJS application running locally on the same machine.
June 1, 2021
by Jawad Hasan Shani DZone Core CORE
· 9,696 Views · 3 Likes
article thumbnail
Deploying CockroachDB on Kubernetes using OpenEBS LocalPV
CockroachDB is a cloud-native SQL database that features both scalability and consistency. The database is designed to withstand data center failures by deploying multiple instances of symmetric nodes in a cluster consisting of several machines, disks, and data centers. Kubernetes’ built-in capabilities to scale and survive node failures make it well suited to orchestrate CockroachDB’s databases. This is particularly for the reason that Kubernetes simplifies cluster management and helps maintain high-availability by replicating data across independent nodes. This guide focuses on how OpenEBS LocalPV devices can be used to persist storage for Kubernetes-Hosted CockroachDB clusters. Introduction to Distributed, Scaled-out Databases Ever growing demands for resilience, performance, scalability and ease of use have led to an explosion of choices for developers and data scientists in search of an open source database to address their needs. Databases are often characterized as either SQL databases, noted for their consistency guarantees with PostgreSQL and MariaDB considered to be ACID compliant (Atomic, Consistent, Isolated, Durable), or NoSQL databases which have been noted for their scalability and flexibility however not considered to be either ACID compliant or completely compatible with SQL. More recently Distributed, Scaled-out Databases were introduced that promise to avoid the trade-offs between SQL and NoSQL databases, allowing for the scalability of NoSQL DBs along with the ACID (Atomic, Consistent, Isolated, Durable) transactions, strong consistency, and relational schemas of SQL DBs. CockroachDB is a distributed database that is built on top of RocksDB as its transactional and key-value store. Cockroach DB supports both ACID transactions and vertical & horizontal scalability. With extensive geographical distribution, CockroachDB can maintain availability with controlled latency in case of disk, machine or even a data center failure. How CockroachDB works: CockroachDB is deployed in clusters consisting of multiple nodes. Each node is divided into five layers: The SQL Layer converts client queries to key-value entities by first parsing them against a YACC file then converting them into an abstract syntax tree. With this tree, the database will generate a network of plan nodes containing a key-value code. When the plan nodes are executed, they initiate communication with the transaction layer. The Transaction Layer then uses two-phase commits to implement the semantics of ACID transactions. These commits are executed across all nodes in the cluster. The commit involves posting write extents and transaction records, then executing read operations. Once a commit has been made at the transaction layer, a request is made to the respective node’s Distribution Layer. This layer then identifies the destination node for the request and forwards the request to its replication layer. The Replication Layer’s primary responsibility is creating multiple copies of data across cluster nodes. It also uses a raft algorithm to ensure consensus between different nodes holding similar copies of data. The Storage Layer uses RocksDB to store data as key-value pairs. Although CockroachDB can run on Mac, Linux, and Windows OS, production instances of CockroachDB are typically run on Linux Virtual machines or containers. The database can be orchestrated either on cloud or on-premises setup. For running stateful applications, orchestration tools like Kubernetes are considered perfect. Orchestrating CockroachDB with Kubernetes Clusters: Before we begin To understand how CockroachDB is orchestrated on Kubernetes, here are some Kubernetes terminology applicable to storage and stateful applications: A StatefulSet is a collection of Kubernetes PODs viewed as a single stateful unit with its own network identity. A StatefulSet is a stable Kubernetes object that always binds to the same persistent storage when it restarts. A Persistent Volume is a block-storage-based file system that is bound to a POD. A volume’s lifecycle is not tied to the POD to which it is attached, and every CockroachDB node can attach to the same persistent volume every time it restarts. A Certificate Signing Request is a request by a client to have their TLS certificate signed by the Certificate Authority built into Kubernetes by default. Role-Based Access Control (RBAC) is the system used by Kubernetes to administer access permissions in the cluster. Roles allow users to access certain resources within the cluster. To use the most up-to-date files, Kubernetes version 1.15 or higher is required to run CockroachDB clusters. The database can be deployed on any Kubernetes distribution, including a Local cluster (such as Minikube), Amazon AWS, EKS, Google GKE and GCE, among others. For persistence and replication, CockroachDB relies on external persistent volumes such as OpenEBS LocalPV. Installing CockroachDB Operators on OpenEBS LocalPV Devices When using OpenEBS with CockroachDB, a LocalPV is provisioned on the node where a CockroachDB POD is attached. The volume uses an unattached block device, which is used to store data. OpenEBS Dynamic LocalPV provisioner can create Kubernetes Local Persistent Volumes using block devices available on the node to persist data, hereafter referred to as OpenEBS LocalPV Device volumes. When compared to native Kubernetes Local Persistent Volumes, OpenEBS LocalPV Device volumes have the following advantages. Dynamic Volume provisioner as opposed to a Static Provisioner. Better management of the block devices used for creating LocalPVs by OpenEBS NDM. NDM provides capabilities like discovering block device properties, setting up device filters, metrics collection and the ability to detect if the block devices have moved across nodes. Once a volume claims a block device, no other application can use the device for storage. If there are limited block devices in other nodes, nodeSelectors can be used to provision storage for applications on particular cluster nodes. The recommended configuration for CockroachDB clusters is at least three nodes with one unclaimed Local SSD per node. This solution guide takes you through installing CockroachDB Kubernetes operators, and then configuring the cluster to use Local OpenEBS devices as the storage engines. The guide also highlights how to access the database for SQL queries, and finally demonstrates how to monitor the database using Prometheus and Grafana. Let us know how you use CockroachDB in production and if you have an interesting use case to share. Also, please check out other OpenEBS deployment guides on common Kubernetes stateful workloads at: Deploying Kafka on Kubernetes Deploying Elasticsearch on Kubernetes Deploying WordPress on DigitalOcean Kubernetes Deploying Magento on Kubernetes Deploying Percona on Kubernetes Deploying Cassandra on Kubernetes Deploying MinIO on Kubernetes Deploying Prometheus on Kubernetes This article has already been published on https://blog.mayadata.io/deploying-cockroachdb-on-kubernetes-using-openebs-localpv and authorised by MayaData for a republish.
May 31, 2021
by Sudip Sengupta DZone Core CORE
· 13,839 Views · 3 Likes
article thumbnail
Kustomize: A Tool for Kubernetes Configuration Management
Kustomize is an easy-to-use tool for Kubernetes configuration management. It is integrated with Kubectl.
May 30, 2021
by Taruvai Subramaniam
· 10,021 Views · 2 Likes
article thumbnail
Top Microservices Frameworks
Choose right framework for microservices architecture.
May 29, 2021
by Ravi Kiran Mallidi DZone Core CORE
· 36,205 Views · 26 Likes
  • Previous
  • ...
  • 209
  • 210
  • 211
  • 212
  • 213
  • 214
  • 215
  • 216
  • 217
  • 218
  • ...
  • Next
  • RSS
  • X
  • Facebook

ABOUT US

  • About DZone
  • Support and feedback
  • Community research

ADVERTISE

  • Advertise with DZone

CONTRIBUTE ON DZONE

  • Article Submission Guidelines
  • Become a Contributor
  • Core Program
  • Visit the Writers' Zone

LEGAL

  • Terms of Service
  • Privacy Policy

CONTACT US

  • 3343 Perimeter Hill Drive
  • Suite 215
  • Nashville, TN 37211
  • [email protected]

Let's be friends:

  • RSS
  • X
  • Facebook
×