DZone
Thanks for visiting DZone today,
Edit Profile
  • Manage Email Subscriptions
  • How to Post to DZone
  • Article Submission Guidelines
Sign Out View Profile
  • Post an Article
  • Manage My Drafts
Over 2 million developers have joined DZone.
Log In / Join
Refcards Trend Reports
Events Video Library
Refcards
Trend Reports

Events

View Events Video Library

The Latest Popular Topics

article thumbnail
How to Call Rest API by Using jQuery AJAX in Spring Boot? [Video]
This short video will teach you how to call a Rest API by using jQuery AJAX in Spring Boot, and consume a RESTful service with jQuery. Let's get started!
June 6, 2021
by Ram N
· 9,377 Views · 3 Likes
article thumbnail
Introducing Cloudera SQL Stream Builder (SSB)
SSB is an improved release of Eventador's SQL Stream Builder with integration into Cloudera Manager, Cloudera Flink, and other streaming tools.
Updated June 6, 2021
by Tim Spann DZone Core CORE
· 14,930 Views · 5 Likes
article thumbnail
Applications for GPU-Based AI and Machine Learning
We look at some of the most talked-about Artificial Intelligence and Machine Learning areas where graphical processing units (GPU) play an ever-increasing role.
June 6, 2021
by Kevin Vu
· 16,785 Views · 5 Likes
article thumbnail
How To Use Kubernetes in AI Projects
What are the benefits of using Kubernetes in AI projects? Take a look at real-world use cases where Kubernetes helped optimize AI project performance and costs.
June 6, 2021
by Anton Logvinenko
· 15,421 Views · 4 Likes
article thumbnail
Get Started With Java Serverless Functions
Quarkus allows you to develop serverless workloads with familiar Java technology.
June 4, 2021
by Daniel Oh DZone Core CORE
· 13,602 Views · 7 Likes
article thumbnail
NLP Features That Are Criminally Overlooked: The Case for SAO
NLP solutions are based on Machine Learning algorithms, and ML rarely delivers great accuracy. Try a not-so-popular NLP tool: SAO (Subject-Action-Object).
June 3, 2021
by Filiberto Emanuele
· 17,134 Views · 4 Likes
article thumbnail
Optimize the Execution Time of Spring Integration Tests
This article covers a multitude of areas on real project data, including time-consuming data, optimization, and integration. Read below for a full tutorial!
June 2, 2021
by shaoyang liu
· 9,837 Views · 2 Likes
article thumbnail
Deep Links With Angular Routing and i18n in Prod Mode
With Angular i18n the different directories for the language build need to be supported. This article shows how to support language-independent deep linking.
June 2, 2021
by Sven Loesekann
· 14,192 Views · 4 Likes
article thumbnail
Creating a Web Chat with SignalR, Web Sockets, Angular and Magic
With good abstractions everything is simple. Changing gears on your car probably involves thousands of moving parts, but still it's dead simple to achieve
June 2, 2021
by Thomas Hansen DZone Core CORE
· 11,668 Views · 2 Likes
article thumbnail
In-Memory Showdown: Redis vs. Tarantool
This in-depth comparison of both Redis and Tarantool considers the strengths of both in-memory databases and helps point out optimal use cases.
June 1, 2021
by Michael Filonenko
· 13,777 Views · 2 Likes
article thumbnail
What Are Hypothetical Indexes in PostgreSQL?
Explore why you might need hypothetical indexes in PostgreSQL and how to use them,
June 1, 2021
by Sahil Aggarwal
· 9,428 Views · 8 Likes
article thumbnail
Deploying CockroachDB on Kubernetes using OpenEBS LocalPV
CockroachDB is a cloud-native SQL database that features both scalability and consistency. The database is designed to withstand data center failures by deploying multiple instances of symmetric nodes in a cluster consisting of several machines, disks, and data centers. Kubernetes’ built-in capabilities to scale and survive node failures make it well suited to orchestrate CockroachDB’s databases. This is particularly for the reason that Kubernetes simplifies cluster management and helps maintain high-availability by replicating data across independent nodes. This guide focuses on how OpenEBS LocalPV devices can be used to persist storage for Kubernetes-Hosted CockroachDB clusters. Introduction to Distributed, Scaled-out Databases Ever growing demands for resilience, performance, scalability and ease of use have led to an explosion of choices for developers and data scientists in search of an open source database to address their needs. Databases are often characterized as either SQL databases, noted for their consistency guarantees with PostgreSQL and MariaDB considered to be ACID compliant (Atomic, Consistent, Isolated, Durable), or NoSQL databases which have been noted for their scalability and flexibility however not considered to be either ACID compliant or completely compatible with SQL. More recently Distributed, Scaled-out Databases were introduced that promise to avoid the trade-offs between SQL and NoSQL databases, allowing for the scalability of NoSQL DBs along with the ACID (Atomic, Consistent, Isolated, Durable) transactions, strong consistency, and relational schemas of SQL DBs. CockroachDB is a distributed database that is built on top of RocksDB as its transactional and key-value store. Cockroach DB supports both ACID transactions and vertical & horizontal scalability. With extensive geographical distribution, CockroachDB can maintain availability with controlled latency in case of disk, machine or even a data center failure. How CockroachDB works: CockroachDB is deployed in clusters consisting of multiple nodes. Each node is divided into five layers: The SQL Layer converts client queries to key-value entities by first parsing them against a YACC file then converting them into an abstract syntax tree. With this tree, the database will generate a network of plan nodes containing a key-value code. When the plan nodes are executed, they initiate communication with the transaction layer. The Transaction Layer then uses two-phase commits to implement the semantics of ACID transactions. These commits are executed across all nodes in the cluster. The commit involves posting write extents and transaction records, then executing read operations. Once a commit has been made at the transaction layer, a request is made to the respective node’s Distribution Layer. This layer then identifies the destination node for the request and forwards the request to its replication layer. The Replication Layer’s primary responsibility is creating multiple copies of data across cluster nodes. It also uses a raft algorithm to ensure consensus between different nodes holding similar copies of data. The Storage Layer uses RocksDB to store data as key-value pairs. Although CockroachDB can run on Mac, Linux, and Windows OS, production instances of CockroachDB are typically run on Linux Virtual machines or containers. The database can be orchestrated either on cloud or on-premises setup. For running stateful applications, orchestration tools like Kubernetes are considered perfect. Orchestrating CockroachDB with Kubernetes Clusters: Before we begin To understand how CockroachDB is orchestrated on Kubernetes, here are some Kubernetes terminology applicable to storage and stateful applications: A StatefulSet is a collection of Kubernetes PODs viewed as a single stateful unit with its own network identity. A StatefulSet is a stable Kubernetes object that always binds to the same persistent storage when it restarts. A Persistent Volume is a block-storage-based file system that is bound to a POD. A volume’s lifecycle is not tied to the POD to which it is attached, and every CockroachDB node can attach to the same persistent volume every time it restarts. A Certificate Signing Request is a request by a client to have their TLS certificate signed by the Certificate Authority built into Kubernetes by default. Role-Based Access Control (RBAC) is the system used by Kubernetes to administer access permissions in the cluster. Roles allow users to access certain resources within the cluster. To use the most up-to-date files, Kubernetes version 1.15 or higher is required to run CockroachDB clusters. The database can be deployed on any Kubernetes distribution, including a Local cluster (such as Minikube), Amazon AWS, EKS, Google GKE and GCE, among others. For persistence and replication, CockroachDB relies on external persistent volumes such as OpenEBS LocalPV. Installing CockroachDB Operators on OpenEBS LocalPV Devices When using OpenEBS with CockroachDB, a LocalPV is provisioned on the node where a CockroachDB POD is attached. The volume uses an unattached block device, which is used to store data. OpenEBS Dynamic LocalPV provisioner can create Kubernetes Local Persistent Volumes using block devices available on the node to persist data, hereafter referred to as OpenEBS LocalPV Device volumes. When compared to native Kubernetes Local Persistent Volumes, OpenEBS LocalPV Device volumes have the following advantages. Dynamic Volume provisioner as opposed to a Static Provisioner. Better management of the block devices used for creating LocalPVs by OpenEBS NDM. NDM provides capabilities like discovering block device properties, setting up device filters, metrics collection and the ability to detect if the block devices have moved across nodes. Once a volume claims a block device, no other application can use the device for storage. If there are limited block devices in other nodes, nodeSelectors can be used to provision storage for applications on particular cluster nodes. The recommended configuration for CockroachDB clusters is at least three nodes with one unclaimed Local SSD per node. This solution guide takes you through installing CockroachDB Kubernetes operators, and then configuring the cluster to use Local OpenEBS devices as the storage engines. The guide also highlights how to access the database for SQL queries, and finally demonstrates how to monitor the database using Prometheus and Grafana. Let us know how you use CockroachDB in production and if you have an interesting use case to share. Also, please check out other OpenEBS deployment guides on common Kubernetes stateful workloads at: Deploying Kafka on Kubernetes Deploying Elasticsearch on Kubernetes Deploying WordPress on DigitalOcean Kubernetes Deploying Magento on Kubernetes Deploying Percona on Kubernetes Deploying Cassandra on Kubernetes Deploying MinIO on Kubernetes Deploying Prometheus on Kubernetes This article has already been published on https://blog.mayadata.io/deploying-cockroachdb-on-kubernetes-using-openebs-localpv and authorised by MayaData for a republish.
May 31, 2021
by Sudip Sengupta DZone Core CORE
· 13,967 Views · 3 Likes
article thumbnail
AWS Serverless Data Lake: Built Real-time Using Apache Hudi, AWS Glue, and Kinesis Stream
In an enterprise system, populating a data lake relies heavily on interdependent batch processes. Today’s business demands high-quality data in minutes or seconds.
May 29, 2021
by Gaurav Gupta
· 13,304 Views · 3 Likes
article thumbnail
Angular vs React SEO: The Basics
Compare Angular and React in terms of their relative performance, popularity, and their SEO friendliness.
May 28, 2021
by Zsolt Varga
· 24,199 Views · 7 Likes
article thumbnail
How to Composite 2 Images Together in Java
Composite a layered image onto a base image by leveraging APIs in Java.
May 26, 2021
by Brian O'Neill DZone Core CORE
· 6,286 Views · 1 Like
article thumbnail
Video Streaming With Akka Streams
Streaming videos should not give you a headache. Proper tools like Akka Streams will increase your efficiency. Here you can learn more about streaming.
May 26, 2021
by Bartłomiej Żyliński DZone Core CORE
· 13,152 Views · 10 Likes
article thumbnail
Different Types of AspectJ Weaving
How each weaving types work, internally.
May 24, 2021
by Axellageraldinc A
· 16,326 Views · 3 Likes
article thumbnail
What Is Serverless With Java?
The serverless development model is now a requirement for enterprises that want to spin up their business applications on-demand rather than running them all the time.
Updated May 22, 2021
by Daniel Oh DZone Core CORE
· 23,748 Views · 36 Likes
article thumbnail
How to Use GitBook for Technical Documentation
How to create gorgeous documentation using GitBook — and why you should use the platform for your next project.
May 22, 2021
by Everett Berry
· 9,128 Views · 3 Likes
article thumbnail
How to Protect URLs from SSRF Threats in Java
Learn how to check URLs for standard and HTML embedded Server-Side Request Forgery attacks using APIs in Java.
May 22, 2021
by Brian O'Neill DZone Core CORE
· 12,536 Views · 3 Likes
  • Previous
  • ...
  • 313
  • 314
  • 315
  • 316
  • 317
  • 318
  • 319
  • 320
  • 321
  • 322
  • ...
  • Next
  • RSS
  • X
  • Facebook

ABOUT US

  • About DZone
  • Support and feedback
  • Community research

ADVERTISE

  • Advertise with DZone

CONTRIBUTE ON DZONE

  • Article Submission Guidelines
  • Become a Contributor
  • Core Program
  • Visit the Writers' Zone

LEGAL

  • Terms of Service
  • Privacy Policy

CONTACT US

  • 3343 Perimeter Hill Drive
  • Suite 215
  • Nashville, TN 37211
  • [email protected]

Let's be friends:

  • RSS
  • X
  • Facebook
×