DZone
Thanks for visiting DZone today,
Edit Profile
  • Manage Email Subscriptions
  • How to Post to DZone
  • Article Submission Guidelines
Sign Out View Profile
  • Post an Article
  • Manage My Drafts
Over 2 million developers have joined DZone.
Log In / Join
Refcards Trend Reports
Events Video Library
Refcards
Trend Reports

Events

View Events Video Library

The Latest Coding Topics

article thumbnail
Sending SMS With Scala
Want to learn how you can send an SMS using Scala? Read through this article and learn how to choose a provider and integrate your applications smoothly.
May 17, 2021
by Bartłomiej Żyliński DZone Core CORE
· 11,730 Views · 4 Likes
article thumbnail
High-Performance Batch Processing Using Apache Spark and Spring Batch
Batch processing is dealing with a large amount of data; it actually is a method of running high-volume, repetitive data jobs and each job does a specific task.
May 16, 2021
by Reza Ganji DZone Core CORE
· 29,554 Views · 7 Likes
article thumbnail
Kubernetes Multi-Tenancy Best Practices With Amazon EKS
Learn best practices and considerations for your multi-tenant apps!
May 16, 2021
by Alfonso Valdes
· 16,433 Views · 1 Like
article thumbnail
mxGraph Usage in TypeScript Projects
Learn how to integrate mxGraph in TypeScript project.
May 16, 2021
by Thomas Bouffard
· 10,299 Views · 3 Likes
article thumbnail
A Guide to Open-Source IaC Testing
Are you using IaC, like Terraform? Learn about IaC OSS testing tools, like Terrascan, Checkov, TFLint, Tf-sec, Sentinel, and others – and how they compare.
Updated May 16, 2021
by Rob Schoening
· 24,748 Views · 6 Likes
article thumbnail
Vue.js and Symfony — User Authentication
Authenticating users in Symfony — with Vue.js as frontend framework.
May 16, 2021
by Dariusz Włodarczyk
· 9,856 Views · 1 Like
article thumbnail
Getting started with Java Serverless Functions using Quarkus and AWS Lambda
Java serverless functions with Quarkus
May 14, 2021
by Daniel Oh DZone Core CORE
· 16,574 Views · 2 Likes
article thumbnail
Dive Deep Into Resource Requests and Limits in Kubernetes
This article will be helpful for you to understand how Kubernetes requests and limits work, and why they can work in an expected way.
May 14, 2021
by Sherlock Xu
· 9,846 Views · 7 Likes
article thumbnail
Veeva Nitro and AWS SageMaker for Life Sciences Data Scientists
There is a rise in industry-specific data analytics solutions because building up and maintaining a custom data warehouse is difficult.
May 14, 2021
by Istvan Szegedi
· 6,750 Views · 2 Likes
article thumbnail
How Spring Security Concurrent Session Control Works: Part 1
In this post, we will understand how a Spring Security concurrent session control works and how to customize it for a clustered environment.
May 13, 2021
by Mohammed ZAHID
· 14,727 Views · 3 Likes
article thumbnail
Spring Data and R2DBC by Example
Take a look at this tutorial that show you how use R2DBC in a Spring project.
May 13, 2021
by moises zapata
· 11,583 Views · 1 Like
article thumbnail
How to Implement Flutter Barcode Scanner From Scratch
Since the new Flutter is not compatible with the old one, I refactored the APIs of the Flutter barcode plugin and added a new method to scan by video stream in real-time.
May 13, 2021
by Xiao Ling
· 9,509 Views · 2 Likes
article thumbnail
Deploy Elasticsearch on Kubernetes Using OpenEBS LocalPV
Overview Elastic Stack is a group of open-source tools that includes Elasticsearch for supporting data ingestion, storage, enrichment, visualization, and analysis for containerized applications. As a distributed search and analytics engine, Elasticsearch is an open-source tool that ingests application data, indexes it then stores it for analytics. Since it gathers large volumes of data while indexing different data types, Elasticsearch is often considered write-heavy. To manage such dynamic volumes of data, Kubernetes makes it easy to configure, manage, and scale Elasticsearch clusters. Kubernetes also simplifies the provisioning of resources for Elasticsearch using Infrastructure-as-Code configurations, abstracting cluster management. While Kubernetes alone cannot store data generated by a cluster, persistent volumes can be used to sustain it for future use. To help with this, OpenEBS provisions local persistent volumes or LocalPV and allows for data to be stored on physical disks. Many users have shared their experience of using OpenEBS for local storage management in Kubernetes for Elasticsearch, including the Cloud Native Computing Foundation, ByteDance (TikTok), and Zeta Associates (Lockheed Martin) on the Adopters list in the OpenEBS community available here. In this guide, we explore how OpenEBS LocalPV can provision data storage for Elasticsearch clusters. This guide will also cover - Primary functions of Elastic Stack operators in a Kubernetes cluster Integrating Elasticsearch operators with Fluentd and Kibana to form the EFK stack Monitoring Elasticsearch cluster metrics with Prometheus and Grafana Getting Started with Elasticsearch Analytics Elasticsearch extends the ability to store and search large amounts of textual, graphical or numerical data efficiently. Kubernetes makes it easy to manage the connections between Elasticsearch nodes, thereby simplifying deploying Elasticsearch on-premises or in hosted cloud environments. It must be noted that Elasticsearch nodes are different from Kubernetes nodes of a cluster. While an Elasticsearch node runs a single instance of Elasticsearch, a Kubernetes node is a physical or virtual machine that the orchestrator runs on. Elasticsearch Cluster Topology From Kubernetes’ point of view, an Elasticsearch node can be considered as a POD. Whenever an Elasticsearch cluster is deployed, three types of Elasticsearch PODs are created: Master - manage the Elasticsearch cluster Client - direct incoming traffic to appropriate PODs Data - responsible for storing and availing cluster data The diagram below shows the topology of a typical 7 POD Elasticsearch cluster with 3-master, 2-client and 2-data nodes: Deploying Elasticsearch involves creating manifest files for each of the cluster’s PODs. By connecting to the cluster, OpenEBS creates a visibility tier that enables cluster monitoring, logging and topology checks for LocalPV Storage. Additionally, to enable cluster-wide analytics, the following tools are deployed : Fluentd - An open-source data collection agent that integrates with Elasticsearch to collect log data, transform it then ship it to the Elastic Backend. Fluentd is set up on cluster nodes to collect and convert POD information and send it to the Elasticsearch data PODs for storage and indexing. It is typically set up as a DaemonSet to run on each Kubernetes worker node. Kibana - Once the cluster is deployed on Kubernetes, it needs to be monitored and managed. To help with this, Kibana is used as a visualization tool for cluster data by providing the Elasticsearch client service as an environment variable in PODs that Kibana should connect to. Solution Guide The following solution guide explains the steps and important considerations for deploying Elasticsearch clusters on Kubernetes using OpenEBS Persistent Volumes. By following the guide, you can create persistent storage for the EFK stack supported by Kubernetes, to which OpenEBS is deployed. The guide includes steps on performing metric checks and performance monitoring for the Elasticsearch cluster using Prometheus and Grafana. Let us know how you use Elasticsearch in production and if you have an interesting use case to share. Also, please check out other OpenEBS deployment guides on common Kubernetes stateful workloads on our website. Deploying Kafka on Kubernetes Deploying WordPress on DigitalOcean Kubernetes Deploying Magento on Kubernetes Deploying Percona on Kubernetes Deploying Cassandra on Kubernetes Deploying MinIO on Kubernetes Deploying Prometheus on Kubernetes This article has already been published on https://blog.mayadata.io/deploy-elasticsearch-on-kubernetes-using-openebs-localpv and has been authorized by MayaData for a republish.
May 12, 2021
by Sudip Sengupta DZone Core CORE
· 7,897 Views · 3 Likes
article thumbnail
Java HTML Report in a Few Lines of Code
A practical example of how to build real-world applications in Java and create a simple but useful front-end with basic HTML.
Updated May 12, 2021
by Pavel Ponec
· 10,158 Views · 1 Like
article thumbnail
Use Shared Packages From an Azure DevOps Feed in a Maven Project
We run through a tutorial on on how to create Azure DevOps Artifacts, connect our Artifacts to a Maven feed, and build and push the changes to our Artifacts.
May 11, 2021
by Sreekumar C
· 19,138 Views · 2 Likes
article thumbnail
Are You Tracking Kubernetes Applications Effectively?
Contrary to logs and observability, which show what happens on a service, tracing allows developers and operators to follow a specific request and how it calls different services and dependencies
May 10, 2021
by Leonid Sandler
· 21,238 Views · 5 Likes
article thumbnail
How to Install VPN on Linux?
Installing a VPN on a Linux machine can give you added security and protect private information to be exposed on the internet. Check out how to do so in this article.
May 10, 2021
by Raunak Jain
· 16,758 Views · 1 Like
article thumbnail
What is RAID in Linux?
RAID in Linux can be used to create logical volumes to ensure recovery from disk failures, backups, etc. RAID uses techniques such as mirroring and stripping.
May 10, 2021
by Raunak Jain
· 27,861 Views · 1 Like
article thumbnail
REST Assured: CRUD Framework for API Testing
Design Pattern for API Testing using Java Rest Assured Library.
Updated May 10, 2021
by Aswani Kumar Avilala
· 18,102 Views · 17 Likes
article thumbnail
Node.js – Dependency Management
Dependency management is part of the core Node.js experience. In this post, we will learn the various patterns of dependency management and how Nodejs load dependencies.
May 10, 2021
by Jawad Hasan Shani DZone Core CORE
· 13,511 Views · 15 Likes
  • Previous
  • ...
  • 389
  • 390
  • 391
  • 392
  • 393
  • 394
  • 395
  • 396
  • 397
  • 398
  • ...
  • Next
  • RSS
  • X
  • Facebook

ABOUT US

  • About DZone
  • Support and feedback
  • Community research

ADVERTISE

  • Advertise with DZone

CONTRIBUTE ON DZONE

  • Article Submission Guidelines
  • Become a Contributor
  • Core Program
  • Visit the Writers' Zone

LEGAL

  • Terms of Service
  • Privacy Policy

CONTACT US

  • 3343 Perimeter Hill Drive
  • Suite 215
  • Nashville, TN 37211
  • [email protected]

Let's be friends:

  • RSS
  • X
  • Facebook
×