Data Engineering Resources

Resolving Permission Issue in Multi-node Hadoop Cluster

It has been observed when we configure and deploy a multi-node Hadoop cluster or add new DataNodes, there is an SSH permission issue in communication with Hadoop daemons.

April 22, 2021

by Gautam Goswami

CORE

· 7,958 Views · 2 Likes

Building an Angular Bot With AWS Lex

Here's an in-depth guide to building your own Angular chatbot.

Updated April 21, 2021

by Amar Deep Singh

· 20,344 Views · 6 Likes

Data Platform as a Service

When we design and build a Data Platform, we are working on providing the capacities and tools that others teams need to develop their projects. Let's discuss!

April 20, 2021

by Miguel Garcia

CORE

· 16,421 Views · 16 Likes

Graph-Based Data Science, Machine Learning, and AI

What does graphing have to do with machine learning and data science? A lot, actually — learn more in The Year of the Graph Newsletter's Spring 2021 edition.

April 20, 2021

by George Anadiotis

· 10,021 Views · 5 Likes

Spring Data JPA + QueryDSL: Taking the Best From Both Worlds

An example of combining the two most powerful frameworks for building a maintainable and type-safe persistence layer; from Spring Data JPA we will take only CRUD operations and for all complex queries we will use QueryDSL.

Updated April 18, 2021

by Dmytro Stepanyshchenko

· 30,164 Views · 5 Likes

MQTT 5 vs. MQTT v3.1.1 for IoT App Development

See what's new with MQTT and IoT.

April 17, 2021

by Daniil Liadov

· 18,846 Views · 2 Likes

Data Ingestion From RDBMS: Leveraging Confluent's JDBC Kafka Connector

Kafka Connect assumes a significant part for streaming data between Apache Kafka and other data systems. Importing data from the Database set to Kafka topic.

April 17, 2021

by Gautam Goswami

CORE

· 7,688 Views · 3 Likes

4 Software QA Metrics To Enhance Dev Quality and Speed

In this article, we discuss how the demand for software is higher than ever. Lines of code govern almost everything we do in our day-to-day activities.

April 16, 2021

by Richard Conn

· 10,468 Views · 3 Likes

Five Handy JavaScript Uploaders to Keep in Mind

Make your development life just a little bit easier with these five uploaders.

Updated April 16, 2021

by Ivan Petrenko

· 17,743 Views · 5 Likes

Most Common IaaS Security Issues and Ways To Mitigate Them

IaaS security issues are the most critical concerns for both users and providers alike, which need to be solved for high performance.

Updated April 16, 2021

by Akash Bakshi

· 7,171 Views · 2 Likes

Audit Database Changes With Debezium

In this article, we will explore Debezium to capture data changes. Debezium is a distributed open-source platform for change data capture. Point the Debezium...

Updated April 16, 2021

by Siva Prasad Rao Janapati

· 16,554 Views · 2 Likes

How to Delay Database Connection Acquisition in Hibernate (Spring Data)

In the case of resource-local (a single data source), Hibernate will acquire the database connection of a JDBC transaction right after the transaction starts.

April 16, 2021

by Anghel Leonard

CORE

· 16,501 Views · 5 Likes

Working With dotConnect for Oracle in ASP.NET Core

The article discusses the striking features of dotConnect for Oracle (a fast ORM for Oracle from Devart) and shows how to work with it in ASP.NET Core.

April 15, 2021

by Joydip Kanjilal

CORE

· 10,777 Views · 2 Likes

Working With Stored Procedures Using dotConnect for Oracle

The article discusses the striking features of dotConnect for Oracle and shows how to work with stored procedures and dotConnect for Oracle in ASP.NET Core 5.

April 15, 2021

by Joydip Kanjilal

CORE

· 8,646 Views · 2 Likes

Python Memo 2: Dictionary vs. Set

A software architect takes a deep dive into the Python language by exploring dictionaries and sets and how these two elements of the language work.

April 15, 2021

by Eason YIN

· 19,288 Views · 2 Likes

Building Event-Driven Microservices That Scale

Event driven microservices are a rage since they provide teams with insane agility at scale. Here’s how you can set it up yourself.

April 14, 2021

by Noorain Panjwani

· 14,564 Views · 2 Likes

Getting Started With Kafka and Rust (Part 2)

A hands-on guide to teach you how to interact with Kafka using the Rust programming language.

April 14, 2021

by Abhishek Gupta

CORE

· 6,204 Views · 3 Likes

Nebula Flink Connector: Implementation and Practices

This post introduces Nebula Flink Connector. Like the pre-defined Flink connectors, it enables Flink to read data from and write data to Nebula Graph.

April 14, 2021

by Nicole Wang

· 6,345 Views · 1 Like

Can a Shift-Left Reduce OpEx Cloud Expenditures?

The cloud has moved from CapEX to OpEX, shifting cloud cost management left by empowering developers and giving them the tools to correlate cloud costs.

April 14, 2021

by Ohad Maislish

· 5,898 Views · 2 Likes

Busy or Lazy?: Design API in Anypoint Studio

Using Anypoint Studio 7.7 and later, we can create API specifications and fragments directly in our Anypoint Studio, or create API Specs in Design Center to be imported.

April 13, 2021

by Ruchi Saini

· 12,845 Views · 2 Likes

The Latest Data Engineering Topics