Data Engineering Resources

Microservices Architecture and User Interfaces

Although ''microservices'' might seem like a buzzword, I suggest taking advantage of the modernized techniques that the microservices movement is generating.

Updated March 9, 2017

by Alejandro Duarte

CORE

· 53,922 Views · 23 Likes

IoT Security Woes

Securing cloud-based IoT is hard; there is a combination of local software, cloud, and hardware solutions to deal with. Let's take a look at a possible solution.

March 9, 2017

by Anatoly Lebedev

· 3,438 Views · 1 Like

Posting JSON Data to a Mule Flow

There are only 11 steps to POSTing JSON data to a Mule flow. JSON data can be sent directly to a Mule flow. The reason for doing this is to access data from a payload.

March 8, 2017

by Danish Sheikh

· 26,952 Views · 1 Like

Capturing AJAX API Requests From Arbitrary Sites With a Chrome Extension

There were no suitable Chrome extensions to monitor HTTP requests from AJAX calls — so we decided to create one ourselves.

March 8, 2017

by Derric Gilling

CORE

· 15,671 Views · 1 Like

Using Random Generator to Hit the Powerball Jackpot

As we continue to explore weights and randomness, see how an open source library tackles winning the biggest prize of them all: the lottery.

March 7, 2017

by John Vester

CORE

· 127,352 Views · 1 Like

Monitoring Out-Of-Memory Errors in Your Servers

Out-of-memory errors happen when your machines run into very low memory somehow. There are a lot of things you can do to avoid OOM.

March 7, 2017

by Denny Zhang

· 11,214 Views · 4 Likes

How to Create a Service Bus With Windows Azure

Windows Azure Service Bus is a brokered, scalable, multi-featured messaging queuing system. It's a reliable message queuing and durable publish/subscribe system.

March 7, 2017

by Jitendra Bafna

· 30,140 Views · 1 Like

Benchmarking Java Lists Performance

LinkedList is slightly slower than ArrayList with adding items to the end of the list. It is also slower when retrieving items with an index (random access).

March 7, 2017

by Jay Sridhar

· 22,000 Views · 10 Likes

Building Angular2 Single Page Applications with Crafter CMS

Developers should separate code from content so non-technical users can easily update the app's content without needing code updates or deployments.

March 7, 2017

by Russ Danner

· 10,636 Views · 3 Likes

Clean Architecture Is Screaming

Uncle Bob's Clean Architecture keeps your application flexible, testable, and highlights its use cases. But there is a cost: No idiomatic framework usage!

March 7, 2017

by Grzegorz Ziemoński

· 56,362 Views · 26 Likes

Spring Boot RESTful API Documentation with Swagger 2

Spring Boot and Swagger 2 play together very well. Just add the dependencies, one configuration file, and a bunch of annotations, and you're ready to go!

March 6, 2017

by John Thompson

· 561,886 Views · 58 Likes

How to Create a Custom Mule Connector With DataSense

When you are going to add DataSense to a custom connector, having configuration declaration is mandatory irrespective of whether the configuration is mandatory.

March 6, 2017

by Anupam Gogoi

· 5,453 Views · 4 Likes

Cloud-Native Middleware Microservices

With cloud-native microservices, you can develop, test, deploy, and maintain independent lightweight services while combining various other technologies.

March 5, 2017

by Kai Wähner

CORE

· 6,579 Views · 4 Likes

How to Publish RAML-Based APIs to Anypoint Exchange

Anypoint Exchange can be connected with Anypoint Studio to download and install connectors, consume APIs, and publish RAML-based APIs.

March 4, 2017

by Jitendra Bafna

· 20,298 Views · 1 Like

Custom Annotation in Java for SQL Injection Safe Parameters

How to verify if incoming data strings are safe from SQL Injection issues.

Updated March 3, 2017

by Ramakrishna Punjal

· 45,018 Views · 20 Likes

Backup, Restore, and Disaster Recovery in Hadoop

Test your backup and restore procedures right after you install your cluster. Backups are a waste of time and space if they don't work and you can't get your data back!

March 3, 2017

by Tim Spann

CORE

· 29,310 Views · 5 Likes

How to Improve Hive Query Performance With Hadoop

Apache Hive is a powerful tool for analyzing data. It's very important that you know how to improve the performance of query when you are processing petabytes of data.

March 3, 2017

by Jitendra Bafna

· 85,599 Views · 9 Likes

JSON With MariaDB 10.2

As popular as JSON is becoming, let's dive into some functions you can implement with it using MariaDB, including an example of indexing.

March 3, 2017

by Anders Karlsson

· 17,993 Views · 7 Likes

How to Remotely Connect to an In-Memory HSQLDB [Snippet]

In-memory databases are a common occurrence with unit tests, so let's take a look at how to remotely connect to an instance if you need to, say, debug some data or tests.

March 2, 2017

by Adrian CITU

· 12,447 Views · 1 Like

HBase Compaction and Data Locality With Hadoop

Compaction is a process by which HBase cleans itself, and data locality is a solution to data not being available to Mapper.

March 2, 2017

by Jitendra Bafna

· 31,274 Views · 5 Likes

The Latest Data Engineering Topics