Data Engineering Resources

We take a look under the hood of Apache Kafka to better understand how this popular framework uses topics and partitions.

April 24, 2019

by Arun Lingala

· 34,006 Views · 13 Likes

How Authentication Works in Encryption

Learn more about authentication and encryption.

April 24, 2019

by Anastasios Arampatzis

· 13,255 Views · 2 Likes

Streaming IoT Data and MQTT Messages to Apache Kafka

Use Apache Kafka for all your IoT data streaming and MQTT message needs!

April 24, 2019

by Ian Skerrett

· 23,377 Views · 13 Likes

Thoughts on Microservices, Part 1: Does My App Need to Be Microservices-Based?

Microservices are great, but not every app needs them. Read on for further thoughts from a chief architect on the proper application of microservices.

April 23, 2019

by Dmitry Alexandrov

· 11,354 Views · 9 Likes

5 Ways Agile is Going to Rule Machine Learning Projects in the Near Future

Agile is bound to be the primary framework used in machine learning and artificial intelligence efforts.

April 23, 2019

by Amit Dua

· 13,176 Views · 2 Likes

How to Write Good Bug Reports and Gather Quality Metrics Data

Learn how to write better bug reports and gather quality metrics.

April 23, 2019

by Anton Angelov

· 9,987 Views · 2 Likes

Using EBS and EFS as Persistent Volume in Kubernetes

Take a look at how you can use EBS and EFS in AWS using the Kubernetes volume plugin.

April 23, 2019

by Samson Gunalan

· 27,352 Views · 2 Likes

How to Test Software, Part I: Mocking, Stubbing, and Contract Testing

Learn more about mocking, stubbing, and contract testing for testing your software.

April 23, 2019

by June Jung

· 15,979 Views · 3 Likes

Microservices and DevOps Using Java, Spring Boot, Git Flow, Jenkins, and Docker

In this post, we develop a microservice using Java and the Spring framework and then use DevOps pipeline to deploy it with Jenkins and Docker.

April 23, 2019

by Amritendu De

· 55,403 Views · 32 Likes

Use Java EE and OpenID Connect to Secure Your Java API

Learn how to use Java EE and OpenID Connect to secure your Java API.

Updated April 22, 2019

by Matt Raible

· 45,356 Views · 4 Likes

Deploying Your Microservices

Ready to deploy your awesome microservices? Read on for one architect's advice on how to make it happen.

April 22, 2019

by James Luterek

· 50,046 Views · 24 Likes

Scalable Select of Random Rows in SQL

Let's explore a scalable select of random rows in SQL.

April 22, 2019

by Pavel Tiunov

· 8,942 Views · 1 Like

AWS Lambda Best Practices

Check out some of the best practices of one of AWS's most popular services here.

April 22, 2019

by Rajesh Bhojwani

· 48,858 Views · 49 Likes

Optimizing Relationships Between Entities in Hibernate

See how to optimize relationships between entities in Hibernate.

April 22, 2019

by Jesus J. Puente

· 12,900 Views · 4 Likes

How to Process Nasty Fixed Width Files Using Apache Spark

Fixed width files can be a pain. Learn how to get around the issues they present using Scala and Spark.

April 19, 2019

by Subhasish Guha

· 30,516 Views · 6 Likes

Contracts for Microservices With OpenAPI and Spring Cloud Contract

In this post, I'll explain how to define contracts at the service level using OpenAPI and Spring Cloud Contract.

April 19, 2019

by John Thompson

· 22,166 Views · 4 Likes

GraphQL: Core Features, Architecture, Pros, and Cons

Explore the GraphQL toolset and its key features, see how GraphQL is taking API design architecture to a new level, and see how it is still losing to REST.

Updated April 19, 2019

by Kseniia Bezugla

· 44,918 Views · 17 Likes

Apache Storm Tutorial

We cover the basics of Apache Storm and implement a simple example of Store that we use to count the words in a list.

April 19, 2019

by Sagar Sharma

· 17,367 Views · 8 Likes

Introduction to Elasticsearch and the ELK Stack, Part 1

In this post, we cover the frameworks that make up the ELK stack (Elasticsearch, Logstash, Kibana [plus Beats]) and how they all work together.

Updated April 18, 2019

by Ayush Jain

· 20,610 Views · 9 Likes

Deploy an Angular App From Visual Studio Code to Azure

This article has a star studded lineup: Node.js, Angular, VS Code, and Azure. Read on to learn how to easily build a web app utilizing these technologies!

Updated April 18, 2019

by Brian De Sousa

· 121,190 Views · 6 Likes

The Latest Data Engineering Topics