Data Engineering Resources

Unraveling Lombok's Code Design Pitfalls: Exploring Encapsulation Issues

Lombok simplifies Java coding but can breach encapsulation. Java 8's Objects.requireNonNull and IDE support are alternatives. Choose wisely.

September 16, 2023

by Otavio Santana

CORE

· 10,497 Views · 8 Likes

A Complete Guide to Open-Source LLMs

Unlock the world of open-source Large Language Models (LLMs) with this comprehensive guide, and embrace the power of collaborative AI in your projects.

September 15, 2023

by Hiren Dhaduk

· 6,532 Views · 1 Like

Top Five AI-Powered Tools for Test Automation

Top 5 AI-Powered Tools for Test Automation: Perfecto Scriptless Mobile, Applitools, Functionize, AccelQ, Testim. Read more about the pros and cons of AI tools.

September 15, 2023

by Anna Boiko

· 5,484 Views · 1 Like

Enhancing Hyperparameter Tuning With Tree-Structured Parzen Estimator (Hyperopt)

This article explores the concept of Tree-Structured Parzen Estimator (TPE) for hyperparameter tuning in machine learning and its application with an example.

September 15, 2023

by Sai Nikhilesh Kasturi

· 3,987 Views · 1 Like

Beyond the Prompt: Unmasking Prompt Injections in Large Language Models

Prompt Injections in Large Language Models - Uncovering the essence of prompt injections within LLMs, unraveling their execution, and examining strategies for prevention.

September 15, 2023

by Tushar Chugh

· 3,512 Views · 3 Likes

REST vs. Message Brokers: Choosing the Right Communication

We’ll delve into the disparities between REST and message brokers in terms of communication, helping you make the right choice for your specific use case.

September 15, 2023

by Shoham Roditi Elimelech

· 13,851 Views · 9 Likes

Application Integration for IoT Devices: A Detailed Guide To Unifying Your Ecosystem

Know how the IoT connects to application integration in this continuously growing and innovating world, and learn IoT strategies to always be up to date.

September 15, 2023

by Pamela Price

· 4,414 Views · 3 Likes

Unraveling LLMs' Full Potential, One Token at a Time With LangChain

LLMs have immense potential across various tasks and domains; however, they may miss the mark on perfection. Add LangChain to the mix and witness heightened capabilities.

September 15, 2023

by Taranjeet Singh

· 3,629 Views · 1 Like

Apache Flink

This tutorial will show you step-by-step how to use Astra as a sink for results computed by Apache Flink, an open-source framework.

September 15, 2023

by Patrick McFadin

· 5,009 Views · 1 Like

Next-Gen Threat Hunting Techniques With SIEM-SOAR Integration

NLP, AI, and ML boost cybersecurity via streamlined data processing, automated incident handling, compliance, and proactive threat detection.

September 15, 2023

by Cheena Shekhawat

· 3,046 Views · 1 Like

Microservices With Apache Camel and Quarkus (Part 5)

After learning how to run our microservices in Minikube in part three of this series, let's look at how to do the same in OpenShift.

September 15, 2023

by Nicolas Duminil

CORE

· 9,009 Views · 7 Likes

Snowflake vs. Data Bricks: Compete To Create the Best Cloud Data Platform

Do you want to get into the race for the best cloud data platform? Take a look at the difference between Snowflake and Data Bricks.

September 15, 2023

by Sanam Naseem

· 3,987 Views · 4 Likes

Messaging Channels in Enterprise Integration Patterns: Enabling Efficient Communication

In this article, we will discuss Messaging Channels in Enterprise Integration Patterns along with the types and their benefits.

September 15, 2023

by Aditya Bhuyan

· 2,713 Views · 2 Likes

What Is Privacy by Design?

Privacy by Design is sometimes considered too abstract. We, therefore, share tips and tactics for engineers to implement each of the seven principles.

September 15, 2023

by Xander W

· 2,515 Views · 1 Like

Mastering Persistence: Why the Persistence Layer Is Crucial for Modern Java Applications

Ignoring the persistence layer in software can cause data problems, slow performance, maintenance issues, and limited adaptability. It's vital for secure, efficient, and flexible applications.

September 15, 2023

by Otavio Santana

CORE

· 8,200 Views · 2 Likes

A Better Web3 Experience: Account Abstraction From Flow (Part 1)

Walletless dApps from Flow use account abstraction to improve the web3 user experience. In part one, we walk through how to build the backend for this dApp.

September 15, 2023

by Alvin Lee

CORE

· 3,917 Views · 2 Likes

Log Analysis: How to Digest 15 Billion Logs Per Day and Keep Big Queries Within 1 Second

This article describes a large-scale data warehousing use case to provide reference for data engineers who are looking for log analytic solutions.

September 15, 2023

by Zaki Lu

· 4,106 Views · 3 Likes

How To Use ChatGPT With Python

Are you looking forward to knowing how you can empower ChatGPT with Python? Learn step-by-step how to set up an account in the Kommunicate platform using Python.

September 14, 2023

by Devashish Mamgain

· 2,631 Views · 1 Like

How to Prompt ChatGPT So It Writes Quality Tech Texts for Your Website

Don't ask it to write a long text, provide as many details and specs as possible, use proper language, and check via AI detectors.

September 14, 2023

by Olesia Filipenko

· 2,124 Views · 2 Likes

Cutting Big Data Costs: Effective Data Processing With Apache Spark

In this article, we will delve into strategies to ensure that your data pipeline is resource-efficient, cost-effective, and time-efficient.

September 14, 2023

by Leonid Chashnikov

· 20,310 Views · 5 Likes

The Latest Data Engineering Topics